Detection of abnormal behavior in a vehicle
A vehicle system detects and communicates risky driving behavior to other users, improving road safety by enabling them to adapt their driving to potential hazards.
Patent Information
- Application Number
- DE112015000502
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2014-02-19
- Filing Date
- 2015-02-19
- Publication Date
- 2024-11-07
- Estimated Expiration
- 2035-02-19
AI Technical Summary
Existing systems fail to effectively identify and alert other road users to vehicles exhibiting risky driving behavior, thereby increasing the risk of accidents.
A vehicle-based system that detects safety-critical operations, calculates the number of such operations over a period, and communicates an increased vigilance requirement to other road users via wireless signals, using various communication technologies.
Enhances the ability of other road users to recognize and respond to potentially dangerous vehicles, reducing the risk of accidents by allowing them to adjust their driving behavior accordingly.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] This patent describes a method and apparatus in a vehicle, and a method and apparatus relating to another road user. In particular, it provides a mechanism for detecting a nearby vehicle that requires a heightened level of alertness regarding safety-critical driving behavior by the driver of that vehicle.
[0002] In traffic situations, it sometimes happens that a nearby driver operates his / her vehicle in an unpredictable, unreasonable manner or simply drives carelessly for various reasons.
[0003] Examples include a driver who suddenly changes lanes without using their turn signals, a driver who uses the inside lane to overtake on a motorway, a driver who overtakes across a solid road marking, or a driver who zigzags between two lanes.
[0004] Such behavior often forces other road users to adjust their driving style in relation to the carelessly driven vehicles by performing harsh braking and / or rapid evasive maneuvers. In the worst case, the result can be a traffic accident.
[0005] However, another road user of a careless driver must keep an eye on nearby vehicles not only in front, but also behind and to the side of their vehicle, as well as traffic signs, lanes, road surfaces, etc., and may therefore have difficulty identifying and identifying the careless driver among the multitude of other, more predictable road users. They must therefore keep a critical eye on all nearby vehicles and may not be able to identify the vehicle that poses the greatest risk of performing unforeseen maneuvers.
[0006] One existing solution to this problem is to mark certain high-risk vehicles, e.g., those driven by learner drivers. Such drivers are often overly cautious and hesitant about their driving style, and can thereby cause misunderstandings among other road users. The problem with the existing sign carried by such vehicles is that it is generally only visible to the vehicle immediately behind. At an intersection or roundabout, a hesitant or unclear action by a learner driver can be misunderstood by another road user who can only see the vehicle in question from the front or side.
[0007] JP 2012 - 168 811 A relates to a system for warning the driver of a rear vehicle of the risk of a collision with the system's host vehicle. The system issues a warning when the host vehicle approaches another vehicle ahead. A following road user will therefore be warned that the host vehicle is in a situation where there is a potential risk of collision, making it possible, for example, to avoid a pile-up. One problem with this solution is that it does not help the driver identify other drivers exhibiting risky behavior in traffic.
[0008] US Patent No. 7,411,485 B2 concerns a system for visually warning a driver who is deviating from the lane in which their vehicle is traveling. The system is activated when the driver shows signs of fatigue. The solution concerns warning the driver of their own careless driving due to fatigue or inattention, but not warning other road users. This solution also does not allow for the identification of other drivers exhibiting risky behavior in traffic.
[0009] US Patent No. 8,031,063 B2 concerns a system for determining whether a host vehicle is performing an unintended lane change and for warning the driver if this occurs. No warning is issued to other road users. This solution also does not allow for the identification of other drivers exhibiting risky behavior in traffic.
[0010] Document DE 11 2010 000 802 T5 discloses a device for recording the normality of vehicle behavior. The normality is to be determined based on the vehicle's movement history. The normality can also be determined based on the state of the vehicle driver, which is determined using a sensor arranged in the vehicle or on a road infrastructure. The degree of normality of the vehicle's behavior can correspond to the degree of compliance with traffic regulations.
[0011] Document DE 10 2011 109 618 A1 describes an emergency braking procedure that is initiated when a driver is incapacitated. Incapacitation is detected by the fact that several driver assistance interventions have been performed and the driver has not actively intervened in the driving process. When emergency braking is performed, surrounding vehicles are warned via vehicle-to-vehicle communication.
[0012] The publication US 2012 / 0025969 A1 discloses a program that predicts a driver's reaction based on previous trips and sensor data capturing a current driving situation. If the predicted reaction is dangerous for surrounding road users, they are warned via wireless communication.
[0013] Document JP 2009 - 134 334 A1 describes how a vehicle receives information about the drivers of nearby vehicles, such as their age, driver's license issue date, and traffic offense history. Based on this information, a display is generated that identifies nearby vehicles whose drivers are unsafe.
[0014] It is clear that much still needs to be done to make it easier for road users to detect and identify careless or dangerous other road users.
[0015] It is therefore an object of this invention to be able to solve at least some of the problems indicated above and to make it easier for a road user to detect a nearby vehicle that requires an increased level of alertness.
[0016] According to the invention, this object is achieved by the independent claims.
[0017] In one aspect of the invention, a method is provided in a vehicle, the method being configured to determine and communicate to another road user that the vehicle requires an increased level of vigilance. The method comprises detecting the number of safety-critical operations of the vehicle during a period of time. The method further comprises comparing the detected number of safety-critical operations with one or more threshold values. The method also comprises forwarding a message to other road users to indicate that an increased level of vigilance is required if the detected number of safety-critical operations exceeds one or more threshold values.
[0018] In a further aspect of the invention, a device is provided which is located on board the vehicle and is configured to determine and communicate to another road user that the vehicle requires an increased level of vigilance. The device comprises a detector configured to detect a safety-critical operation of the vehicle. The device further comprises a processor circuit configured to receive from the detector an indication of a safety-critical operation by the driver and to calculate the number of safety-critical operations by the driver during a period of time. The processor circuit is also configured to compare the detected number of safety-critical operations with one or more threshold values.The processor circuit is also configured to send a control signal to trigger the forwarding of a message to the other road user to indicate that an increased level of vigilance is required with respect to the vehicle when the number of detected safety-critical operations exceeds one or more thresholds.
[0019] In a third aspect of the invention, a method is provided. The further method is designed to direct the attention of another road user to a vehicle requiring a heightened level of alertness. The method comprises receiving a message from the vehicle indicating that a heightened level of alertness is required with respect to the vehicle. The method further comprises displaying the vehicle requiring a heightened level of alertness.
[0020] In a fourth aspect of the invention, a device is provided that is configured to draw the attention of another road user to a vehicle requiring a heightened level of alertness. Such a device comprises a receiver configured to receive a warning message from the vehicle indicating that a heightened level of alertness is required. The device also comprises a display device configured to display the vehicle requiring a heightened level of alertness.
[0021] By identifying drivers who are dangerous or require increased vigilance and enabling another road user to identify the vehicle in question, the attention of other road users can be drawn to the greatest hazards in nearby traffic, potentially helping to reduce the risk of a traffic accident. This benefits both the driver of the dangerous vehicle and other nearby road users. Thus, a safer road user environment and increased safety for the vehicles involved are achieved.
[0022] Other advantages and further novel features are indicated by the detailed description set forth below.
[0023] Embodiments of the invention will now be described in more detail with reference to the accompanying drawings, which illustrate various embodiments: Fig. 1A illustrates a vehicle and another road user according to one embodiment. Fig. 1B illustrates a vehicle and another road user according to one embodiment. Fig. 2 illustrates an example of a vehicle interior in a vehicle according to an embodiment. Fig. Figure 3A illustrates an example of a vehicle interior in another road user's vehicle. Fig. 3B illustrates an example of a display in another road user's vehicle according to one embodiment. Fig. 4A illustrates an example of a scenario in which another road user is warned about a vehicle, according to one embodiment. Fig. 4B illustrates an example of a screen of another road user according to one embodiment. Fig. 5 illustrates an example of a scenario in which another road user is provided with a means for providing an assessment of the driving style of the driver of a vehicle, according to one embodiment. Fig. 6 illustrates an example of a vehicle interior in another road user's vehicle according to one embodiment. Fig. 7 is a flowchart illustrating a method according to an embodiment of the invention. Fig. 8 is an illustration of an apparatus according to an embodiment of the invention. Fig. 9 is a flowchart illustrating a method according to an embodiment of the invention. Fig. 10 is an illustration of an apparatus according to an embodiment of the invention. DETAILED DESCRIPTION
[0024] Embodiments of the invention include methods and apparatus that may be practiced according to some of the examples described below. However, this invention may be embodied in many different forms and should not be considered limited to the embodiments described herein, which are instead intended to illuminate and clarify various aspects.
[0025] Further aspects and features of the invention may be revealed by the detailed description set forth below when read in conjunction with the accompanying drawings. The drawings are, however, to be considered merely as examples of various embodiments and not as limiting the invention, which is limited only by the appended claims. Furthermore, the drawings are not necessarily drawn to scale and, unless expressly stated otherwise, are intended to conceptually illustrate aspects of the invention.
[0026] The Fig. 1A shows a vehicle 100 suitable for powered movement, inter alia, in a first direction 105. The vehicle 100 may be, for example, but not necessarily, a cargo vehicle, a truck, a long-haul truck, a bus, a car, a tractor, a motorcycle, or similar land-based, manned or unmanned means of transport. Also shown, in addition to the vehicle 100, is another road user 110. In the illustrated example, the other road user 110 takes the form of a cargo vehicle, this being merely an arbitrary example. The other road user could, for example, be any of the vehicle types mentioned above, or a pedestrian, a cyclist, or the like.
[0027] In one embodiment, a vehicle 100 is detected that is being operated carelessly, or with respect to the same, the other road user 110 has reason to be particularly attentive. Examples of such reasons may include the driver showing signs of fatigue or inattention, the driver being a newly licensed driver, the driver frequently being involved in traffic accidents, the vehicle's fuel being used up shortly (possibly causing a sudden stop of the vehicle, or the driver making a late lane change to reach an exit to a gas station), or the like. The detected vehicle 100 draws the attention of the other road user 110 to itself by suitable means, e.g.by an acoustic signal, a voice message, or visually by a marking on a screen or on the windshield or a head-up display on the windshield, on which the vehicle 100 is marked as an increased risk. The other road user 110 can thus be alerted to the increased risk posed by the vehicle 100 with its current driver.
[0028] The other road user 110 can thus be helped to quickly identify and recognize a vehicle 100 that has a driver with a driving style that is unpredictable or dangerous in traffic. By being made aware of the increased accident risk posed by the vehicle 100, the other road user 110 is able to concentrate on the vehicle and adapt their driving style in good time, e.g., by maintaining an additional distance from the vehicle 100, overtaking the vehicle 100 with a wide margin, reducing their own speed, etc. Thus, an accident can be avoided and / or its consequences reduced. This is beneficial not only for the other road user 110 but also for the driver of the vehicle 100 and other nearby road users.
[0029] A particular vehicle 100 may be driven by different drivers on different occasions, and in certain embodiments, the driver is therefore identified, for example, by reading a vehicle's digital tachograph card in commercial traffic, reading the driver's driving license, or by various predetermined drivers having different keys for the vehicle or, for example, short-range radio transmitters (also called tags) that identify them as individual drivers of the vehicle.In certain embodiments, it is also possible to consider facial recognition of the driver using a camera mounted in the vehicle for this purpose, or to determine their fingerprints using a fingerprint reader, which may be built into the steering wheel or gearshift, for example, or to consider a retinal scanner that identifies the driver's eyes, or a similar form of biometric identification method. The identification of the driver, such as the adjustment of the driver's seat, the steering wheel angle, and other driver-related parameters, can also be related to a stored history of their driving data in certain embodiments.
[0030] An individual adaptation based on threshold values for various safety-critical operations of the vehicle 100 is thus enabled based on historical information about an identified driver of the vehicle 100.
[0031] The term “vehicle 100 requiring a heightened level of alertness” is sometimes used herein interchangeably with the term “driver requiring a heightened level of alertness.”
[0032] The Fig. Figure 1B shows the same scenario with the vehicle 100 and the other road user 110 as in Fig. 1A, but observed from above.
[0033] The driver of vehicle 100 has crossed the lane guide line multiple times during a certain period of time. In one embodiment of the invention, the driver of this vehicle 100 may be classified as requiring a heightened level of vigilance. A message indicating the need for a heightened level of vigilance with respect to vehicle 100 may, in certain embodiments, be forwarded to the other road user 110 via a wireless interface.
[0034] This wireless interface may, for example, be based on one of the following vehicle-to-vehicle communication technologies: Global System for Mobile Communications (GSM), Enhanced Rates for GSM Evolution (EDGE), Universal Mobile Telecommunications System (UMTS), Code Division Access (CDMA), (CDMA 2000), Time Division Synchronous CDMA (TD-SCDMA), Long Term Evolution (LTE), LTE-Advanced; Wireless Fidelity (Wi-Fi) defined by the Institute of Electrical and Electronics Engineers (IEEE) standards 802.11 a, ac, b, g and / or n, Internet Protocol (IP), WLAN, Bluetooth and / or Near Field Communication (NFC) or a similar radio-based communication technology, in various embodiments possibly via a base station or the like.
[0035] The Fig. 2 shows an example of a vehicle interior in the vehicle 100. The vehicle 100 is equipped with a device 200 for determining that the vehicle 100 requires an increased level of vigilance regarding detected safety-critical operations of the vehicle 100. The device 200 is also configured to inform another road user 110 by sending a wireless warning message that the vehicle 100 requires an increased level of vigilance.
[0036] The vehicle 100 is also equipped with one or more detectors 210 of the same, similar, or different type, which are configured to detect a safety-critical operation of the vehicle 100. The detector 210 may, for example, take the form of a camera directed at the driver's eyes and / or a vehicle sensor, e.g., a steering wheel angle sensor, yaw rate sensor, and / or accelerometer. Some examples of different detectors 210 that may interact in the vehicle 100 are given below.
[0037] Examples of safety-critical operations may include: changing lanes without using the turn signals; changing lanes without looking in the rearview mirror; the driver has their eyes closed for more than a predetermined period of time; the driver looks at something other than the windshield / rearview mirror for more than a certain period of time; the driver is driving in a lane different from that indicated by the navigation system (GPS) (and may therefore be inclined to make a rapid lane change shortly); the vehicle is about to run out of fuel; overtaking another vehicle on the inside; zigzagging between other vehicles in different lanes; maintaining a gap of less than three seconds to a vehicle in front; the driver activates their mobile phone without hands-free operation while driving.the vehicle's tachograph indicates that the maximum permitted driving time without a break / daily rest period is about to be exceeded / has been exceeded (if the vehicle 100 has a tachograph); the driver drives the vehicle 100 without a break beyond a certain time limit, e.g. 4 hours; exceeding a speed limit or exceeding the speed limit by, for example, more than 10%; a fatigue warning device in the vehicle 100 indicates that the driver is tired; a breathalyzer in the vehicle indicates that the driver has consumed alcohol; the vehicle comes to a standstill on a motorway, the vehicle reverses on a motorway, the vehicle 100 has to turn left on a main road;or any similar events. This list is not exhaustive but rather should be considered as examples of various inappropriate driving events that indicate that the driver poses a traffic hazard.
[0038] A detector 210 configured to detect that the driver changes lanes without looking in the rearview mirror or that their eyes are closed for longer than a predetermined period of time may take the form of a camera or the like. A detector 210 configured to detect when the driver changes lanes without using turn signals or when the driver is driving in a lane different from that indicated by the vehicle's navigation system (GPS) may include one or more sensors for monitoring the vehicle's position on the roadway. A detector 210 configured to detect when the distance to a preceding vehicle is less than three seconds may, for example, take the form of a distance measuring device, e.g., a laser rangefinder capable of measuring the distance to a preceding vehicle.
[0039] For example, the detector 210 may further include a fatigue warning aid in the vehicle 100 that may indicate that the driver is tired, or a breathalyzer in the vehicle 100 that may indicate that the driver has consumed alcohol.
[0040] When a safety-critical operation is detected by the detector / sensors 210, a message about it is sent to the device 200 via a wireless or wired interface. Such wired communication may, for example, take place via the vehicle's communication bus, which may take the form of one or more cables, a data bus, e.g., a CAN (Controller Area Network) bus, a MOST (Media Oriented Systems Transport) bus, or some other bus configuration.
[0041] The device 200 and the detector / sensors 210 may also, or alternatively, be provided with wireless communication via a wireless interface, in certain embodiments, for example, any of those listed above.
[0042] The device 200 can then calculate the number of safety-critical driver operations detected during a period of time and compare the resulting number with a threshold. If the threshold is exceeded, the device 200 can transmit a control signal via a wireless interface, e.g., via a transmitter, to trigger the forwarding of a message to the other road user 110 to indicate that an increased level of vigilance is required with respect to the vehicle 100.
[0043] In certain embodiments, the device 200 may also be configured to determine that the vehicle 100 being driven by the driver requires a heightened level of alertness because the driver is a driver in training, whether at a driving school or during a private training drive. This may be achieved, for example, by the driver themselves marking the vehicle to indicate that the vehicle 100 requires a heightened level of alertness due to the training drive. Alternatively, the driver's license may be read, and a lack of a license may be interpreted as indicating that a training drive or unlawful driving is taking place in the vehicle 100. The fact that the driver of the vehicle does not have a valid driver's license may in itself be a cause for concern for the other road user 110.
[0044] In certain embodiments, device 200 may determine that the driver holds a driver's license issued less than a second threshold, where the threshold may be a number of years, e.g., one year, two years, five years, or a multiple of, or an intermediate value between, these values. This is because a driver who has only recently been eligible to hold a driver's license will have more limited experience than other drivers.
[0045] Device 200 can also determine that the driver is older than a third threshold, which may be, for example, 70 years, 75 years, 80 years, or an intermediate value. People above these age groups are often overrepresented in accident statistics.
[0046] The device 200 may also determine whether the driver has previously had his / her license revoked, e.g., by identifying the driver from the license, sending a query to a database as to whether his / her license has previously been revoked, and determining that the vehicle 100 driven by him / her requires a heightened level of vigilance in this case.
[0047] Device 200 can also send a query to the vehicle registration authority and determine whether the vehicle 100 is subject to a driving ban and / or reported missing. A vehicle that is banned due to a failed vehicle inspection can pose a traffic safety risk.
[0048] In certain embodiments, the vehicle 200 may also determine that the driver's damage-free period is less than a fourth threshold, which may be, for example, one year, two years, three years, four years, or the like. For example, the device 200 may identify the driver from their driver's license, send a query to a database belonging to, for example, the driver's insurance company, and determine that the vehicle they are driving requires a heightened level of vigilance.
[0049] In certain embodiments, device 200 may also detect that vehicle 100 is an emergency vehicle responding to an emergency situation and therefore requires a heightened level of vigilance, as it has the right, and sometimes the obligation, to disregard general traffic regulations, such as speed limits. In this case, device 200 may, in certain embodiments, detect when the driver activates the vehicle's sirens / blue lights.
[0050] The device 200 may also, in certain embodiments, detect other vehicle types with a particular driving pattern, e.g., postal vehicles (which often stop at mailboxes), garbage trucks (which often stop in front of buildings and carry garbage collectors who jump out of the vehicle), cleaning vehicles such as salt spreader / plow vehicles (which may be forced to cross traffic lanes, make sudden stops and turns, etc.), and / or may detect that a vehicle other than a bus or taxi is traveling in a bus lane (since that road user may be expected to be in the bus lane and then perform a quick lane change).
[0051] In certain embodiments, a check can be performed, e.g., based on a driver's license, whether the driver has a criminal record, or whether the vehicle has been reported missing. People with a criminal lifestyle are often less inclined to drive considerately and cautiously.
[0052] In certain embodiments, the driver can input into device 200 that the vehicle 100 requires a heightened level of alertness. This can be the case, for example, in an emergency situation where the driver is transporting a person who is ill or in need of care to a hospital or the like, e.g., if a heavily pregnant woman needs to be taken to a maternity ward. The driver can also choose to activate the sending of warning messages based on their assessment of current or long-term limitations on their ability to drive, e.g., due to fatigue, stress, sudden illness, or other causes.A passenger on board the vehicle 100 may also input into the device 200 that the vehicle 100 requires an increased level of vigilance, since a passenger is often better able to assess the inadequate driving ability of the driver than the driver himself, while at the same time the passenger has an obvious self-protection interest in not being involved in an accident.
[0053] In certain cases, the detector 210 may include a noise level meter and / or a dissatisfaction detector, allowing the detection of noisy / noisy passengers and / or dissatisfied / crying children on board. Dissatisfied / noisy passengers and so-called know-it-alls may be responsible for increasing stress on the driver and potentially requiring a heightened level of alertness.
[0054] In certain embodiments, detector 210 may be configured to read the driver's stress level by measuring one or more stress-related body parameters, such as moisture on the driver's skin, electrical resistance on the driver's skin, eye movement frequency, body temperature, heart rate, respiration, blood pressure, muscle movements, sweaty hands, or the like. Driver stress, regardless of the cause, may thus be detected by comparing it to one or more threshold values.
[0055] In certain embodiments, other road users may also assess that the driver's vehicle requires a heightened level of vigilance, e.g., due to negligent driving. The driver may have previously received and stored assessments of their driving style, and if the number of critical assessments exceeds a configurable threshold, then in one embodiment, the driver is assessed as requiring a heightened level of vigilance. This configurable threshold may, for example, be 1, 2, 5, 10, or a value between or close to these values, or may be a multiple of one or more of these values.
[0056] The driver of the vehicle may also have been blacklisted by the other road user 110 during a previous encounter on the road, in which case the other road user may have indicated that a permanent warning and blacklisting for the driver of the vehicle 100 is desirable.
[0057] The Fig. Figure 3A shows an example of a vehicle interior of the other road user 110 driving behind the vehicle 100, e.g. in the previously described Fig. 1A and Fig. 1B. In this example, the other road user 110 may be a car, truck, bus, or the like. The other road user 110 has access to a device 300 to direct his / her attention to a nearby vehicle 100 requiring a heightened level of alertness. The device 300 includes or is connected to a receiver 310 configured to receive from the vehicle 100 a warning message indicating a need for a heightened level of alertness. The receiver 310 may receive wireless signals transmitted using any of the previously enumerated vehicle-to-vehicle communication technologies.
[0058] The device 300 may also include or be connected to a display device 320, wherein the display device is configured to indicate the vehicle 100 that requires an increased level of alertness on the part of the other road user 110. This display device 320 is in Fig. 3A is shown as an example of a screen with a camera on the rear facing the roadway and the vehicle 100 in front. Such an example of a warning of a dangerous vehicle 100 that the display device 320 / screen can provide is also shown in Fig. 3B, in which the vehicle 100 is highlighted on the screen and a text message warns the other road user 110 that the vehicle 100 has been operated unsafely.
[0059] The display device 320 may also, or alternatively, include a loudspeaker or the like and provide an audible or voice message that draws the attention of the other road user to the vehicle 100.
[0060] The Fig. 4A shows an example of a device 300 equipped with a receiver 310 and connected to a display device 320. The other road user 110 in this example is a pedestrian standing on the side of the road, and here near a pedestrian crossing.
[0061] In this example, the device 200 on board the vehicle 100 has performed detection and analysis of the driver's behavior at pedestrian crossings and has assessed that the driver has a tendency to fail to yield right of way, e.g., by failing to stop at three of the last five pedestrian crossings approached where it would have been appropriate to stop. Warning the other road user 110 of this allows the other road user 110 to avoid relying on the vehicle 100's right of way and thus avoid being struck.
[0062] In the illustrated example, the other road user's device 300 takes the form of a mobile phone or similar portable unit configured to receive wireless signals from the vehicle's device 200. The warning may be relayed, for example, by playing a suitable voice message to draw the other road user's attention to the vehicle 100.
[0063] In a Fig. In the embodiment illustrated in Figure 4B, the display device 320 may be in the form of glasses with a built-in transparent screen on which a marking or warning of the vehicle 100 may appear. This may be achieved, for example, but not necessarily, through a technique sometimes referred to as augmented reality (AR).
[0064] Augmented reality is a general term for a technology in which information from the user's physical environment, e.g., the environment surrounding the vehicle 100 as seen by the other road user 110 via the glasses 320, is blended with information from a software application, in this case, a marking and a warning related to the vehicle 100. One possible example of augmented reality may be the partial display of the image from a mobile camera in conjunction with the name of an object appearing in the image. Augmented reality may, in various embodiments, be viewed on a screen, via a computer, a mobile phone, a television (movie console), via a projection onto another display surface, such as the windshield of a vehicle, a head-up display, or the like.
[0065] The Fig. 5 shows an example of an embodiment in which a vehicle 100 overtakes another road user 110. The other road user 110 may be provided with a means for indicating an assessment of the driving skills of the driver of the vehicle 100, here through a questionnaire displayed on the device 300 of the other road user, e.g., on his / her mobile phone or other similar device. In the example shown, a rating of the driver could be expressed in terms of three levels. This is merely an arbitrary example, and such an assessment may, in different embodiments, comprise any number of levels, including the possibility of only blacklisting a vehicle.
[0066] Another advantage of this embodiment is that warning other road users about a driver of a vehicle 100 that may be dangerous in traffic, thereby reducing the risk of accidents, can encourage many drivers to drive considerately to achieve a high rating. This behavior on the part of the driver can be further encouraged, for example, through a social community, sometimes referred to as a "community," or the like, in which high ratings confer high status. In certain embodiments, the driver's rating can also be displayed on a website or the like.
[0067] The Fig. 6 shows an example of an embodiment from the perspective of another road user. The traffic on the road ahead is seen by the other road user 110 through the windshield of his / her vehicle; among other things, he / she sees the vehicle 100, which in this example is highlighted by a star and an arrow marking to attract the other road user's attention.
[0068] Other preceding vehicles in this example are marked with a circle to indicate that they are equipped with a device 200, but that no reason for increased vigilance with respect to these drivers has been detected, or with a triangle to indicate that the respective vehicle either does not have a functioning device 200 or does not wish to communicate its status.
[0069] These markings can be displayed in different embodiments, for example by means of augmented reality technology on a head-up display against the windshield, projected against the windshield or displayed through the windshield equipped with a transparent screen.
[0070] This scenario shows an example of how the other road user 110 can use the information received from several nearby vehicles to determine the vehicle 100 that he / she must treat with priority and caution.
[0071] The Fig. 7 illustrates an example of an embodiment of the invention in the form of a flowchart of a method 700 in a vehicle 100 for determining and communicating to another road user 110 that the vehicle 100 requires an increased level of alertness.
[0072] In certain embodiments, examples in which the vehicle 100 is considered to require a heightened level of alertness include: the driver is in driver training; the driver's license was issued less than a second threshold ago; the driver is older than a third threshold, e.g., 75 years of age; the driver has previously had their license suspended; the driver has a number of years without a claim according to their insurance company that is less than a fourth threshold; the vehicle 100 is an emergency vehicle responding to an emergency situation; the vehicle's fuel is about to run out; the vehicle 100 is traveling in a bus lane without being a bus or taxi; the vehicle 100 is a mail vehicle, a garbage truck, or a cleaning vehicle, e.g.,a salt-spreading or ploughing vehicle; the driver or a passenger arranges for the warning message to be forwarded to the other road user 110; and / or the driver or the vehicle 100 were previously assessed by the other road user 110 or other road users as requiring an increased level of vigilance.
[0073] In order to be able to correctly determine this need for an increased level of alertness and communicate it to the other road user 110, the method 700 may comprise several steps 701-704, although it should be noted that some of the steps described here are part of only certain alternative embodiments of the invention, e.g., step 704. Furthermore, the described steps 701-704 may also be executed in a different chronological order than that indicated by the numerical sequence, and some of the steps may be executed in parallel with one another. The method comprises the following steps: Step 701
[0074] Detecting multiple safety-critical steps of the vehicle during a period of time.
[0075] This period can be predetermined or configurable. For example, it can be one hour, one day, one year, a lifetime, or a period in between. In certain embodiments, it can be different for different safety-critical operations.
[0076] The safety-critical operation of the vehicle 100 may be caused by its driver and may include, for example: changing lanes without using the direction indicators; changing lanes without looking in the rearview mirror; the driver having their eyes closed for more than a predetermined period of time; driving in a lane different from that indicated by the navigation system (GPS); overtaking another vehicle on the inside; a gap of less than three seconds to a vehicle ahead; the driver activating their mobile phone without hands-free operation while driving; the vehicle's tachograph indicating that the maximum permitted driving time without a break / daily rest period is about to be exceeded / has been exceeded; the speed limit being exceeded; a fatigue warning aid on board the vehicle 100 indicating that the driver is tired;a breathalyzer on board the vehicle 100 indicates that the driver has consumed alcohol, or other similar events;
[0077] Other examples of safety-critical operations of the vehicle 100 may include bringing the vehicle to a stop on a highway, reversing the vehicle on a highway, or having the vehicle 100 perform a left turn on a state highway. Step 702
[0078] The detected 701 number of safety-critical operations is compared with one or more threshold values.
[0079] In certain embodiments, the safety-critical operation may, for example, be performing a lane change without activating the turn signals, and the time period may, for example, be one hour. The threshold may be set to a predetermined or configurable integer between zero and infinity, e.g., three.
[0080] It is also possible for two or more thresholds to be configured for the same safety-critical operation in certain embodiments, e.g., such that if the number of safety-critical operations is below a first threshold, the vehicle 100 is not considered to require an increased level of vigilance; if the number of safety-critical operations exceeds a first threshold but not a further higher threshold, the vehicle 100 is considered to require an increased level of vigilance; and if the number of safety-critical operations exceeds both the first threshold and the second threshold of the vehicle 100, the vehicle 100 is considered to require a significantly increased level of vigilance; and so on.
[0081] In certain embodiments, such limits may be different for different types of safety-critical operations. For certain types of safety-critical operations, the limit may be zero. Step 703
[0082] A message is forwarded to the other road user 110 to indicate a need for an increased level of vigilance if the detected 701 number of safety-critical operations exceeds the one or more thresholds.
[0083] The forwarded message may contain information directed to the other road user that the vehicle 100 does not require an increased level of vigilance if the detected number 701 of safety-critical operations does not exceed the one or more limit values.
[0084] The message can be relayed via a wireless interface through vehicle-to-vehicle communication, e.g., WLAN, Wi-Fi, Bluetooth, or a similar radio communication-based technology. The other road user 110 can thus be warned or made aware of the need for a heightened level of vigilance with respect to the vehicle and can take appropriate action in response, e.g., by maintaining an additional distance. Step 704
[0085] This step may be part of some, but not necessarily all, embodiments of method 700.
[0086] An assessment of the need for a heightened level of alertness with respect to the vehicle may, in certain embodiments, be received from the other road user 110 via a wireless interface and may include, for example, a judgment, rating, estimation, or blacklisting.
[0087] Such assessments may be received via a wireless interface through vehicle-to-vehicle communication, e.g. WLAN, Wi-Fi, Bluetooth or a similar radio communication-based technology.
[0088] Other road users are thus enabled to leave feedback regarding the driver and / or the behavior of a particular vehicle in traffic and thereby also indirectly warn other road users about the vehicle 100 without having to confront the driver and, for example, use gestures to convey their assessment of his / her driving skills, whereby the gestures themselves could pose a traffic hazard by distracting attention from the current traffic situation.
[0089] The Fig. 8 shows an embodiment of a device 200 on board a vehicle 100 for determining and communicating to another road user 110 that the vehicle 100 requires an increased level of alertness.
[0090] This device 200 is configured to perform at least some of the previously described steps 701-704 of the method 700.
[0091] In order to determine and generate a signal to inform the other road user 110 that the vehicle 100 requires an increased level of alertness, the device 200 comprises several components described in more detail below. Certain of the described subcomponents are present in some, but not necessarily all, embodiments. Further electronics may also be present in the device 200 that are not entirely necessary for understanding the function of the device 200 according to the invention and are therefore not described in the Fig. 8 and this description are omitted.
[0092] The device 200 comprises or is connected to one or more detectors 210 configured to detect at least one safety-critical operation of the vehicle 100.
[0093] In certain embodiments, such detectors 210 may be equipped, for example, with a camera that follows the driver's eyes, vehicle sensors such as a steering wheel angle sensor, yaw rate sensor, and / or accelerometer, one or more sensors for monitoring the vehicle's position on the roadway, positioning devices such as a GPS, distance measuring devices such as a laser distance meter or a distance meter based on image processing, ultrasound, or the like, or a fatigue warning aid onboard the vehicle 100 that may indicate that the driver is tired, or a breathalyzer onboard the vehicle 100 that may indicate that the driver has consumed alcohol, a noise level meter onboard the vehicle 100, a meter for one or more stress-related physical parameters of the driver, or the like.
[0094] The detector 210 can also be configured to detect when the driver changes lanes without using the turn signals, changes lanes without looking in the rearview mirror, or has closed their eyes for more than a predetermined period of time. The detector 210 can also be configured to detect when the driver is driving in a lane that differs from the one indicated by the navigation device (GPS), overtaking another vehicle on the inside, or the distance to a preceding vehicle is less than three seconds.The detector 210 may also be configured to detect when the driver activates his / her mobile phone without hands-free operation while driving; when the vehicle's tachograph indicates that the maximum permitted driving time without a break / daily rest period is about to be exceeded / has been exceeded; when speed limits are exceeded; when a fatigue warning aid in the vehicle 100 indicates that the driver is tired and / or when a breathalyzer in the vehicle indicates that the driver has consumed alcohol.
[0095] The detector 210 may also be configured to detect when the driver brings the vehicle 100 to a stop on a highway, reverses the vehicle 100 on a highway, or causes the vehicle to make a left turn on a federal highway, or when any other safety-critical or illegal maneuver is performed with the vehicle 100.
[0096] The device 200 further comprises a processor circuit 820 configured to receive an indication of a safety-critical operation by the driver from the detector 210 and to calculate the number of safety-critical operations performed by the driver during a specific period of time. The processor circuit 820 is also configured to compare the number of detected safety-critical operations with one or more threshold values. The processor circuit 820 is also configured to transmit a control signal to trigger the forwarding of a message to the other road user 110 to indicate that an increased level of vigilance is required with respect to the vehicle 100 if the number of detected safety-critical operations exceeds one or more threshold values.
[0097] Processor circuitry 820 may, for example, take the form of one or more central processing units (CPUs), microprocessors, or other logic capable of evaluating and executing instructions and / or reading and writing data. Processor circuitry 820 may handle data for input, output, or data processing, including caching data, control functions, and the like.
[0098] The device 200 may also, in certain embodiments, include a signal receiver 810 configured to receive a wired or wireless signal from the detector 210.
[0099] In certain embodiments, the signal receiver 810 is configured to receive from the other road user 110 an assessment of the need for an increased level of alertness with respect to the vehicle.
[0100] The device 200 may further comprise, also in certain embodiments, a storage unit 825 configured to store detected safety-critical operations of the vehicle 100, threshold values, the history of previous vehicle-related data, previously received assessments of the driver's driving skills, or the like.
[0101] The storage unit 825 may, in various embodiments, take the form of, for example, a memory card, flash memory, USB memory, hard disk, or other similar non-volatile data storage devices of a permanent nature, e.g., any of a ROM (read-only memory), PROM (programmable read-only memory), EPROM (erasable PROM), flash memory, EEPROM (electrically erasable PROM), etc.
[0102] In certain embodiments, the device 200 may also include a transmitting circuit 830 configured to transmit a control signal for generating an alarm signal or information and transmit it via a wireless interface to be received by the other road user 110.
[0103] In certain embodiments, the transmitter may be part of the device 200 or the transmitter circuit 830, forming a single unit. The wireless interface may be based on WLAN, Wi-Fi, Bluetooth, or a similar radio-based communication to enable vehicle-to-vehicle communication.
[0104] The invention further comprises a computer program on board a vehicle 100 for alerting another road user 110 that the vehicle 100 requires an increased level of vigilance by executing a method 700 according to at least some of the previously described steps 701-704 when the computer program is executed in a processor circuit 820 of the device 200. In various embodiments, this device 200 may be located on board the vehicle 100 or outside the vehicle 100.
[0105] The method 700 according to steps 701-704 for alerting the other road user 110 that the vehicle 100 requires an increased level of alertness can be implemented by one or more processor circuits 820 of the device 200 in conjunction with a computer program code in a non-volatile data carrier to execute one, some, or all of the method steps 701-704 described above. A computer program can thus include instructions for executing steps 701-704 when the program is loaded into the processor circuit 820 of the device 200.
[0106] The Fig. 9 illustrates an example of an embodiment of the invention in the form of a flowchart of a method 900 for directing the attention of another road user 110 to a vehicle 100 that requires an increased level of alertness.
[0107] In order to be able to alert the other road user 110 that the vehicle 100 requires an increased level of vigilance, the method 900 may comprise several steps 901-903. However, it should be noted that some of the steps described here form part of only certain alternative embodiments, e.g., step 903. The described steps 901-903 may also be executed in a different chronological order than that indicated by the numerical sequence, and some of the steps may be executed in parallel with one another. The method 900 comprises the following steps: Step 901
[0108] A message indicating a need for an increased level of vigilance with respect to a vehicle 100 is received by the vehicle 100.
[0109] This message can be received via a wireless interface, e.g. vehicle-to-vehicle communication, such as WLAN, Wi-Fi, Bluetooth or a similar radio communication-based technology.
[0110] In certain embodiments, the message received by the vehicle 100 may indicate that the vehicle 100 does not require an increased level of alertness. Step 902
[0111] The vehicle 100 requiring an increased level of alertness is displayed in order to draw the attention of the other road user 110 to this vehicle 100.
[0112] In certain embodiments, such indicators may include, for example, a visual marker on a screen 320, e.g., a head-up display, a screen integrated into the windshield, or glasses. They may also include a sound, e.g., an acoustic signal, a melody, or a voice message. Such indicators may also include tactile signals in the steering wheel or driver's seat.
[0113] In certain embodiments, the indication may be provided by the vehicle 100 that does not require an increased level of alertness. The other road user 110 may thus understand that a particular vehicle 100 is equipped with a device 200 for determining and communicating to another road user 110 that the vehicle 100 requires an increased level of alertness. The other road user will therefore also understand that less attention needs to be paid to this vehicle 100. Step 903
[0114] This step may be part of some, but not necessarily all, embodiments of method 900.
[0115] An assessment of the need for an increased level of alertness with respect to the vehicle 100 and / or the driving skills of its driver may, in certain embodiments, be made and sent to the vehicle 100, for example, via a wireless interface.
[0116] The Fig. 10 shows an embodiment of a device 300 for directing the attention of another road user 110 to a vehicle 100 that requires an increased level of alertness.
[0117] This device 300 is configured to perform at least some of the previously described steps 901-903 of the method 900.
[0118] In order to be able to draw the attention of the other road user 110 to the vehicle 100, which requires a heightened level of alertness, the method 900 may include several components described in more detail below. Certain of the described subcomponents are present in some, but not necessarily all, embodiments. Further electronics may also be present in the device 300 that are not entirely necessary for understanding the function of the device 300 according to the invention and are therefore not described in the Fig. 10 and this description are omitted.
[0119] The device 300 includes or is connected to a receiver 310 configured to receive wireless signals via a wireless interface. The wireless interface may be based on WLAN, Wi-Fi, Bluetooth, or a similar radio-based communication to enable vehicle-to-vehicle communication.
[0120] The device may also include or be connected to a display device 320, wherein the display device is configured to indicate the vehicle 100 requiring an increased level of alertness. Such a display device 320 may, in various embodiments, be part of one or more units, such as a screen, touchscreen, computer screen, mobile phone screen, television, via a projection on another image surface, such as the windshield of a vehicle, a head-up display, a screen integrated into the windshield, glasses, or the like, or may be equipped with one or more units. The display device 320 may also be part of or be equipped with a loudspeaker, a siren, an alarm, headphones, a tactile actuator, or similar units.
[0121] The indication may be a graphic, visual marker, and / or a sound, e.g., an acoustic signal, a melody, or a voice message. It may also include a tactile signal.
[0122] The device 300 may further comprise, in certain embodiments, a processor circuit 1020 configured to detect and direct the attention of another road user to a vehicle 100 requiring an increased level of alertness.
[0123] Processor circuitry 1020 may, for example, take the form of one or more central processing units (CPUs), microprocessors, or other logic capable of evaluating and executing instructions and / or reading and writing data. Processor circuitry 1020 may handle data for input, output, or data processing, including caching data, control functions, and the like.
[0124] The device 300 may also include a signal receiver 1010 configured to receive a wired or wireless signal from the vehicle 100, or rather, a transmitter onboard the vehicle 100. The wireless interface may be based on WLAN, Wi-Fi, Bluetooth, or a similar radio communication-based technology to enable vehicle-to-vehicle communication.
[0125] In certain embodiments, the device may also include a memory 1025 configured to store information relating to the vehicle 100.
[0126] The storage unit 1025 may, for example, take the form of a memory card, flash memory, USB memory, hard disk, or other similar non-volatile data storage devices of a permanent nature, e.g., any of a ROM (read-only memory), PROM (programmable read-only memory), EPROM (erasable PROM), flash memory, EEPROM (electrically erasable PROM), etc.
[0127] In certain embodiments, the device 300 may also include a transmission circuit 1030 configured to transmit a control signal for generating an alarm signal, or visual, auditory, or tactile information indicating that the vehicle 100 requires a heightened level of alertness. The vehicle 100 may therefore be displayed, for example, on the display device 320.
[0128] In certain embodiments, the transmitting circuit 1030 may also be configured to transmit an assessment of the need for alertness with respect to the vehicle 100 and / or the driving ability of its driver to the vehicle 100, e.g., via a wireless interface.
[0129] The invention further comprises a computer program in the device 300 for alerting the other road user 110 that the vehicle 100 requires an increased level of vigilance by executing a method 900 according to at least some of the previously described steps 901-903 when the computer program is executed in a processor circuit 1020 of the device 300. In various embodiments, this device 300 may be located on board the other road user's vehicle or, for example, be part of the other road user's mobile phone, portable computer, or the like.
[0130] The method 900 according to steps 901-903 for alerting another road user 110 to the vehicle 100 requiring a heightened level of alertness may be implemented by one or more processor circuits 1020 of the device 300 in conjunction with computer program code in a non-transitory data carrier to execute one, more than one, some, or all of the method steps 901-903 described above. A computer program may thus include instructions for executing steps 901-903 when the program is loaded into the processor circuit 1020 of the device 300.
[0131] Certain embodiments further include a system for determining and communicating to another road user 110 that a vehicle 100 requires an increased level of vigilance. Such a system may include, on board the vehicle 100, a device 200 equipped with or connected to a detector 210 configured to detect safety-critical operations of the vehicle 100 and a processor circuit 820 configured to emit a control signal to trigger the forwarding of a message to the other road user 110 indicating a need for an increased level of vigilance with respect to the vehicle 100 if the number of safety-critical operations exceeds the threshold. The system further includes a device 300 for directing the attention of another road user 110 to a vehicle 100 requiring an increased level of vigilance.The device 300 may be equipped with or connected to a receiver 310 configured to receive a warning message from the vehicle 100 indicating a need for an increased level of alertness. The device 300 may further be equipped with or connected to a display device 300 configured to indicate the vehicle 100 requiring an increased level of alertness.
Claims
[1] A computer-assisted method (700) in a vehicle (100) for determining and communicating to another road user (110) that the vehicle (100) requires an increased level of alertness, the method (700) being characterized by: Detecting (701) the number of safety-critical operations of the vehicle (100) during a period, Comparing (702) the number of detected (701) safety-critical operations with one or more limit values, and with historical information about a detected driver of the vehicle (100), Forwarding (703) a message to the other road user (110) to indicate that an increased level of vigilance is required if the number of detected (701) safety-critical operations exceeds one or more thresholds, or based on the historical information about the identified driver, and Receiving (704), from the other road user (110), an assessment of the need for an increased level of vigilance with regard to the vehicle (100). [2] The method (700) of claim 1, wherein the safety-critical operation of the vehicle (100) is caused by its driver and comprises: changing lanes without using the direction indicators; changing lanes without the driver looking in the rearview mirror; the driver having his / her eyes closed for more than a predetermined period of time; driving in a lane different from that indicated by the vehicle's navigation system; overtaking other vehicles on the inside; a distance of less than three seconds to a vehicle in front; the driver activating his / her mobile phone without hands-free operation while driving; the vehicle's tachograph indicates that the maximum permitted driving time without a break is about to be exceeded / has been exceeded, or the daily rest period is about to be shorter / has been shorter than permitted; exceeding a speed limit;a fatigue warning aid on board the vehicle (100) indicates that the driver is tired; an alcohol meter on board the vehicle (100) indicates that the driver has consumed alcohol; [3] The method (700) of any of claims 1 and 2, wherein the safety-critical operation of the vehicle (100) comprises bringing the vehicle (100) to a stop on a highway, reversing the vehicle (100) on a highway, making the vehicle (100) perform a left turn on a highway. [4] The method (700) according to any one of claims 1-3, wherein the vehicle (100) requires an increased level of alertness if the driver is in driver training; the driver's license was issued less than a second threshold; the driver is older than a third threshold, e.g., 75 years of age; the driver has previously had his / her license revoked; the driver has a number of years without a claim according to his / her insurance company that is less than a fourth threshold; the vehicle (100) is an emergency vehicle responding to an emergency situation; the vehicle's fuel will soon be used up; the vehicle (100) is traveling in a bus lane without being a bus or taxi; the vehicle (100) is a postal vehicle, a garbage truck, or a cleaning vehicle, e.g.,a salt-spreading or ploughing vehicle; the driver or a passenger arranges for the warning message to be forwarded to the other road user (110); and / or the driver or the vehicle (100) were previously assessed by the other road user (110) or other road users as requiring an increased level of vigilance. [5] The method (700) according to any one of claims 1-4, wherein the forwarded (703) message contains information to the other road user (110) that the vehicle (100) does not require an increased level of vigilance if the number of detected (701) safety-critical operations does not exceed the one or more limit values. [6] The method (700) of any of claims 1-5, wherein the message is forwarded (703, 704) via a wireless interface by vehicle-to-vehicle communication, such as WLAN, Wi-Fi, Bluetooth or a similar radio communication-based technology. [7] Device (200) in a vehicle (100) for determining and communicating to another road user (110) that the vehicle (100) requires an increased level of alertness, the device (200) being characterized by a detector (210) configured to detect a safety-critical operation of the vehicle (100), a processor circuit (820) configured to receive from the detector (210) an indication of a safety-critical operation by the driver, calculate the number of safety-critical operations by the driver during a period of time, compare the number of detected safety-critical operations with one or more threshold values and with historical information about a detected driver of the vehicle, and send a control signal to trigger the forwarding of a message to the other road user (110) to indicate that an increased level of vigilance with respect to the vehicle (100) is required if the number of detected safety-critical operations exceeds the one or more threshold values, or based on the historical information about the detected driver, and a signal receiver (810) configured to receive from the other road user (110) an assessment of the need for an increased level of alertness with respect to the vehicle (100). [8] A computer program in a vehicle (100) for alerting another road user (110) that the vehicle (100) requires an increased level of alertness by executing a method (700) according to any one of claims 1-6 when the computer program is executed in a processor circuit (820) of a device (200) according to claim 7.
Citation Information
Patent Citations
Method for operating vehicle, involves automatically determining driving impairment of driver while activating engagement to brake, steering or drive train function of vehicle, so that vehicle is decelerated to standstill
DE102011109618A1
DEVICE FOR PREDICTING THE MOVEMENT OF A MOBILE BODY
DE112010000802T5
Vehicle control device
JP2009134334A
Following vehicle collision warning device
JP2012168811A
Method and system to enhance traffic safety and efficiency for vehicles
US20120025969A1
Cited By
METHOD FOR ISSUING A DRIVER ATTENTION WARNING, CALCULATION DEVICE AND COMPUTER-READY STORAGE MEDIUM
DE102025118153A1
