Method for testing the attentiveness of an occupant of a vehicle and device, as well as vehicle comprising a corresponding device

The method and device enhance occupant attentiveness testing by asking questions about real-time vehicle events, ensuring reliable response evaluation and maintaining attention, thus improving driving safety.

DE102024208567B3Active Publication Date: 2025-12-31VOLKSWAGEN AG
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
DE102024208567
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-09-10
Publication Date
2025-12-31
Estimated Expiration
2044-09-10

AI Technical Summary

Technical Problem

Existing methods for testing occupant attentiveness in vehicles are not reliable, user-friendly, and do not effectively maintain attention through interaction, particularly at critical moments like stationary situations near level crossings.

Method used

A method and device that ask occupants questions about events in their vicinity, using sensors to detect stationary conditions and real-time events like train crossings, compare responses to detected events, and provide feedback, with fatigue detection based on activity levels.

Benefits of technology

Enhances the reliability and user experience of attentiveness testing by ensuring accurate response evaluation and maintaining attention through interactive questioning, thereby improving driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A method (100) for testing the attentiveness of an occupant of a vehicle (50) is proposed, comprising asking (103) at least one question to the occupant of the vehicle (50) regarding an event occurring in the vicinity of the vehicle (50), wherein the method (100) includes recognizing (104) the event and comparing (105) the event with the occupant's response to the question. The invention further relates to a corresponding device and a vehicle comprising such a device.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a method and a device for testing the attentiveness of an occupant of a vehicle, as well as to a vehicle.

[0002] Methods for observing events in the vicinity of a vehicle are generally known from the prior art. For example, DE 10 2018 207 300 A1 discloses a method for detecting an approaching train in order to provide feedback to the driver of a motor vehicle or to initiate stopping or accelerating the vehicle independently. This can be achieved, for example, by flashing a warning signal to indicate the direction from which the train is approaching.

[0003] EP 3 792 142 A2 also shows a method for monitoring a train system, in which at least one track and at least one train are observed.

[0004] US 2019 / 0 016 358 A1 describes a method for determining the direction and speed of a train using laser measurements.

[0005] German patent DE 10 2022 120 344 A1 relates to a method for analyzing the driver's level of attention. The method comprises the following steps: capturing the vehicle environment perceptible to the driver using a vehicle sensor; analyzing the vehicle environment; generating a question concerning the vehicle environment; issuing the question to the driver; capturing the driver's response to the question; and determining the driver's level of attention based on the response.

[0006] German patent application DE 10 2013 018 783 A1 discloses a method for operating an entertainment system in a motor vehicle, comprising the steps of: a) acquiring vehicle data relating to the vehicle and / or environmental data relating to the vehicle's surroundings, b) evaluating the current and / or preceding vehicle data and / or environmental data to determine reference data, c) generating a question whose correct answer relates to the reference data, d) outputting the question to at least one occupant of the vehicle by means of at least one output device, e) capturing an occupant's answer by means of at least one capture device, f) evaluating the answer to determine response data and determining a comparison result by comparing the response data with the reference data, g) generating or adjusting an evaluation information depending on the comparison result.and h) Output of the valuation information by the output device or at least one valuation output device.

[0007] The present invention is therefore based on the objective of making the testing of an occupant's attention and thus concentration ability more reliable, simpler, more pleasant for the occupant and also easier to verify.

[0008] The problem is solved by a method for testing the attention of a vehicle occupant, wherein the method comprises asking the occupant at least one question about an event taking place in the vicinity of the vehicle, wherein the method includes recognizing the event and comparing the event with a corresponding answer from the occupant to the question, wherein the method detects that the vehicle is stationary before asking the at least one question, wherein the vehicle is stationary before a level crossing, wherein the event is the crossing of a train, wherein the question relates to at least one feature of the train, and wherein the method includes detecting the fatigue of the at least one occupant, whereby a fatigue assessment of the occupant is adjusted depending on the driver's activity in relation to the at least one question.It is, in particular, a computer-implemented method.

[0009] The event in question can be something that has already occurred, is currently happening, or will happen in the near future. The question can therefore be directed toward the past or future and / or refer to the present. If the question concerns an event in the future, the inmate might, for example, be asked to estimate what will happen next.

[0010] The area surrounding the vehicle is understood to mean, in particular, the area that can be overlooked by at least one occupant and is therefore within the occupant's line of sight.

[0011] The occupant may, in particular, be the driver of the vehicle. This procedure ensures that the driver is paying attention and thus guarantees driving safety.

[0012] The procedure serves primarily to test the attention, in other words, the concentration, and thus also the driving ability of the occupant or driver. Furthermore, attention can be maintained by asking the questions and evaluating the answers. In other words, an interaction with the occupant is established, which both tests and maintains their attention.

[0013] The procedure can include providing feedback to the occupant regarding the comparison. This allows the procedure to inform the occupant whether their response regarding the event matches the actually detected event.

[0014] The method detects that the vehicle is stationary before the at least one question is asked, specifically that the vehicle is stationary before a level crossing. Preferably, the level crossing is detected, for example, via a navigation system and / or a first sensor, such as a camera on the vehicle, and / or a vehicle-to-vehicle system.

[0015] In particular, the questioning of at least one is carried out exclusively upon detection of a vehicle coming to a standstill, preferably a safe standstill. A safe standstill is defined as a standstill lasting longer than a predefined threshold, for example, at a level crossing and / or a red light.

[0016] The event in question is a train crossing a level crossing, and the question relates to at least one characteristic of the train, such as its direction of travel, model, speed, or color. Thus, the occupant's attention can be tested based on a real-life event.

[0017] The questions posed can be seat-dependent. Therefore, different questions can be asked depending on the occupant's position within the vehicle. For example, the questions can depend on the occupant's field of vision. Furthermore, the driver might be asked different questions than another occupant.

[0018] The procedure may, in particular, include asking each occupant of the vehicle a question and comparing the answers accordingly, as described above.

[0019] The question being asked and / or the occupant's answer being entered can be done in various ways, for example, verbally or visually, e.g., via displays and input on a vehicle screen, such as an infotainment system screen. The occupant's reaction and thus answer, e.g., a head shake or nod, can also be detected visually, e.g., via a second sensor such as a camera.

[0020] The event can be detected, in particular, by means of at least one camera on the vehicle, preferably by means of a first sensor on the vehicle. Furthermore, at least one microphone on the vehicle can be used to detect the event. For example, an external microphone on the vehicle can be used to detect the direction from which a train is approaching. In addition, events can be detected via vehicle-to-vehicle communication with other vehicles, with the other vehicles reporting the event to the corresponding vehicle.

[0021] The procedure includes fatigue detection of at least one occupant, whereby a fatigue rating is adjusted depending on the occupant's activity level in relation to at least one question. For example, a predefined activity threshold can be established. It can be determined, for instance, whether the occupant responds to the questions and, preferably, with what reaction time. If the activity level exceeds a predefined threshold, the fatigue rating can be reduced.

[0022] In another aspect, the invention relates to a device for testing the attention of a vehicle occupant, wherein the device comprises an interaction module for asking the vehicle occupant at least one question regarding an event occurring in the vehicle's vicinity. This could, for example, be the vehicle's infotainment system. Interaction with the occupant can take place via its at least one microphone and / or camera. The camera can, for example, detect a nod or a shake of the head.

[0023] The device may further comprise a first sensor for detecting the event and an evaluation module for comparing the event with the occupant's response to the question. The first sensor may, in particular, comprise a camera and / or a lidar sensor and / or a radar sensor.

[0024] The device may further include a second sensor for detecting fatigue in at least one occupant. In particular, the device is designed to carry out a method described above. The device is, in particular, a driver assistance system.

[0025] Furthermore, the invention relates to a vehicle comprising a device as described above.

[0026] They show in a purely schematic representation Fig. 1. A procedural scheme of a procedure for testing the attentiveness of an occupant of a vehicle; Fig. 2. a device for testing the attentiveness of an occupant of a vehicle; and Fig. 3: a vehicle comprising a device according to Fig. 2.

[0027] Fig. Figure 1 shows a method 100 for testing the attention of a vehicle occupant, comprising asking 103 at least one question to the vehicle occupant regarding an event occurring in the vicinity of the vehicle. The event is detected 104, and a comparison 105 is made between the event and the occupant's answer to the question. Before asking 103 the at least one question, a standstill of the vehicle can be detected 101, for example, the detection 102 of a standstill at a level crossing. After the comparison 105, feedback on the comparison can be provided 106. Furthermore, the method 100 can include fatigue detection 107 of the at least one occupant, wherein the fatigue rating can be adjusted depending on the occupant's activity in relation to the at least one question 108. Preferably, the fatigue rating is reduced if a minimum level of activity is present 109.

[0028] Fig. Figure 2 shows a device 10 for testing the attention of a vehicle occupant, comprising an interaction module 11. The interaction module 11 is used to ask the vehicle occupant at least one question. This could, for example, be an infotainment module of the vehicle. Furthermore, the device 10 includes an evaluation module 12, which is configured to compare the event with a response from the occupant. The device 10 can include at least a first sensor 13 for detecting the event and a second sensor 14 for fatigue detection. The first sensor 13 is specifically designed to detect the vehicle's surroundings, while the second sensor 14 can be an interior sensor.

[0029] Fig. Figure 3 shows a vehicle 50 comprising a device 10 according to Fig. 2. Reference symbol list 100 methods for testing the attentiveness of a vehicle occupant 101 Determining that the vehicle has come to a standstill 102 Determining a standstill before a level crossing 103 questions posed to at least one occupant of the vehicle regarding an event taking place in the vicinity of the vehicle 104 Recognizing the event 105 Comparison of the event with the inmate's answer to the question 106 Providing feedback on the comparison to the inmate 107 Fatigue detection 108 Adjusting an inmate fatigue rating based on inmate activity 109 Lowering the fatigue rating 10 Device for testing the attentiveness of a vehicle occupant 11 Interaction module 12 Evaluation module 13 first sensor 14 second sensor 50 vehicles

Claims

[1] Method (100) for testing the attention of an occupant of a vehicle (50), wherein the method (100) comprises asking (103) at least one question to the occupant of the vehicle (50) regarding an event taking place in the vicinity of the vehicle (50), wherein the method (100) comprises recognizing (104) the event and comparing (105) the event with an answer given by the occupant to the question, characterized by, that the procedure (100) detects a standstill of the vehicle (101) prior to asking (103) the at least one question, wherein a standstill is detected before a level crossing (102), wherein the event is a crossing of a train, wherein the question relates to at least one feature of the train, and that the procedure (100) includes a fatigue detection (107) of the at least one occupant, wherein a fatigue assessment of the occupant is adjusted depending on an activity of the driver in relation to the at least one question (108). [2] Method (100) according to claim 1, characterized by that the occupant is the driver of the vehicle. [3] Method (100) according to claim 1 or 2, characterized by , that the procedure (100) includes providing (106) feedback on the comparison to the inmate. [4] Method (100) according to claim 1, characterized bythat the feature is a direction of travel of the train. [5] Method (100) according to claim 1 or 4, characterized by that the feature is a model of the train. [6] Method (100) according to one of claims 1, 4 or 5, characterized by that the characteristic is the speed of the train. [7] Method (100) according to any one of claims 1, 4 to 6, characterized by that the feature is a color of the train. [8] Device (10) for carrying out the method for testing the attentiveness of an occupant of a vehicle according to any one of claims 1 to 7, characterized by, that the device (10) comprises an interaction module (11) for asking (103) at least one question to the occupant of the vehicle regarding an event taking place in the vicinity of the vehicle, wherein the device (10) further comprises a first sensor (13) for detecting (104) the event and an evaluation module (12) for comparing (105) the event with an answer from the occupant to the question. [9] Device (10) according to claim 8, characterized by , that the device (10) includes a second sensor (14) for fatigue detection (107) of the at least one occupant. [10] Device (10) according to one of claims 8 or 9, characterized by , that the device (10) is designed to carry out a method (100) according to one of claims 1 to 7. [11] Vehicle (50) comprising a device (10) according to any one of claims 8 to 10.

Citation Information

Patent Citations

  • Methods for operating an entertainment system in a motor vehicle and motor vehicle

    DE102013018783A1

  • METHOD FOR ANALYSING A DRIVER'S LEVEL OF ATTENTION

    DE102022120344A1