Method for checking the attentiveness of an occupant in a vehicle, device, and vehicle comprising a corresponding device

Abstract

The invention relates to a method (100) for checking the attentiveness of an occupant in a vehicle (50), comprising asking (103) the occupant in the vehicle (50) at least one question about an event occurring in the surroundings of the vehicle (50), wherein the method (100) comprises detecting (104) the event and comparing (105) the event with a response of the occupant to the question. The invention further relates to a corresponding device and to a vehicle comprising such a device.

Description

[0001] Description

[0002] Method for testing the attentiveness of an occupant of a vehicle and device, as well as vehicle comprising a corresponding device

[0003] The present invention relates to a method and a device for testing the attentiveness of an occupant of a vehicle, as well as to a vehicle.

[0004] Methods for observing events in the vicinity of a vehicle are generally known from the prior art. For example, DE 102018 207 300 A1 discloses a method for detecting an approaching train in order to provide feedback to the driver of a motor vehicle or to initiate stopping or accelerating the vehicle independently. This can be achieved, for example, by flashing a warning signal to indicate the direction from which the train is approaching.

[0005] EP 3 792 142 A2 also shows a method for monitoring a train system, in which at least one track and at least one train are observed.

[0006] US 2019 / 0016358 A1 discloses a method for determining the direction and speed of a train using laser measurements.

[0007] The present invention is therefore based on the objective of making the testing of an occupant's attention and thus concentration ability more reliable, simpler, more pleasant for the occupant and also easier to verify.

[0008] The problem is solved by a method for testing the attention of a vehicle occupant, wherein the method comprises asking the occupant at least one question about an event occurring in the vicinity of the vehicle, and wherein the method includes recognizing the event and comparing the event with a corresponding answer from the occupant to the question. It is, in particular, a computer-implemented method.

[0009] The event in question can be something that has already occurred, is currently happening, or will happen in the near future. The question can therefore be directed toward the past or future and / or refer to the present. If the question concerns an event in the future, the inmate might, for example, be asked to estimate what will happen next.

[0010] The area surrounding the vehicle is understood to mean, in particular, the area that can be overlooked by at least one occupant and is therefore within the occupant's line of sight.

[0011] The occupant may, in particular, be the driver of the vehicle. This procedure ensures that the driver is paying attention and thus guarantees driving safety.

[0012] The procedure serves primarily to test the attention, in other words, the concentration, and thus also the driving ability of the occupant or driver. Furthermore, attention can be maintained by asking the questions and evaluating the answers. In other words, an interaction with the occupant is established, which both tests and maintains their attention.

[0013] The procedure can include providing feedback to the occupant regarding the comparison. This allows the procedure to inform the occupant whether their response regarding the event matches the actually detected event.

[0014] The method can detect that the vehicle is stationary before the at least one question is asked; for example, it can detect that the vehicle is stationary before a level crossing. Preferably, the level crossing is detected, for example, via a navigation system and / or a first sensor, e.g., a camera on the vehicle, and / or a vehicle-to-vehicle system.

[0015] In particular, the questioning of at least one is carried out exclusively upon detection of a vehicle coming to a standstill, preferably a safe standstill. A safe standstill is defined as a standstill lasting longer than a predefined threshold, for example, at a level crossing and / or a red light.

[0016] The event in question could be a train crossing a level crossing, with the question relating to at least one characteristic of the train, such as its direction of travel, model, speed, or color. Thus, the occupant's attention can be tested based on a real-life event.

[0017] The questions can be posed based on the passenger's position within the vehicle. This means that different questions can be asked depending on the passenger's location. For example, the questions can be tailored to the passenger's field of vision. Furthermore, the driver can be asked different questions than other passengers. The procedure can involve asking each passenger a question and comparing the answers as described above.

[0018] The question being asked and / or the occupant's answer being entered can be done in various ways, for example, verbally or visually, e.g., via displays and input on a vehicle screen, such as an infotainment system screen. The occupant's reaction and thus answer, e.g., a head shake or nod, can also be detected visually, e.g., via a second sensor such as a camera.

[0019] The event can be detected, in particular, by means of at least one camera on the vehicle, preferably by means of a first sensor on the vehicle. Furthermore, at least one microphone on the vehicle can be used to detect the event. For example, an external microphone on the vehicle can be used to detect the direction from which a train is approaching. In addition, events can be detected via vehicle-to-vehicle communication with other vehicles, with the other vehicles reporting the event to the corresponding vehicle.

[0020] The procedure can include fatigue detection of at least one occupant, whereby a fatigue rating is adjusted depending on the occupant's activity level in relation to the at least one question. For example, a predefined activity threshold can be established. It can be determined, for instance, whether the occupant responds to the questions and, preferably, with what reaction time. If the activity level exceeds a predefined threshold, the fatigue rating can be reduced.

[0021] In another aspect, the invention relates to a device for testing the attention of a vehicle occupant, wherein the device comprises an interaction module for asking the vehicle occupant at least one question regarding an event occurring in the vehicle's vicinity. This could, for example, be the vehicle's infotainment system. Interaction with the occupant can take place via its at least one microphone and / or camera. The camera can, for example, detect a nod or a shake of the head.

[0022] The device may further comprise a first sensor for detecting the event and an evaluation module for comparing the event with the occupant's response to the question. The first sensor may, in particular, comprise a camera and / or a lidar sensor and / or a radar sensor.

[0023] The device may further include a second sensor for detecting fatigue in at least one occupant. In particular, the device is designed to carry out a method described above. The device is, in particular, a driver assistance system.

[0024] Furthermore, the invention relates to a vehicle comprising a device as described above.

[0025] They show in a purely schematic representation

[0026] Figure 1 shows a process diagram of a procedure for testing the attentiveness of an occupant of a vehicle;

[0027] Figure 2 shows a device for testing the attentiveness of a vehicle occupant; and

[0028] Figure 3: a vehicle comprising a device according to Figure 2.

[0029] Figure 1 shows a method 100 for testing the attention of a vehicle occupant, comprising asking the occupant at least one question about an event occurring in the vicinity of the vehicle. The event is detected, and a comparison is made between the event and the occupant's answer to the question. Before asking the question, the vehicle may be stationary, for example, at a level crossing. After the comparison, feedback on the comparison may be provided. Furthermore, the method 100 may include fatigue detection of the occupant, and the fatigue assessment may be adjusted depending on the occupant's activity in relation to the question.The fatigue rating is preferably reduced if a minimum level of activity is present 109.

[0030] Figure 2 shows a device 10 for testing the attention of a vehicle occupant, comprising an interaction module 11. The interaction module 11 is used to pose at least one question to the vehicle occupant. This could, for example, be an infotainment module of the vehicle. Furthermore, the device 10 includes an evaluation module 12, which is configured to compare the event with a response from the occupant. The device 10 can include at least a first sensor 13 for detecting the event and a second sensor 14 for fatigue detection. The first sensor 13 is specifically designed to detect the vehicle's surroundings, while the second sensor 14 can be an interior sensor.

[0031] Figure 3 shows a vehicle 50 comprising a device 10 according to Figure 2.

[0032] Reference symbol list

[0033] Procedure for testing the attention of a vehicle occupant

[0034] Determining that the vehicle has come to a standstill

[0035] Determining a standstill before a level crossing

[0036] Asking at least one question to an occupant of the vehicle regarding an event taking place in the vicinity of the vehicle

[0037] Recognition of the event

[0038] Comparison of the event with the inmate's answer to the question

[0039] Providing feedback on the comparison to the inmate

[0040] Fatigue detection

[0041] Adjusting an inmate's fatigue assessment based on activity

[0042] Inmates

[0043] Lowering the fatigue rating

[0044] Device for testing the attentiveness of a vehicle occupant

[0045] Interaction module

[0046] Evaluation module first sensor second sensor

[0047] vehicle

Claims

- 7 - Patent claims 1. Method (100) for testing the attention of an occupant of a vehicle (50), characterized in that the method (100) comprises asking (103) at least one question to the occupant of the vehicle (50) regarding an event taking place in the vicinity of the vehicle (50), wherein the method (100) comprises recognizing (104) the event and comparing (105) the event with an answer given by the occupant to the question.

2. Method (100) according to claim 1, characterized in that the occupant is a driver of the vehicle.

3. Method (100) according to claim 1 or 2, characterized in that the method (100) comprises providing (106) feedback on the comparison to the occupant.

4. Method (100) according to one of the preceding claims, characterized in that the method (100) detects (101) that the vehicle is stationary before asking (103) the at least one question.

5. Method (100) according to claim 4, characterized in that a standstill is detected before a level crossing (102).

6. Method (100) according to claim 5, characterized in that the event is a crossing of a train, wherein the question relates to at least one feature of the train.

7. Method (100) according to claim 6, characterized in that - 8 - the feature is a direction of travel of the train.

8. Method (100) according to claim 6 or 7, characterized in that the feature is a model of the train.

9. Method (100) according to one of claims 6 to 8, characterized in that the feature is a speed of the train.

10. Method (100) according to one of claims 6 to 9, characterized in that the feature is a color of the train.

11. Method (100) according to one of the preceding claims, characterized in that the method (100) comprises a fatigue detection (107) of the at least one occupant, wherein a fatigue assessment of the occupant is adapted (108) depending on an activity of the driver in relation to the at least one question.

12. Device (10) for testing the attention of an occupant of a vehicle, characterized in that the device (10) comprises an interaction module (11) for asking (103) at least one question to the occupant of the vehicle regarding an event taking place in the vicinity of the vehicle, wherein the method (100) further comprises a first sensor (13) for detecting (104) the event and an evaluation module (12) for comparing (105) the event with an answer of the occupant to the question.

13. Device (10) according to claim 12, characterized in that the device (10) comprises a second sensor (14) for fatigue detection (107) of the at least one occupant.

14. Device (10) according to one of claims 12 or 13, - 9 - characterized in that the device (10) is designed to carry out a method (100) according to one of claims 1 to 11.

15. Vehicle (50) comprising a device (10) according to one of claims 12 to 14.

Images