Method for adjusting a signaling device to output signals to a driver and a system
The method and system in autonomous vehicles use driving and occupant status information to adjust signals, addressing sudden awakenings and enhancing comfort and safety by informing occupants of their surroundings and necessary actions.
Patent Information
- Application Number
- DE102020202388
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-02-25
- Publication Date
- 2025-07-31
- Estimated Expiration
- 2040-02-25
AI Technical Summary
In autonomous vehicles, occupants may experience sudden awakenings due to unexpected traffic situations, leading to disorientation and panic-like states as they struggle to grasp the driving situation quickly, which can compromise safety and comfort.
A method and system that utilize driving and occupant status information to adjust a signal device, providing targeted signals to inform occupants of their surroundings and necessary actions during wake-up, enhancing awareness and reducing disorientation.
Enhances occupant comfort and safety by allowing quick comprehension of the driving situation upon waking, minimizing disruptive stimuli, and promoting a smooth transition back to sleep or appropriate action when needed.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a method for adjusting a signaling device which is arranged in a vehicle with an autonomous operating mode and outputs signals to a driver of the vehicle, and to a system for a vehicle with an autonomous operating mode.
[0002] Newer motor vehicles can have an autonomous operating mode. This operating mode is also referred to as piloted or autonomous driving. This operating mode can be classified from level 0 to 5. The higher the level, the less intervention is expected and required from a driver in vehicle operation. At level 5, driver interaction is no longer necessary. This allows the driver to sleep while the vehicle is operating.
[0003] US Pat. No. 9,725,036 B1 describes a method for alerting a sleeping vehicle occupant. This method can determine whether a wake-up event has occurred. The wake-up event can be associated with refueling the vehicle. Furthermore, data about a vehicle occupant can be collected. A determination as to whether the vehicle occupant is asleep can be made based on the collected data about the vehicle occupant. In response to determining that the vehicle occupant is asleep, an occupant wake-up call can be triggered within the vehicle.
[0004] In general, it has been shown that vehicle occupants experience or sense the holistic traffic situation in a vehicle more directly (e.g. acoustically through horns from other road users, acceleration, braking maneuvers, steering maneuvers of the vehicle, lights from other road users) compared to other means of transport such as trains or airplanes.
[0005] During autonomous driving, it can also happen that the vehicle occupant is suddenly woken from sleep, for example due to the traffic situation or the vehicle's own strong steering maneuvers.
[0006] Furthermore, it has been shown that a vehicle occupant can be in a disturbed state after waking up or during the waking process. The vehicle occupant must first grasp the current traffic and / or driving situation and, in the worst case, can even experience panic-like states due to excessive stimuli (e.g., honking, other road users, acceleration, or steering maneuvers of the vehicle) during the waking process, especially if the context of the current traffic and / or driving situation is not grasped promptly.
[0007] The object of the present invention is to provide a method and a system that at least partially overcome the aforementioned disadvantages. In particular, a method and a system are to be provided by which a vehicle occupant in a vehicle with an autonomous operating mode can understand their traffic and / or driving situation as quickly as possible.
[0008] This object is achieved by the method according to claim 1 and the system according to claim 10. Further advantageous embodiments of the invention emerge from the subclaims and the following description of preferred embodiments of the present invention.
[0009] A first aspect of the present invention relates to a method for setting a signaling device to output signals to a driver of a vehicle with an autonomous operating mode. The method comprises: - Determining driving status information for the vehicle; - Determining a setting parameter for the signaling device depending on the driving status information; - Determining occupant status information from which a waking status and a sleeping status of an occupant of the vehicle can be determined; - Detecting the occupant's awakening; and - Adjusting the signaling device based on the setting parameter in response to detecting the wake-up process.
[0010] The vehicle can be designed as a motor vehicle and, in particular, powered by an internal combustion engine and / or an electric motor. The autonomous operating mode can have up to six levels of autonomy. The lowest level of autonomy, 0, corresponds to driver operation, i.e., the driver drives the vehicle themselves. The highest level of autonomy, Level 5, in contrast, corresponds to fully automated driving, in which driver operation, i.e., driver intervention, is generally no longer required.
[0011] The driving status information for the vehicle includes both past and current information. Furthermore, the driving status information includes at least one of the following: driving situation, traffic situation, particularly in the vehicle's surroundings, emergency situation, the vehicle's route or schedule, vehicle-related status information (e.g., oil level, fuel level, energy level of a traction battery, etc.), and passenger-related events (e.g., incoming calls, messages, etc.). It is understood that the examples given for the driving status information for the vehicle are not exhaustive.
[0012] The traffic situation includes, for example, at least one of other road users and traffic events (e.g., horns, sirens, traffic lights, etc.). The vehicle's route or timetable includes adherence to and / or deviation from / changes to these.
[0013] The driving status information for the vehicle is determined / derived from data collected by a corresponding driver detection system. The driver detection system can comprise at least one of the following detection devices: a microphone, a camera device, environmental sensors such as radar and / or lidar systems, navigation systems, a fuel level sensor, a load sensor, and so on. In particular, the driver detection system can often already be present on the vehicle.
[0014] Depending on the driving status information, a setting parameter for the signaling device is determined. The setting parameter is thus derived / determined from the past and current driving status information. Thus, the signaling device can be adjusted or controlled by the setting parameter according to the driving status information. This occurs, as described later, in response to the occupant waking up.
[0015] The signals output by the signaling device are determined by the setting parameter. Since the setting parameter depends on the driving status information and the signaling device is set using the setting parameter, the signals from the signaling device are indicative of the driving status information.
[0016] The occupant status information of the occupant in the vehicle interior is determined / derived from data acquired via a corresponding occupant detection system, which may include at least one of the following detection devices: electroencephalography (EEG) sensor, microphone, camera device, motion, acceleration, pressure, eyelid beat, respiratory rate, temperature, heart rate sensor, and pulse oximeter. Some of these detection devices may be located in the contact area of a seating / reclining device for the occupant. The occupant is, in particular, the driver of the vehicle.
[0017] The occupant detection system can be on-board, i.e., be part of the vehicle. Alternatively or additionally, the occupant detection system can be partially provided / integrated into a wearable device. For example, such a wearable can be designed as a smartwatch, virtual reality (VR) glasses, augmented reality (VR) glasses, etc.
[0018] Furthermore, a sleep state, particularly the individual sleep types "light sleep," "deep sleep," and "REM (rapid eye movement) sleep," can be recorded using a smartphone and, in particular, a corresponding app. An acceleration sensor built into the smartphone can detect the occupant's movements. This allows the occupant's sleep phase to be determined.
[0019] The detection system for determining occupant status information can, at least indirectly, detect / measure one of the following: brain wave image (EEG), heart rhythm (electrocardiography, ECG), oxygen saturation of the blood (pulse oximetry), body temperature, respiratory flow (via mouth and / or nose), respiratory movement, muscle tension (electromyography, EMG), leg movement, eye movement (electrooculography, EOG), body position, body sounds.
[0020] The measurements and / or data from the occupant detection system for determining the occupant status information, and the occupant status information obtained from them, are such that the occupant's sleep and wake status can be determined from them. In other words, the occupant's wake, sleep, and wake phases can be determined from the occupant status information. Consequently, the occupant's wake-up process can also be detected / determined.
[0021] In response to the detection of a wake-up event or the occupant waking up, the signaling device is now adjusted based on the setting parameter. The current setting parameter is used, i.e., the setting parameter determined from the driving status information available at or during the wake-up event.
[0022] The method allows the occupant to be made aware of the current driving situation by the signals from the signaling device when waking up or during the waking process.
[0023] Furthermore, the occupant is enabled to understand the current driving situation as quickly and clearly as possible shortly after waking up or waking up. This increases driving comfort during fully automated driving. Furthermore, driving safety is also increased during this journey, as the occupant is not confronted with unnecessary stimuli (e.g., honking of other road users, acceleration and / or steering maneuvers of the vehicle) in response to waking up, but rather primarily receives the signals from the signaling device, thus preventing the occupant from becoming disturbed and / or panic-like shortly after waking up.
[0024] If the system detects the occupant transitioning from sleep to wakefulness, the occupant is informed, with minimal to no overwhelming signals, that there is no dangerous situation (and, if necessary, that they can return to sleep immediately) or that there is indeed a dangerous situation requiring intervention or action by the occupant. This allows the occupant to be calmed down as quickly as possible if there is no dangerous situation, allowing them to return to sleep immediately.
[0025] By making waking up as less disturbing and as comfortable as possible for the occupant, the willingness to use autonomous driving of the vehicle during a sleep state is also increased.
[0026] In some embodiments, the presence and absence of a requirement for action by the occupant can be indicated / displayed or represented by the signals emitted by the signaling device.
[0027] The signals can be used to inform the occupant that a driving situation does not require any action, in which intervention or action by the occupant is not required. Furthermore, the signals can be used to inform the occupant that a driving situation does require action, in which intervention or action by the driver is at least optional, if not required.
[0028] Particularly in a driving situation that does not require action, the system can calm the occupant as quickly as possible by adjusting the signaling device accordingly, allowing them to return to sleep if necessary. Otherwise, the occupant can react accordingly if a driving situation requiring action arises.
[0029] A driving situation without the need for action can occur if, for example, a planned route with planned (arrival) times can be adhered to.
[0030] In other embodiments, the need for action may be divided into at least two levels of urgency.
[0031] A driving situation requiring action may arise, for example, if a trip is delayed according to a planned route. In this case, the occupant can optionally intervene in the driving process to plan a new route if necessary or drive themselves. This would correspond to a lower level of urgency.
[0032] Another driving situation requiring action may arise when intervention or action by the occupant is necessary. Such a driving situation occurs in particular when timely intervention by the occupant is necessary, for example when deciding whether to choose a new route or when fuel needs to be added or a vehicle's drive battery needs to be recharged. In emergency situations that may require an emergency stop, the occupant should be specifically woken up and informed of the emergency situation. Optionally, the occupant can be given appropriate instructions for dealing with the emergency situation. Since intervention is not optional but also necessary in these cases, a higher level of urgency applies.
[0033] In further embodiments, the action requirement can be user-defined. In other words, the driving situations for which no action is required, an optional action requirement, or a required action requirement exists can be defined by the occupant and stored in a driver profile. This driver profile can be stored in a database. This database can be stored in a vehicle-mounted control unit and / or on an external server. Driver profiles stored in external databases, in particular, can be retrieved, for example, when ordering a vehicle from mobility providers, such as vehicle rental companies.
[0034] In other embodiments, the signaling device can emit at least one of visual, acoustic, or haptic signals. In particular, the signaling device can comprise at least one of a lighting device, a loudspeaker device, a display device, and a vibration device. The signaling device can usually already be present on the vehicle and / or can be retrofitted.
[0035] Thus, the signals of the signaling devices may include at least one of the following: text signal, color signal, light signal, voice signal, and vibration signal. It is understood that this list is not exhaustive.
[0036] In particular, when haptic signals are issued to the occupant, the occupant does not have to open their eyes during a waking phase to perceive the signal from the signaling device. For example, a vibration signal can be transmitted to the occupant via the signaling device, which can be designed as an adjustment and / or vibration arrangement for a seating / reclining arrangement for the occupant. For example, a predetermined periodic vibration signal can indicate that the occupant can continue sleeping because no action is required. Alternatively or additionally, another vibration signal, e.g. with a comparatively short-frequency beat, can be used to communicate that everything is OK, but there is a delay of more than one hour compared to the scheduled arrival time.Or, further predetermined vibration signals can be used to signal that an incoming phone call from an unknown person or a known person has been suppressed (due to the occupant's sleep state). The occupant can then use appropriate voice commands to control the vehicle's infotainment system to initiate the appropriate callbacks. In another embodiment, the occupant can use appropriate voice commands to obtain information about the missed call, e.g., from their infotainment system, and initiate the appropriate callback.
[0037] The use of haptic signals further increases passenger comfort, as they do not have to open their eyes while driving.
[0038] In some embodiments, the signals output by the signaling device can be representative of different escalation levels. Thus, a first signal can represent a first escalation level in which no action is required. A second signal can represent a second escalation level in which an optional action is required. A third signal can represent a third escalation level in which an action is required.
[0039] For example, the escalation levels can include the following scenarios: Green: The planned route and scheduled times can be maintained. No occupant intervention is necessary. Yellow: There are changes to the planned journey (e.g. delays), but passenger intervention is not absolutely necessary. Red: A decision is required from the occupant. A (timely) intervention or action by the occupant is required, e.g., a decision regarding the new route to take.
[0040] In particular, in an embodiment in which the signaling device is configured to output colored visual signals, the escalation levels can be represented by displaying corresponding colors. In particular, the use of a traffic light system is possible, in which the (above-mentioned) first, second, and third escalation levels can be indicated by "green," "yellow," and "red," respectively. Alternatively or additionally, the number of escalation levels and the corresponding color scheme can be user-defined.
[0041] By using a traffic light system with a signaling device that can emit colored visual signals, the occupant can be informed of the presence of driving status information as gently as possible, yet very obviously upon waking up.
[0042] In some embodiments, the setting parameter can also be dependent on the occupant or driver profile, i.e., user-defined. Alternatively or in addition to the user-defined action requirements, the setting or control of the signaling device can also be user-defined. For example, a driver may prefer that signals be transmitted only in text form, e.g., on a display device in the vehicle. Alternatively or additionally, depending on the driving status information, a corresponding signal type and / or a combination of the various signal types can be output by the signaling device. For example, color signals can be combined with voice announcements and / or text display, e.g., about the estimated time of arrival or delay, current driving speed, current position on a map, etc.
[0043] For example, the signaling device can be set / controlled such that, in one example, after waking up, the occupant is only informed of the current time and estimated time of arrival via the signaling device's signals. They can also be informed of what woke them up. Furthermore, they can be informed of an incoming and possibly expected phone call that was suppressed during their sleep state.
[0044] In some embodiments, the use and / or intensity of the visual, haptic, and acoustic signals can also be user-defined and / or dependent on the driving status information. The intensity of the acoustic signals corresponds to the volume of the signals.
[0045] In some embodiments, the signaling device may comprise a vehicle interior lighting, which is designed in particular as an ambient lighting.
[0046] In other embodiments, the method may further comprise: - Determining driving events from the driving status information; and - Displaying driving events on a vehicle display device.
[0047] Determining driving events is equivalent to determining a driving status information history. This allows the driver to understand why they woke up after waking up. The driving events or driving status information history can be displayed using, particularly animated, representations of past driving situations, traffic situations, etc. These situations can be detected, in particular, by appropriate environmental sensors.
[0048] For example, it is possible to display certain driving events, such as sudden braking, on a vehicle display so that the occupant can understand why they woke up. Furthermore, it is also possible to inform the occupant via text and / or a voice announcement that another road user honked in this context and that the honking exceeded a threshold for the volume in the vehicle interior. Accordingly, the occupant can also display a report list of driving events (driving status information history), particularly vehicle maneuvers with associated times and locations, from their entire past sleep period.In particular, it is possible to record at least one of the following possible driving events: acceleration, braking, and steering maneuvers of the vehicle that result in forces exceeding certain thresholds on the driver; exceedances of a threshold volume in the vehicle interior; and brightness levels exceeding a threshold in the vehicle cabin. These driving events can be displayed, possibly animated. This allows the occupant to at least partially understand later why they slept restlessly.
[0049] Furthermore, the occupant can have routes on which they slept poorly, e.g., due to road surface conditions, marked with a comment, allowing them to select a different route for a future trip. The occupant can also be informed during future route planning that they slept poorly on a suggested route last time or several times in the past.
[0050] By displaying driving events or the driving status information history, a higher level of acceptance of the driving style of the autonomously operated vehicle can be built up and, in addition, a stronger sense of safety can be developed for the occupants.
[0051] In other embodiments, the method may further comprise: - Adjusting at least one of an information display device and a comfort device depending on the occupant status information.
[0052] The information display device and / or comfort device can be present on the vehicle side, ie integrated into the vehicle.
[0053] An information presentation device can comprise at least one of a display instrument, a combination instrument, a navigation system, a vehicle infotainment system, VR glasses, and AR glasses. Thus, the brightness of the visual representations on the information presentation device, in particular its display device, can be reduced or even hidden when the occupant is asleep, and correspondingly increased or displayed when they are awake. Alternatively or additionally, acoustic signals of the information presentation device can be reduced or even hidden when the driver is asleep, and correspondingly displayed or displayed when they are awake. Alternatively or additionally, it is also possible to switch off the information presentation device while the driver is asleep and switch it back on again when they are awake.
[0054] The comfort device can be configured, for example, as at least one of an air conditioning system, a music playback device, a seat heating device, VR glasses, and AR glasses. For example, the air conditioning system and / or the seat heating device can be set such that an optimal sleeping temperature or one preferred by the driver is established in the vehicle interior or on the seat when the driver is asleep. The output volume of the music playback device can also be reduced when the driver is asleep to create comfortable sleeping conditions. Alternatively or additionally, it is also possible to switch off the comfort device while the driver is asleep and switch it back on again when awake.
[0055] By adjusting at least one of the information display device and the comfort device depending on the occupant status information, falling asleep, sleeping and waking up of the occupant can be made easier, since during sleep phases the occupant is disturbed by fewer stimuli, in particular visual and / or acoustic signals, within the vehicle cabin.
[0056] In further embodiments, the occupant status information may include at least one of the following: respiratory rate, respiratory flow, respiratory depth, body temperature, heart rate, pulse, blood pressure, blood oxygen saturation, eyelid flutter, eye movement, voltage fluctuations on the head surface, brain wave pattern, leg movement, body position, and body sounds of the occupant.
[0057] From this information, the occupant's sleep and wakefulness states can be determined relatively reliably, so that a waking process can be deduced.
[0058] According to a second aspect, the present invention relates to a system for a vehicle having an autonomous operating mode, comprising: a driver detection system for determining driving status information; an occupant detection system for determining occupant status information, wherein the occupant status information includes a wake status and a sleep status of an occupant of the vehicle; a signaling device for issuing signals to the occupant; and a control device configured to carry out one of the methods described above.
[0059] The statements made regarding the driving status information in the first aspect of the present invention apply to the driving status information.
[0060] The driver detection system may comprise at least one of the following detection devices: level sensors, microphones, camera devices, environmental sensors such as radar and lidar systems, navigation systems, etc. In particular, these detection devices may already be present on the vehicle. The driver detection system is thus configured to collect data from which the driving status information for the vehicle can be determined / derived.
[0061] The statements made regarding the occupant status information in the first aspect of the present invention apply to the occupant status information.
[0062] The occupant detection system can comprise at least one of the following detection devices: electroencephalography (EEG) sensor, microphone, camera device, motion, acceleration, pressure, eyelid, respiratory rate, temperature, heart rate sensor, pulse oximeter. The occupant detection system is thus configured to capture data from which the occupant status information can be determined / derived. For this purpose, the occupant detection system can comprise one or more sensor arrangements and be partially present on the vehicle, i.e., be part of the vehicle. Alternatively or additionally, the occupant detection system can be partially provided / integrated in a wearable device, i.e., a wearable. For example, such a wearable can be designed as a smartwatch, VR glasses, AR glasses, etc.
[0063] The statements made regarding the signaling device in the first aspect of the present invention apply to the signaling device.
[0064] The control device can be configured as a single control unit or a network of control units. The control device is connected to the driver detection system and occupant detection system described above via an internal vehicle data connection (bus system) and / or a wireless connection.
[0065] Furthermore, the control device is configured to carry out the methods described above. Specifically, the control device is configured to carry out the following steps: - Determining driving status information for the vehicle; - Determining a setting parameter for the signaling device depending on the driving status information; - Determining occupant status information from which a waking status and a sleeping status of an occupant of the vehicle can be determined; - Detecting the occupant's awakening; and - Adjusting the signaling device based on the setting parameter in response to detecting the wake-up process.
[0066] The explanations given in the first aspect of the present invention apply to these steps.
[0067] It is possible for the methods and system described above to be transferred in a corresponding manner from the vehicle environment to the living area. In this way, it is also possible to detect a person in the living area waking up. In response to the detection of the waking up, signals, in particular calming ones, can be transmitted to the person via a signaling device arranged in the living area, e.g. room lighting and / or a voice output device. A voice control device can also be used in this context. In particular, certain signals can be transmitted in a bedroom, e.g. via the ambient lighting, whereby the signal indicates that, for example, a specific person has called. The procedure familiar to an occupant from a vehicle cabin can also be transferred to a hotel room, so that they do not have to adapt.This allows hotels to retrieve custom (wake-up) profiles and use them in a hotel room.
[0068] Embodiments of the invention will now be described by way of example and with reference to the accompanying drawings, in which: Fig. 1 schematically shows a system for a vehicle according to an embodiment; and Fig. 2 a method according to an embodiment.
[0069] In Fig. 1 shows the structure of a system 100 for a vehicle 1. The dashed line 1 corresponds to a vehicle system boundary. The vehicle 1 is designed and configured to execute an automated operating mode. The vehicle 1 comprises a control unit 2, which is connected via an internal vehicle data connection, e.g., a bus system, to a driver detection system 3, an occupant detection system 5, a navigation system 7, a signaling device 9, an information display device 11, and a comfort device 13. Optionally, the control unit 2 can be connected via a wireless data connection to at least one wearable 15, e.g., a smartwatch.
[0070] The driver detection system 3 can comprise at least one of the following detection devices: a camera device, a microphone, a radar sensor, a lidar sensor, a sensor for detecting fuel level / consumption, and a sensor for detecting the capacity of a vehicle's drive battery. The driver detection system 3 is designed to detect data from which driving status information can be determined / derived.
[0071] In some embodiments, microphones are provided for determining the driving status information in order to detect noises outside the vehicle interior of the vehicle 1. Additionally, microphones can also be provided to detect noises inside the vehicle interior. The same applies to camera devices for determining the driving status information.
[0072] The occupant detection system 5 can comprise at least one of the following detection devices: an EEG sensor, a camera device, a microphone, an acceleration sensor, a motion sensor, a pressure sensor, an eyelid sensor, a respiration rate sensor, a temperature sensor, a heart rate sensor, and a pulse oximeter. The occupant detection system 5 is configured to capture data from which occupant status information can be determined / derived. In particular, the driver detection system is configured to capture data about the occupant.
[0073] The EEG sensor can be incorporated into a smartwatch, VR headset, and / or AR headset. Alternatively or additionally, the EEG sensor can be incorporated into a headrest of a seating / reclining device of the vehicle 1. This allows an EEG measurement to be performed over a distance (headrest to head), which allows the occupant's alertness and / or fatigue level to be determined. The EEG sensor can thus record the corresponding data without contact with the driver.
[0074] An eyelid blink sensor can be integrated, for example, into VR and / or AR glasses. The eyelid blink sensor detects whether the occupant's eyelids are closed for an extended period of time. This can be implemented, for example, with an optical sensor that looks at one of the occupant's eyes and can distinguish between the states "eye open" and "eye closed." If the eyes are closed for longer than a predetermined period, e.g., two minutes, it can be assumed that the occupant has fallen asleep. The predetermined period can be driver-dependent.
[0075] In some embodiments, at least one of the camera device and the microphone of the driver detection system may be that of the occupant detection system.
[0076] The navigation system 5 is designed and configured to determine the current position of the vehicle 1, to calculate and track the route, and to perform other functions typical of a navigation system. Accordingly, the driving status information can also be determined from the data of the navigation system 5.
[0077] The signaling device 9 can comprise at least one of a lighting device, in particular ambient lighting, for the vehicle interior, a loudspeaker device, or an actuator for the driver's seating / reclining device, in particular a vibration device. The signaling device 9 can also comprise a display device for transmitting text information. The signaling device 9 can output at least one of visual, acoustic, and haptic signals.
[0078] The information display device 11 can be configured as a display instrument, a combination instrument, and / or an infotainment system. The comfort device 13 can be configured as an air conditioning system, seat / recliner heating, or music playback device. The wearable 15 can be configured as a smartwatch, VR glasses, or AR glasses.
[0079] In Fig. Figure 2 shows an embodiment of the method according to the invention. S and E represent a start and an end of the method, respectively.
[0080] In S1, the driving status information is determined. The driving status information is derived from data collected and provided by the driver detection system 3 and the navigation system 3.
[0081] In S2, a setting parameter for the signaling device 9 is determined from the driving status information. For this purpose, the control unit 2 can have at least one of logics, models, characteristic maps, machine learning modules, etc., that can determine the setting parameter. In S2a, which is optional, a driving status information history can be determined from the driving status information, which is a, in particular chronological, list of driving events.
[0082] In S3, the occupant status information is determined. The occupant status information is derived from data collected and provided by the occupant detection system 5 and, if applicable, wearables 9. The implementations of S2 and S3 are interchangeable.
[0083] In S3a, which is optional, the information display device 11 and the comfort device 13 are adjusted depending on the occupant status information.
[0084] In S4, a query is performed to determine whether the occupant has woken up or is present. The awakening process is determined from the occupant status information. If the query is negative, i.e., no awakening process is detected, the process returns to S1. This ensures that the current occupant status information, the current driving status information, and a corresponding (current) setting parameter are taken into account in query S4.
[0085] In S5, the signaling device 9 is set according to the (currently determined) setting parameter.
[0086] In some embodiments, the signaling device 9 comprises a display device and / or ambient lighting, so that a green color can be indicated that no dangers exist and no action is required by the occupant. If, in another driving situation, an action is actually required by the occupant, the signaling device 9 can be set using a corresponding setting parameter to display a (warning) color, e.g., "yellow" or "red." This allows the driver to immediately recognize the driving situation and / or the overall situation.
[0087] If, in (rare) dangerous situations, the occupant actually needs to take action, a text message can be displayed on the display device with an optional animated display on the display device and / or a voice announcement indicating the form in which the driver should take this action (e.g., "When the vehicle stops in approximately two minutes, please get out on the right-hand side in the direction of travel.").
[0088] In S6, which is optional, the driving status information history is displayed, provided it was previously determined in S2a. This allows the occupant to be informed about the last driving event (e.g., a previous honk from another road user) that was immediately temporally related to the occupant waking up, e.g., with text information on the display. Alternatively or additionally, this information can be provided via a voice announcement. List of reference symbols 1 vehicle 2 control unit 3 Driver detection system 5 Occupant detection system 7 Navigation system 9 Signaling device 11 Information display device 13 Comfort device 15 Wearable E End of procedure S1-S6 process steps S Start of procedure
Claims
[1] Method for setting a signaling device (9) to output signals to an occupant of a vehicle (1) having an autonomous operating mode, the method comprising: - Determining driving status information for the vehicle (1); - determining a setting parameter for the signaling device (9) as a function of the driving status information; - determining occupant status information from which a waking status and a sleeping status of an occupant of the vehicle (1) can be determined; - Detecting the occupant's awakening; and - Adjusting the signaling device based on the setting parameter in response to detecting the wake-up process. [2] Method according to claim 1, wherein the presence and non-presence of a requirement for action by the occupant can be indicated by the signals emitted by the signaling device (9). [3] Method according to claim 1 or 2, wherein the need for action can be divided into at least two levels of urgency. [4] A method according to claim 2 or 3, wherein the action requirement is user-defined. [5] Method according to one of the preceding claims, wherein the signaling device (9) outputs at least one of visual, acoustic or haptic signals. [6] Method according to one of the preceding claims, wherein the signaling device (9) comprises a vehicle interior lighting, which is designed in particular as an ambient lighting. [7] A method according to any one of the preceding claims, further comprising: - Determining driving events from the driving status information; and - Displaying the driving events in a display device of the vehicle (1). [8] A method according to any one of the preceding claims, further comprising: - Setting at least one of an information display device (11) and a comfort device (13) depending on the occupant status information. [9] A method according to any one of the preceding claims, wherein the occupant status information comprises at least one of respiratory rate, respiratory flow, respiratory depth, body temperature, heart rate, pulse, blood pressure, oxygen saturation in the blood, eyelid flutter, eye movement, voltage fluctuations on the surface of the head, brain wave pattern, leg movement, body position and body sounds. [10] System (100) for a vehicle (1) having an autonomous operating mode, comprising: a driver detection system (3) for determining driving status information; an occupant detection system (5) for determining occupant status information, wherein the occupant status information includes a wake status and a sleep status of an occupant of the vehicle; a signaling device (9) for outputting signals to the occupant; and a control device (2) which is arranged to carry out the method according to one of claims 1 to 9.
Citation Information
Patent Citations
procedure for calculating a return time
DE102014011264A1
vehicle attention-getting system
DE102016202946A1
System and procedure for a vehicle to wake a vehicle occupant during an automated driving process
DE102017214365A1
Driving assistance apparatus and driving assistance method
US20170368936A1
Wake-up alerts for sleeping vehicle occupants
US9725036B1