Method for operating a motor vehicle, display device and motor vehicle comprising such a display device

Abstract

The invention relates to a method for operating a motor vehicle (1), wherein a control device (4) of the motor vehicle effects an at least semi-automatic control of the motor vehicle (1), and wherein a display device (2) outputs non-journey-related information (I) to a driver of the motor vehicle (1) during a journey with the motor vehicle (1) in a first driving situation, characterised in that the display device (2) modifies the output of this non-journey-related information (I) in a second driving situation which differs from the first driving situation.

Description

[0001] Description

[0002] Method for operating a motor vehicle, display device and motor vehicle with such a display device

[0003] The present invention relates to a method for operating a motor vehicle and a display device for a motor vehicle as well as a motor vehicle with such a display device.

[0004] In recent times, there has been an increasing development of so-called autonomous motor vehicles and, in general, motor vehicles that enable automatic control of the vehicle.

[0005] Some distinguish between partially automated and highly automated driving. In partially automated driving, the driver can briefly remove their hands from the steering wheel. However, the driver must constantly monitor the assistance systems and correct any malfunctions. The driver remains responsible for accidents, even if the vehicle has not reported a malfunction.

[0006] In highly automated driving, the driver is allowed to temporarily turn away from the driving task and the traffic. In certain specific use cases, the car drives independently. However, the driver must temporarily take over control of the vehicle upon request from the system.

[0007] The present invention is particularly applicable to highly automated driving, but applications for partially automated driving would also be conceivable.

[0008] In practice, it is increasingly desirable to entertain or, if necessary, inform the driver while driving. However, road safety must not be compromised under any circumstances. Driver entertainment is often combined with visual information. Various entertainment devices are known from the state of the art. This has led to the idea of ​​using a karaoke function while driving, although not yet for the driver.

[0009] With current technology, the driver cannot use the karaoke system while driving. Furthermore, they cannot watch movies and / or videos, as these are always played on the central screen, preventing the driver from seeing the road and thus becoming highly distracted. Distracting entertainment options are disabled while driving or restricted to the driver only.

[0010] DE 102021 212 655 A1 discloses a method for controlling a display unit in a motor vehicle and a display controller for implementing this method. A first information signal comprising multimedia and / or HMI content is received. If a situation arises that impairs the operation of the vehicle, the contents of at least one second information signal are displayed in a highlighted manner.

[0011] US 2016 / 0280234 A1 describes a method for using a communication device in a vehicle while an autopilot is activated.

[0012] GB 2580861 discloses improvements for the driver's reactions of a motor vehicle. A display system comprises at least one screen on which information, entertainment, or media is displayed. However, in autonomous mode, emerging driving hazards are displayed in real time.

[0013] The present invention is therefore based on the object of improving the possibilities for entertaining vehicle occupants, and in particular the driver, without compromising driving safety.

[0014] These objects are achieved according to the invention by the subject matter of the independent patent claims. Advantageous embodiments and further developments are the subject matter of the dependent claims.

[0015] In a method according to the invention for operating a motor vehicle, a control device of the motor vehicle effects at least semi-automatic control of the motor vehicle, in particular for longitudinal and / or lateral guidance of the motor vehicle, and a display device outputs non-driving-related information to a driver of the motor vehicle during the driving of the motor vehicle in a first driving situation. The display device preferably outputs this non-driving-related information in a visually perceptible manner.

[0016] According to the invention, the display device modifies the output of this non-driving-related information in a second driving situation which differs from the first driving situation and / or the non-driving-related information output by the display device is modified in a second driving situation which differs from the first driving situation and, in particular, the manner in which it is displayed is modified.

[0017] A modification of the journey-related information is understood in particular to mean that the information content of this information is not or not necessarily changed, but its presentation, for example the font size of this information and / or an arrangement.

[0018] In contrast to the prior art, it is therefore proposed that, in certain driving situations or under certain conditions, the display of non-driving-related information and / or its presentation to the driver be changed. This can increase the driver's attention to road traffic.

[0019] Preferably, the first driving situation is a normal driving situation, i.e., a driving situation in which no malfunctions or irregularities occur. In particular, the first driving situation is a driving situation in which driver intervention in the driving process is not required and / or in which the vehicle is driving independently or fully automatically.

[0020] Preferably, the second driving situation is a driving situation in which irregularities and / or (unexpectedly occurring) dangerous situations and / or errors or the like occur. In particular, the second driving situation is a driving situation in which driver intervention is necessary and / or in which highly automated control of the vehicle is at least temporarily impossible or limited.

[0021] For example, in the second driving situation, a deer crossing the road or something similar could occur in front of the vehicle. It is also possible that the second driving situation is caused by a failure of an assistance system. Non-driving-related information is understood to mean that the information is not related to the current driving situation and / or is independent of the current operation of the vehicle. For example, information about the current speed or tire pressure would be driving-related. Safety-relevant information such as the outside temperature is also an example of driving-related information.

[0022] In particular, non-driving information is information that primarily or exclusively serves to entertain and / or provide non-driving information to the driver. For example, song lyrics, image sequences, or similar information could be displayed to the driver. General information from social networks could also be considered non-driving information.

[0023] An essential component of the invention is a display device, in particular a HUD, which displays visual entertainment content during highly automated driving. If driver intervention is required (for example, in a dangerous situation or if an assistance system is no longer available), the entertainment content is preferably modified and, in particular, reduced in size or minimized, so that the driver's attention is fully redirected to the situation on the road.

[0024] This effect can be enhanced by visual effects (e.g., highlighting the cause of the hazardous situation (deer on the road or similar) in color). This can accelerate the perception of the situation requiring intervention, thus minimizing reaction time. Additionally, an audible alarm or audible information can be issued when such a second driving situation occurs.

[0025] An example of a specific use case is karaoke. Only the lyrics need to be displayed on the HUD. The driver's attention is only partially distracted from the road, and they can intervene quickly by minimizing and highlighting as described above. In addition, audio output can be interrupted or the volume reduced when the second driving situation mentioned above occurs.

[0026] Additionally, it would be possible (particularly depending on a criticality and / or a criticality signal) for the display device to be controlled in such a way that the contents of at least one second information signal are displayed in a highlighted manner, and in particular an information signal that also includes the situation impairing the operation of the vehicle. In particular, this second information signal can be journey-related information.

[0027] This second information signal and / or the journey-related information can contain content and in particular video content from a camera directed in the direction of travel to an area in front of the vehicle.

[0028] In this case, it can additionally be provided that contents of a second information signal and / or journey-related information to be highlighted are displayed in a highlighted manner and, in particular, also in a highlighted manner compared to the non-journey-related information.

[0029] The use of entertainment applications (e.g., a karaoke application) is also made available to the driver during highly automated driving via a display device. This redirects the driver's attention back to the road in dangerous situations.

[0030] A vehicle can be a semi-autonomous, autonomous (e.g., Level 3, 4, or 5 (SAE J3016 standard)), or self-driving motor vehicle. Level 5 refers to fully automated vehicles. The vehicle can be partially controlled by a driver or drive autonomously. In addition to a road vehicle, the vehicle can also be an air taxi, an aircraft, or another means of transport or another type of vehicle, such as an aircraft, watercraft, or rail vehicle.

[0031] In a further continuous embodiment, the output of the driving-related information is modified and / or the display device (or a control device) modifies the output of the non-driving-related information in such a way that the driver of the motor vehicle's attention to a traffic situation is improved and / or increased.

[0032] This means, for example, that the information is reduced in size or moved to the edge of the display, allowing the rider to focus more on what's happening on the bike. The modification particularly favors changing the rider's field of vision and / or attention, and in particular, they are no longer focused on the road.

[0033] In a further advantageous embodiment, the modification is selected from a group of modifications which includes hiding the non-journey-related information, reducing the size of the non-journey-related information, shifting the non-journey-related information with respect to the display device, changing an orientation, changing a highlight such as a frame, choosing a font style (italics, bold, underline, font or the like), changing the color (e.g. font color) of the non-journey-related information, changing the contrast of the non-journey-related information, changing the brightness of the non-journey-related information, combinations or the like.

[0034] This allows, for example, a displayed font or text to be reduced in size, moved, or changed in color or contrast, etc. These modifications are preferably user-configurable.

[0035] In another preferred method, the display device is a head-up display (HUD). A head-up display is particularly suitable for outputting said information to the driver of a motor vehicle, as the driver does not have to change their viewing direction when viewing the information.

[0036] Therefore, especially if this information is modified, he can immediately return to what is happening on the road without turning his head.

[0037] In a further preferred method, the first driving situation is a normal and / or fault-free driving situation and / or the second driving situation is a situation deviating from a normal situation and / or an error situation.

[0038] The second driving situation occurs in particular when unforeseen events occur that require intervention by the driver. This can be the case, for example, when unforeseeable events occur, such as wild animals crossing the road or people on the roadway. However, it can also be an error situation, which can occur, for example, when various assistance systems are activated. Of particular importance for the driving situation are those spaces that are traffic-relevant for the vehicle or the driver, i.e. spaces that can either be driven through by the vehicle itself (in the future) or from which environmental influences, in particular in the form of other road users or animals, are to be expected, whose presence or behavior can affect the vehicle's travel, in particular its safe operation.For example, a second driving situation could arise if the vehicle is driving on a road near a kindergarten or school where greater caution is required.

[0039] In a further advantageous embodiment, the display device modifies the output of this non-driving-related information in the second driving situation depending on features characteristic of the second driving situation, or the non-driving-related information is modified depending on such features.

[0040] For example, the modification can be made depending on a criticality (a situation).

[0041] If, for example, immediate driver intervention is required, non-driving-related information may be completely hidden and replaced with a warning. In situations that only require increased driver attention, such as the failure of a specific assistance system, only minor changes or modifications may be made, such as slightly reducing the size of the displayed font.

[0042] In a further advantageous embodiment, a processor unit of the vehicle determines the criticality of a specific hazardous situation. Different events could be assigned to different criticality levels. The modification is preferably carried out depending on the determined criticality level.

[0043] Additionally or preferably, the criticality determined (by the vehicle's processor unit) is a criticality of a need for the driver to take over. The criticality can in particular be characteristic of the necessity or importance (e.g. with regard to vehicle safety and / or road safety and / or the risk of a hazardous situation occurring at a predetermined hazard level) that the driver intervenes in the vehicle control (e.g., longitudinal and / or lateral control of the vehicle) and takes over control of the vehicle with regard to at least one driving task (e.g., longitudinal and / or lateral control of the vehicle). "Taking over the driving task" can be understood to mean that the driver now takes over the vehicle without a driver assistance system for automatically performing this driving task.It is also conceivable that the driver assistance system remains active to automatically carry out the driving task, but the driver can override this assistance system to carry out the driving task.

[0044] Preferably, the determination of whether a modification of the non-journey-related information should be made is carried out depending on the (determined) criticality and / or the (determined) criticality level.

[0045] Particularly preferably, various types of modification are predefined and / or adjustable, which are selected depending on the (determined) criticality level. For example, at a higher criticality level, the output of non-driving-related information can be minimized to a greater extent than at a lower criticality level, where it is assumed that less driver attention is required.

[0046] Preferably, a modification from a first output type of the non-driving information, which is provided in a first driving situation, to a second output type of the non-driving information, which is provided in the second driving situation, takes place continuously. For example, the output non-driving information can be minimized and / or shifted (with respect to the display device) essentially continuously until the second output type is reached. It is also conceivable that a shift path is determined and / or retrieved along which the output of the non-driving information is shifted and / or scaled until the intended second output type is reached.

[0047] It is also conceivable that the second output type achieved by modifying the display of the non-driving information is determined depending on the driver's field of vision required in relation to the necessary attention and / or is repeatedly checked (for example at fixed time intervals) and adjusted if necessary.

[0048] For example, depending on the position of a foreign object that causes a dangerous situation or that is the cause of the second driving situation, such as wild animals crossing the road, it could be determined at which new (centre of gravity) position of the non-driving information output the driver's field of vision is (if possible) not restricted with regard to the position of the foreign object, but preferably at the same time remains (as well as possible) perceptible to the driver.

[0049] In particular, a selection of the output type and / or output position and / or selection of the center, which is selected for the (centric) stretching or scaling of the non-technical information output and / or to be output, is preferably carried out within the scope of the modification as a function of the determined source causing the triggering of the second driving situation (for example its relative position to the vehicle and / or to the driver) and / or as a function of a field of vision of the driver predicted and / or detected and / or determined (by the control device).

[0050] A control system could, for example, also determine the driver's predicted field of vision depending on the vehicle's direction of travel and / or its (current and / or planned) trajectory. For example, a driver's field of vision could be assumed / predicted to be different during a right turn than during a left turn.

[0051] In a further preferred method, the control device effects fully automatic and / or highly automated control of the motor vehicle (particularly for longitudinal and / or lateral guidance). This particularly involves the aforementioned highly automated operation of a motor vehicle. The present invention is particularly suitable for this type of operation.

[0052] In another preferred method, the non-journey-related information is selected from a group of information that includes text information, image information, or information containing symbols. Particularly preferably, the information is displayed in color.

[0053] In another preferred method, the non-driving-related information is coupled with the output of audio information. This is particularly intended for a karaoke application. For example, music, such as a song without lyrics, is played with the audio output, and the text information is output to the driver as non-driving-related information so that they can sing along to the lyrics. Preferably, audio information coupled with the output of the visual non-driving-related information is modified, preferably in conjunction with the modification of visual non-driving-related information. For example, the volume and / or the output location (by selecting a loudspeaker) can be varied.

[0054] For example, the volume of the audio output can be reduced. This reduction can be achieved continuously. It's also conceivable that the volume reduction occurs in a single modification step, such as within half a second or a tenth of a second, so that the volume change also increases the driver's attention.

[0055] It is also conceivable that the audio output is modified in such a way that a loudspeaker is selected that is not located near the driver, for example in a rear area of ​​the vehicle.

[0056] Preferably, the modification of the audio information coupled with the output of the optical non-journey-related information takes place simultaneously with the modification of the (visual) non-journey-related information (on the display device).

[0057] In another preferred method, the modification of the non-driving-related information is adjustable. For example, the driver or a user of the motor vehicle can select by how much text information should be scaled when a dangerous situation occurs, for example, by reducing its size by half, etc.

[0058] In a further preferred method, at least one parameter which is characteristic of the presence of a second driving situation is detected by means of a detection device.

[0059] For example, a detection device can detect the occurrence of sudden disturbances, such as a wild animal crossing, and accordingly issue a signal that is characteristic of the initiation of the second driving situation.

[0060] In addition, however, it can also be a detection device that detects the failure of vehicle assistance systems. If such a failure is detected, a signal can also be output which indicates to the display device that a second driving situation has occurred and that the non-driving-related information must be modified accordingly. The present invention further relates to a display device, in particular a head-up display for outputting information to a driver of an at least semi-automatically controlled motor vehicle. This display device is suitable and intended to output non-driving-related information to the driver of the motor vehicle while driving the motor vehicle in a first driving situation.

[0061] According to the invention, the display device is further suitable and intended to modify the output of this non-driving information in a second driving situation that differs from the first driving situation. For this purpose, the display device can have a control device or be in communication with a control device that effects a corresponding modification when certain parameters occur.

[0062] It is therefore also proposed on the device side that the display device modifies the output of the information when a driving situation changes, for example by reducing the font size.

[0063] Preferably, the display device is configured, suitable and / or intended to carry out the method described above as well as all method steps already described above in connection with the method individually or in combination with one another.

[0064] Conversely, the method can be equipped with all the features described in the context of the display device, individually or in combination with one another. In particular, it can comprise a control device that is suitable and intended for determining a modification of an output of the non-journey-related information and controlling the implementation of the modification on the display device.

[0065] The present invention is further directed to a vehicle, in particular a motor vehicle, with a display device of the type described above. This vehicle particularly preferably has a control device that allows automated and, in particular, highly automated control of the motor vehicle.

[0066] In a further continuous embodiment, the vehicle has a detection device that is suitable and intended to detect the presence of a second driving situation and / or parameters characteristic of a second driving situation. As mentioned above, this can, for example, be a situation in which sudden disturbances such as a deer crossing the road occur in the vehicle's field of vision. Such parameters can also include the failure of driver assistance systems. In the event of such a failure, the driver of the motor vehicle should resume control of the vehicle.

[0067] In a further advantageous embodiment, the motor vehicle has a processor device that is suitable and intended for assigning a criticality or criticality level to specific events. Depending on this criticality, the above-mentioned modification of the non-journey-related information is preferably also possible.

[0068] Further advantages and embodiments can be seen from the attached drawings:

[0069] Showing:

[0070] Fig. 1 is a representation of a motor vehicle according to the invention in a first driving situation; and

[0071] Fig. 2 shows the motor vehicle from Figure 1 in a second driving situation.

[0072] Fig. 1 shows a motor vehicle 1 (more precisely, its interior). This motor vehicle has a display device 2. This is, in particular, a head-up display. However, the display device could also be a monitor in the vehicle's console. This head-up display outputs non-driving-related information, in this case, for example, song lyrics. At the same time, a corresponding melody can be played via the vehicle's audio system, but without vocals, so that the driver can sing along to the lyrics.

[0073] The reference number 4 schematically denotes a control device which enables a highly automated control of the motor vehicle.

[0074] The reference number 20 indicates a route ahead of the motor vehicle.

[0075] Fig. 2 shows the motor vehicle shown in Figure 1 in a second driving situation. In this driving situation, a disturbance occurs, such as a wild animal crossing the road. Accordingly, driving-related information 11 is output via the display device. Additionally, warning symbols 22, such as arrows in this case, can be output to indicate a specific hazard.

[0076] Information I, which is not related to driving, is shifted to the edge of the display and significantly reduced in size. This draws the driver's attention entirely or primarily to what's happening in front of the vehicle, allowing them to intervene in the driving situation.

[0077] The applicant reserves the right to claim all features disclosed in the application documents as essential to the invention, provided they are novel, individually or in combination, over the prior art. It is further noted that the individual figures also describe features that may be advantageous in and of themselves. The skilled person will immediately recognize that a specific feature described in a figure may be advantageous even without adopting further features from that figure. Furthermore, the skilled person will recognize that advantages may also arise from a combination of several features shown in individual or different figures.

[0078] List of reference symbols Motor vehicle Display device Control device Road Non-trip-related information Trip-related information

Claims

Patent claims 1. Method for operating a motor vehicle (1), wherein a control device (4) of the motor vehicle effects at least semi-automatic, preferably fully automatic and / or highly automated, control of the motor vehicle (1), and wherein a display device (2) outputs non-trip-related information (I) to a driver of the motor vehicle (1) during a journey with the motor vehicle (1) in a first driving situation, characterized in that the display device (2) modifies the output of this non-trip-related information (I) in a second driving situation which differs from the first driving situation.

2. Method according to claim 1, characterized in that the display device (2) modifies the output of the non-journey-related information (I) in such a way that the attention of the driver of the motor vehicle (1) with regard to a traffic situation is improved.

3. Method according to one of the preceding claims, characterized in that the modification is selected from a group of modifications which includes a reduction in the size of the non-journey-related information (I), a shifting of the non-journey-related information with respect to the display device (2), a change in the color of the non-journey-related information (I), a change in the contrast of the non-journey-related information (I), a change in the brightness of the non-journey-related information (I), combinations and the like.

4. Method according to one of the preceding claims, characterized in that the display device (2) is a head-up display (HUD).

5. Method according to one of the preceding claims, characterized in that the first driving situation is a normal driving situation, in particular a fault-free situation, and / or the second driving situation is a situation deviating from a normal situation and / or an error situation.

6. Method according to one of the preceding claims, characterized in that the display device (2) modifies the output of this non-driving-related information in the second driving situation as a function of features characteristic of the second driving situation.

7. Method according to one of the preceding claims, characterized in that the non-journey-related information (I) is selected from a group of information which contains text information, image information or symbol information, and / or the non-journey-related information is coupled with the output of audio information.

8. Method according to one of the preceding claims, characterized in that when the second driving situation occurs, the display device outputs driving-related information (11).

9. Display device (2) for outputting information to a driver of an at least semi-automatically controlled motor vehicle (1), wherein the display device (2) is suitable and intended to output non-trip-related information (I) to the driver of the motor vehicle (1) during a journey with the motor vehicle (1) in a first journey situation, characterized in that the display device (2) is suitable and intended to modify the output of this non-trip-related information and / or to change its representation in a second journey situation which deviates from the first journey situation.

10. Vehicle (1), in particular a motor vehicle, comprising a display device (2) according to the preceding claim, wherein the vehicle (1) preferably has a detection device which is suitable and intended to detect the presence of the second driving situation.

Images