Method and device for displaying information to a driver of a motor vehicle, and motor vehicle

The method and device use augmented reality to display driving information through avatars and text on a portable display device, addressing the challenge of presenting information to drivers without distracting them, thereby improving safety and navigation.

WO2024256133A1PCT designated stage expired Publication Date: 2024-12-19AUDI AG
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2024/063955
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-06-15
Filing Date
2024-05-21
Publication Date
2024-12-19

AI Technical Summary

Technical Problem

Modern vehicles face challenges in presenting information to drivers in a way that is easily recognizable and non-distracting, with some information being difficult or unavailable without third-party devices.

Method used

A method and device that utilize a portable display device, such as augmented reality glasses or headgear, to detect control operations and display driving information, including navigation instructions, alerts, and secondary information, using sensors and a processor to provide intuitive and social visualization of relevant data through avatars or text, ensuring the information is presented in a manner that does not distract the driver.

Benefits of technology

The solution effectively displays critical information to drivers without diverting their attention from driving, enhancing safety and navigation by providing intuitive and interactive guidance through avatars and text, while also making additional information about the route and surroundings accessible.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2024063955_19122024_PF_FP_ABST
    Figure EP2024063955_19122024_PF_FP_ABST
Patent Text Reader

Abstract

The invention relates to a method (1000) for displaying information to a driver of a motor vehicle (1), having the steps of detecting (1070) a control actuation of the motor vehicle by the driver, determining (1080) driving information for the driver on the basis of the control actuation, and displaying (1090) the driving information (10) on a portable viewing device (110) of the driver.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Method and device for displaying information for a driver of a motor vehicle and motor vehicle

[0002] DESCRIPTION:

[0003] The invention relates to methods and a device for displaying information for a driver of a motor vehicle and to motor vehicles.

[0004] Modern vehicles offer a wealth of information to drivers. However, this information is difficult to see and distracts from proper ferry operation. Other information is difficult for drivers to access or even unavailable without using a third-party device, such as a mobile phone.

[0005] It is therefore an object of the present invention to provide improved methods and an improved device for displaying information to a driver of a motor vehicle. In particular, it is an object of the present invention to achieve better visualization of information for a driver.

[0006] This problem is solved by the subject matter of the independent claims. Advantageous further developments are specified in the dependent claims.

[0007] According to a first aspect, a method for presenting information, in particular driving information, to a driver of a motor vehicle is provided. The method comprises the steps of detecting a control operation of the motor vehicle by the driver, determining driving information for the driver based on the control operation, and displaying the driving information on a portable display device of the driver.

[0008] The present method serves to visualize driving information for a driver of a motor vehicle. The driver sits in particular in the driver's seat of the motor vehicle and wears a viewing device. The viewing device can be a device designed to display elements of the real world, i.e., reality, together with elements of a virtual world, i.e., virtual reality. In particular, the viewing device is a pair of glasses worn on the nose and / or in front of the driver's eyes. Alternatively, it can also be a device attached to the driver's headgear, such as a visor, in particular of a helmet, such as an open-face helmet or full-face helmet.When worn, at least part of the display device is positioned in front of the driver's eyes in such a way that he or she can see the elements displayed thereon, in particular the driving information described below.

[0009] The viewing device can in particular be designed as a device that is configured to present a virtual reality (VR) to the wearer of the viewing device, i.e. the driver. Virtual reality in this case means a visual representation of a reality that is at least partially filled with images of things, such as objects or a panorama, that are not in the immediate vicinity of the passenger. In particular, the method serves to blend parts of the actual reality, as it occurs around the motor vehicle in the exterior space as well as in the interior of the motor vehicle, with a virtual reality. This reality can also be referred to as augmented reality (AR), augmented virtuality (AV), and / or mixed reality (MR).the method is designed to represent both a virtual reality and an augmented reality, whereby both terms are used synonymously below unless otherwise indicated. In a first step of the method according to the invention, a control actuation of the motor vehicle by the driver is detected or determined. A control actuation is in particular an actuation of a motor vehicle control element, such as a steering wheel, an accelerator pedal and / or a brake pedal. In particular, the control actuation is steering, acceleration and / or braking or an actuation of a device of the motor vehicle which brings about such an actuation. For this purpose, the motor vehicle can have suitable sensors which can detect such an actuation, such as a steering wheel sensor, in particular a steering wheel angle sensor, an accelerator pedal and / or a brake pedal sensor.

[0010] In a further step of the method according to the invention, driving information for the driver is determined or calculated based on the control operation.

[0011] The determination can be made, in particular, using a processor device that has access to the one or more sensors. This can be done both wired and wirelessly. For example, a driver warning can be determined based on excessive application of the accelerator pedal or steering. Alternatively or additionally, the driver can be alerted to a specific location in the vehicle's surroundings.

[0012] In a further step of the method according to the invention, the previously determined driving information is displayed on the driver's portable display device. For this purpose, the processor device, in particular, has access to the display device and provides it with the necessary data. This can be done either wired or wirelessly.

[0013] The driving information can be displayed, in particular, in the form of a so-called avatar. An avatar is a realistic or near-realistic virtual representation, for example, in the form of a person or a human-like figure and / or in the form of a car, in particular the motor vehicle in which the driver is currently driving.

[0014] In particular, the avatar in the form of a human can display gestures and / or hand signals to the driver. The avatar can be depicted photorealistically or nearly so, or alternatively, as a comic and / or fantasy figure. Furthermore, the avatar in the form of a car can drive ahead of the vehicle along a route. Additionally or alternatively, the driving information can also include displayed text, as described below.

[0015] The method according to the invention makes it possible to display relevant information to the driver while driving without distracting them from driving, while simultaneously presenting it in a pleasant and social manner for the driver or other people. In particular, the use of an avatar makes it possible to present and display driving information in a particularly vivid, intuitive, and easily understandable way.

[0016] According to a further development, the method further comprises detecting a navigation destination of the motor vehicle, wherein the driving information is additionally determined based on the navigation destination.

[0017] In this case, a navigation destination is an address, such as a street and house number, a coordinate, a point of interest (POI) and / or a compass direction.

[0018] Data can be collected, in particular, through user input, as will be explained in more detail below. Alternatively, data can also be collected through access to a navigation system.

[0019] The driving information is also determined based on the previously recorded navigation destination of the vehicle. In particular, the driving information can be determined and displayed to the driver, taking into account the steering input and the navigation destination. This allows the avatar to additionally display navigation instructions.

[0020] This training ensures that the driver is not distracted when navigating to a destination and can reach it safely.

[0021] According to a further development, the method further comprises detecting a location of the motor vehicle, wherein the driving information is additionally determined based on the location.

[0022] A location includes the current location of the motor vehicle and / or a radius around the motor vehicle within a specified radius, such as 100m, 500m, or 1000m. This can be determined using a suitable location sensor, such as a GPS sensor.

[0023] Alternatively or additionally, the location of the motor vehicle includes a future location of the motor vehicle, for example, a location that lies on a route to a navigation destination and / or that will be reached in the future based on the road layout. This can be derived from the motor vehicle's navigation system and / or from stored map data, in particular using a GPS sensor.

[0024] The driving information is also determined based on the previously recorded location of the vehicle. In particular, the driving information can be determined and displayed to the driver, taking into account the steering input and the location. For example, the avatar can also display a POI or a point of interest along the route.

[0025] This advanced development makes it possible to make the journey particularly informative. In particular, it is possible to inform the driver about important events along a navigation route. According to a further development, the method also includes recording a

[0026] Acceleration of the motor vehicle, whereby the driving information is additionally determined based on the acceleration.

[0027] An acceleration includes in particular a longitudinal acceleration and / or a lateral acceleration of the motor vehicle or a mixture and / or a resulting acceleration vector.

[0028] For example, acceleration includes longitudinal acceleration when driving straight ahead and / or lateral acceleration when cornering. Acceleration can also take a negative value, for example, during deceleration.

[0029] Additionally or alternatively, the method can also detect a speed and / or derive it from the acceleration.

[0030] Acceleration is recorded using suitable sensors, such as acceleration sensors, one or more gyroscopes, in particular a MEMS gyro, and / or one or more inertial sensors. Acceleration can also be recorded using sensors already present in the vehicle and / or derived from driving data.

[0031] Driving information is also determined based on the previously recorded acceleration of the vehicle. In particular, driving information can be determined and displayed to the driver, taking into account the steering input and acceleration. This allows the avatar to additionally display steering input instructions.

[0032] This advanced training makes it possible to indicate to the driver at an early stage when he or she should brake or steer.

[0033] In particular, this makes it possible to alert the driver to excessive acceleration or speed and instruct them to decelerate before a dangerous situation arises. This is particularly safe. According to a further development, the method further includes detecting a user input from the driver, with the driving information being displayed additionally based on the user input.

[0034] In this case, a user input comprises an input made by the driver on the motor vehicle or on an input device of the motor vehicle. The user input is suitable for communicating information, in particular wishes, needs, and / or requests of the driver, to the motor vehicle or the processor device. In particular, a user input is not a control operation of the motor vehicle by the driver or an input other than that.

[0035] A user input is, for example, the actuation of a specific button, key, and / or switch. Alternatively or additionally, a user input is an input on a touch screen, in particular a selection of a virtual button displayed on the touch screen and / or a text input on a virtual keyboard displayed on the touch screen.

[0036] Alternatively or additionally, the user input is a voice input and / or a gesture. The user input is not tied to the driver and / or the wearer of the visual device and can also be provided by a passenger and / or co-driver of the driver, even if the passenger is not wearing a visual device.

[0037] In particular, the user input is a previously described navigation destination or something different from it. For example, the user input is a request to display specific POIs along the route.

[0038] The driving information is also displayed based on previously recorded user input. In particular, the driving information can be determined and displayed to the driver, taking into account the steering wheel operation and user input. This allows the avatar to further incorporate user preferences into its display.

[0039] Alternatively or additionally, the user input comprises a question to the avatar, for example regarding the operation of a function of the vehicle, and the driving information comprises an explanation of this function by the avatar.

[0040] Furthermore, the user input includes the operation of a function, in particular a comfort function of the vehicle, and the avatar additionally visualizes this activation of the comfort function. For example, the avatar can change its color when the heater is activated. In particular, physical interaction with the avatar can also be simulated by activating vehicle functions. For example, the avatar can virtually jump toward the driver while simultaneously activating the seatbelt tensioner, pressing the driver into the seat.

[0041] This advanced feature allows the driver to provide user feedback. In particular, they can interact with the avatar through user input and thus communicate their wishes and needs. This enables a particularly interactive process.

[0042] According to a further development, the method further comprises retrieving secondary information, wherein the driving information is additionally determined based on the secondary information.

[0043] In this case, secondary information is information relating to the motor vehicle, the driver, a passenger, and / or the surroundings of the motor vehicle. In particular, secondary information is information that is not stored in the motor vehicle and / or is only accessed on an ad hoc basis. For example, secondary information includes additional information about a POI, such as opening hours, public reviews, and / or available parking spaces.

[0044] The retrieval can be carried out in particular via a communication device of the motor vehicle and / or the processor device, for example according to a mobile radio communication standard such as 3G, 4G or 5G and / or according to a Car2X communication standard.

[0045] The driving information is also determined based on the previously retrieved secondary information. In particular, the driving information can be determined and displayed to the driver, taking into account the steering input and the secondary information. This allows the avatar to incorporate additional information into its display.

[0046] This further development makes it possible to retrieve additional information, for example about the navigation destination or along the route, based on the user input and to display this to the driver.

[0047] This enables a particularly informative process.

[0048] According to a further development, the method further comprises detecting a position of the driver, wherein the driving information is additionally displayed based on the position.

[0049] In this case, a driver's position particularly includes a seat position. This driver's seat position can be derived, for example, from a seat setting, such as a memory function, and / or calculated from seat occupancy sensors, such as weight sensors.

[0050] Alternatively or additionally, the driver's position includes a position in the interior, in particular relative to objects present in the interior, such as the A-pillar, the windshield, the steering wheel, and / or the interior mirror. In particular, the driver's position also includes a position of the viewing device relative to these objects. For this purpose, one or more sensors, in particular image capture sensors, can be used in the interior of the motor vehicle and / or on the viewing device. For example, an infrared sensor on the interior mirror can detect the driver, and in particular their head, in an image and use this to determine the driver's position in the motor vehicle.

[0051] The driving information is then additionally displayed based on the previously detected driver position. In particular, the driving information can be displayed to the driver taking into account the steering input and the driver's position. This allows the avatar to be positioned very precisely for display on the display device. In particular, the avatar can be positioned so that it is displayed to the driver at a specific location, such as at the edge of the field of vision, and in particular, so that it does not obscure the road layout.

[0052] This further development makes it possible to take into account the position and in particular the seating position and thus the individual field of vision of the driver, thus enabling a particularly safe and at the same time comfortable display.

[0053] According to a further development, the method further comprises an acoustic reproduction of the driving information.

[0054] The acoustic reproduction can be carried out in particular via loudspeakers located in the vehicle interior and / or on the display device.

[0055] The acoustic playback of driving information can include the same information as the one displayed or different information. For example, the avatar can display a hand signal for braking and simultaneously acoustically play the command "Stop" or "Brake." This further development makes it possible to also inform the driver acoustically, either redundantly or with additional information. This enables particularly safe and / or informative information.

[0056] According to a further aspect, a method for displaying information to a driver of a motor vehicle is provided.

[0057] The method comprises the steps of detecting a location of the driver, detecting a location of the motor vehicle, determining vehicle information for the driver based on the detected positions and displaying the vehicle information on a portable display device of the driver.

[0058] This aspect, described in more detail below, serves in particular to enable the driver to interact with the motor vehicle from outside, without the driver being inside the vehicle. Furthermore, this aspect particularly serves to enable interaction with the motor vehicle without detecting a driver's steering action. This aspect can follow the previously described aspect of the method, as well as occur before and / or between the two.

[0059] The location of the motor vehicle can be detected using a suitable sensor, as described above. The driver's location can also be detected using a suitable sensor, such as a GPS sensor built into the portable display device or another device linked to the display device and / or the motor vehicle, such as a smartphone. The driver's location relative to the motor vehicle can also be detected, for example, via radio communication such as Wi-Fi, Bluetooth, or NFC. This also allows communication between the portable display device and the motor vehicle, for example by communicating the vehicle information described below from the motor vehicle to the portable display device.

[0060] Vehicle information for the driver is then determined based on these two detected positions and displayed to the driver on a portable display device.

[0061] The vehicle information can, in particular, be the location of the motor vehicle. This vehicle information can then include a distance and / or a direction to the motor vehicle. In addition, the vehicle information can also include further information about the motor vehicle, such as a license plate, a color and / or a type of motor vehicle. The vehicle information can also include information about the surroundings of the motor vehicle, such as photographs, objects or landmarks in the vicinity of the motor vehicle. In particular, the vehicle information can also include information about the parking space of the motor vehicle, such as the name and location of the parking space, a floor, a parking space number or a parking space section.

[0062] The vehicle information can in particular be displayed at least partially or completely in the form of a so-called avatar, as already described above. In particular, the avatar can be designed to guide a route to the motor vehicle by displaying this avatar on the portable display device in such a way that it runs in front of the driver and turns into the correct streets, alleys or parking lot sections on the way to the motor vehicle, thus guiding the driver to the motor vehicle. Alternatively or additionally, the avatar can be displayed in such a way that it is located at and / or on the vehicle and / or highlights it graphically or in some other way on the portable display device. In particular, the avatar can be displayed in such a way that it interacts with the driver, for example by waving or making a guiding hand gesture, thus signaling to the driver where and how to find the motor vehicle.

[0063] In particular, detecting a specific location of the driver and / or a specific distance of the driver from the motor vehicle can trigger the method. For example, the method detects that the driver is approaching the vehicle and / or has entered the parking space in which the motor vehicle is located. In particular, determining the vehicle information can occur in response to detecting a specific location of the driver.

[0064] This makes it easier for the driver to locate the vehicle. This allows the driver to be guided safely and reliably to the vehicle, particularly in confusing and / or large parking lots or in city centers. This is also particularly helpful if the vehicle is a rental car that the driver has only briefly seen from the outside and cannot remember its type, color, and / or license plate number.

[0065] The method can be further developed by further comprising the step of detecting a user input from the driver, wherein the display of the vehicle information is additionally based on the user input.

[0066] The user input can be captured as described above. In particular, the user input is a voice input and / or a gesture, which is captured and processed, for example, by the wearable display device.

[0067] In particular, the user input may include a question to the avatar, for example, regarding the operation of a function of the vehicle, and the driving information may include an explanation of this function by the avatar, as previously described. In particular, this vehicle function may be a function relating to the exterior of the motor vehicle, such as opening a fuel cap, a cargo cover, and / or a trunk.

[0068] This allows one or more functions to be explained to the driver, particularly in the case of a new vehicle or a rental car.

[0069] It is understood that these aspects can be combined with the previously described aspects of a method and, in particular, can be carried out by the same device. In particular, these aspects can alternate with the previously described aspects of the method and / or can occur before or after each other.

[0070] The method is in particular a computer-implemented method which can be carried out partially or completely by a data processing device and / or one or more processor devices, as will be explained further below with regard to the device according to the invention.

[0071] For use cases or application situations that may arise during the method and which are not explicitly described here, it may be provided that, in accordance with the method, an error message and / or a request to enter user feedback is issued and / or a default setting and / or a predetermined initial state is set.

[0072] According to a further aspect, a device for displaying information for a driver of a motor vehicle is specified. The device, which can also be referred to as a control device, can have a data processing device or a processor device that is configured to carry out an embodiment of the method according to the invention. For this purpose, the processor device can have at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). Furthermore, the processor device can have program code that is configured to carry out the embodiment of the method according to the invention when executed by the processor device. The program code can be stored in a data memory of the processor device. The processor device can, for example,based on at least one circuit board and / or on at least one SoC (System on Chip).

[0073] In particular, the device may be a portable viewing device.

[0074] According to a further aspect, a motor vehicle is provided comprising such a device or control device.

[0075] The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.

[0076] As a further solution, the invention also encompasses a computer-readable storage medium comprising program code which, when executed by a computer or computer network, causes the computer to carry out an embodiment of the method according to the invention. The storage medium can be provided at least partially as a non-volatile data memory (e.g. as a flash memory and / or as an SSD - solid state drive) and / or at least partially as a volatile data memory (e.g. as a RAM - random access memory). The storage medium can be arranged in the computer or computer network. However, the storage medium can also be operated, for example, as a so-called app store server and / or cloud server on the Internet. The computer or computer network can provide a processor circuit with, for example, at least one microprocessor.The program code can be provided as binary code and / or as assembly code and / or as source code of a programming language (e.g., C) and / or as a program script (e.g., Python). The invention also encompasses combinations of the features of the described embodiments. Thus, the invention also encompasses implementations that each have a combination of the features of several of the described embodiments, unless the embodiments have been described as mutually exclusive.

[0077] With regard to the embodiments and further developments of the device and the motor vehicle as well as their advantages, reference is made to the previously described embodiments and further developments of the method, which apply equally.

[0078] Exemplary embodiments of the invention are described below. Shown are:

[0079] Fig. 1 is a schematic flow diagram of an embodiment of a method for providing driving assistance to a driver of a motor vehicle;

[0080] Fig. 2 is a schematic view of an embodiment of a device for providing driving assistance to a driver of a motor vehicle;

[0081] Fig. 3 is a schematic view of a further embodiment of a device for providing driving assistance to a driver of a motor vehicle from Fig. 2;

[0082] Fig. 4 is a schematic view of another embodiment of a device for providing driving assistance to a driver of a motor vehicle from Fig. 3; Fig. 5 is a schematic view of another embodiment of a device for providing driving assistance to a driver of a motor vehicle from Fig. 4;

[0083] Fig. 6 is a schematic view of another embodiment of a device for providing driving assistance to a driver of a motor vehicle from Fig. 5; and

[0084] Fig. 7 is a schematic view of another embodiment of a device for providing driving assistance to a driver of a motor vehicle from Fig. 2.

[0085] The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual features of the invention that can be considered independently of one another, each of which also develops the invention independently of one another. Therefore, the disclosure is intended to encompass combinations of the features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.

[0086] In the figures, the same reference symbols designate elements with the same function.

[0087] Fig. 1 shows a schematic flow diagram of an embodiment of a method 1000 for representing driving assistance for a driver of a motor vehicle.

[0088] The method 1000 begins with a first step 1010, in which a driver's position is detected. This step can also be referred to as an initial step and forms the basis for a particularly precise representation. The method 1000 continues with a further step 1020, in which a user input from the driver is detected.

[0089] The method 1000 continues with a further step 1030 in which a location of the motor vehicle is detected.

[0090] The method 1000 continues with a further step 1040 in which a navigation destination of the motor vehicle is detected.

[0091] The method 1000 continues with a further step 1050 in which an acceleration of the motor vehicle is detected.

[0092] The method 1000 continues with a further step 1060 in which secondary information is retrieved.

[0093] The method 1000 continues with a further step 1070 in which a control operation of the motor vehicle by the driver is detected.

[0094] Steps 1020 to 1070 can be referred to as acquisition steps and can be repeated in different sequences and / or periodically, particularly asynchronously. For example, a location and / or a control operation of the motor vehicle is recorded regularly, but a user input is recorded only when needed, and a navigation destination is recorded only once or when changed.

[0095] The method 1000 continues with a further step 1080 in which driving information for the driver is determined based on the detection steps.

[0096] The method 1000 continues with a further step 1090, in which the previously determined driving information is displayed on a portable display device of the driver. The display may also take into account or be based on the detections from the initial step 1010 and the user input from step 1020.

[0097] The method 1000 continues with a further step 1100 in which the previously determined driving information is also reproduced acoustically.

[0098] With this step 1100, the method 1000 ends and can start again from the beginning if necessary.

[0099] Figs. 2 to 7 described below show a device that is particularly designed to carry out the method described in connection with Fig. 1. It is understood that the embodiments shown in the following Figs. 2 to 7 can exist side by side or can be executed or realized simultaneously and / or successively by the same device.

[0100] Fig. 2 shows a schematic view of an embodiment of a device 100 for representing driving assistance for a driver of a motor vehicle 1.

[0101] The driver, who is not shown in this Fig. 2 for reasons of clarity, sits in the driver's seat 2 and looks through a portable viewing device 110, which is part of the device 100. The viewing device 110 is embodied here as an augmented reality viewing device, comprising partially or fully transparent viewing glasses 111 and 112, through which the driver can see reality in the form of an interior 3 of the motor vehicle 1 and an exterior 4 of the motor vehicle.

[0102] Alternatively, the display device 110 can also be designed as a completely virtual display device comprising one or more image capture devices that capture parts of the interior 3 and the exterior 4 and display them to the driver through non-transparent viewing glasses. The device 100 is designed to detect a control operation of the steering wheel 5 of the motor vehicle 1 by the driver, determine driving information for the driver based on this control operation, and display this driving information on the driver's portable display device 110.

[0103] It is understood that not only the driver can wear such a display device, but also one or more passengers who are shown the same information, in particular driving information, or different information.

[0104] In the embodiment shown in Fig. 2, the driving information 10 is displayed in the form of a human-like avatar. This avatar can, for example, move its arms and thus display driving information to the driver, such as acceleration, braking, or a steering maneuver such as turning and / or changing lanes.

[0105] Fig. 3 shows a schematic view of another embodiment of a device for providing driving assistance to a driver of a motor vehicle from Fig. 2.

[0106] In addition to the embodiment shown in Fig. 2, not only a human or human-like avatar is shown, but also further information, in particular secondary information, which was retrieved from a location remote from the motor vehicle 1. The secondary information is displayed here, for example, as a speech bubble, but can also be alternatively or additionally reproduced as an acoustic playback on a loudspeaker in the interior 3 of the motor vehicle.

[0107] The secondary information is based on the current location of the vehicle and a planned navigation destination. The secondary information includes a restaurant recommendation for a restaurant that is nearby and / or on the route to the navigation destination. In addition to the name and address, further information can also be displayed, such as a rating. In particular, the secondary information can be retrieved and displayed based on user input from the driver or passenger, for example, based on a voice command requesting that nearby restaurants with good ratings be displayed.

[0108] In contrast to the embodiment shown in Fig. 2, the human-like avatar is displayed here outside the vehicle 1 and, in particular, such that it has the size and / or position like a human in the real outside world 4. The avatar is therefore displayed, in particular, such that it is located at the side of the road and / or not in the path of the motor vehicle 1.

[0109] Fig. 4 shows a schematic view of another embodiment of a device for providing driving assistance to a driver of a motor vehicle from Fig. 3.

[0110] In addition to the embodiment shown in Fig. 3, not only a human or human-like avatar with a first secondary information in the form of a speech bubble is shown, but also a further, second secondary information in the form of the larger-than-life bottle of lemonade.

[0111] This bottle may be displayed based on user behavior, particularly because the driver previously searched for or mentioned this type of lemonade. Alternatively or additionally, a purchase option may be located at the location in reality where this bottle is displayed. Additionally, the speech bubble or acoustic playback of the avatar may also indicate this type of lemonade. Fig. 5 shows a schematic view of another embodiment of a device for displaying driving assistance for a driver of a motor vehicle from Fig. 4.

[0112] In contrast to the embodiment shown in Fig. 4, an avatar of the motor vehicle and a navigation instruction are displayed as driving information for the driver. In particular, the driving information indicates a free parking space for the motor vehicle that is located near a navigation destination of the vehicle.

[0113] This free parking space can be identified as such, in particular, using image recognition algorithms. Additionally or alternatively, the free parking space can also be identified using the current location of the vehicle and / or navigation data. Additionally or alternatively, the free parking space can also be determined using environmental sensors, such as ultrasound.

[0114] Fig. 6 shows a schematic view of another embodiment of a device for providing driving assistance to a driver of a motor vehicle from Fig. 5.

[0115] In contrast to the embodiment shown in Fig. 5, only the avatar of the motor vehicle is displayed, along with additional driving information in the form of control instructions for the driver, which also serve as navigation instructions. In particular, the control instructions can include instructions indicating acceleration, steering, and / or deceleration to the driver.

[0116] Firstly, the driver is indicated to turn into the next dead-end street, both by the arrows and by the position of the vehicle's avatar, as well as by the avatar's activated turn signal. Secondly, the first two arrows behind the avatar indicate to the driver that they should decelerate before turning, then accelerate moderately until the apex of the curve is reached, as indicated by the first two arrows in front of the avatar, and then accelerate more rapidly, as indicated by the last three arrows in front of the avatar.

[0117] Fig. 7 shows a schematic view of another embodiment of a device for providing driving assistance to a driver of a motor vehicle from Fig. 2.

[0118] In contrast to Fig. 2, no driving information is shown in the form of an avatar, but rather a visual highlighting of interior objects using the display device. In particular, the driver can specify a preferred color and / or interior trim via user input, which is then displayed in certain situations or permanently.

[0119] In particular, the visual representation can correspond to a driving style and / or driving setting. For example, a different instrument cluster may be displayed in a sport mode than in an energy-saving mode.

[0120] Overall, the examples show how driving information in the form of an avatar can be provided in a motor vehicle in combination with a viewing device, such as augmented or virtual reality glasses.

[0121] In particular, embodiments of the invention can establish an emotional bond between driver and avatar, whereby the displayed information can be visualized better and more vividly.

[0122] Embodiments also enable safer vehicle operation and, in particular, navigation by the driver, since the control instructions and / or navigation instructions can be displayed to the driver in a position that is easily visible to the driver and, at the same time, does not obstruct the field of vision.

Claims

PATENT CLAIMS: 1 . Method (1000) for displaying information to a driver of a motor vehicle (1 ), comprising: Detecting (1070) a control operation of the motor vehicle (1) by the driver; Determining (1080) driving information for the driver based on the control operation; and Displaying (1090) the driving information (10) on a portable display device (110) of the driver.

2. The method (1000) according to claim 1, further comprising: Detecting (1040) a navigation destination of the motor vehicle; wherein the determination (1080) of the driving information is additionally carried out based on the navigation destination.

3. Method (1000) according to one of the preceding claims, further comprising: Detecting (1030) a location of the motor vehicle (1); wherein the determining (1080) of the driving information is additionally carried out based on the location.

4. Method (1000) according to one of the preceding claims, further comprising: Detecting (1050) an acceleration of the motor vehicle (1); wherein the determining (1080) of the driving information is additionally carried out based on the acceleration.

5. Method (1000) according to one of the preceding claims, further comprising: Detecting (1020) a user input from the driver; wherein the display (1090) of the driving information is additionally based on the user input.

6. Method (1000) according to one of the preceding claims, further comprising: Detecting (1010) a position of the driver; wherein the display (1090) of the driving information is additionally based on the position.

7. Method (1000) according to one of the preceding claims, further comprising: Retrieving (1060) secondary information; wherein the determining (1080) of the driving information is additionally carried out based on the secondary information.

8. Method (1000) according to one of the preceding claims, wherein the driving information is additionally reproduced acoustically (1100).

9. A method for displaying information to a driver of a motor vehicle, comprising: Recording a driver’s location, Detecting a location of the motor vehicle, Determining vehicle information for the driver based on the detected positions and Displaying vehicle information on a driver's portable display.

10. Device (100) for displaying information for a driver of a motor vehicle (1), comprising a processor device which is designed to carry out a method according to one of the preceding claims.

11. Motor vehicle (1) comprising a device according to claim 9.

Citation Information

Patent Citations

  • Driving support device, wearable device, driving support system, driving support method, and computer-readable recording medium

    US20200180645A1

  • Vehicle driving system

    US20220289249A1