Method for displaying a virtual image in a motor vehicle and motor vehicle

Abstract

The present invention relates to a method for displaying a virtual image in a motor vehicle (1). The procedure comprises the following steps: - Detecting the position of a head (3) and / or a direction of gaze (4) of a vehicle occupant (5) by means of a detection device (6), - Transmitting the position of the head (3) and / or the direction of gaze (4) to a computer device (7), - Controlling an adjustment device (8) for adjusting a display device (9) by means of the computer device (7) such that the display device (9) is adjusted to follow a head movement and / or the direction of gaze (4) of the vehicle occupant (5) in such a way that the display device (9) always remains in a predefined field of vision of the vehicle occupant (5). This allows a vehicle occupant (5) to be offered a virtual reality without the need for uncomfortable VR glasses.

Description

[0001] The present invention relates to a method for displaying a virtual image in a motor vehicle, according to the preamble of claim 1. The invention further relates to a motor vehicle with a computer device for carrying out this method.

[0002] From DE 10 2021 111 050 A1, a generic method for displaying a virtual image in a motor vehicle is known. In one embodiment, a system comprises a sensor system configured to generate sensor data acquired from the vehicle's environment. This system further comprises a control module configured to use a processor to determine a scene of the environment based on the sensor data, store a shape of at least one feature in the scene, modify video data based on the stored shape, and present the modified video data for display to the vehicle occupant.

[0003] From DE 10 2019 220 040 A1, a method for preventing motion sickness when viewing an image displayed on a screen in a moving vehicle is known. The method comprises a reading step and a determination step, wherein in the reading step a trajectory planning signal, representing a planned trajectory of the vehicle, and a display signal, representing at least one application displayed on the screen, are read. In the determination step, using the trajectory planning signal and the display signal, an image movement signal is determined to shift a background image displayed as the background for the displayed image content relative to the displayed image content of the at least one application shown on the screen.

[0004] From DE 10 2019 122 632 A1, a display system for a motor vehicle is known that has an output unit for displaying image content to a user and an input unit for entering operating actions for the image content. The display system has a recognition unit that is configured to recognize the user's seating position in the motor vehicle and a processing unit that is configured to determine an available action space based on the seating position and to adjust the displayed image content and / or the user's action radius based on the available action space.

[0005] From DE 10 2020 119 648 A1 a system and a method for user interfaces of a vehicle environment are known, in particular for autonomous vehicles, in which the orientation or attention of the vehicle occupants is not limited to a direction of movement.

[0006] From DE 10 2014 018 700 A1, a device for monitoring a vehicle environment is known with a camera which is oriented forward in the longitudinal direction of the vehicle and comprises an amorphous optic, wherein the amorphous optic is designed in such a way that an image of the vehicle environment captured by the camera is compressed in the horizontal direction and can be displayed on an image sensor of the camera.

[0007] From DE 10 2022 119 199 A1 a method is known for capturing an image of a vehicle ahead by a host vehicle camera in order to estimate a dimension of the vehicle ahead and a first distance between a host vehicle and the vehicle ahead as a reaction to the image.

[0008] DE 10 2015 218 162 A1 is a known UDP display method for a vehicle.

[0009] From DE 10 2018 201 631 A1 a method for generating a virtual representation to extend the field of vision in a vehicle is known.

[0010] From DE 10 2023 002 267 A1, a projection interaction system for a motor vehicle is known, comprising a projection device configured to be rotatable through 360° on the vehicle's interior roof. Furthermore, a capture device is provided, configured to capture data information associated with the vehicle.

[0011] Generally speaking, so-called virtual reality glasses (VR glasses), or virtual reality devices in general, are worn by a user and maintain a constant distance between the user's eyes and a display device, such as a screen. A system-related requirement is the constant distance between the internal screens and the eyes, which necessitates wearing the virtual reality glasses, and the associated weight may be perceived as bothersome.

[0012] The present invention therefore addresses the problem of providing an improved or at least an alternative embodiment of a method of the generic type, by means of which, in particular, virtual reality can be realized in a motor vehicle without the need for additional VR glasses.

[0013] This problem is solved according to the invention by the subject matter of independent claim 1. Advantageous embodiments are the subject matter of the dependent claims.

[0014] The present invention is based on the general concept of providing, for the first time, a communicating detection and adjustment device in a motor vehicle, which, on the one hand, detects the position and / or the direction of gaze of a user or vehicle occupant and, on the other hand, aligns a display device, for example, a screen or display, with the position or head movement of the vehicle occupant and / or the direction of gaze of the vehicle occupant in such a way that the occupant always keeps the display device, i.e., the screen, in their field of vision. This makes it possible for the user to keep the screen in view even when turning their head or changing their viewing angle.In particular, this allows the display device to be positioned analogously to a VR headset screen at a predefined distance and angle to the head of the vehicle occupant. In the inventive method for displaying a virtual image in a motor vehicle, a detection device first captures the position of the head and the direction of gaze of a vehicle occupant and transmits the position of the head and / or the direction of gaze to a computer. Subsequently, the computer controls an adjustment device to adjust a display device such that the display device follows the head movement and / or the direction of gaze of the vehicle occupant in such a way that the display device is always kept within a predefined field of vision of the vehicle occupant, in particular at a predefined distance and angle to the head of the vehicle occupant.The computer unit is connected to both the adjustment mechanism and the detection unit via data transmission. If the user / vehicle occupant changes their viewing direction or turns their head, this is detected by the detection unit and transmitted to the computer unit. The computer unit then controls the adjustment mechanism so that it follows the changed head position or viewing direction of the user, ensuring that the user always keeps the displayed information in their field of vision. For example, if the user turns their head to the right, the computer unit adjusts the screen or display accordingly, thus ensuring that the user / vehicle occupant never loses visual contact with the display, i.e., the screen.The inventive method thus allows a virtual reality to be displayed to the vehicle occupant via the display device, without the vehicle occupant having to wear VR glasses, which are often perceived as unpleasant.

[0015] In an advantageous further development of the inventive method, the computer system detects a rest state and controls the adjustment mechanism of the display unit such that it moves the display unit into a park position, provided the computer system detects the rest state. In such a park position, or generally in a rest position, the display unit lies flat against a dashboard, for example, and does not protrude into the passenger compartment, thus allowing the user to enter and exit the vehicle without hindrance. The rest state detected by the computer system can be determined, for example, when an engine is switched off, when an ignition key is removed, or when the vehicle is put into a standby mode.

[0016] In a further advantageous embodiment of the solution according to the invention, the computer controls the adjustment device in such a way that it holds the display device at a predefined distance and angle to the head of the vehicle occupant. This fulfills a necessary system-related requirement for VR glasses, namely the constant distance of the display device to the eyes, thus enabling the user / vehicle occupant to view a virtual reality undisturbed even without VR glasses.

[0017] The present invention is further based on the general concept of equipping a motor vehicle with a detection device for sensing the position of a vehicle occupant's head and / or gaze direction and for transmitting this position and / or gaze direction to a computer system, wherein the computer system is configured to carry out the method according to the preceding paragraphs. Specifically, the computer system is capable of controlling the adjustment device in such a way that it follows the position of the vehicle occupant's head or head movement and / or gaze direction in such a way that the display device, for example a screen, always remains within the vehicle occupant's field of vision.The inventive motor vehicle makes it possible for the first time to present a virtual reality experience to a vehicle occupant via at least one movable screen without the risk of the user losing eye contact with the screen. This is because the computer system constantly detects the position of the user's head and / or gaze direction via the sensor and adjusts the display device accordingly, ensuring the user maintains a constant view of the screen. This eliminates the need to wear heavy and often uncomfortable VR glasses.

[0018] In an advantageous embodiment of the motor vehicle according to the invention, the adjustment device for adjusting the display unit is arranged on a center console of the motor vehicle. In the area of ​​the center console, many motor vehicles already have a relatively large screen, i.e., a relatively large display unit, on which information, for example, from a navigation system, can be displayed. Up to now, however, such screens in the center console have been either fixed or merely foldable on the center console or dashboard.In the motor vehicle according to this embodiment, the adjusting device for adjusting the display device can be arranged on the center console, so that in the parking position the display device lies flat on the center console and is therefore arranged in a less obtrusive manner, while in a use position it can be extended into a passenger compartment via the adjusting device and always kept in the user's field of vision.

[0019] Alternatively, it is of course also conceivable that the adjustment device is arranged on an A-pillar, a B-pillar and / or a C-pillar of the motor vehicle, whereby it is of course also conceivable that several display devices are coupled with several associated adjustment devices, thereby offering a user of the motor vehicle full visual contact with the display devices.

[0020] It is also conceivable to connect the adjustment device to the headliner of the vehicle, so that in this case the adjustment device extends the display device downwards from the park / rest position, which is, for example, flat against the headliner, and moves it in the passenger compartment via a mechanical articulated arm.

[0021] In a particularly preferred embodiment of the motor vehicle according to the invention, the display device is designed as a transparent screen. Transparent screens offer the significant advantage that they not only provide image information but, in particular, are also at least partially transparent when switched off, thus allowing the user of the motor vehicle to be presented with a mixed image, i.e., an image combining virtual reality or displayed information and / or the real environment.

[0022] Further important features and advantages of the invention will become apparent from the dependent claims, the drawings and the associated description of the figures based on the drawings.

[0023] It is understood that the features mentioned above and those to be explained below can be used not only in the combinations specified, but also in other combinations or individually, without departing from the scope of the invention as defined by the claims. Components of a higher-level unit, such as a device, apparatus, or arrangement, mentioned above and those to be mentioned below, which are designated separately, can form separate parts or components of this unit or be integral areas or sections of this unit, even if this is depicted differently in the drawings.

[0024] Preferred embodiments of the invention are shown in the drawings and are explained in more detail in the following description, wherein identical reference numerals refer to identical or similar or functionally identical components.

[0025] They show, schematically, Fig. 1 Individual process steps of a method according to the invention for displaying a virtual image in a motor vehicle according to the invention, Fig. 2 an interior view of a motor vehicle according to the invention with a computer device for carrying out the method according to the invention.

[0026] According to the Fig. 1 discloses an inventive method for displaying a virtual image in a motor vehicle 1 (compare Fig. 2) a total of three process steps A to C.

[0027] In the first process step A, the position of a head 3 and / or the gaze direction 4 of a vehicle occupant 5 is detected by a detection device 6, for example, a camera. In process step B, the position of the head 3 and / or the gaze direction 4 is transmitted from the detection device 6 to a computer 7. In process step C, the computer 7 then controls an adjustment device 8 to adjust a display device 9 such that the display device 9 follows the head movement and / or gaze direction 4 of the vehicle occupant 5, ensuring that the display device 9 is always within the vehicle occupant 5's field of vision. The computer 7 can control the adjustment device 8 to hold the display device 9 at a predefined distance and angle to the head 3 or the eyes of the vehicle occupant 5, analogous to VR glasses.

[0028] With the appropriate method, it is thus possible for the first time to present a virtual reality to the vehicle occupant 5 of the motor vehicle 1 via the display device 9 regardless of his direction of view 4, which was previously only possible by putting on VR glasses, which was often perceived as unpleasant for a vehicle occupant 5 in a motor vehicle 1.

[0029] The motor vehicle 1 according to the invention has at least the detection device 6, the computer device 7, at least one display device 9 and at least one associated adjustment device 8, wherein the detection device 6 is connected to the computer device 7 and the computer device 7 is connected to the adjustment device 8, for example an articulated arm, and to the display device 9 in a data-transmitting, i.e., communicating, manner.

[0030] In the present case, the adjusting device 8 for adjusting the display device 9 is connected to a center console of the motor vehicle 1, whereby alternatively, a connection of the adjusting device 8 to an A-pillar 12, a B-pillar 13, a C-pillar, a headliner 10 or a dashboard 11 is also conceivable.

[0031] Furthermore, the display device 9 can be designed as a transparent screen, which offers the vehicle occupant 5 in the motor vehicle 1 according to the invention the additional advantage of being able to see through the display device 9, particularly when it is not activated. In addition, the display device 9 can also be used to present a so-called mixed virtual reality, in which virtual images are mixed or superimposed with real images. Information and operating functions can also be offered via the display device 9.

[0032] The display unit 9 can also be adjusted into a parking position by means of the adjustment device 8, in which it lies flat against, for example, the dashboard 11, an A-pillar 12, or the center console. The parking position is assumed by the display unit 9 based on a control command from the computer unit 7, provided that the computer unit 7 determines, for example, that the vehicle 1 is parked or put into a non-use state.

[0033] By means of the inventive method and by means of the inventive motor vehicle 1 it is thus possible for the first time to hold a display device 9 for displaying a virtual reality at a predefined distance to the eyes of the vehicle occupant 5 and at the same time to adjust the display device 9 depending on the direction of gaze, which in particular makes wearing VR glasses in the motor vehicle 1 unnecessary. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2021 111 050 A1

[0002] DE 10 2019 220 040 A1

[0003] DE 10 2019 122 632 A1

[0004] DE 10 2020 119 648 A1

[0005] DE 10 2014 018 700 A1

[0006] DE 10 2022 119 199 A1

[0007] DE 10 2015 218 162 A1

[0008] DE 10 2018 201 631 A1

[0009] DE 10 2023 002 267 A1

[0010]

Claims

[1] Method for displaying a virtual image in a motor vehicle (1), characterized by the following steps; - Detecting the position of a head (3) and / or a direction of gaze (4) of a vehicle occupant (5) by means of a detection device (6), - Transmitting the position of the head (3) and / or the direction of gaze (4) to a computer device (7), - Controlling an adjustment device (8) for adjusting a display device (9) by means of the computer device (7) such that the display device (9) is adjusted to follow a head movement and / or the direction of gaze (4) of the vehicle occupant (5) in such a way that the display device (9) always remains in a predefined field of vision of the vehicle occupant (5). [2] Method according to claim 1, characterized by, that the computer device (7) determines a rest situation and, when a rest situation is determined, controls the adjustment device (8) in such a way that it moves the display device (9) into a park position. [3] Method according to claim 1 or 2, characterized by , that the computer device (7) controls the adjustment device (8) in such a way that it holds the display device (9) at a predefined distance and angle to the head (3) of the vehicle occupant (5). [4] Motor vehicle (1), - with a detection device (6) for detecting the position of a head (3) and the direction of gaze (4) of a vehicle occupant (5) and for transmitting the position of the head (3) and / or the direction of gaze (4) to a computer device (7), - with a computer device (7) for carrying out the method according to one of the preceding claims. [5] Motor vehicle (1) according to claim 4, characterized by, that the adjusting device (8) for adjusting the display device (9) is connected to a center console of the motor vehicle (1). [6] Motor vehicle (1) according to claim 4, characterized by , that the adjusting device (8) for adjusting the display device (9) is attached to a roof liner (13) of the motor vehicle (1). [7] Motor vehicle (1) according to claim 4, characterized by , that the adjusting device (8) for adjusting the display device (9) is attached to an A-pillar (12) of the motor vehicle (1). [8] Motor vehicle (1) according to claim 4, characterized by , that the adjusting device (8) for adjusting the display device (9) is attached to a B-pillar of the motor vehicle (1). [9] Motor vehicle (1) according to claim 4, characterized by , that the adjusting device (8) for adjusting the display device (9) is attached to a C-pillar of the motor vehicle (1). [10] Motor vehicle (1) according to any one of claims 4 to 9, characterized by , that the display device (9) is designed as a transparent screen.

Images