Driving motor vehicle in virtual environment

By using head-mounted devices and processing devices on motor vehicles, a view of real and virtual environments is solved, and the problem of difficult to simulate the driving experience of motor vehicles in virtual environments in the prior art is achieved, achieving a more realistic driving experience and improving the safety of training.

CN119836653APending Publication Date: 2025-04-15BAYERISCHE MOTOREN WERKE AG
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380049433.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-09-26
Filing Date
2023-09-19
Publication Date
2025-04-15

AI Technical Summary

Technical Problem

The prior art is difficult to truly simulate the driving experience of a motor vehicle in a virtual environment, especially under extreme driving conditions, where the simulator cannot provide sufficient sense of reality and safety.

Method used

By combining head-mounted devices and processing devices, a view of a mix of real and virtual environments is provided to the driver a hybrid driving experience. The system includes a camera for capturing a view of the interior space of the motor vehicle, a model for generating a view of the virtual environment, and superimposing the two through processing devices to provide to the driver.

Benefits of technology

It realizes a more realistic driving experience in a virtual environment, allowing drivers to control the motor vehicle in a real environment, while simulating various driving conditions through the virtual environment, improving the authenticity and safety of training.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119836653A_ABST
    Figure CN119836653A_ABST
Patent Text Reader

Abstract

A system (100) comprises a head-mounted device arranged for mounting on the head of a driver (120) of a motor vehicle (105) wherein the head-mounted device comprises a camera (130) for providing a first view (205) of an interior space of the motor vehicle (105) and a visual display means for the driver (120); a model (170) for providing a view of a virtual environment of the motor vehicle (105) with respect to a predetermined attitude; the invention relates to a device for determining the position of the head of a driver (120) relative to the real environment of a motor vehicle (105), and a processing device (110). In this case, the processing device (110) is designed to superimpose a first view (205) of the interior with a second view (210) of the virtual environment with respect to the determined position and to provide the superimposed view to the driver (120).
Need to check novelty before this filing date? Find Prior Art

Description

Background Art

[0001] The motor vehicle can be controlled by the driver in a predetermined environment. For example, the motor vehicle can be moved on a test section away from public road traffic in order to train the driver in controlling the motor vehicle. The test section can include means to dynamically bring the driver into a predetermined driving situation so that he can better learn to deal with said driving situation. Thus, the driver can be trained without exposing the motor vehicle, the driver or another person to excessive risks.

[0002] The training device on the test track is usually designed so that even if the driver cannot complete the task given to him or even loses control of the vehicle, as little damage as possible occurs. For example, a series of vertical fountains can be provided, towards which the vehicle can be driven. If a predetermined distance has been reached, some of the fountains can be turned off, so that a gap is created, through which the driver can steer the vehicle. If he misses the gap, the vehicle is hit by the fountains, but does not hit any solid objects.

[0003] Such training devices are complex to set up and operate. Not all driving maneuvers that can be performed with a motor vehicle can be trained with a single training device. For example, the series of fountains mentioned are usually fixedly installed and cannot be changed in order to define a predetermined curve.

[0004] Conversely, test sections can also be used to check the functionality of a motor vehicle under predetermined driving situations. Thus, important aspects of the chassis, brake system or steering system, for example, can be tested in practice. Here, too, it is true that even well-equipped test sections have only limited flexibility and cannot carry out as many different tests as desired on a predetermined limited area.

[0005] It has already been proposed to simulate the behavior of a motor vehicle in predetermined driving situations. The driver can sit in a simulator which simulates the interior of the motor vehicle. The exterior area of ​​the motor vehicle can be obtained via a corresponding display device (e.g. a projector) system. The simulator can be tilted in order to simulate forces acting on the driver in the longitudinal or transverse direction.

[0006] In principle, many different driving situations can be simulated at will using simulators. However, simulators can only convey real driving to the driver in some aspects. For example, accelerations with a strength exceeding the acceleration due to gravity cannot be generated. Driving around bends, accelerations and decelerations in the vehicle's extreme range cannot always be realistically obtained. Therefore, the training of drivers in simulators can be imperfect. Simulators can also only be used to test motor vehicles to a limited extent, because their actual driving behavior is usually not known accurately enough and therefore cannot be correctly simulated in some cases. Summary of the invention

[0007] The object of the present invention is to provide a technology for driving a motor vehicle more realistically in a virtual environment. The present invention achieves this object by means of the technical solution of the independent claim. The dependent claims provide preferred embodiments.

[0008] The system according to the invention comprises a head mounted device, which is arranged to be mounted on the head of a motor vehicle driver. The head mounted device comprises a camera for providing a first view of the interior space of the motor vehicle and a visual display device for the driver. In addition, the system comprises a model for providing a view of a virtual environment of the motor vehicle relative to a predetermined posture; a device for determining the posture of the driver's head relative to the real environment of the motor vehicle and a processing device. The processing device is arranged to superimpose the first view of the interior space with a second view of the virtual environment relative to the determined posture and provide it to the driver.

[0009] It has been recognized that a realistic driving sensation of a motor vehicle can be best achieved by moving a real motor vehicle in a real environment. At the same time, situations that characterize a predetermined driving situation can be best simulated by constructing a virtual environment.

[0010] It is proposed to mix the views of the real environment and the virtual environment with one another and present them to the driver. The driver should be able to recognize elements in the interior of the motor vehicle unchanged, while the view of elements outside the motor vehicle is replaced by a corresponding view of the virtual environment. In this way, the driver can move the motor vehicle in the real environment, but at the same time has the impression that he is driving through the virtual environment.

[0011] By mixing real and virtual content, a convincing and non-contradictory sensory impression can be created for the driver. He can fully control the vehicle and use all systems present on the vehicle. These systems can include, for example, driver assistance systems, entertainment systems or comfort systems. The virtual environment can be controlled so that the driver can experience predetermined driving situations and learn to control the vehicle in these situations.

[0012] For example, driving techniques such as drifting along a predetermined curve can be taught in this way without danger. The boundaries of the curve may only exist in the virtual environment, while in the real environment there are neither boundaries nor obstacles. If the motor vehicle leaves the virtual curve, no real damage to the motor vehicle will occur. In this way, any curve or sequence of curves can be created in the virtual environment, and the driver can use the motor vehicle to actually drive through these curves or sequences of curves. These curves can be provided in a space-saving and delay-free manner with respect to a relatively small real area. The creation or setting of real infrastructure in the real environment can be eliminated. The motor vehicle can be better observed under a predetermined driving condition, which can be realized by the driver in the virtual environment. Therefore, the motor vehicle can be tested more targeted.

[0013] The interior of the motor vehicle can be defined by a window pane. The superposition is preferably provided in such a way that the virtual environment is visible to the driver only in the region of the window pane. The rest of the interior, which may include, for example, the roof, vehicle side rails, the dashboard, the steering wheel, vehicle seats, operating elements, side doors, the vehicle floor or the center console, is preferably displayed to the driver from the perspective that the driver's head occupies relative to the motor vehicle.

[0014] There may also be multiple window panes, which can be treated in the same way. For example, a front window pane may be located in front of the driver, a side window pane on the right or left side may be installed on the driver's side, or a roof window with another window pane may be installed in the roof. The window panes of the motor vehicle are transparent and allow people in the motor vehicle who are not wearing a head mounted device to see the real environment of the motor vehicle.

[0015] Predetermined visual markings may be mounted at the window pane. The processing device may be configured to determine the position of the window pane relative to the markings in the first view of the interior space.

[0016] In the scanning of the interior, visual marks are automatically recognized more easily than the borders of the window panes. It is thus possible to prevent the part of the virtual environment that the driver sees in the area of ​​the window pane from having an incorrect size or orientation relative to the view of the interior. Furthermore, it is possible to better prevent the recognized position of the window pane in the first view from shifting, for example during dynamic maneuvers of the motor vehicle. Otherwise, a shift of the views relative to one another could lead to an unrealistic impression on the driver, which could lead to side effects such as difficulty in finding directions or nausea.

[0017] The marking can be assigned the shape of the window pane. For example, the marking can include a two-dimensional binary optical code (for example in the form of a QR code), and the shape can be assigned to this code. In addition, a size or a position can also be assigned to the marking or the code expressed by the marking. The system can be set up for different motor vehicles, wherein motor vehicles with differently shaped window panes can have different markings. Based on the recognized marking, the system can better determine on which type of motor vehicle the system is located, or which shape of the window pane is correct.

[0018] The device can include a first sensor for determining the posture of the motor vehicle in the real environment and a second sensor for determining the posture of the driver's head in the motor vehicle. Thus, for example, the posture of the driver's head relative to the real environment can be determined by means of the processing device based on the two postures determined by means of the sensors. It has been shown that a realistic driving impression can only be achieved if the real environment and the virtual environment are coordinated with each other in a high-quality manner. The posture of the driver's head relative to the real environment can be better determined by means of the two sensors. Thus, the first and second views can be coordinated with each other with increased accuracy.

[0019] Further preferably, one or more other sensors or information sources on the motor vehicle are also used to better determine the posture of the driver's head in the virtual environment or the posture of the motor vehicle in the virtual environment. Such sensors can be arranged to determine the position or orientation or orientation, or determine both together in the form of a posture.

[0020] The device may include an absolute positioning device. The absolute positioning device may be formed in particular by a receiver for a satellite-based navigation system (GNSS). The positioning device may additionally be configured to determine and provide a direction of movement and a speed of movement.

[0021] In addition, the device may include a relative positioning device. The relative positioning device may be formed in particular by an odometer. The odometer may work based on rotation sensors at the wheels of the motor vehicle. The steering angle or the driving speed of the motor vehicle may also be used to determine the relative position of the motor vehicle. In another embodiment, a camera-based odometer may be provided, wherein the position of the motor vehicle is determined with respect to the apparent positions of landmarks in the real surroundings of the motor vehicle and the known absolute positions assigned to these landmarks.

[0022] The device may also include an acceleration sensor. The acceleration sensor is preferably configured to determine the acceleration along or about the longitudinal axis, vertical axis or transverse axis of the motor vehicle. Thus, in particular, pitching, shaking or pitching of the motor vehicle can be taken into account. The acceleration sensor may also be used to determine vibrations of the motor vehicle.

[0023] The system may include means for limiting the position of the motor vehicle to a predetermined area of ​​the real environment. This technique is known as geo-fencing. If the motor vehicle exceeds a predetermined range or such a foreseeable situation exists, the motor vehicle may be controlled longitudinally and / or laterally in order to counteract this situation. The area may be selected so that obstacles or fragile objects are arranged outside of the area. Thus, safety inside and outside the motor vehicle may be better ensured.

[0024] Another measure for ensuring safety can include additional operating devices for other persons on board, which are used to control the motor vehicle longitudinally or laterally. For example, an additional brake pedal can be provided for the co-pilot, who further preferably does not wear a head-mounted device. If a predetermined, controllable driving state is left, the co-pilot can take over the control of the motor vehicle.

[0025] It is further preferred that the system correctly reproduces the display in the interior rearview mirror or the exterior rearview mirror. If the interior of the motor vehicle is bounded by a window pane, on the outside of which a rearview mirror is mounted, a further view of the virtual environment relative to the rearview mirror can be determined and superimposed on the first view so that it is visible to the driver in the rearview mirror. In a corresponding manner, a further view of the virtual environment relative to the interior rearview mirror mounted in the interior can be determined and superimposed at the corresponding position of the first view. As a result, the driver can see the area behind the driver in the virtual environment better and in a conventional manner.

[0026] According to another aspect, a motor vehicle comprises a system as described herein. The motor vehicle can be used to train a driver to guide the motor vehicle or to instruct the driver to bring the motor vehicle into a predetermined driving situation, for example in order to study driving behavior.

[0027] The method according to the invention comprises the following steps: determining the posture of the head of a motor vehicle driver relative to the real environment of the motor vehicle; determining a first view of the interior space of the motor vehicle from the driver's head; determining a second view of the virtual environment of the motor vehicle relative to the determined posture; superimposing the first view of the interior space with the second view of the virtual environment; and providing the superposition to the driver.

[0028] The method can be implemented partially or completely with the aid of the system described herein. In particular, at least a part of the method can be implemented with the aid of a processing device comprised by the system. The processing device can in particular be implemented electronically and, for example, comprise a programmable microcomputer or microcontroller. The method can be in the form of a computer program product with program code means. The computer program product can be stored on a computer-readable data carrier. Features or advantages of the system can be transferred to the method, and vice versa.

[0029] The virtual environment can be adapted to the movement of the motor vehicle. Thus, the driver can be instructed to control the motor vehicle in a predetermined manner dynamically, i.e., according to the controls issued by the driver. For example, instructions can be given to change the steering angle, or an ideal line can be displayed, on which the driver should keep the vehicle. This makes it possible to learn predetermined driving techniques, such as drifting, or to guide the motor vehicle into a predetermined driving state in a game-like manner. This can speed up the training of drivers or the execution of predetermined tests of motor vehicles.

[0030] In an extended embodiment, the method can be applied to two systems on two motor vehicles. It is also possible for more motor vehicles to participate in the method, each of which carries the system described herein on board. In this case, the motor vehicles are in a real, but separate environment. In this case, the virtual environment for the systems or motor vehicles is identical to one another. Thus, the interaction between the motor vehicles can be simulated more realistically but without risk.

[0031] The model can include an avatar for each motor vehicle, wherein the avatar is updated according to the movement of the individual motor vehicles. Thus, for example, a collision of the avatars can be determined without a vehicle collision. Optionally, a visual indication of the avatar of the corresponding other motor vehicle can be shown on the motor vehicle. Thus, the driver of one of the motor vehicles can have the impression that he sees the other motor vehicle in the environment of his own motor vehicle. A collision of two motor vehicles can be correspondingly shown on the other motor vehicle.

[0032] This continuation can be used to present complex scenarios or to allow drivers to compete with one another regarding a predetermined task. Driving situations that require more than one vehicle can be achieved by coordinated guidance of the drivers of several vehicles. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The present invention will now be described in more detail with reference to the accompanying drawings, in which:

[0034] Figure 1 A system on a motor vehicle is shown;

[0035] Figure 2 An overlay of views is shown;

[0036] Figure 3 showing the driver of the motor vehicle; and

[0037] Figure 4 A flow chart of the method is shown. DETAILED DESCRIPTION

[0038] Figure 1The system 100 is shown on a motor vehicle 105. The system 100 shown includes a processing device 110 connected to a head mounted device 115. The head mounted device 115 is configured to be mounted on the head of a driver 120 of the motor vehicle 105. The driver 120 is located in the interior space of the motor vehicle 105 and can control the longitudinal or lateral movement of the motor vehicle 105. In addition, the driver can also use other systems or devices on the motor vehicle 105.

[0039] The head mounted device 115 comprises at least one visual display device 125 for the driver 120. The head mounted device 115 is preferably designed so that the display device 125 is complete for the driver 120, that is, he can visually perceive only the content provided to him by means of the display device 125. In the embodiment shown, a display device 125 is provided for each eye of the driver 120. In addition, a camera 130 is mounted on the head mounted device 115, which is provided for providing at least a view of the interior of the motor vehicle 105.

[0040] The imaging properties of the camera 130 are preferably adapted to the optical properties of the visual system of the driver 120, so that the view provided by means of the camera 130 can be output on the display device 125 and a visual impression as close as possible to that obtained by the driver 120 without the use of the head mounted device 115 can be set. If necessary, the view can be adapted in this sense by means of the processing device 110. It should be noted that a plurality of cameras 130 can also be included in the head mounted device 115 or installed at the head mounted device 115.

[0041] A beacon 135 can be mounted on the head mounted device 115, which can be used as a visual reference sample. The beacon 135 is preferably shaped and mounted on the head mounted device 115 so that it visually indicates the position and / or orientation of the head mounted device 115. For example, another camera 130 can be mounted on a structural element of the motor vehicle 105 and is configured to visually scan the head mounted device 115. Based on the scan, the beacon 135 can be easily identified, so that the position or orientation of the head mounted device 115 can be determined.

[0042] In a corresponding manner, beacon 135 may be mounted on a structural element of motor vehicle 105 , and the position or orientation of head mounted device 115 may be determined by means of a visual scan of beacon 135 by camera 130 mounted on head mounted device 115 .

[0043] Purely by way of example, Figure 1The frame 140 of the window pane 145 is selected as a structural element, which defines the interior of the motor vehicle 105. The beacon 135 can be installed at the upper edge of the frame 140, for example, in the area of ​​the interior rearview mirror 150. The camera 130 is arranged at the lower edge of the frame 140 by way of example.

[0044] Optionally, a visual marking 155 is provided on the window pane 145, which is preferably implemented in one or two dimensions. The marking 155 can be binary-coded, wherein the marking comprises light and dark parts, the arrangement and extent of which can be automatically processed in order to decipher the message encoded thereby. The message can indicate the geometry of the window pane 145. The geometry can in particular relate to the size or shape of the window pane 145. In another embodiment, the message 155 includes an indication of an entry in a data memory, wherein the entry is assigned information about the geometry of the window pane 145. The data memory can include a plurality of entries and assigned geometries.

[0045] Preferably, the system 100 also includes a receiver 160 for signals of a satellite-based global navigation system (GNSS). Based on the received signals, the receiver 160 can determine the geographic location of the vehicle 105 and optionally the direction and speed of movement of the vehicle 105.

[0046] An acceleration sensor 165 may be provided in order to determine the rotational acceleration or acceleration of the motor vehicle 105 about one or more spatial axes. Preferably, the acceleration sensor 165 is provided for determining about the longitudinal axis, the vertical axis and the transverse axis of the motor vehicle 105. Here, the acceleration along one of the axes (translation) or about one of the axes (rotation) may be determined. A corresponding acceleration sensor 165 may also be mounted on the head mounted device 115 and connected to the processing device 110.

[0047] The system 100 further comprises a model 170, which is configured to simulate a virtual environment. The virtual environment is coordinated with the real environment of the motor vehicle 105. For this purpose, the position of the virtual environment relative to the real environment is predetermined. If the motor vehicle 105 moves in the real environment, it moves in the virtual environment in the same way. If the motor vehicle 105 follows a predetermined trajectory, the motor vehicle 105 assumes a series of poses, with respect to which views of the virtual environment can be determined respectively with the aid of the model 170. The series of views provided corresponds to the impression of driving along the trajectory through the virtual environment.

[0048] The course of the background of the real environment of motor vehicle 105 is preferably presented as if in the virtual environment. Thus, in particular slopes, roads, objects or landmarks of the real environment can be reflected in the virtual environment.

[0049] Further preferably, an interface 175 for connecting to devices on the motor vehicle 105 is provided. In particular, position parameters, orientation parameters or movement parameters of the motor vehicle 105 can be obtained via the interface 175. Exemplary devices on the motor vehicle 105 that can provide such information include an ABS system, an electronic chassis control device, an engine control device for a drive motor or a navigation system. Optionally, sensors on the motor vehicle 105 can also be used for the system 100. For example, an already existing interior camera 130 can be used to scan the head mounted device 115.

[0050] Optionally, a wireless communication device 180 is provided, which may be configured to communicate with another system 100 at a central location or in another motor vehicle 105 .

[0051] Figure 2 An overlay 200 is shown that can be shown to a driver 120 on a motor vehicle 105 when viewed through a head mounted device 115. The overlay 200 includes a portion of a first view 205 and a portion of a second view 210. The first view 205 is provided by means of a camera 130 mounted at the head mounted device 115 of the driver 120. The second view 210 is determined by a view of a virtual environment of the motor vehicle 105 relative to the pose of the driver 120 head.

[0052] The first view 205 relates to the interior of the motor vehicle 105 and reflects what the driver 120 would also see without the head mounted device 115 in a corresponding head position. This includes all equipment components and functional parts of the motor vehicle 105, in particular the steering wheel and the cockpit. The driver 120 also sees himself, as in Figure 2 As can be seen, for example, by the hands of driver 120 on the steering wheel.

[0053] A portion of the second view 210 fades into the first view 205 at a point where the interior of the motor vehicle 105 is bounded by the window pane 145. The transition between the first view 205 and the second view 210 is Figure 2 These lines are usually not part of the views 205 , 210 and cannot be recognized by the driver 120 .

[0054] exist Figure 2 In the illustration of , a front window and side windows are provided, wherein the exterior rearview mirror 215 can be recognized through the side windows. Optionally, a part of a third view 220 can be shown on the mirror surface of the exterior rearview mirror 215, which is determined by means of the pose of the model 170 in the virtual environment relative to the exterior rearview mirror 215. In a corresponding manner, the exterior rearview mirror or interior rearview mirror located opposite can be processed.

[0055] To illustrate one possible way in which the system 100 operates, Figure 2 In FIG. 2 , two doors 225 are shown next to each other in the virtual environment of motor vehicle 105 .

[0056] The driver 120 may have the task of driving through the door that is displayed to him in a specific manner (e.g., in a predetermined color) and avoiding another door that may be displayed to him in another predetermined color. The color of the door 225 may be changed, for example, according to a predetermined pattern or randomly. In particular, the color may be gradually displayed later depending on the driving speed and the distance of the motor vehicle 105 from the door 225. In this way, the driver 120 can also be trained in his reaction ability and the ability to drive the motor vehicle 105 through the correct door 225 in a controlled manner even at high speeds.

[0057] Figure 3 An exemplary view of a driver 120 in a motor vehicle 105 with a system 100 is shown. A head mounted device 115 is mounted on the head of the driver 120. The head mounted device 115 is preferably relatively small and lightweight so that it does not hinder the driver 120 and does not interfere with his head movements. Two cameras 130 are mounted in the area in front of the eyes of the driver 120. The elements of the beacon 135 are distributed on the frame of the head mounted device 115.

[0058] Parts of the real environment of motor vehicle 105 can be seen through the side windows and rear window. Driver 120 cannot see the real environment, and parts of the virtual environment of motor vehicle 105 are gradually displayed to him in the area of ​​window 145 via head mounted device 115.

[0059] Figure 4 A flow chart of a method 400 is shown. The method 400 can be carried out in particular by means of the system 100 .

[0060] In step 405 , the head mounted device 115 can be detected from the vehicle 105 . For this purpose, the head mounted device 115 can be scanned by means of a fixedly mounted camera 130 .

[0061] In step 410, the pose of the driver's 120 head in the vehicle 105 may be determined. To this end, the pose of the head mounted device 115, such as the position relative to the beacon 135 on the visual scan, may be determined.

[0062] In step 415, the interior of the vehicle 105 can be scanned from the head mounted device 115. For this purpose, a camera 130 mounted on the head mounted device 115 can be used. Optionally, the pose of the driver's 120 head can also be determined based on the scan. For this purpose, in particular, the position of a beacon 135 fixedly mounted on the motor vehicle 105 can be determined in the scan.

[0063] To determine the attitude of vehicle 105 in the real environment, the absolute position of vehicle 105 may be determined in step 420 . For this purpose, for example, GNSS receiver 160 or a camera-based position recognition device may be used, which may be connected to system 100 via interface 175 .

[0064] In step 425 , the acceleration of motor vehicle 105 may be determined. The acceleration may be determined with the aid of acceleration sensor 165 or based on systems on motor vehicle 105 , such as a drive system or a brake system.

[0065] The relative position of motor vehicle 105 can be determined in step 430. In particular, the relative position can be determined relative to movement information or speed information of motor vehicle 105. For this purpose, in particular, signals of an odometer of motor vehicle 105, which are available via interface 175, can be evaluated.

[0066] Based on the information collected in steps 420 to 430 , the pose of motor vehicle 105 in the real environment may be determined in step 435 .

[0067] In step 440, the posture of the driver's 120 head in the real environment can be determined based on the posture of the driver's 120 head in the motor vehicle 105 and the posture of the motor vehicle 105 in the real environment. For the best result, the posture of the head should be determined in step 440 with the highest possible accuracy and with the smallest possible time delay in dynamic situations. Intermediate results can be improved based on other information.

[0068] In step 445, a view of the virtual environment may be determined based on the determined gesture. This view is also referred to herein as a second view.

[0069] Based on the scanning of the interior space in step 415, the following view of the interior space can be determined, which view is also referred to herein as a first view. In an optional step 450, the position of the window glass 145 can be determined in the first view. To this end, the boundaries of the window glass 145 can be determined in the first view, or geometric information about the shape or extent of the window glass 145 can be applied accordingly.

[0070] The first and second views can be superimposed in step 455. In this case, preferably the part of the first view that is located in the region of window pane 145 is replaced by a corresponding part of the second view.

[0071] In step 460 , the overlay may be output to the driver 120 via at least one display device 125 of the head mounted device 115 .

[0072] Reference numerals list

[0073] 100 Systems

[0074] 105 Motor Vehicles

[0075] 110 Processing device

[0076] 115 Head-mounted devices

[0077] 120 Driver

[0078] 125 Display device

[0079] 130 Camera

[0080] 135 Beacon

[0081] 140 Frame

[0082] 145 Window Glass

[0083] 150 Interior rearview mirror

[0084] 155 Marks

[0085] 160GNSS Receiver

[0086] 165 Acceleration sensor

[0087] 170 Models

[0088] 175 Interface

[0089] 180 Communication devices

[0090] 200 Overlay

[0091] 205 First View

[0092] 210 Second View

[0093] 215 Exterior mirror

[0094] 220 Third View

[0095] 225 doors

[0096] 400 Methods

[0097] 405 Detect headset from vehicle

[0098] 410 Determine the posture of the driver's head in the vehicle

[0099] 415 Scanning the interior space of a vehicle from a head-mounted device

[0100] 420 Determine absolute position

[0101] 425 Determine acceleration

[0102] 430 Determine relative position

[0103] 435Determine the posture of the vehicle in the real environment

[0104] 440 Determine the driver's head posture in the real environment

[0105] 445 Determine the view of the virtual environment

[0106] 450 Confirm window glass

[0107] 455 Overlay View

[0108] 460 Output to driver

Claims

1. A system (100), wherein: The system (100) comprises: - a head mounted device, the head mounted device being arranged to be mounted on the head of a driver (120) of a motor vehicle (105), - wherein the head mounted device comprises a camera (130) for providing a first view (205) of the interior space of the motor vehicle (105) and a visual display device for the driver (120); - a model (170) for providing a view of a virtual environment of a motor vehicle (105) relative to a predetermined posture; - means for determining the posture of the driver's (120) head relative to the real environment of the motor vehicle (105); A processing device (110) is configured to superimpose a first view (205) of the interior space with a second view (210) of the virtual environment relative to the determined posture and to provide the same to the driver (120).

2. The system (100) according to claim 1, wherein: The interior of the motor vehicle (105) is defined by a window pane; wherein the superposition is provided such that the virtual environment is visible to the driver (120) only in the region of the window pane.

3. The system (100) according to claim 2, wherein: A predetermined visual marking is mounted at the window pane, and wherein the processing means (110) is arranged to determine the position of the window pane relative to the marking in a first view (205) of the interior space.

4. The system (100) according to claim 3, wherein: The marking is assigned the shape of the window pane.

5. The system (100) according to any of the preceding claims, wherein: The device comprises a first sensor (160, 165, 175) for determining the posture of a motor vehicle (105) in a real environment and a second sensor (130) for determining the posture of a driver's (120) head in the motor vehicle (105).

6. The system (100) according to claim 5, wherein: The device comprises an absolute positioning device (160).

7. The system (100) according to claim 5 or 6, wherein: The device comprises a relative positioning device (175).

8. The system (100) according to any one of claims 5 to 7, wherein: The device includes an acceleration sensor (165).

9. The system (100) according to one of the preceding claims, further comprising means for limiting the position of the motor vehicle (105) to a predetermined area of ​​the real environment.

10. The system (100) according to one of the preceding claims, wherein: The interior space of the motor vehicle (105) is defined by a window glass (145), and a rearview mirror (215) is installed on the outer side of the vehicle; wherein a further view (215) of the virtual environment relative to the rearview mirror (215) is determined and superimposed on the first view (205) so that it is visible to the driver (120) in the rearview mirror (215).

11. A motor vehicle (105) comprising a system (100) according to one of the preceding claims.

12. A method (400), comprising the steps of: - determining (440) the posture of the head of the driver (120) of the motor vehicle (105) relative to the real environment of the motor vehicle (105); - determining (415) a first view (205) of the interior of the motor vehicle (105) from the driver's (120) head; - determining (445) a second view (210) of the virtual environment of the motor vehicle (105) relative to the determined posture; - superimposing (455) the first view (205) of the interior space with the second view (210) of the virtual environment; as well as - providing the overlay to the driver (120).

13. The method (400) of claim 12, wherein: The virtual environment is adjusted according to the movement of the motor vehicle (105).

14. The method (400) according to claim 12 or 13, wherein: The system (100) is provided on two motor vehicles (105) in two real environments that are separate from one another, wherein only one common virtual environment is used for the system (100).