Display system for vehicle for implementing extended rearview mirror function

By installing a surrounding environment detection device in the vehicle and transmitting the image to the data glasses, covering an angle range greater than 120°, the problem that the virtual rearview mirror system cannot detect dead angles is solved, and the panoramic display and danger of the surrounding environment of the rear vehicle is realized. Perception improves driving safety.

CN119305481APending Publication Date: 2025-01-14BAYERISCHE MOTOREN WERKE AG
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202410608317.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-07-13
Filing Date
2024-05-16
Publication Date
2025-01-14

AI Technical Summary

Technical Problem

The virtual rearview mirror system used in existing vehicles cannot effectively detect and display the dead corners of the vehicle surrounding the rear, resulting in the invisible situation in time without the head turning.

Method used

By installing a surrounding environment detection device in the vehicle, the image of the surrounding environment of the rear vehicle is detected and transmitted to the data glasses, the data glasses are used to simulate and display in the presentation area with at least 50% of the width of the area above the front windshield, covering Angle ranges greater than 120°, including dead angles, and assist drivers in perceiving dangers through image processing and visual marking.

Benefits of technology

It realizes comfortable observation of the rear environment of the vehicle and rapid perception of dangerous events, allowing the driver to see the dead corners of the environment around the rear vehicle without turning his head, significantly improving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119305481A_ABST
    Figure CN119305481A_ABST
Patent Text Reader

Abstract

The invention relates to a method for operating a display system for data glasses in a vehicle, comprising the following steps: detecting an image of a rear vehicle surroundings by means of a surroundings detection device; transmitting at least part of the image of the rear vehicle surroundings as object information to the data glasses; the image of the rear vehicle surroundings is presented in a contact simulation manner in a presentation region at a fixed position of the vehicle, the presentation region being located in front of or on an upper region of a front windshield of the vehicle, the presentation region extends over the width of the front windshield of the vehicle, in particular over at least 50%, preferably more than 70%, of the width of the front windshield of the vehicle, in this way, only a part of the image of the rear vehicle surroundings in the partial region of the presentation region is displayed on the display surface of the data glasses in each case when the glasses posture is determined.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a display system with augmented reality data glasses for use in a vehicle. The invention also relates to the implementation of a virtual rearview mirror with improved hazard recognition. Background Art

[0002] Augmented reality data glasses (also called head-mounted displays) are known, which can present images on one or two display surfaces in the field of vision of the wearer of the data glasses by means of a display device. The display surface can correspond to a reflective surface, which directs the image to the eyes of the wearer of the data glasses. The viewing opening of the data glasses is transparent, so that the real environment can also be perceived in the usual way through the display surface of the data glasses. The display surface is arranged in the viewing opening in such a way that the information to be displayed, such as texts, symbols, graphics, video displays, etc., can be displayed superimposed on the perception of the environment.

[0003] The information can be presented to the wearer of the data glasses in a contact-simulated manner, that is, in such a way that the information is superimposed as a display object on a specific environmental object or a specific position or a specific location area that is associated (zugeordnet) in the real environment or is oriented at the specific environmental object, or the specific position or the specific location area, or in such a way that the display object to be displayed is displayed in a specific orientation / orientation of the data glasses or their wearer.

[0004] Furthermore, display systems are known which display the rear or back vehicle area on a screen display, in particular to facilitate reverse driving.

[0005] Document DE 10 2017 221 317 A1, for example, relates to a method for operating a display system with data glasses in a vehicle, the method comprising the following steps:

[0006] - providing information about the position of one or more environmental objects in the surroundings of the motor vehicle in a vehicle-fixed coordinate system;

[0007] —— Obtain the posture of the data glasses in the vehicle's fixed coordinate system;

[0008] - Provide the location and size of the vehicle's rearview mirrors;

[0009] - providing object information associated with the one or more environmental objects, respectively, the object information respectively specifying information about a virtual object to be displayed and its position in a coordinate system fixed to the vehicle,

[0010] - Determine the rearview mirror area on one or more display surfaces of the data glasses according to the posture of the data glasses and the position and size of the vehicle rearview mirror;

[0011] - Modified the display of virtual objects in the rearview mirror area.

[0012] Assisting motor vehicle drivers by means of virtual rearview mirrors is useful, since the rear view can be presented to the driver in a forward perspective and thus in many cases the driver's head can be avoided, which means greater comfort for the driver. A virtual rearview mirror corresponds to an electronic system in which the vehicle surroundings behind can be detected by means of one or more cameras and can be output to the driver in real time via a suitable display in the instrument panel or in the area of ​​the vehicle's rearview mirror.

[0013] However, due to the static adjustment of the rear camera and / or the limited image portion of the rear view of the vehicle surroundings presented in the virtual rearview mirror, blind spots cannot be detected without additional head rotation. As a result, dangerous situations occurring in the non-visible area cannot be perceived or cannot be perceived in time. Summary of the invention

[0014] The object of the present invention is therefore to enable a comfortable view of the area of ​​the vehicle surroundings behind the vehicle with the aid of augmented reality data glasses in a display system, wherein dangerous events can also be perceived in an improved manner and more quickly.

[0015] This object is achieved by a method for operating a display system for augmented reality data glasses according to claim 1 and a display system according to the independent claims.

[0016] Further refinements are given in the dependent claims.

[0017] According to a first aspect, a method for operating a display system for data glasses in a vehicle is provided, the method comprising the following steps:

[0018] ——Using the surrounding environment detection device to detect the image of the surrounding environment of the rear vehicle;

[0019] - transmitting at least a part of the image of the vehicle surroundings behind as object information to the data glasses;

[0020] - Presenting the image of the rear vehicle surroundings in a contact-simulated manner in a presentation area at a fixed position of the vehicle, which presentation area is located in front of or above an upper area of ​​a windshield of the vehicle, wherein the presentation area extends over the width of the windshield of the vehicle, in particular over at least 50%, preferably more than 70% of the width of the windshield of the vehicle, so that in the case of a certain glasses posture, only a part of the image of the rear vehicle surroundings in a partial area of ​​the presentation area is displayed on the display surface of the data glasses.

[0021] A general problem with rearview mirrors and virtual rearview mirrors is that the image portion of the rear vehicle surroundings that can be presented is not sufficient to allow all areas of the vehicle surroundings that are not directly visible to be seen, or if these areas are to be presented in full, they are so reduced in their presentation in conventional display systems that details, such as dynamic surrounding objects, such as pedestrians, can no longer be perceived in sufficient size and detail.

[0022] A display system is described herein, which has an assistance system in a vehicle, which detects and generates an image of the vehicle's surroundings behind based on one or more cameras arranged on the outside of the vehicle, and has data glasses connected or connectable to the assistance system, to which at least a part of the image of the vehicle's surroundings behind is transmitted in real time, so that the image can be presented in a positionally reliable or contact-simulated manner in the upper area of ​​the front windshield depending on the glasses' attitude of the data glasses. In addition, the assistance system can assist the data glasses in determining the attitude.

[0023] The image of the vehicle surroundings behind is detected by a surroundings detection device having one or more cameras arranged on the vehicle. Therefore, the camera images of the one or more cameras can be rendered into a relevant image of the vehicle surroundings behind by a suitable image processing method, thereby forming a kind of panoramic image of the vehicle surroundings behind. In addition, the image of the vehicle surroundings behind can be perspectively corrected.

[0024] The method comprises providing an image of the vehicle's surroundings behind relative to a vehicle coordinate system in a positionally reliable or contact-simulated manner for display in the upper region of the front windshield of the motor vehicle. This region is usually also provided with conventional rearview mirrors. However, this generally only shows a very small part of the vehicle's surroundings behind.

[0025] The above method provides that a fixed presentation area is reserved in the upper area of ​​the front windshield for presenting an image of the vehicle surroundings behind. Here, the image of the vehicle surroundings behind includes a large angle range, which is in particular greater than 120° and therefore also includes blind spots. In order to present the image faithfully to the details, the width of the presentation area is selected to be so large that the entire image of the vehicle surroundings behind cannot be fully perceived from the driver's position without a change in perspective (turning the head), but only a part of the image of the vehicle surroundings behind is fully perceived. If the driver uses his data glasses to look at a part of the presentation area, the driver sees the corresponding part of the image of the vehicle surroundings behind, which is associated with this area. By scaling the image of the vehicle surroundings behind to the width of the presentation area that is enlarged relative to conventional rearview mirror systems, the image of the vehicle surroundings behind is avoided from being overly reduced or cropped. By means of the contact-simulated presentation of the display object in the data glasses, a corresponding part of the image of the vehicle surroundings behind can be fully perceived as a display object for the driver through a change in perspective. By turning his head or changing the direction of his gaze while viewing the presentation area, the driver can decide which part of the image of the vehicle surroundings behind him he wants to view.

[0026] It can be provided that the image of the vehicle surroundings behind includes an angular range that is in particular greater than 120° and preferably covers an angular range between -110° to -70° and +110° to +70°, preferably between -90° and 90°, relative to the longitudinal direction of the vehicle and thus also includes the blind spot that is always present in conventional rearview mirrors. An angle of 0° corresponds to the longitudinal direction of the vehicle facing rearward.

[0027] The advantage of the above method is that the driver himself can decide which part of the image of the vehicle surroundings behind he wants to observe and is not restricted by the hard limitations of the presentation surface of the physical rearview mirror or the orientation of the camera for the display-based virtual rearview mirror.

[0028] The image of the rear vehicle surroundings can be presented in a mirror-inverted manner, so that the user perceives the image portion of the image of the left area of ​​the rear vehicle surroundings in the left part of the presentation area and correspondingly perceives the image portion of the image of the right area of ​​the rear vehicle surroundings in the right part of the presentation area. As a result, the driver intuitively perceives the rear vehicle surroundings and can also see blind spots.

[0029] In particular, a region of the rear vehicle surroundings which is located directly behind the vehicle can be presented in the middle of the presentation area or in the center of the front windshield.

[0030] As is known from data glasses, the image of the rear vehicle surroundings is presented in a contact-simulated manner, so that the rear area of ​​the vehicle surroundings is fixedly associated with the upper area of ​​the windshield. In particular, the image of the rear vehicle surroundings is presented as a panoramic image over the entire width of the upper area of ​​the windshield or over a large part of the windshield, such as between 70% and 100% of the width of the windshield. Thus, for example, it can be provided that an area of ​​the rear vehicle surroundings is presented at a conventional position in the center of the windshield, which area is directly behind the vehicle in the longitudinal direction of the vehicle. The corresponding left and right areas of the rear vehicle surroundings then extend to the left and to the right.

[0031] It can be provided that a glasses gesture is provided in a vehicle-fixed assistance system, wherein a portion of an image of the vehicle surroundings to the rear is acquired as object information, which is perceptible in the data glasses when the driver's line of sight corresponds to the glasses gesture, wherein the portion of the image of the vehicle surroundings to the rear is transmitted to the data glasses so that the image is displayed at the data glasses in a contact simulated manner.

[0032] In order to reduce the data transmission rate when transmitting the image of the rear vehicle surroundings to the data glasses, only a portion of the image of the rear vehicle surroundings is transmitted to the data glasses depending on the eyewear position of the data glasses, which portion of the image contains a portion corresponding to the just perceptible portion of the image of the rear vehicle surroundings. In this way, the bandwidth required for transmitting data to the data glasses, which is required for the portion of the image of the rear vehicle surroundings currently being presented, can be significantly reduced.

[0033] In addition, with the aid of the eyeglass gesture of the data glasses, it is possible to identify which areas of the vehicle surroundings behind the driver are currently not perceived because these areas are outside the presented part of the image of the vehicle surroundings behind, wherein, when a dangerous situation occurs, a visual mark, such as an arrow symbol, is displayed in one of the areas not perceived, and the arrow symbol prompts the driver to look at a certain area of ​​the image of the vehicle surroundings behind, in such a way that the viewing angle, i.e. the head gesture / eyeglass gesture, changes accordingly in the direction of the visual mark. The dangerous situation and its position in the image of the vehicle surroundings behind can be identified, for example, by an image analysis method applied to the image of the vehicle surroundings behind, such as object recognition and the like. The visual mark then indicates the direction in which the driver must change his line of sight in order to be able to perceive the dangerous situation.

[0034] By evaluating the image of the rear vehicle surroundings, a dangerous situation can be detected, for example if a dynamic surrounding object approaches the vehicle from behind or if a child is located in the area of ​​the rear vehicle surroundings.

[0035] According to another aspect, a display system for operating data glasses in a vehicle is provided, comprising:

[0036] a surroundings detection device configured to detect an image of the vehicle surroundings behind using the surroundings detection device;

[0037] a communication device which is designed to transmit at least a part of the image of the rear vehicle surroundings as object information to the data glasses.

[0038] In addition, the display system may include data glasses, wherein the data glasses are configured to present an image of the rear vehicle surroundings in a contact-simulated manner in a presentation area at a fixed position of the vehicle, the presentation area being located in front of or above an upper area of ​​a windshield of the vehicle, wherein the presentation area extends over the width of the windshield of the vehicle, in particular over at least 50%, preferably more than 70%, of the width of the windshield of the vehicle, so that in a certain glasses posture only a portion of the image of the rear vehicle surroundings in a partial area of ​​the presentation area is displayed on the display surface of the data glasses.

[0039] The presentation area of ​​the front windshield may be tinted or blacked out. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The following further describes various embodiments with the aid of the accompanying drawings. In the accompanying drawings:

[0041] Figure 1 A schematic diagram showing a display system in a vehicle for presenting a virtual image of a rear vehicle surrounding environment;

[0042] Figure 2 A schematic diagram showing a display system, and

[0043] Figure 3 A flow chart is shown for illustrating a method for operating a display system. DETAILED DESCRIPTION

[0044] Figure 1 A schematic top view of a display system is shown, wherein a vehicle 1 is shown, in which a driver or vehicle occupant N wears data glasses 3. The data glasses 3 are connected to an auxiliary system 2 fixed to the vehicle via a communication connection 4. The communication connection 4 is designed as a data transmission channel, for example in the form of a wireless or wired communication connection. The communication connection 4 can transmit any type of data and information between the auxiliary system 2 and the data glasses 3, for example based on data transmission packaged in data packets. The communication connection 4 can be based on Wi-Fi, Bluetooth, Bluetooth Low Energy or similar standardized radio protocols, for example.

[0045] Figure 2 A more schematic diagram of a display system is shown.

[0046] The assistance system 2 can in particular be arranged in a stationary manner in the vehicle 1 . The assistance system 2 can be equipped with a communication unit 23 which enables data transmission between the data glasses 3 and the assistance system 2 via a communication connection 4 .

[0047] In addition, the assistance system 2 can be connected to a surroundings detection system 21, which has a plurality of cameras 22 pointing to the vehicle surroundings. The camera 22 can detect the vehicle surroundings behind, in particular in the form of camera images. The one or more cameras 22 can include, for example, an RGB camera, an IR camera, a fisheye camera, a dynamic vision sensor, or the like.

[0048] The assistance system 2 may have a control unit 24 in order to evaluate the camera images of the vehicle surroundings behind with respect to surrounding objects by means of a pattern recognition method.

[0049] Furthermore, the control unit 24 can combine and / or render the simultaneously detected camera images into an image of the vehicle area behind and make it available in real time.

[0050] Furthermore, the assistance system 2 comprises a vehicle motion sensor system (IMU sensor system) 25 which can be designed, for example, in the form of a 6-DOF inertial sensor and which provides motion data of the movement of the vehicle 1 in the form of translational acceleration or angular acceleration or angular velocity.

[0051] The data glasses 3 include two transparent viewing windows 32, which are embedded in a frame 31 in a manner known per se. The frame 31 is provided with temples 33, for example, so that the data glasses 3 can be worn on the head of a user.

[0052] Furthermore, one or both viewing windows 32 (spectacles) are provided with a transparent display surface 35, through which a display image for presenting a virtual display object can be projected into the eyes of the wearer of the data glasses 3 by a suitable device, for example, by a display device 36 arranged on the frame 31. The display device 36 can have a microprocessor or a similar computing unit and a display unit, for example, a projection device, etc. The display unit can be configured to direct an electronically generated display image to the display surface 35 and image / present the display image there.

[0053] By means of the transparent design of the display surface 35, electronically generated images can be superimposed on the real environment that can be perceived through the display surface 35. By means of the display device 36, virtual display objects such as texts, symbols, video information, graphics or the like can be presented on one or both display surfaces 35.

[0054] The data glasses 3 can be worn on the user's head like a typical visual aid, wherein the data glasses 3 can be placed on the user's nose with the frame 31 and the temples 33 can be placed laterally against the user's head. Therefore, the user's line of sight direction in a straight line orientation is realized through the transparent display surface 35 of the window 32, so that the user's line of sight direction and position predetermined by the eye position and the optical line of sight axis (eye axis) have a fixed relationship with respect to the position and orientation of the data glasses 3, that is, with respect to the glasses' posture.

[0055] In order to display display objects, such as graphic symbols, texts or glasses data, the corresponding object information in the form of object data is transmitted from the assistance system 2 to the data glasses 3 or is already provided in the data glasses 3. In this case, the object data specifies the type of the display object, such as a text object, an icon or another identifier of a display area, and specifies the object pose (position and orientation) for the display object presented in a contact-simulated manner. The object pose can be specified relative to a world-fixed environment coordinate system or a vehicle-fixed vehicle coordinate system.

[0056] A glasses movement sensor device 38 (IMU sensor device, inertial sensor device) can be provided, which is designed, for example, in the form of a 6-DOF inertial sensor. The glasses movement sensor device provides relative or differential glasses movement information of the movement of the data glasses 3 in the form of translational acceleration and angular acceleration or angular velocity, which can be converted into position and orientation changes, i.e., differential glasses attitudes, in particular by corresponding (also double) integration, so that the information about the absolute glasses attitude can be updated at a high frequency by applying a time integration method.

[0057] The relative or differential eye movement information in the form of position and orientation changes determined by the eye movement sensor device 38 can be used in a manner known per se to determine world-fixed eye posture data for the current eye posture of the data eye glasses 3. In order to determine vehicle-fixed absolute eye posture data, the eye movement information must be adjusted to the vehicle movement information (also relatively or differentially) so that only the movement of the data eye glasses 3 in the vehicle 1 can be evaluated. In this case, the movement difference between the data eye glasses movement and the movement of the vehicle 1 is determined and evaluated to determine the eye posture.

[0058] The control unit 37 can receive object information from the assistance system 2, for example, via the communication device 39, or provide and process the object information in another way, so that the represented display object can be displayed in a contact-simulated manner according to the eyeglass gesture relative to the vehicle coordinate system in the corresponding viewing angle range that the user of the data glasses 3 is looking at and in which the surrounding objects can be perceived. That is, when the vehicle-fixed position of the display object is located in the viewing angle range of the data glasses 3, the display object given by the object information is displayed on the display surface 35.

[0059] The user N of the data glasses 3 is located in the vehicle 5 as an occupant, and the glasses posture of the data glasses 3 can be changed by head movement and vehicle movement. In order to present the display object on the display surface of the data glasses 3 in a contact-simulated manner with reference to the environment position (i.e., the corresponding object information is provided with the environment position), the absolute glasses posture data with reference to the environment coordinate system must exist in the data glasses 3. Accordingly, in order to present the display object on the display surface of the data glasses 3 in a contact-simulated manner with reference to the vehicle-fixed position (i.e., the corresponding object information is provided with the position relative to the vehicle), the absolute glasses posture data with reference to the vehicle coordinate system must exist in the data glasses 3.

[0060] In order to realize the rearview mirror function, the specific object information corresponds to a part of the image of the vehicle surroundings at the rear, which is just perceptible according to the current eyeglass posture of the driver. For this purpose, the object information is associated with the position or area of ​​the presentation area 6 on the windshield 5. The presentation area 6 corresponds to a position of the vehicle fixed in the upper section of the windshield 5 and can extend over 50% to 100% of the width of the windshield 5. If the driver does not look at the presentation area 6, the transmission of the determined object information can be stopped. If the driver looks at a part of the presentation area, the transmission of the determined object information can only involve the association of the image of the vehicle surroundings at the rear to the corresponding, associated local part of the presentation area.

[0061] Figure 3 A flow chart is shown for illustrating a method for presenting an image of the rear vehicle surroundings as a virtual rearview mirror for a motor vehicle driver.

[0062] The rear vehicle surroundings are understood to be regions between −110° and −70° and 70° and 110° with a rearward orientation in a horizontal plane, with reference to the longitudinal direction of the vehicle, ie an angle of 0° corresponds to the rearward longitudinal direction of the vehicle.

[0063] The image of the rear vehicle surroundings now corresponds to a panoramic image resulting from the recording of the rear vehicle surroundings over an angular range of -110° to -70° up to 70° to 110°. The image of the rear vehicle surroundings is used in a mirror-like manner and for presentation in the data glasses 3. In this case, the image of the rear vehicle surroundings presents object information that is fixedly positioned with reference to the vehicle coordinate system in a presentation area of ​​the windshield 5. For this purpose, according to conventional rearview mirrors, the upper area of ​​the windshield 5 is used as presentation area 6, for example, starting from the upper edge of the windshield 5 with a height between 5% and 20%, for example 10%, of the windshield. Preferably, the image of the rear vehicle surroundings extends over an area that extends almost over the entire width of the windshield 5 or over a large part of the windshield, for example between 50% and 100% of the width of the windshield 5.

[0064] The presentation area is preferably colored or darkened in order to achieve a good image perception for the image information presenting the image of the vehicle area behind.

[0065] The method described below is carried out cyclically.

[0066] In step S1, the vehicle surroundings behind at the current moment are first detected by means of the surroundings detection system 21. If the vehicle surroundings behind are detected by a plurality of cameras 22 or the like, a combined image of the vehicle surroundings behind is generated or rendered. In particular, a perspective correction can also be performed, in particular with reference to the position of the driver, which can be derived from the position of the data glasses 3.

[0067] In step S2, the eyeglass pose of the driver's data glasses 3 is detected in the assistance system 2. This can be done, for example, by an interior tracking system having an interior camera 26 directed toward the driver. By means of corresponding visual tracking methods, absolute eyeglass pose data in the form of the position and orientation of the data glasses 3 can be determined from the interior camera images detected in this way, and thus it can be seen in which direction the driver is looking.

[0068] In step S3, it is checked with the aid of the glasses posture data whether the driver is looking at the presentation area in the upper section of the front windshield 5. For this purpose, conventional methods of 3D image processing are used. If it is determined that the driver's line of sight is directed to a section of the presentation area (selected as yes), the method continues with step S4. Alternatively (selected as no), jump back to step S1.

[0069] In step S4, a portion is generated from the image of the vehicle surroundings behind. The portion corresponds to a section of the presentation area that the driver is looking at. To this end, the image of the vehicle area behind is scaled onto the entire presentation area, so that each section of the presentation area corresponds to a portion of the image of the vehicle area behind.

[0070] In a subsequent step S5 , the corresponding part of the image of the rear vehicle surroundings is transmitted as object information to the data glasses 3 .

[0071] There, the corresponding partial contact is then presented to the driver in step S6 in a simulated manner, so that the driver sees the corresponding part of the image of the vehicle surroundings behind in his field of vision. If the driver does not look at the presentation area, the corresponding part of the image of the vehicle surroundings behind can not be transmitted at all, so as to thus conserve the bandwidth of the data transmission channel between the assistance system 2 and the data glasses 3.

[0072] An association can be made between the presentation area and the image of the rear vehicle surroundings so that when the driver looks toward the position of the rearview mirror, i.e., at the middle area on the front windshield 5 relative to the width direction, the portion corresponds to the image portion of the center of the rear vehicle surroundings. If the driver's line of sight is directed to a portion of the presentation area that is located to the left of the middle position of the presentation area, the left area of ​​the rear vehicle surroundings is displayed as a portion of the image of the rear vehicle surroundings. This applies similarly to the position to the right of the middle position of the presentation area.

[0073] In a subsequent step S7, a check is performed by evaluating the image of the rear vehicle surroundings to determine whether a critical event or a dangerous situation has occurred in the area of ​​the rear vehicle surroundings. If a critical event has occurred (yes), the method continues with step S8. Otherwise (no), the method returns to step S1. For example, when dynamic environmental objects (especially at a speed greater than a predetermined speed threshold) approach the vehicle from behind, when a child is in the rear vehicle surroundings, and the like, critical events can be detected in real time by continuously analyzing the image of the rear vehicle surroundings.

[0074] In step S8, a check is made in the assistance system 2 whether a critical event can be perceived by the driver using the current eyeglasses posture of the data glasses 3. The event is perceptible when the data glasses 3 display, according to the current eyeglasses posture, a portion of the presentation area associated with the portion of the image of the vehicle surroundings behind in which the event occurs. If this is not the case (selection is No), a warning symbol, such as an arrow symbol, is transmitted as further object information to the data glasses 3 and displayed, which indicates in which direction the driver must change his sight direction (eyeglasses posture) in order to perceive the dangerous situation. Warning symbols are generally used to instruct the driver to look at another section of the presentation area in order to perceive a potentially critical dangerous situation there.

[0075] Reference numerals list

[0076] 1 Vehicle

[0077] 2 Auxiliary systems

[0078] N Vehicle occupants

[0079] 3 Data Glasses

[0080] 4 Communication Connection

[0081] 5. Front windshield

[0082] 6 Rendering Area

[0083] 21. Surrounding environment detection system

[0084] 22 Camera

[0085] 23 Communication unit

[0086] 24 Control Unit

[0087] 25 Vehicle motion sensing device

[0088] 26 Internal Space Camera

[0089] 31 Framework

[0090] 32 Windows

[0091] 33 glasses leg

[0092] 35 Display surface

[0093] 36 Display device

[0094] 37 Control Unit

[0095] 38 Eyeglass motion sensor

[0096] 39 Communication Unit

Claims

1. A method for operating a display system for data glasses (3) in a vehicle (1), the method comprising the following steps: - using a surrounding environment detection device (21) to detect (S1) an image of the surrounding environment of the rear vehicle; - transmitting (S4) at least a part of the image of the vehicle surroundings behind as object information to the data glasses (3); - presenting (S6) an image of the vehicle surroundings behind in a contact-simulated manner in a presentation area at a fixed position of the vehicle, the presentation area being located in front of or above an upper area of ​​a front windshield (5) of the vehicle (1), wherein: The presentation area (6) extends over the width of the vehicle's windshield (5), in particular over at least 50% and preferably more than 70% of the width of the vehicle's windshield (5), so that in a certain eyeglass posture only a portion of the image of the rear vehicle surroundings in a partial area of ​​the presentation area (6) is displayed on the display surface (35) of the data glasses (3).

2. The method according to claim 1, wherein: The image of the rear vehicle surroundings includes an angular range which is in particular greater than 120° and preferably covers an angular range between −110° to −70° and +110° to +70°, preferably between −90° and 90°, relative to the vehicle longitudinal direction.

3. The method according to claim 1 or 2, wherein: The presentation of the image of the rear vehicle surroundings is performed in a mirror-inverse manner, so that a part of the left area of ​​the image of the rear vehicle surroundings is presented in the left part of the presentation area (6) and a part of the right area of ​​the image of the rear vehicle surroundings is presented in the right part of the presentation area (6).

4. The method according to any one of claims 1 to 3, wherein: The presentation area (6) extends from the upper edge of the windshield (5) over a height range of the windshield (5), in particular over a range of 10% to 20% of the height.

5. The method according to any one of claims 1 to 4, wherein: In a vehicle-mounted assistance system (2), a glasses gesture is provided, wherein a portion of an image of the vehicle's surroundings behind is determined as object information, which can be perceived in the data glasses (3) when the driver's line of sight corresponds to the glasses gesture, wherein the portion of the image of the vehicle's surroundings behind is transmitted to the data glasses (3) so that the image is displayed at the data glasses in a contact-simulated manner.

6. The method according to any one of claims 1 to 5, wherein: With the aid of the eyeglass gesture of the data glasses (3), it is detected which areas of the rear vehicle surroundings that the driver currently does not perceive because these areas are outside the displayed part of the image of the rear vehicle surroundings, wherein, in the event of a dangerous situation, a visual marking, such as an arrow symbol, is displayed in one of the non-perceived areas, which prompts the driver to look at a specific area of ​​the image of the rear vehicle surroundings.

7. The method according to claim 6, wherein: When dynamic surrounding objects approach the vehicle from behind, a dangerous situation is detected by analyzing the image of the rear vehicle surroundings.

8. A display system for operating data glasses (3) in a vehicle (1), the display system comprising: - a surroundings detection device (21), which is configured to detect an image of the vehicle surroundings behind using the surroundings detection device (21); - A communication device which is designed to transmit at least a part of the image of the rear vehicle surroundings as object information to the data glasses (3).

9. The display system according to claim 8, comprising data glasses (3), wherein: The data glasses (3) are configured to present an image of the rear vehicle surroundings in a contact-simulated manner in a presentation area at a fixed position of the vehicle, the presentation area being located in front of or above an upper area of ​​a front windshield (5) of the vehicle (1), wherein the presentation area (6) extends over the width of the front windshield (5) of the vehicle, in particular over at least 50%, preferably more than 70%, of the width of the front windshield (5) of the vehicle, so that in the case of a certain glasses posture, only a portion of the image of the rear vehicle surroundings in a partial area of ​​the presentation area (6) is displayed on the display surface (35) of the data glasses (3).

Citation Information

Patent Citations

  • Method and device for operating data glasses in a motor vehicle

    DE102017221317A1