Display system for showing operating instructions for a control element in a motor vehicle

Abstract

Display system (20) for displaying an operating instruction (30) for a control element (32) in a motor vehicle (10), comprising a display device (22) of the motor vehicle (10) designed as a spatially imaging display with a display surface (24) and a control device (26), wherein - the display device (22) is configured to generate a virtual image in a predetermined display area (18) located outside the display device (22) such that the virtual image is visible from a predetermined viewpoint (14) in front of the display surface (24) as a three-dimensional virtual image (28); and - the control device (26) is configured to detect an activation signal for the display device (22) and to control the display device (22) according to a control instruction assigned to the detected activation signal to display a three-dimensional virtual image (28); characterized in that - the display system (20) includes the control element (32) which is associated with an operating device (34) of the motor vehicle (10); and - the specified display area (18) is arranged in a specified environment (36) of the control element (32); and - the display system (20) is configured to display the operating instruction (30) for the control element (32) by means of the three-dimensional virtual image (28) in accordance with the control instruction assigned to the detected activation signal, if the detected activation signal is assigned to the control element (32); and - the display system (20) comprises a sensor device (38) configured to detect a positioning and / or gesture of a user's hand (42) within a detection range (40) of the sensor device (38) as a sensor signal, and the display system (20) is configured to provide the activation signal to the control device (26) associated with the detected sensor signal; and / or - the display system (20) comprises a user identification device (48) which is configured to detect the presence of a user (12) in the motor vehicle (10) and to identify a user status of the detected present user (12), for which purpose a user profile is stored in the user identification device (48) in which the user status is specified for the user (12), which indicates whether the user (12) is a first-time user (12) of the motor vehicle (10) and which includes an assessment of the user's (12) experience with the control element (32) of the operating device (34) of the motor vehicle (10), and the display system (20) is configured to provide the activation signal of the control unit (26) associated with the identified user status.

Description

[0001] The invention relates to a display system for displaying an operating instruction for a control element in a motor vehicle and to a motor vehicle with such a display system.

[0002] Nowadays, many motor vehicles are equipped with a display system, such as a touchscreen located in the center console. This display system can show information from the vehicle's navigation system, a user interface for the multimedia system, and / or instructions for the driver, for example, regarding the operation of a control element.

[0003] DE 10 2017 205 277 A1 discloses a method for interaction between a means of transport and an occupant, in which a holographic representation of a gear selector switch, visible to the occupant, is displayed. Subsequently, an activation action by the occupant on the holographic representation of the gear selector switch is detected, and the means of transport is controlled according to the detected activation action.

[0004] German patent DE 10 2013 011 531 A1 discloses a method for operating a motor vehicle assistance system, in which it is detected whether a vehicle occupant is pointing a finger at a control element. If this is the case, predetermined information regarding the control element is output, since the pointing of the vehicle occupant is interpreted as a contactless selection of the control element.

[0005] German patent application DE 10 2007 043 935 A1 discloses a vehicle system and a method for operating the vehicle system. Information, such as explanatory information, is displayed on a touchscreen, and control inputs are recorded. In this context, the explanatory information can be projected as a graphical representation onto a display surface.

[0006] DE 10 2017 130 714 A1 discloses a method for supporting a pilot in operating an aircraft by means of an augmented reality system, by means of which supporting information is displayed to the pilot in the area of ​​an operating element of the aircraft.

[0007] EP 2 372 512 A1 discloses a user interface for an electronic vehicle device by means of which a virtual three-dimensional image is displayed in front of a display unit. A virtual interaction element of the virtual three-dimensional image can be selected using a user-controlled object.

[0008] DE 10 2013 021 978 A1 discloses a method for the augmented display of at least one real control element on a mobile device, which records an environment in a vehicle interior and displays it on a screen of the mobile device together with additional information.

[0009] DE 103 03 792 A1 discloses a method for displaying vehicle-specific information in the form of a three-dimensional representation on a vehicle-specific display device.

[0010] The object of the invention is to provide a solution by means of which operating instructions for a control element in a motor vehicle can be provided in an easily understandable manner for a vehicle occupant.

[0011] This problem is solved by the subject matter of the independent patent claims. Advantageous embodiments with expedient and non-trivial developments of the invention are specified in the dependent claims, the following description, and the figures.

[0012] The invention is based on the understanding that for a first-time user of a motor vehicle and / or a first-time user of a specific function of a motor vehicle, it is often not intuitively clear how to operate a particular control element of the vehicle. It would therefore be helpful for the user if operating instructions regarding the operation of the control element in the vehicle were provided. With the help of these instructions, the user could then familiarize themselves with the operation of the vehicle or at least the operation of the specific control element. Nowadays, such operating instructions are generally displayed as a help message on a central display unit of the vehicle, which is typically located in the area of ​​the vehicle's center console.However, the user may find it difficult to associate the displayed help message with the corresponding control element in the vehicle and / or the corresponding function of the vehicle, especially if the control element is not located in the immediate vicinity of the help message. In this case, the user may have difficulty linking the help message to the corresponding control element in the vehicle. Furthermore, implementing the operating procedure for the control element and / or function of the vehicle, as provided by the help message, may be difficult for the user at the actual control element, for example, due to the necessary information transfer from the help message to the operation of the control element.Therefore, in order to make the operating instructions easier for the user to understand, it is advisable to provide the operating instructions relating to the control element and / or the function of the motor vehicle in the immediate vicinity of the actual control element or the control element that triggers the function.

[0013] The display system according to the invention for displaying operating instructions for a control element in a motor vehicle comprises a display device designed as a spatially imaging display with a display surface and a control unit. The spatially imaging display is preferably designed as a stereo display. A stereo display is understood to be a display of stereoscopic and three-dimensional images for a depth impression through stereoscopic vision by means of a screen. Thus, a virtual three-dimensional representation of an object can be displayed or projected using a stereo display. The display device is designed to generate a virtual image in a predetermined display area located outside the display device in such a way that the virtual image is visible as a three-dimensional virtual image from a predetermined viewpoint in front of the display surface.The object displayed by the stereo display is thus visible from the viewpoint at a predetermined position, referred to here as the display area, between the viewpoint and the surface of the display. The display device is designed to show the three-dimensional virtual image in the display area using autostereoscopy, shutter technology, a polarizing filter (e.g., using polarization filter technology), light field technology, and / or other spatial display technologies. Preferably, no glasses are required for viewing the image displayed by the display device. Suitable display devices include, for example, a volume display, a spherical display, and / or a holographic display.The predefined viewpoint is, for example, the gaze origin of a user of the display system, who is seated, for instance, in the driver's or passenger's seat of the vehicle in which the display system is installed, and is looking at the display surface of the display device, which is located, for example, in the area of ​​the vehicle's center console. The three-dimensional virtual image is then displayed in the predefined display area, which lies on a line of sight between the gaze origin, i.e., the viewpoint, and at least a portion of the display surface. The display area is therefore at least partially encompassed by the user's field of vision.

[0014] The control unit is designed to detect an activation signal for the display device and to control the display device according to a control instruction assigned to the detected activation signal, in order to display the three-dimensional virtual image. The control unit thus receives a trigger signal, with a specific instruction assigned to the received trigger signal, according to which the display device is then controlled. If, for example, the activation signal contains the information that the vehicle user wants information about a gear selector lever, the control instruction is selected from, for example, several possible control instructions stored in the display system that is precisely assigned to this detected activation signal and provides information about the gear selector lever as an operating instruction.Subsequently, according to this control instruction, a three-dimensional virtual image is displayed, designed, for example, as an aid animation, explaining how to operate the vehicle's gear selector lever. The corresponding three-dimensional virtual image could therefore be, for example, a virtual representation of the gear selector lever, supplemented with arrows to explain and visually clarify for the user the direction of movement of the gear selector lever to achieve its various functions.

[0015] The display system also includes a control element as the vehicle's operating device. This control element is, for example, the gear selector lever, which is designed to select a gear ratio of the vehicle's transmission. The predefined display area of ​​the display device is arranged within a predefined area surrounding the control element. Thus, the display area is, for example, positioned vertically above the gear selector lever as an exemplary control element, with a further requirement that this display area is located within a typical field of vision of the user, between the point of view and the display surface. Alternatively or additionally to the arrangement of the display area above the control element, the display area can be arranged laterally to the side of the control element and / or longitudinally in front of or behind the control element.

[0016] The display system is designed to show the operating instructions for the control element using a three-dimensional virtual image, according to the control instruction assigned to the detected activation signal, provided the detected activation signal is associated with the control element. For example, the control unit of the display system checks whether the activation signal for the control element covered by the display system has been provided to the control unit. If this is the case, that is, if, for example, an activation signal has been received that is associated with the gear selector lever, the display described above is activated, by means of which the operating instructions for the gear selector lever as a control element are displayed as a three-dimensional virtual object in the predefined display area, which is located in the predefined vicinity of the gear selector lever.With such a display, the user is also alerted to a currently appropriate gear change. The operating instruction is then a three-dimensional representation of a shift recommendation, displayed, for example, directly above the gear selector lever in the vehicle. In this case, the operating instruction displays the corresponding movement of the gear selector lever to execute the shift recommendation, generated, for example, by a control unit of the vehicle, as a three-dimensional aid animation. An operating instruction within the meaning of the invention is therefore not only a general clarification of the general operation of the corresponding control element and / or the corresponding function of the vehicle, but also details of a currently advantageous and / or possibly even necessary operation of the control element.

[0017] Alternatively or additionally to the gear selector lever as the control element for the display system, as described above, the control element could be a vehicle control for opening a loading flap and / or a fuel filler flap and / or a hazard warning switch. To ensure that the specified display area is located within the specified environment of the control element, assuming that the specified environment is always in close proximity to the control element, the display device must be positioned in the vehicle such that the specified display area is always aligned along the line of sight between the typical viewpoint of a user and the display surface.

[0018] The vehicle's display system creates a three-dimensional virtual image that appears to float above, beside, and / or below a control element, serving as an operating instruction for that specific control. This image is positioned along the line of sight between the user's viewpoint, the surrounding area of ​​the control element, and the display surface of the device, which projects the corresponding help animation or instruction into the display area. This allows the user to easily and intuitively associate the displayed operating instruction with the control element.This leads to a noticeable improvement in the comprehensibility of the operating instructions provided in the vehicle compared to a traditional help display on a two-dimensional display element, as there is a direct and easily understandable connection to the actual control element. The user no longer needs to rethink their approach or devise precise sequences of movements to, for example, translate the information from the help display into actual operating movements of the real control element, but can simply follow the helpful animation displayed, for example, three-dimensionally above the control element. This results in a significant increase in user comfort, especially when using the vehicle and / or the control element for the first time.The operating instructions for the control element are therefore provided in the vehicle in an easily understandable way for a vehicle occupant as user.

[0019] According to the invention, the display system includes a sensor device. The sensor device is arranged, for example, in the ceiling area of ​​the vehicle and / or in the area of ​​the center console of the vehicle and is designed, for example, as a camera device. The sensor device is configured to detect the positioning and / or gesture of a user's hand within a detection range of the sensor device as a sensor signal. If, for example, the user moves their hand into the detection range of the sensor device and / or performs a specific gesture within this detection range, the respective of these two actions is provided to the display system in the form of sensor signals for further evaluation. The display system is then configured to provide the activation signal for the control unit that corresponds to the detected sensor signal.Simply by positioning the user's hand within the sensor's detection range, a specific activation signal can be generated, triggering the display of a corresponding operating instruction as a three-dimensional virtual object via the display system's display unit. For example, if the sensor's detection range encompasses the area around the control element, or possibly a larger or smaller area around the control element, positioning the user's hand within this range can trigger the display of the operating instruction for that specific control element via the three-dimensional virtual image.Such a positioning of the hand would therefore be the activation signal assigned to this control element, whereby this activation signal is detected based on the sensor signal of the sensor device and provided to the control device.

[0020] Alternatively or additionally, a specific gesture within the detection range of the sensor device can be evaluated in such a way that an activation signal corresponding to that gesture is provided to the control unit. Thus, a specific gesture can be provided, such as a pointing gesture towards a particular control element, by means of which the vehicle user can trigger the display of the operating instructions for that specific control element and / or a specific function of the vehicle associated with that control element.

[0021] This makes the display system particularly intuitive and easy for the user to activate. Depending on which control element the user requests an instruction for, a corresponding detection range can be provided by a sensor device positioned within the vehicle. Ultimately, this enables gesture control to display the operating instruction for the control element in the vehicle. In particular, the positioning of the hand in the vicinity of the control element clearly indicates that the user intends to activate it, thus ensuring that the operating instruction is provided with a high probability at the time actually desired by the user.

[0022] The invention also includes embodiments that offer additional advantages.

[0023] According to another embodiment, the display system includes a microphone. This microphone is, for example, integrated into the vehicle. The microphone is designed to detect an acoustic signal within the vehicle. The display system is configured to evaluate the detected acoustic signal as a voice command signal and to provide the activation signal to the control unit corresponding to the evaluated voice command signal. Thus, the display system allows for voice activation of the operating instructions. For example, the user in the vehicle can ask, "What is the button with the double-bordered triangle for?", whereupon an operating instruction for the hazard warning switch is displayed by the display system. This operating instruction is preferably displayed in close proximity to the hazard warning switch as a control element.This can also be combined with gesture and position recognition from the sensor system, enabling, for example, a voice command such as, "What is this control for?" while the user points to the desired control. By recognizing this pointing gesture within the sensor's detection range, combined with the evaluation of the voice command signal, the correct activation signal can be generated and provided to the control unit. This allows the control unit to display the corresponding operating instructions for the desired vehicle control as a three-dimensional virtual image. The display system is therefore particularly easy and intuitive to use and activate.

[0024] In another embodiment, the display system includes a vehicle control unit. This unit is designed to acquire vehicle data describing the current state of the vehicle. For example, the unit may detect a current hazard, the vehicle's location (such as at a gas station or in front of a garage door), and / or other driving situations. The display system is configured to evaluate the acquired vehicle data as a driving state signal and provide the activation signal for the control unit corresponding to this signal.If the vehicle data indicates a hazardous situation, such as abrupt and severe braking due to an obstacle detected by an external sensor in front of the vehicle, the "hazard situation" driving condition signal is evaluated. This driving condition signal is then assigned a corresponding activation signal, which, for example, classifies the operation of the hazard warning lights as particularly relevant for the user. As a control instruction assigned to this activation signal, information regarding the vehicle's hazard warning lights is then displayed in the form of a three-dimensional virtual image, using the operating instructions. In such a hazardous situation, the display system could therefore activate automatically, showing an operating instruction concerning the hazard warning lights.

[0025] Another example involves vehicle data describing the current position of the vehicle in the vicinity of a gas station. The vehicle status signal "Stopped at a gas station" is then determined, and an activation signal is provided. This signal is associated with an operating instruction for pressing a fuel filler button and / or a tailgate opening button. The operating instruction for pressing the fuel filler button and / or the tailgate opening button is then displayed by the display unit as a three-dimensional virtual image.

[0026] Various vehicle data provided by the vehicle can be analyzed to determine whether the operation of a vehicle control element is highly likely in the near future, allowing the user to be shown a corresponding instruction. The described display system thus activates automatically in numerous driving situations where it is particularly relevant to the user, thereby increasing user comfort.

[0027] According to the invention, the display system includes a user identification device. The user identification device is configured to detect the presence of a user in the vehicle and to identify the user status of the detected user. The user identification device therefore includes, for example, a camera system configured to capture the user of the vehicle, who is, for example, sitting in the driver's seat, in the form of image data. Furthermore, the user identification device includes an evaluation unit that can access, for example, a user profile stored in the vehicle, so that the user is identified and their user status is also known.The presence of the vehicle user can alternatively or additionally be detected by a corresponding sensor device detecting the presence of a specific vehicle key for the vehicle, whereby a stored user profile is assigned to this vehicle key, so that the user status of the user assigned to the detected vehicle key is also known to the display system.

[0028] A user status within the meaning of the invention is the user status "first-time user of the motor vehicle," as is conceivable, for example, for the renter of a vehicle rented from a rental car. Furthermore, the user status can contain information about the user's experience with a particular control element, for example, whether they have operated it frequently and therefore most likely no longer require operating instructions, whether they have previously encountered problems operating this control element, so that further or initial operating instructions would be useful, or whether the user has never operated the control element according to their user profile. The display system is designed to provide the activation signal for the control unit associated with the identified user status.For example, if a new user of the vehicle is detected, who might be using the gear selector for the first time, the operating instructions for the gear selector can be provided automatically, without the user having to, for example, place their hand near the sensor or issue a corresponding voice command, such as immediately after starting the vehicle. The display shown by the system can therefore be controlled solely based on the identified user status.

[0029] This has the advantage that, for example, a learning mode can be automatically activated, in which, for instance, a corresponding operating instruction is automatically displayed as a three-dimensional virtual image for each control element that the user might potentially need to operate in the near future. The learning mode is particularly suitable for rental cars, i.e., vehicles that can be booked by different people for a single trip. Therefore, the current user may not be very familiar with the vehicle and its operation and would thus be presented with a particularly clear and intuitive virtual guide for individual controls of the vehicle by means of one or more provided operating instructions. This simplifies the operation of the vehicle for the user, which can lead to a significant increase in comfort.

[0030] Furthermore, one embodiment of the display system includes a camera system located inside the vehicle. This camera system is designed to capture camera data and evaluate it to determine the eye position and / or gaze direction of the vehicle's occupant. The control unit is designed to use this evaluated camera data to generate the control command. For example, if the occupant's eye position is known, the distance between the occupant's eyes and the display surface can be determined—that is, the distance of the gaze point from the display surface. This is because the eye position corresponds to the gaze point from which the occupant views the display surface. If the occupant's gaze direction has also been evaluated, the occupant's viewing angle to the display surface can be determined.Based on this data, the precise location of the display area in front of the screen surface, where the three-dimensional virtual image can be shown, can be calculated. Ultimately, details regarding the type and location of the projection of the three-dimensional virtual image by the display device can be determined. This ensures that the operating instructions are always clearly visible to the vehicle user, as the camera data provides current and reliable details regarding the user's line of sight to the screen surface.

[0031] For example, if the vehicle is parked in front of a garage, an animation explaining how to operate a garage door opener can be displayed. If the relevant control element for which operating instructions are to be displayed is not within the user's line of sight to the display, an alternative, more detailed three-dimensional animation can be shown. This animation specifies the location of the control element inside or, if applicable, outside the vehicle, and / or its movement inside or outside the vehicle. The provided operating instructions then also serve as an aid for the user, ensuring that the operating instructions for the control element are easily understandable for the user inside the vehicle.

[0032] The motor vehicle according to the invention comprises a display system as described above. The display system is preferably arranged in the area of ​​a center console of the motor vehicle. The invention also includes further developments of the motor vehicle according to the invention, which have features as already described in connection with the further developments of the display system according to the invention. For this reason, the corresponding further developments of the motor vehicle according to the invention are not described again here.

[0033] The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.

[0034] Alternatively, the motor vehicle can be encompassed by the display system according to the invention.

[0035] The invention also includes the control unit for the display system. The control unit comprises a processor unit configured to operate the display system. For this purpose, the processor unit can include at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). Furthermore, the processor unit can include program code configured to operate the display system when executed by the processor unit. The program code can be stored in a data memory of the processor unit.

[0036] The invention also includes combinations of the features of the described embodiments.

[0037] The following are examples of embodiments of the invention.

[0038] The single figure shows a cutaway view of a motor vehicle with a display system for showing operating instructions in the motor vehicle.

[0039] The embodiment described below is a preferred embodiment of the invention. In this embodiment, the described components each represent individual features of the invention, which can be considered independently of one another and each further develops the invention independently. Therefore, the disclosure is intended to include combinations of features of the embodiment other than those shown. Furthermore, the described embodiment can also be supplemented by further features of the invention already described.

[0040] In the figure, identical reference symbols denote functionally equivalent elements.

[0041] The single figure shows a sketch of a motor vehicle 10. A user 12 is located in an interior 11 of the motor vehicle 10. The user 12's eye position is hereinafter referred to as the gaze point 14. From this eye position, the user 12 looks in a direction 16 towards a center console 13.

[0042] The motor vehicle 10 comprises a display system 20, which includes a display device 22 designed as a spatial imaging display with a display surface 24. The spatial imaging display can be designed as a stereo display. The display device 22 is arranged in the center console 13 of the motor vehicle 10. The display system 20 also includes a control unit 26. The display device 22 is designed to generate a virtual image in a predefined display area 18 located outside the display device 22 by means of autostereoscopy. Alternatively, the virtual image can be generated using shutter technology, polarizing filters, light field technology, or another spatial display technology. The display area 18 is located within the user's field of vision 12.The virtual image is generated in such a way that the virtual image is visible as a three-dimensional virtual image 28 from the specified viewpoint 14, that is, from the eye position of the user 12, in front of the display surface 24.

[0043] The control unit 26 is configured to detect an activation signal for the display unit 22 and to control the display unit 22 to display the three-dimensional virtual image 28 according to a control instruction assigned to the detected activation signal. The three-dimensional virtual image 28 ultimately displays an operating instruction 30 for the control element 32.

[0044] The display system 20 also includes a control element 32 of an operating device 34 of the motor vehicle 10. This control element 32 is a gear selector lever 32 of a gearbox as an operating device 34 of the motor vehicle 10. In the following, the same reference numeral is used for the gear selector lever 32 as for the control element 32.

[0045] The specified display area 18 of the display device 22 is arranged in a specified environment 36 of the control element 32, that is, in an overlap area of ​​the user's field of vision 12 with the environment 36 of the control element 32.

[0046] The display system 20 is configured to display the operating instruction 30 for the control element 32 by means of the three-dimensional virtual image 28, in accordance with the control instruction assigned to the detected activation signal, if the detected activation signal is assigned to the control element 32. For example, a desired actuation of the gear selector lever 32 by the user 12 is registered as a corresponding activation signal. This is done, for example, by means of a sensor device 38 of the display system 20. This sensor device is configured to detect the positioning and / or gesture of a hand 42 of the user 12 within a detection area 40 of the sensor device 38 as a sensor signal, whereupon the display system 20 evaluates the detected sensor signal, for example, to check whether an activation signal for the display system 20 is assigned to this detected sensor signal.If this is the case, for example, if the positioning of hand 42 within the detection area 40 outlined here is stored as an activation signal for displaying an operating instruction 30 concerning the gear selector lever 32, the three-dimensional virtual image 28 is displayed, which explains how to operate the gear selector lever 32. This is illustrated here as an arrow symbol pointing in four directions, representing the operating instruction 30. The presence of user 12's hand 42 within the detection area 40 of the sensor device 38 is thus interpreted as an indication from user 12 that they are interested in operating the gear selector lever 32 as a control element 32, whereupon a corresponding operating instruction 30 is displayed as a three-dimensional virtual image 28 to assist them.For example, a pointing gesture can be recorded as a gesture of the hand 42 of the user 12, with which the user 12 points, for example, to the gear selector lever 32 to signal that he wants an explanation of exactly this control element 32 in the motor vehicle 10.

[0047] The corresponding activation signal for the control unit 26 can alternatively or additionally be provided in another way. For example, this can be done based on the signals from a microphone unit 44 of the display system 20. The microphone unit 44 is designed to detect an acoustic signal in the motor vehicle 10. The display system 20 is designed to evaluate the detected acoustic signal as a voice command signal and to provide the activation signal for the control unit 26 that is associated with the evaluated voice command signal. Such a voice command signal could, for example, be: "How do I operate the gear selector lever?" The operating instruction 30 for the gear selector lever 32 is then displayed as control element 32 as described.

[0048] The display system 20 also includes a vehicle control unit 46, which is configured to acquire vehicle data describing the current driving state of the motor vehicle 10. The display system 20 is further configured to evaluate the acquired vehicle data from the vehicle control unit 46 as a driving state signal. Such a driving state signal describes, for example, a hazardous situation, which is detected based on conspicuous braking acceleration data and an obstacle in front of the motor vehicle, detected by means of an external sensor device of the motor vehicle 10. An alternative driving state signal is, for example, the positioning of the motor vehicle 10 at a gas station or in front of a garage.

[0049] The activation signal associated with the selected driving condition signal is provided to the control unit 26. In the case of a hazard situation, the activation signal relates, for example, to a hazard warning switch in the vehicle, so that, using the control instruction, an operating instruction 30 for operating the hazard warning switch as a control element 32 is displayed as a corresponding three-dimensional virtual image 28. If the vehicle is positioned at the filling station, the operating instruction 30 can be used to operate a loading flap opening element or a fuel tank opening element of the vehicle 10. If the vehicle is positioned in front of the garage, the operation of a garage door opener can be provided as a three-dimensional virtual image 28 using a corresponding operating instruction 30. The corresponding details regarding the operating instruction 30 are stored in the control unit 26 of the display system 20 in the form of the control instruction.Depending on the situation, the display area 18 may not be located within the specified environment 36 of the control element 32. If this is the case, a corresponding operating instruction 30 can still be issued in the vehicle 10, whereby the operating instruction 30 is selected in such a way that it is clear to the user 12 where the corresponding control element 32 is located inside or outside the vehicle 10.

[0050] The display system 20 also includes a user identification device 48, which is configured to detect the presence of user 12 in the motor vehicle 10 and to identify the user status of the detected, present user 12. A user profile is stored in the user identification device 48 for this purpose. The presence of user 12 can be detected, for example, by the presence of a personalized vehicle key or by means of a camera device 50, which captures and evaluates an image of user 12 by identifying a person in the image. The user profile can be stored in the motor vehicle 10 for this purpose.However, it may alternatively or additionally be provided that the motor vehicle 10 can access user profiles stored on an external server via a communication connection, so that ultimately the user 12 can be reliably identified.

[0051] For user 12, the stored user profile specifies a user status indicating whether user 12 is a first-time user of the motor vehicle 10. The user status also includes an assessment of user 12's experience with one or more controls 32 of the operating device 34 of the motor vehicle 10. The display system 20 is configured to provide the activation signal for the control unit 26 associated with the identified user status. If the user status indicates first-time user, it may be provided that a corresponding operating instruction 30 is automatically displayed for at least a selection of controls 32 using the three-dimensional virtual image 28 to assist the first-time user 12 with their initial use of the motor vehicle 10.

[0052] The camera device 50 is also designed to capture camera data and evaluate it to determine the eye position (viewpoint 14) and / or the viewing direction (16) of the user (12) of the vehicle (10). The control unit 26 is configured to evaluate the camera data thus processed to generate the control instruction. Based on the eye position (viewpoint 14) and the viewing direction (16), the precise location of the display area (18) relative to the display surface (24) can be determined. Subsequently, the system precisely determines how the virtual image must be technically projected so that it is displayed as a three-dimensional virtual image (28) at the desired location (i.e., within the display area (18)).

[0053] Alternatively or additionally to the display area 18 shown here above the control element 32 in the vehicle's vertical direction (z-direction), this display area 18 can be located below the control element 32 in the vehicle's vertical direction. Alternatively or additionally, the display area 18 can be located in a longitudinal direction (x-direction) in front of or behind the control element 32. Alternatively or additionally, the display area 18 can be located laterally to the control element 32 (y-direction) in front of or behind the control element 32.

[0054] Overall, the examples demonstrate how the invention can provide a spatial aid animation for the control element 32. This aid animation is referred to as operating instruction 30. Ultimately, to provide the operating instruction 30, a 3D display, i.e., the stereo display as a display device 22, is arranged in the motor vehicle 10 such that the user 12 can see the three-dimensional virtual image 28 in space above, beside, or below an associated control element 32, which may be, for example, a rotary push-button, a lever, and / or a button. The corresponding electronic connection with the desired sensor, which includes, for example, the sensor device 38, controls the described display of the three-dimensional virtual image 28 by means of the display system 20.

Claims

[1] Display system (20) for displaying an operating instruction (30) for a control element (32) in a motor vehicle (10), comprising a display device (22) of the motor vehicle (10) designed as a spatially imaging display with a display surface (24) and a control device (26), wherein - the display device (22) is configured to generate a virtual image in a predetermined display area (18) located outside the display device (22) such that the virtual image is visible from a predetermined viewpoint (14) in front of the display surface (24) as a three-dimensional virtual image (28); and - the control device (26) is designed to detect an activation signal for the display device (22) and to control the display device (22) in accordance with a control instruction assigned to the detected activation signal to display a three-dimensional virtual image (28); characterized by , that - the display system (20) includes the control element (32) which is associated with an operating device (34) of the motor vehicle (10); and - the specified display area (18) is arranged in a specified environment (36) of the control element (32); and - the display system (20) is configured to display the operating instruction (30) for the control element (32) by means of the three-dimensional virtual image (28) in accordance with the control instruction assigned to the detected activation signal, if the detected activation signal is assigned to the control element (32); and - the display system (20) comprises a sensor device (38) configured to detect a positioning and / or gesture of a user's hand (42) within a detection range (40) of the sensor device (38) as a sensor signal, and the display system (20) is configured to provide the activation signal to the control device (26) associated with the detected sensor signal; and / or - the display system (20) comprises a user identification device (48) which is configured to detect the presence of a user (12) in the motor vehicle (10) and to identify a user status of the detected present user (12), for which purpose a user profile is stored in the user identification device (48) in which the user status is specified for the user (12), which indicates whether the user (12) is a first-time user (12) of the motor vehicle (10) and which includes an assessment of the user's (12) experience with the control element (32) of the operating device (34) of the motor vehicle (10), and the display system (20) is configured to provide the activation signal of the control unit (26) associated with the identified user status. [2] Display system (20) according to the preceding claim, wherein the display system (20) comprises a microphone device (45) configured to detect an acoustic signal, and the display system (20) is configured to evaluate the detected acoustic signal as a voice command signal and to provide the activation signal associated with the evaluated voice command signal to the control device (26). [3] Display system (20) according to one of the preceding claims, wherein the display system (20) comprises a vehicle control unit (46) configured to acquire vehicle data describing a current driving state of the motor vehicle (10), and the display system (20) configured to evaluate the acquired vehicle data as a driving state signal and to provide the activation signal of the control unit (26) associated with the evaluated driving state signal. [4] Display system (20) according to one of the preceding claims, wherein the display system (20) comprises a camera device (50) arranged in an interior (11) of the motor vehicle (10), which is configured to capture camera data and evaluate the captured camera data to determine an eye position and / or a direction of view (16) of a user (12) of the motor vehicle (10), and the control device (26) is configured to evaluate the camera data evaluated in this way to generate the control instruction. [5] Motor vehicle (10) with a display system (20) according to one of the preceding claims.

Images