Method and apparatus for activating a function

Abstract

Method for activating a function of a vehicle (10) comprising the steps:- detecting a focusing (200), in particular by the gaze of a user of a vehicle, of a first display element (2) of the vehicle (10) associated with the function, and- activating (400) the function in response to an additional acoustic input as confirmation of the focusing (200).

Description

[0001] The present invention relates to a device and a method for activating a function of a vehicle. In particular, the present invention relates to the intuitive operation of a vehicle by means of alternative activation steps.

[0002] It is known in the art to display function-associated elements in motor vehicles, for example, by selecting and then confirming them using pushbuttons or rotary / push controls. For instance, menu items are displayed on a screen often referred to as a human-machine interface (HMI), which can be selected and confirmed using buttons or rotary controls. However, motor vehicle functions are currently not selectable via the so-called head-up display (HUD) or its graphical user interface (GUI), as is possible, for example, when selecting function elements via the touchscreen of a smartphone. The vehicle menu only allows for display options, such as the position and / or brightness of the displays in the HUD. Pure control or...Selecting functions via gesture or gaze tracking would not be sufficient, as misinterpretations of user actions would be possible depending on the driving situation.

[0003] It is an object of the present invention to eliminate the disadvantages known in the prior art.

[0004] According to the invention, a method for activating a function of a vehicle with the features of claim 1 and a device with the features of claim 10 are proposed. The method according to the invention comprises the step of detecting the focusing of a display element of the vehicle associated with a function to be activated. In other words, a user directs their gaze to a displayed element presented to them, which is linked to a predefined function. The display element can, for example, be a field within an HMI, a HUD, or an instrument cluster of the vehicle, assigned a predetermined function. Subsequently, the function is activated in response to an additional haptic and / or acoustic input and / or a gesture as confirmation of the user's focusing.In other words, the user activates ("executes") the function associated with the display element by pressing a predefined element of the vehicle to confirm focus. Alternatively or additionally, a voice command can be used to confirm the function associated with the focused display element. Alternatively or additionally, a gesture can be recognized and used to confirm the function associated with the focused display element. This allows for a particularly user-friendly and intuitive function selection, as focusing on an already displayed element provides random access to a available function without having to take one's eyes off the road or hands off the steering wheel for an extended period.

[0005] A preferred method for additional input is a control step performed on a smartphone located in the vehicle. This could involve, for example, a short-range radio connection between the smartphone and a communication unit in the vehicle, which can be used to relay the control step to the vehicle. Alternatively or additionally, voice input can be provided in the form of a voice command, as is common practice when entering function commands, phone numbers, locations, or selecting a radio station. Alternatively or additionally, a predefined gesture can be recognized by a camera system and evaluated as additional input.Using a gesture to activate a function is advantageous because the correlation of gestures with focused objects prevents unintended activations in purely gesture-based control, as the gesture is linked to the current intention / action context by viewing a display element. Therefore, when using a gesture in conjunction with prior focusing, a function associated with the display element is only activated if the object was previously focused for selection. An unintentional gesture, such as one made during conversation, can thus be distinguished from an intentional gesture to activate a function associated with a focused display element in the context of user interface interaction.Alternatively or additionally, haptic activation of a control element permanently installed in the vehicle, such as a rotary / push-button controller or a control unit integrated into the steering wheel, can be predefined as an additional input. The aforementioned operating steps are intuitive for the user and require little attention, thus reducing the user's distraction from the road.

[0006] Preferably, the first display element can be shown by means of a so-called head-up display (HUD), an instrument cluster, or a universal vehicle-based screen. The HUD offers the advantage that the driver's gaze can remain fully focused on the traffic situation while the inventive method is carried out. The instrument cluster or a multifunctional HMI, on the other hand, offers the advantage of ensuring maximum contrast in the display element and enabling the applicant to quickly recognize it thanks to its particularly high resolution.

[0007] Furthermore, it is preferred that the first display element is visually highlighted when the focus is detected. In other words, it becomes apparent to the user that their focus of the display element has been recognized and that simple confirmation via additional input is sufficient to activate the function. In this way, operating errors can be avoided, which could occur, for example, if the user makes additional inputs that cannot be assigned to a first display element according to the invention.

[0008] Preferably, the detection of focus can be achieved using an imaging method. In other words, an optical sensor (e.g., a camera) can capture the user's eyes and, based on the user's pupil alignment, determine which of the displayed elements are being focused on. This offers the advantage that sensors already installed in the vehicle for other purposes (e.g., user authorization, fatigue detection) can be used, thus reducing the additional hardware required to implement the method according to the invention.

[0009] For example, the function can include displaying secondary display elements associated with sub-functions. In other words, the function associated with the first display element can represent the calling of a subordinate menu item, whose secondary display elements can be selected analogously to the first display element by focusing and then confirming, thus activating the associated sub-functions. Naturally, the sub-functions can call further (third) display elements, which are associated with corresponding additional functions, and so on. In this way, the display elements of a level can be displayed relatively large, which facilitates focusing and also makes it more reliable to recognize when focusing.In a further configuration, the first display element can be shown by a primary device, while the second display element, associated with sub-functions, is shown by a secondary device. The primary device could, for example, be a central HMI where basic function clusters are represented by their respective primary display elements. When one or more display elements are selected, a variety of secondary display elements for selecting corresponding sub-functions can be shown in the HUD as a secondary device. In this way, a user can make a preliminary selection with a quick glance at the HMI, and then "port" the selected sub-functions to the HUD by confirming the focus. This allows the user to conveniently select one of the sub-functions without taking their eyes off the road.

[0010] Suitable acoustic inputs include oral sounds, such as those produced easily as spoken commands or voiceless noises (e.g., tongue clicks). Voiceless sounds also offer the advantage of minimally disturbing fellow travelers, as the human ear is less likely to interpret voiceless sounds as containing relevant information.

[0011] According to a second aspect of the present invention, a device for activating a vehicle function is proposed, comprising an optically detectable display for showing a first display element associated with a vehicle function. Additionally, an optical detection device is provided for recognizing when the vehicle user focuses on the display element. This can, for example, be used as an interior camera for fatigue detection or user identification. Furthermore, an input unit is provided for receiving additional haptic and / or acoustic input and / or for recognizing a predefined gesture as additional input. The input unit can be designed, for example, as a push button, rotary / push controller, microphone, pressure-sensitive display, camera system, or similar device.In particular, the input unit can be located on the steering wheel of the vehicle, allowing the user to make the additional input without taking a hand off the steering wheel.

[0012] Finally, a processing unit is provided by which the device is configured to carry out the steps of a process as described in detail in connection with the first-mentioned aspect of the invention. However, the features, combinations of features, and advantages of the first-mentioned aspect of the invention can be so clearly transferred to the device according to the invention that, to avoid repetition, reference is made to the preceding statements.

[0013] Further details, features and advantages of the invention will become apparent from the following description and the figures. These show:

[0014] Fig. 1 a schematic view of components of an embodiment of a device according to the invention within a vehicle; and

[0015] Fig. 2 a flowchart illustrating steps of an embodiment of a method according to the invention.

[0016] Fig. Figure 1 shows the cockpit of a vehicle. 10 , in whose windshield 6 an umbrella 1 A head-up display (HUD) is planned as the first feature. Three cameras. 3a , 3b and 3c a camera system 3 Optical recognition devices are located in the area of ​​a sun visor, in the area of ​​the dashboard, or in the area of ​​the left A-pillar of the vehicle. 10 arranged. The cameras 3a , 3b and 3c are equipped with an electronic control unit 5 connected as a processing unit for data exchange. In addition, a combination instrument cluster is included. 13and an HMI 11 The first devices intended for displaying elements are... 11 a list of entries associated with sub-functions 12a , 12b , 12c , 12d as second display elements. Also on the HUD 1 The first display elements are shown, of which one display element 2 The highlighted element is activated when the user focuses on it. This confirms the highlighted display element. 2 The user has a microphone available 8 , a rotary / push-button switch 4 , a steering wheel button 9 as a control unit and a camera system 3 for gesture recognition. The aforementioned elements represent input units for receiving additional haptic or acoustic input and / or for recognizing a gesture to confirm focus. The functionality of the in Fig. 1 device shown or of the device shown in Fig. 1 of the depicted vehicle 10 is based on the in Fig. The two illustrated process steps are explained.

[0017] Fig. Figure 2 shows a flowchart illustrating the process steps of an embodiment of the method according to the invention. In step 100 A first display element is shown on a display in the vehicle. In step 200 The user focuses on the display element, which is detected by a processing unit using an indoor camera. In response to this detection, the following steps occur: 300 The display element is visually highlighted compared to other display elements. This can include, for example, a border and / or a color inversion and / or a blinking effect. In step 400The user activates an input device, thereby confirming that they have focused on the highlighted display element and activating a function associated with the first display element. This function consists of the following: in step 500 A variety of secondary display elements are shown for selecting corresponding sub-functions. In step 600 The user focuses on one of the displayed secondary elements, which also highlights it visually, and confirms the focus by pressing the input device again. This process can, of course, be continued (possibly repeatedly) in a further subordinate hierarchy.

[0018] Even though the aspects of the invention and advantageous embodiments have been described in detail with reference to the exemplary embodiments explained in conjunction with the accompanying drawing figures, modifications and combinations of features of the illustrated exemplary embodiments are possible for the person skilled in the art without leaving the scope of the present invention, the scope of protection of which is defined by the accompanying claims. Reference symbol list 1 HUD 2 Display element 3-camera system 3a, 3b, 3c Camera 4 rotary / push controls 5 electronic control unit 6 Windscreen 7 Steering wheel 8 microphones 9 Steering wheel button 10 vehicles 11 HMI 12a, 12b, 12c, 12d entries 13 Instrument cluster 100–600 process steps

Claims

[1] Method for activating a function of a vehicle ( 10 ) comprehensively the steps: – Recognizing a focus ( 200 ), in particular through the view of a vehicle user, a first display element associated with the function ( 2 ) of the vehicle ( 10 ), and – Activate ( 400 ) the function in responding to an additional haptic and / or acoustic input and / or a gesture as confirmation of focusing ( 200 ). [2] Method according to claim 1, wherein the additional input – a smartphone operating step, and / or – voice input, and / or – a predefined gesture recognized by a camera system, and / or – a haptic activation of a mechanism permanently installed in the vehicle ( 10 ) built-in control element ( 4 ), in particular a rotary push-button controller or one integrated into a steering wheel ( 7) integrated control unit ( 9 ), is. [3] Method according to claim 1 or 2, wherein the first display element ( 2 ) by means of – a so-called head-up display ( 1 ), or – of a combination instrument ( 13 ), or – a universal vehicle-based screen ( 11 ) is displayed. [4] Method according to one of the preceding claims, wherein in responding to the detection of focusing ( 200 ) the first display element ( 2 ), especially after a predefined focusing period ( 200 ), is visually highlighted ( 300 ). [5] Method according to any of the preceding claims, wherein the first display element ( 2 ) includes a simple graphical representation of the function. [6] Method according to any of the preceding claims, wherein the detection of focusing ( 200) using an imaging technique. [7] Method according to any of the preceding claims, wherein the function is a representation ( 500 ) with sub-functions associated second display elements ( 12a , 12b , 12c , 12d ) includes. [8] Method according to claim 7, wherein a representation ( 100 ) of the first display element ( 2 ) by means of an initial setup ( 1 ) is done, and the representation ( 500 ) with sub-functions associated second display elements ( 12a , 12b , 12c , 12d ) by means of a second facility ( 11 ). [9] Method according to any of the preceding claims, wherein the acoustic input is an oral sound, in particular a speech command or a voiceless sound. [10] Device for activating a function of a vehicle ( 10 ) comprehensive – a visually perceptible display ( 1 ) to display a first display element associated with a vehicle function ( 2 ), – an optical recognition unit ( 3 ) to detect a focus ( 200 ) of the display element ( 2 ) by a user of the vehicle ( 10 ), in particular through his gaze, and especially a gesture of a vehicle occupant, – an input unit ( 4 , 8 , 9 ) to receive additional haptic and / or acoustic input, and – a processing unit ( 5 ), by which the device is configured to perform the steps of a method according to one of the preceding claims.

Images