Method for operating a touch-sensitive control display of a vehicle, computer-readable medium, system, and vehicle

Abstract

The invention relates to a method for operating a touch-sensitive control display of a vehicle, the method comprising: providing a control request for a function of the vehicle on the touch-sensitive control display of the vehicle; detecting an intention to operate the function in response to the provided control request by an interior camera of the vehicle; detecting no touch-based control interaction in response to the provided control request by the touch-sensitive control display of the vehicle; and if the interior camera detects the control interaction and the touch-sensitive control display does not detect a touch-based control interaction: capturing an intention to operate the function with a microphone in the interior of the vehicle;and executing the vehicle's function depending on the operating intention of the function detected by the microphone and the operating intention of the function detected by the interior camera.

Description

The invention relates to a method for operating a touch-sensitive operating display of a vehicle. The invention further relates to a computer-readable medium for operating a touch-sensitive operating display of a vehicle, to a system for operating a touch-sensitive operating display of a vehicle, and to a vehicle comprising the system for operating a touch-sensitive operating display of a vehicle.Touch-sensitive displays in vehicles often cannot register input when wet. An occupant of the vehicle may be overseeded and / or deceased in operation of a wet touch-sensitive display.DE 10 2008 016 172 A1 describes a method for operating a motor vehicle having a display for displaying variable information and a touchscreen arranged above the display for inputting commands by touching the touchscreen and having a microphone, wherein an operating mask dependent on an acoustic command is displayed on the display if an approach of a hand to the touchscreen takes place or is detected simultaneously with the input of the acoustic command.DE 103 60 655 A1 describes an operating system for a vehicle having a screen display with a plurality of display areas for displaying entries of a menu structure with a plurality of menu levels, a manual actuating means for selecting and / or activating at least one entry in a current menu level from the menu structure, voice control means for redundant selection and / or activation of at least one entry from the menu structure, which simultaneously forms a keyword for the voice control means. According to the invention, the entries of the menu structure are divided into different groups, wherein a first group comprises entries which can be selected and / or activated only with the manual actuating means, wherein a second group comprises entries which can be selected and / or activated with the manual actuating means and / or the voice control means, and wherein the second group is divided into at least two concept groups which can be specified by simple rules and which determine which keywords for menu guidance can currently be input.DE 10 2006 028 046 A1 describes a combined display and operating device for a motor vehicle, comprising a touch-sensitive screen for displaying and selecting operating functions, wherein a device for detecting an operating means, in particular a hand or a finger, is provided, wherein the screen can be switched from an information mode to an operating mode in which the selection of operating functions is possible in the case of an operating means detected in a predetermined region around the screen.DE 10 2023 117 452 A1 describes a touch screen input system having at least one visually perceptible button at at least one position, comprising an active, inductive input device which is configured to generate an alternating electromagnetic field, a touch-sensitive layer which is configured to detect actuations of the touch screen input system by the input device and first position information of the input device, a conductor loop layer which is configured to detect the alternating electromagnetic field and to determine second position information of the input device by comparison of induction signal strengths, and a computing device which is configured to check whether the first position information, the second position information and the button position match, and if so to trigger the button in the case of an actuation detected by the touch-sensitive layer.It is therefore an object of the invention to operate a touch-sensitive control display of a vehicle more efficiently. In particular, it is an object of the invention to operate a touch-sensitive control display of a vehicle more efficiently when wet.This object is achieved by the features of the independent claims. Advantageous embodiments and further developments of the invention are evident from the dependent claims.According to a first aspect, the invention is distinguished by a method for operating a touch-sensitive operator display of a vehicle. The method can be a computer-implemented method and / or a control device-implemented method. The method comprises providing an operating request for a function of the vehicle on the touch-sensitive operating display of the vehicle, detecting an operating intention of the function in response to the provided operating request for the function by an interior camera of the vehicle, and detecting no touch-based operating interaction in response to the provided operating request for the function by the touch-sensitive operating display of the vehicle. If the interior camera recognizes the operating interaction and the touch-sensitive operating display does not recognize a touch-based operating interaction, the method comprises capturing an operating intention of the function with a microphone in an interior of the vehicle, and executing the function of the vehicle as a function of the operating intention of the function captured with the microphone and the operating intention of the function recognized with the interior camera.The function can advantageously be executed by the user if no touch-based operating interaction with the touch-sensitive operating display is possible at least temporarily. Distraction of the user when a function is executed in a touch-based manner can thus be reduced efficiently. Further, the method may efficiently reduce false positive function executions possible with purely camera-based function execution using the microphone of the vehicle.According to one advantageous configuration, the method can provide the operating request as a virtual operating button on the touch-sensitive operating display. This allows the function of the vehicle to be easily operated by the user.According to a further, advantageous embodiment, the method can provide the control request for the function of the vehicle for a time-limited period of time as a function of the function on the touch-sensitive control display of the vehicle. This allows the time interval in which the user can execute the function by means of a touch-based operating interaction to be defined.According to a further, advantageous embodiment, the detection of the operating intention of the function in response to the provided operating request of the function by the interior camera of the vehicle can comprise a detection of a preferably touch-based operating interaction of a user of the vehicle in response to the provided operating request of the function with the touch-sensitive operating display of the vehicle by the interior camera of the vehicle. With this, the interior camera can efficiently recognize an operation intention of the user.According to a further advantageous configuration, the detection of no touch-based operating interaction in response to the provided operating request of the function by the touch-sensitive operating display of the vehicle can comprise detection of a deviation of a contact surface on the touch-sensitive operating display of the vehicle from a position of the operating request on the touch-sensitive operating display of the vehicle by a wet hand of the user of the vehicle and / or a wet surface of the touch-sensitive operating display of the vehicle, and detection of no touch-based operating interaction in response to the provided operating request of the function by the touch-sensitive operating display of the vehicle in dependence on the detected deviation. This may temporarily restrict an operating interaction with the touch-sensitive operating display by the user of the vehicle.According to a further, advantageous configuration, the detection of an operating intention of the function with a microphone in the interior of the vehicle can comprise detection of audio information of the user of the vehicle after the detected operating intention of the function in response to the provided operating request of the function with the microphone of the vehicle, wherein the audio information is representative of an expression of a surprise with respect to the operating interaction with the touch-sensitive operating display and / or comprises an expression of an intention with respect to an execution of the function. Furthermore, the detection of the operating intention of the function with the microphone in the interior of the vehicle can comprise a detection of an operating intention of the function with the microphone in the interior of the vehicle as a function of the detected audio information of the user. This allows an operating intention to be detected efficiently with the microphone of the vehicle.According to a further aspect, the invention is distinguished by a computer-readable medium for operating a touch-sensitive operator display of a vehicle, wherein the computer-readable medium comprises instructions which, when executed on a computer, execute the method described above.According to a further aspect, the invention is distinguished by a system for operating a touch-sensitive operator display of a vehicle, wherein the system is designed to carry out the method described above.According to a further aspect, the invention is distinguished by a vehicle comprising the system described above for operating a touch-sensitive operator display of a vehicle.Further features of the invention are evident from the claims, the figure and the description of the figures. All features and combinations of features mentioned above in the description and the features and combinations of features mentioned below in the description of the figures and / or shown alone in the figure can be used not only in the respectively specified combination but also in other combinations or else alone.A preferred exemplary embodiment of the invention is described below with reference to the appended drawings. This results in further details, preferred embodiments and developments of the invention. In detail, schematically shows FIG. 1 illustrates an example method of operating a touch-sensitive control display of a vehicle.In detail, FIG. 1 shows an example method 100 of operating a touch-sensitive control display of a vehicle. The method may detect an intention to operate a user of the vehicle, for example a driver or a passenger of the vehicle, using a touch-sensitive operator display and may perform a function of the vehicle in the event of a wet condition or another disturbance of a touch-sensitive operator input of the user.The method 100 may provide an operation request of a function of the vehicle on the touch-sensitive operation display of the vehicle 102. For example, the function may be a telephone function of the vehicle. For example, the operation request of the function may be an operation request for accepting or rejecting a telephone call of the telephone function of the vehicle. In general, the operator request for a function of the vehicle can be provided on the touch-sensitive operator display in a time-limited manner. The user of the vehicle may perform touch-based operation interaction only as long as the operation request of the function is provided on the touch-sensitive operation display.The method 100 can recognize 104 an operating intention of the function in response to the provided operating request of the function by an interior camera of the vehicle. For example, the operating intention may comprise a touch-based operating interaction of the user with the provided operating request on the touch-sensitive operating display. Furthermore, the method 100 cannot recognize 106 a touch-based operating interaction in response to the provided operating request for the function by the touch-sensitive operating display of the vehicle. In other words, although the method 100 can recognize the operating intention by the interior camera, the touch-sensitive operating display cannot detect a touch-based operating interaction whether the user is performing the touch-based operating interaction. For example, the touch-sensitive operator display cannot recognize the touch-based operator interaction of the user because a finger of the user is wet, the touch-sensitive operator display is wet, and / or there is a fault or defect in the touch-sensitive operator display that prevents a touch-based operator interaction of the user in response to the provided operator request for the function. Steps 104 and 106 may occur once or multiple times. For example, the method 100 can only execute the following steps of the method 100 if, even if the steps 104 and 106 are run through a plurality of times, the touch-sensitive operator display does not recognize an operator intervention by the user of the vehicle.If the interior camera detects the operating interaction and the touch-sensitive operating display does not detect a touch-based operating interaction, the method 100 may detect 108 an operating intention of the function with a microphone in an interior of the vehicle. For example, the operation intention of the user of the vehicle can be recognized with respect to the function using the microphone if the user of the vehicle verbalizes the operation intention. For example, the user's intention to operate may be recognized when a command to execute the function, for example "accept", or an expression of an expected function of the touch-sensitive operator display, for example "why is this not?", is detected with the microphone of the vehicle.The method 100 can finally execute the function of the vehicle as a function of the operating intention of the function detected with the microphone and the operating intention of the function detected with the interior camera 110. The function of the vehicle can also be carried out by the user of the vehicle if no touch-based operating interaction with the touch-sensitive operating display is currently possible, for example because wetness does not enable any touch-based operating interaction with the touch-sensitive operating display.Advantageously, the method can enable a user of the vehicle to operate a touch-sensitive operator display under conditions such as wet conditions. By recognizing an operating intention with the interior camera and the microphone of the vehicle, a function of the vehicle, in particular a time-critical function of the vehicle, can be executed reliably. Furthermore, the additional detection of the operating intention with the microphone of the vehicle further reduces false positive function executions. User distraction during an operating interaction with the touch-sensitive operating display is efficiently reduced. The user does not have to perform the operating interaction with the touch-sensitive operating display a plurality of times until, for example, the wet is no longer present on the touch-sensitive operating display and the function can be performed with a touch-based operating interaction. Reliability in function execution with the touch-sensitive operation display can be improved efficiently.List of reference characters100 Method 102 Providing an operating request for a function of the vehicle 104 Detecting an operating intention of the function 106 Detecting no touch-based operating interaction 108 Detecting an operating intention of the function with a microphone 110 Executing the function of the vehicle

Claims

A method (100) of operating a touch-sensitive operator display of a vehicle, the method comprising: providing (102) an operator request of a function of the vehicle on the touch-sensitive operator display of the vehicle; detecting (104) an operator intention of the function in response to the provided operator request of the function by an interior camera of the vehicle; detecting (106) no touch-based operator interaction in response to the provided operator request of the function by the touch-sensitive operator display of the vehicle; and if the interior camera detects the operator interaction and the touch-sensitive operator display does not detect any touch-based operator interaction: detecting (108) an operator intention of the function with a microphone in an interior of the vehicle; and executing (110) the function of the vehicle depending on the operation intention of the function detected with the microphone and the operation intention of the function detected with the interior camera.The method (100) of claim 1, wherein the method (100) provides the operation request as a virtual operation button on the touch-sensitive operation display.Method (100) according to one of the preceding claims, wherein the method (100) provides the control request for the function of the vehicle for a time-limited period of time as a function of the function on the touch-sensitive control display of the vehicle.The method (100) according to any one of the preceding claims, wherein detecting (104) the operating intention of the function in response to the provided operating request of the function by the interior camera of the vehicle comprises detecting an operating interaction of a user of the vehicle in response to the provided operating request of the function with the touch-sensitive operating display of the vehicle by the interior camera of the vehicle.The method (100) of any of the preceding claims, wherein detecting (106) no touch-based operator interaction in response to the provided operator request of the function by the touch-sensitive operator display of the vehicle comprises: detecting a deviation of a contact surface on the touch-sensitive operator display of the vehicle from a position of the operator request on the touch-sensitive operator display of the vehicle by a wet hand of the user of the vehicle and / or a wet surface of the touch-sensitive operator display of the vehicle; and detecting no touch-based operator interaction in response to the provided operator request of the function by the touch-sensitive operator display of the vehicle in dependence on the detected deviation.The method (100) according to any one of the preceding claims, wherein the acquiring (108) an operating intention of the function with a microphone in the interior of the vehicle comprises: acquiring audio information of the user of the vehicle after the recognized operating intention of the function in response to the provided operating request of the function with the microphone of the vehicle, wherein the audio information is representative of an expression of a surprise regarding the operating interaction with the touch-sensitive operating display and / or comprises an expression of an intention regarding an execution of the function; and acquiring an operating intention of the function with the microphone in the interior of the vehicle in dependence on the acquired audio information of the user.A computer readable medium for operating a touch-sensitive control display of a vehicle, the computer readable medium comprising instructions which, when executed on a computer, perform the method (100) of any one of claims 1 to 6.A system for operating a touch sensitive control display of a vehicle, the system being configured to perform the method (100) of any one of claims 1 to 6.A vehicle comprising the system for operating a touch-sensitive control display of a vehicle according to claim 8.

Images