Operating device for operating a vehicle function of a motor vehicle, motor vehicle having an operating device and method for operating a vehicle function

Abstract

The invention relates to an operating device (10) and a method for operating a vehicle function. The operating device (10) comprises a contact-sensitive input surface (12) which can change shape, a gesture identification unit (16) and a computing unit (18), wherein the contact-sensitive input surface (12) which can change shape is designed to detect touch inputs on the input surface (12) and to generate haptically activatable buttons (14), wherein the gesture identification unit (16) is designed to detect contactless operating gestures, and wherein the computing unit (18) is designed to learn operating codes from the touch inputs on the input surface (12) and / or the haptic activations of the generated buttons (14) and / or the contactless operating gestures for vehicle functions and when such a learned operating code is detected, to carry out the allocated vehicle function.

Description

[0001] Operating device for operating a vehicle function of a motor vehicle, motor vehicle with an operating device and method for operating a vehicle function

[0002] DESCRIPTION:

[0003] The invention relates to an operating device for operating a vehicle function of a motor vehicle. Furthermore, the invention relates to a motor vehicle with such an operating device and a method for operating a vehicle function.

[0004] User interfaces for operating vehicle functions are known. Operation is typically performed via manual input or voice. DE 10 2017 109 043 A1 discloses a method for the variable control of operating functions in a motor vehicle. For operating processes to execute operating functions, the driver can define individual operating patterns by actuating an actuating element provided for executing an operating function of a device and, after activating a learning mode, either actuating an actuating element provided for operating another operating function of a device in the vehicle several times in succession or actuating several actuating elements of at least one other device in the vehicle one or more times in succession.The type and sequence of the operating elements operated during the learning mode as well as the operating function linked to them in the future are stored in storage means by a control and processing unit coupled to the vehicle bus.

[0005] US 2006 / 0047386 A1 discloses an apparatus and method for operating devices and systems in a motor vehicle that reduce distraction for a vehicle user. One or more touch-sensitive pads are mounted on the steering wheel of the vehicle, with the vehicle user touching the pads in a predetermined, synchronized pattern to perform functions such as controlling a radio or a window. At least one of the touch patterns for generating various commands can be selected by the vehicle user.

[0006] The object of the invention is to expand operating options for vehicle functions.

[0007] This object is achieved by the independent patent claims. Advantageous developments of the invention are disclosed in the dependent patent claims, in the following description, and in the figures.

[0008] One aspect of the invention relates to an operating device for operating a vehicle function of a motor vehicle, comprising a touch-sensitive, shape-changing input surface, a gesture recognition device and a computing device, wherein the touch-sensitive, shape-changing input surface is designed to detect touch inputs on the input surface and to generate haptically actuatable buttons, wherein the gesture recognition device is designed to detect contactless operating gestures, and wherein the computing device is designed to learn operating codes from the touch inputs on the input surface and / or the haptic actuations of the generated buttons and / or the contactless operating gestures for vehicle functions and to carry out the associated vehicle function upon detection of such a learned operating code.

[0009] In other words, the operating device can have different modalities that enable touch input and contactless operating gestures. With touch inputs, an input can either be made on a touch-sensitive input surface, for example, a pattern or symbol can be drawn, and / or the touch-sensitive input surface can be configured to change shape and thus form buttons that can be pressed by a user. For example, a shape-changing surface, such as a flexible or elastic film, can be used for this purpose, wherein actuators can be arranged beneath the shape-changing surface that can be extended or retracted to generate the buttons. Pressing these generated buttons can then be detected, for example, by a pressure signal at the actuators and / or at the touch-sensitive input surface of the generated buttons.

[0010] To determine contactless operating gestures, the operating device can have sensors designed for this purpose, for example optical sensors, such as a camera sensor or a laser sensor, and / or a radar sensor and / or an ultrasonic sensor.

[0011] By inputting information on the operating device, operating codes can be learned to execute vehicle functions. This means that a separate operating code can be learned for each vehicle function from one or more inputs that can be performed contactlessly or by touch. An operating code refers to a combination or pattern of inputs that can be freely selected by the user of the operating device. For example, a contactless operating gesture can be performed first, followed by a manual input on the input surface. Once the operating codes have been learned, the computing unit of the operating device can trigger the execution of the assigned vehicle function by entering the learned operating code again.

[0012] The invention offers the advantage of providing multiple options for controlling vehicle functions, allowing each user to select their preferred operating method. Furthermore, individual operating codes can be defined, which can increase customization and, with appropriate selection of the operating codes, also increase convenience.

[0013] The invention also includes embodiments which provide additional advantages.

[0014] One embodiment provides that the input surface is configured to detect a position of the touch input and / or to simultaneously detect multiple touch positions. This means that the position of the touch input on the input surface can be determined, for example, to be able to establish a pattern of input positions. Furthermore, the input surface can be configured to detect multi-touch inputs, i.e., multiple touch positions simultaneously. In particular, it can often be provided that the input surface is also configured to detect a touch pressure as a touch input, especially when a key generated on the input surface is pressed.

[0015] Preferably, the input surface is configured for character input. This means that during touch input, for example, when a finger is swiped across the input surface, adjacent positions can be detected, thus allowing a continuous path that forms, for example, a character to be recognized. This allows individual characters or words to be formed, enabling further customization.

[0016] A further embodiment provides that the input surface for generating the haptically actuatable buttons comprises a touch-sensitive, flexible or elastic film and deformation elements, wherein the deformation elements are designed to deform the film to generate the haptically actuatable buttons by movement using a respective actuator. This means that one or more movably mounted plates or stamps can be arranged below or behind the film (from a user's perspective) as deformation elements, wherein each deformation element can be moved into different extended positions relative to the film by means of an actuator, for example by means of a motor, wherein it touches the film and thus creates or defines a corresponding shape by flexible or elastic deformation of the film, depending on the current initial position of the film.Consequently, individual keys or keypads can be created.

[0017] Another embodiment provides for the gesture recognition device to have a radar sensor. This means that the gesture recognition device can generate an electromagnetic signal to detect contactless operating gestures, which is reflected by the user's hand, allowing the gesture to be detected contactlessly. The electromagnetic waves of the radar sensor can be configured, for example, in the radio frequency range or in the range of light waves, which means that a LIDAR can be used as the radar sensor. Alternatively or additionally, the gesture recognition device can have a camera sensor and / or an ultrasonic sensor to detect the contactless operating gestures.

[0018] A further embodiment provides that the computing device is designed to load the user's learned operating codes after recognizing a user-specific operating code. In other words, the operating device can be learned by several different users, each of whom has their own operating codes for the vehicle functions. In order to load the learned operating codes for a user, it can be provided that the computing device recognizes user-specific operating codes and can thus retrieve a set of learned operating codes for the user. This has the advantage of increasing convenience for the respective users. A further embodiment provides that the operating code comprises a combination of at least one operating input and at least one contactless operating gesture. This means that at least two different modalities can be provided for operating a vehicle function.The order of the modalities can preferably be freely chosen. This has the advantage of minimizing unintentional input errors.

[0019] A further embodiment provides that the operating device further comprises a microphone device configured to detect a voice command as a further operating input. This means that, as an additional modality for generating operating codes, a voice command can be executed, which can be detected by a microphone device of the operating device. This allows the possibilities for operating codes to be expanded, resulting in even better user customization. Particularly preferably, a user's voice can also be recognized by the microphone device, which further improves the provision of the operating codes.

[0020] According to the invention, a motor vehicle with such an operating device is also provided. The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.

[0021] A further aspect of the invention relates to a method for operating a vehicle function using an operating device according to one of the preceding claims, wherein a touch input is detected by an input surface of the operating device and a contactless operating gesture is detected by a gesture recognition device of the operating device, wherein a learned operating code consisting of a combination of the detected touch input and the contactless operating gesture is determined by a computing device of the operating device, and wherein a vehicle function, which is also stored with the learned operating code, is controlled by the computing device. This results in the same advantages and possible variations as with the operating device.

[0022] For use cases or application situations that may arise during the method and which are not explicitly described here, it may be provided that, in accordance with the method, an error message and / or a request to enter user feedback is issued and / or a default setting and / or a predetermined initial state is set.

[0023] The invention also includes the control device for the motor vehicle. The control device can have a data processing device or a processor device that is configured to carry out an embodiment of the method according to the invention. For this purpose, the processor device can have at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). In particular, a CPU (Central Processing Unit), a GPU (Graphical Processing Unit), or an NPU (Neural Processing Unit) can be used as the microprocessor. Furthermore, the processor device can have program code that is configured to carry out the embodiment of the method according to the invention when executed by the processor device. The program code can be stored in a data memory of the processor device.The processor device can be based, for example, on at least one circuit board and / or on at least one SoC (System on Chip).

[0024] The invention also includes developments of the method according to the invention which have features as have already been described in connection with the developments of the operating device according to the invention. For this reason, the corresponding developments of the method according to the invention are not described again here. As a further solution, the invention also comprises a computer-readable storage medium comprising program code which, when executed by a computer or computer network, causes the computer or computer network to carry out an embodiment of the method according to the invention. The storage medium can be provided at least partially as a non-volatile data memory (e.g. as a flash memory and / or as an SSD - solid state drive) and / or at least partially as a volatile data memory (e.g. as a RAM - random access memory). The storage medium can be arranged in the computer or computer network.The storage medium can also be operated, for example, as a so-called app store server and / or cloud server on the Internet. The computer or computer network can provide a processor circuit with, for example, at least one microprocessor. The program code can be provided as binary code and / or as assembly code and / or as source code of a programming language (e.g., C) and / or as a program script (e.g., Python).

[0025] The invention also encompasses combinations of the features of the described embodiments. The invention therefore also encompasses implementations that each comprise a combination of the features of several of the described embodiments, unless the embodiments are described as mutually exclusive.

[0026] Exemplary embodiments of the invention are described below. Shown are:

[0027] Fig. 1 shows an operating device according to an exemplary embodiment;

[0028] Fig. 2 shows the operating device according to a further exemplary embodiment;

[0029] Fig. 3 shows a motor vehicle with an operating device; Fig. 4 shows an exemplary method sequence for operating a vehicle function;

[0030] Fig. 5 shows another exemplary process sequence for operating a vehicle function.

[0031] The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual features of the invention that can be considered independently of one another, each of which also develops the invention independently of one another. Therefore, the disclosure is intended to encompass combinations of the features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.

[0032] In the figures, the same reference symbols designate elements with the same function.

[0033] Fig. 1 shows an operating device 10 for operating a vehicle function of a motor vehicle according to an exemplary embodiment. The operating device 10 can comprise a touch-sensitive input surface 12 on which touch inputs can be detected. The input surface 12 can, for example, have capacitive sensors that can determine the position of touch inputs, preferably from multiple touch positions simultaneously. Furthermore, the input surface 12 can be configured to change shape to create buttons 14 that can be felt haptically. This means that the buttons 14 can form elevations and / or depressions on the input surface 12.For this purpose, the operating device 10 can, for example, comprise deformation elements (not shown) beneath a surface of the input surface 12. The surface of the input surface 12 can, for example, be an elastic or flexible film, which is preferably touch-sensitive, and which can form the buttons 14 by adjusting the deformation elements. The deformation elements can, for example, be designed as stamps, which can adjust their height by means of a respective actuator in order to thus create the buttons 14. Thus, in addition to a pure touch input on the input surface 12, a key actuation can also be detected as a touch input.

[0034] Furthermore, the operating device 10 can have a gesture recognition device 16 designed to detect contactless operating gestures. The gesture recognition device 16 can, for example, be arranged beneath a surface of the input surface 12 in order to detect an area above the input surface 12. The gesture recognition device 16 can preferably be designed as a radar sensor that emits electromagnetic waves and can detect a reflection signal.

[0035] The touch inputs and contactless operating gestures detected by the input surface 12 and the gesture recognition device 16 can be evaluated by a computing device 18 of the operating device 10. The computing device 18 can be a computer that can determine a pattern for an operating code from combinations of the touch inputs on the input surface 12 and / or the haptic actuations of the generated buttons 14 and / or the contactless operating gestures of the gesture recognition device 16, wherein the operating code can be assigned to a vehicle function. This means that it is possible to learn which vehicle function should be executed with which operating code. For example, an operating code can be learned for a respective vehicle function that executes the vehicle function when the combination is performed again.Preferably, this can be performed individually for each user of the operating device 10, wherein the computing device 18 can load a set of learned operating codes for a user after a user-specific operating code has been recognized. Optionally, the operating device 10 can also include a microphone device 20 configured to detect voice commands, wherein the voice commands can be used as further input for generating operating codes.

[0036] In Fig. 2, the operating device 10 is shown in a state in which no buttons 14 are formed, but rather the input surface 12 forms a substantially planar surface. "Substantially" in this context means that no buttons 14 are tactile and / or visible on the input surface 12.

[0037] The planar input surface can be used, for example, to enter characters and recognize them as touch inputs. Furthermore, the position of a touch and / or a pressure touch can be detected. For touch-sensitive detection of touch inputs, the input surface 12 can be equipped, for example, with a capacitive, piezoelectric, and / or resistive sensor.

[0038] Fig. 3 shows a motor vehicle 22 with an operating device 10. The operating device 10 can, for example, be arranged in a center console of a motor vehicle 22 to enable improved access for a driver of the motor vehicle 22. However, other positions for arranging the operating device 10 in the motor vehicle 22 are also possible. For example, the operating device 10 can also be arranged on a dashboard and / or a door of the motor vehicle 22. Furthermore, the positioning of the operating device can not be limited to a driver of the motor vehicle 22, but can be provided for every passenger.

[0039] Fig. 4 shows exemplary operating codes for operating a vehicle function. One or more touch inputs and / or contactless operating gestures can be performed consecutively to learn an operating code for a vehicle function and / or to execute a vehicle function by repeating the operating code.

[0040] For example, the engine of motor vehicle 22 can be started using an operating code. A driver can learn an operating code for starting the engine, for example, by repeating a specific sequence three times. This can preferably consist of at least two modalities, meaning that at least one touch input and at least one contactless operating gesture can be performed. In this example, in a step S10, the user can flick the screen in a predetermined area above input surface 12 as a contactless operating gesture 24, so that gesture recognition device 16 recognizes the operating gesture 24. Subsequently, in a step S12, a button 14 can be pressed by a user as a touch input 26. After the learned sequence of this operating code, computing device 18 can, for example, control motor vehicle 22 to start the engine.

[0041] Fig. 5 shows another exemplary sequence for entering an operating code. In step S14, a V, for example, can be shown as a contactless operating gesture 24 within a detection area of ​​the gesture recognition device 16. Subsequently, a V can be drawn on the input surface 12 as a touch input 26 in order to assign the vehicle function to the operating code.

[0042] Any sequence and / or any number of inputs can be performed to generate the operating codes. It is also possible, for example, to define the same function for different users, such as starting the engine, but with differently learned operating codes. After recognizing a user-specific operating code, the computing device 18 can recognize the user, thereby making it possible to differentiate between users in addition to linking a function to the operating code. Consequently, the multimodal operating device 10, which is equipped with a radar sensor 16, morphing haptic buttons 14, and an integrated trackpad 12, which is multi-touch capable and can recognize written input, can provide the option of creating individual operating codes by combining the elements and of accessing specific vehicle functions using these operating codes.

[0043] Overall, the examples show how an operating device 10 for operating a vehicle function of a motor vehicle, a motor vehicle with an operating device and a method for operating a vehicle function can be provided.

Claims

PATENT CLAIMS: 1 Operating device (10) for operating a vehicle function of a motor vehicle (22), comprising a touch-sensitive, shape-changing input surface (12), a gesture recognition device (16), and a computing device (18), wherein the touch-sensitive, shape-changing input surface (12) is designed to detect touch inputs on the input surface (12) and to generate haptically actuatable buttons (14), wherein the gesture recognition device (16) is designed to detect contactless operating gestures, and wherein the computing device (18) is designed to learn operating codes from the touch inputs on the input surface (12) and / or the haptic actuations of the generated buttons (14) and / or the contactless operating gestures for vehicle functions and to carry out the associated vehicle function upon detection of such a learned operating code. 2 Operating device (10) according to claim 1, wherein the input surface (12) is designed to detect a position of the touch input and / or to simultaneously detect a plurality of touch positions. 3 Operating device (10) according to one of the preceding claims, wherein the input surface (12) is designed for character input. 4 Operating device (10) according to one of the preceding claims, wherein the input surface for generating the haptically actuatable buttons (14) has a touch-sensitive, flexible or elastic film and deformation elements, wherein the deformation elements are designed to deform the film for generating the haptically actuatable buttons by movement by means of a respective actuator. 5 Operating device (10) according to one of the preceding claims, wherein the gesture recognition device (16) comprises a radar sensor. 6 Operating device (10) according to one of the preceding claims, wherein the computing device (18) is designed to load learned operating codes of the user after recognizing a user-specific operating code. 7 Operating device (10) according to one of the preceding claims, wherein the operating code comprises a combination of at least one touch input and at least one contactless operating gesture. 8 Operating device (10) according to one of the preceding claims, wherein the operating device (10) further comprises a microphone device (20) which is designed to determine a voice command as a further operating input. 9 Motor vehicle (22) with an operating device (10) according to one of the preceding claims.

10. A method for operating a vehicle function with an operating device (10) according to one of the preceding claims, wherein a touch input is detected by an input surface (12) of the operating device (10) and a contactless operating gesture is detected by a gesture recognition device (16) of the operating device (10), wherein a learned operating code consisting of a combination of the detected touch input and the contactless operating gesture is determined by a computing device (18) of the operating device (10), and wherein a vehicle function that is stored for the learned operating code is controlled by the computing device (18).

Images