Vehicle, user interface and method for interacting with a steering wheel of a vehicle

Abstract

The invention proposes a vehicle (10), a user interface and a method for interacting with a steering wheel (17) of a vehicle (10). The method comprises the following steps: detecting (500) a first gesture (1) of a user (5) by means of a touch-sensitive surface (6, 7) of a steering wheel (17) of the vehicle (10); creating a first reference for the first gesture (1) by means of the data of the surfaces (6, 7); detecting a second gesture (2) of the user (5) by means of a touch-sensitive surface (6, 7) of a steering wheel (17) of the vehicle (10); creating a second reference for the second gesture (2) by means of the data of the surfaces (6, 7); a sufficient similarity of the first reference and the second reference is determined, a model (8) within which the first gesture (1) and the second gesture (2) are at least partially located is predefined in response, and a function of the vehicle (10) is triggered by a third gesture (3) if the third gesture (3) conforms to the model (8).

Description

Field of the Invention

[0001] The present invention relates to a vehicle, a user interface, and a method for interacting with the steering wheel of a vehicle. In particular, the present invention relates to a more flexible user interface design for use by a user across time and across vehicles. Background Art

[0002] Modern vehicles have a large number of functions that passengers can access at will. In addition to voice operation and touchscreens, in particular gesture-based user input has proven suitable as a user interface, which is collected, for example, by a capacitive sensing device. However, the user interfaces known in the prior art have a series of disadvantages: on the one hand, there is a problem of false triggering because different users perform gestures in different ways. In other words, for example, the orientation of a first swipe gesture in the case of a first user is sometimes significantly different from that of a second swipe gesture of a second user. In addition, a specific gesture may have a completely different meaning for a first customer than for a second customer. In other words, for a second customer, performing a certain swipe gesture to change the view is not intuitive enough, and he would prefer to cause a view change by an alternative (swipe) gesture. In addition, physical limitations may also prevent a user from performing a specific gesture or only allow limited performance. For example, stiff joints may prevent a user from spreading their fingers / thumb arbitrarily.

[0003] In addition, car-sharing and rental models continue to be popular among customers / users. However, frequent vehicle changes sometimes require re-adapting new vehicles to the preferences of the user in the prior art. Summary of the Invention

[0004] The object of the present invention is to alleviate or eliminate the disadvantages identified above in connection with the prior art.

[0005] According to the present invention, the above task is solved by a method for interacting with the steering wheel of a vehicle. The vehicle can be configured as a passenger car, a transporter, a truck, a motorcycle, an air vehicle, and / or a water vehicle. The interaction can be performed by a user inside the vehicle, and thus the user can also be referred to as a passenger, a driver, a co-driver, or a rear passenger. In a first step, a first gesture of the user is detected by means of a touch-sensitive surface of the vehicle's steering wheel. In other words, the gesture is (automatically) analyzed by a sensor or by sensor technology and further transmitted in a data technology form. Subsequently, a first reference is created for the first gesture by means of the data of the surface. The touch-sensitive surface can be understood as a digitizer or a touch-sensitive input surface. In other words, the data technology representation of the (first) gesture actually performed by the user is acquired. The resulting first reference can, for example, represent the time course of the touch points between the user's fingers and the touch-sensitive surface. In a further step, a second gesture of the user is also detected by means of the (same) touch-sensitive surface of the vehicle's steering wheel. The second (swiping) gesture preferably corresponds to the first gesture in terms of its basic characteristics and its position on the touch-sensitive surface. To ensure sufficient similarity, the user interface can output a corresponding indication to the user, by means of which the user is requested to repeat the first gesture with a second gesture that is slightly changed but matches the same function call in terms of its basic characteristics. After the input is completed, a second reference is automatically created for the second gesture by means of the data of the touch-sensitive surface. Thus, the actual trajectory or time course of the touch points between the user's body and the touch-sensitive surface is represented in a data technology form by the first and second references. Subsequently, a sufficient similarity or consistency between the first gesture and the second gesture is determined. Here, the gaps and / or differences and / or spatial offsets of the two gestures or corresponding components to each other can be evaluated to determine the degree to which the nature of the first gesture matches the nature of the second gesture, or the degree to which the first gesture performed by the user should be similar or consistent with the second gesture. Other optional checking steps are discussed below. In response to the determination of sufficient similarity, a predefined model is subsequently defined, in which the first gesture and the second gesture are at least partially located. This step can be understood as determining a boundary region or a "channel" for the first and second gestures, such that the created model fully encloses the first gesture and the second gesture in a sufficiently consistent manner at least in the middle (main) section or the core region of the gesture, or forms a kind of "union", the boundary region of which is defined by the planar extension or time course of the first and second gestures, and the first gesture and the second gesture are located within this boundary region. By means of this model or the intermediate spatial region proposed above, the first gesture and the second gesture can be separated from other gestures, and these other gestures can thus be defined for other function calls. Therefore, the model can also be understood as a virtual tube or a virtual band (possibly "blurring" over time), the area of which can be defined by the first gesture and the second gesture or can at least be affected by them.In particular, the position between the corresponding points of the first gesture and the second gesture can also be determined to belong to the model, while the area that reaches a predefined degree outside the path between the corresponding points of the first gesture and the second gesture no longer belongs to the model. Subsequently, the function of the vehicle is triggered by a third gesture that conforms to the model or maintains a sufficient gap from the model. The user himself can determine at an earlier time point which function to associate with the model determined as described above. This can be done before performing the first and second gestures, or after performing the first and second gestures, or after reassigning a (new) function of the vehicle to a gesture that has been previously defined and, if possible, already assigned to other functions of the vehicle. In this way, the user can define his preferred first / second gesture or the design of the model himself, and then use it to trigger the function that matches his preferred gesture. Therefore, the physical limitations have less impact on the gesture operation of the vehicle, the learning and adaptation process can be significantly more intuitive, and the definable gestures are more comfortable for individual users. Therefore, the user acceptance can be improved, and the misoperation or misrecognition can be significantly reduced.

[0006] The dependent claims indicate preferred improvements of the method according to the invention.

[0007] Preferably, other learning steps can be performed to improve the model. This can be done during the initial learning process in such a way that the user performs not only two gestures, but three, four, five or additional gestures to determine the model. The user can be a customer who has just purchased a vehicle and now wants to personalize it. However, the user can also be a customer of a fleet / car sharing pool who takes over the vehicle only for borrowing and use. However, the model formation can also be performed during use or after a predefined event occurs and / or after a predefined time period has elapsed since the execution of the first gesture or the second gesture. Here, a fourth gesture is detected by means of the sensors of the vehicle, and a fourth reference for the fourth gesture is recorded or analyzed by means of the sensor data. These steps clearly correspond to those described above in connection with the first gesture and the second gesture, so that, in order to avoid repetition, reference is made to the above description. Now, the model can be updated according to the data of the fourth gesture or the fourth reference, and if possible, it can be specified or generalized.

[0008] All steps in this disclosure that are not explicitly assigned to human behavior or perception can be understood as being performed automatically and / or by sensor technology. They can be performed by or with the aid of an evaluation unit (electronic controller, ECU) and / or by the vehicle or its on-board electronics.

[0009] In a corresponding manner, other types of gestures can also be predefined for triggering additional (second) functions, so as to facilitate user access to the second function in a manner according to the present invention. The corresponding situation applies to the third function, the fourth function, and all other functions, which are known from the prior art to be reasonably analyzable through / by means of the touch-sensitive surface of the steering wheel.

[0010] If the first gesture and the second gesture have a sufficiently appropriate similarity, the vehicle or the user interface can output corresponding feedback to the user: the input is okay. If it is found that the first gesture and the second gesture do not have an appropriate similarity to each other, corresponding negative feedback can be output to the user, and if possible, one or both of the gestures are required to be performed again. This can have an output in text form, graphical nature, or sound nature. Therefore, it is possible to prevent the collected gestures from being too similar to each other, and thus prevent future models from recognizing too few gestures correctly performed by the user, and on the other hand, prevent overly "broad" models from assigning too many different gestures to the same function or too few other gestures with a sufficient gap from the current gesture.

[0011] The touch-sensitive surface can be arranged, for example, on the steering wheel, such that when the user comfortably / ergonomically holds the steering wheel at the three o'clock position and the nine o'clock position, they only need to slightly place their thumb in an unnatural position to manipulate the touch-sensitive surface for gesture input. In this way, the force consumption is reduced, and operational ergonomics are obtained.

[0012] The configuration of gesture input as described in detail above can be started in response to the recognition of a predefined user input. For example, the user can select a menu item in the user menu or make a predefined voice input for this purpose. It is also possible to recognize a predefined driving situation or operating situation, and in response thereto, start the configuration mode. For example, it can be recognized that the user has reached a disappointment threshold by the user making multiple user inputs, and in response thereto, the function desired by the user is significantly triggered. This situation can be determined by means of multiple repeated operation steps and / or by means of the user's rejection comments / noise / voice announcements. In response thereto, it is thus proposed according to the present invention to perform the first and / or second gesture of its own, so as to improve user ergonomics from then on.

[0013] A possible scenario for initializing the method steps according to the present invention can be realized, for example, in response to a predefined driving situation and / or operating situation. For example, it can be determined that the user is sitting in the vehicle for the first time. This can be achieved digitally or based on face recognition / voice recognition, etc. In principle, it can also be recognized that this is the first user after the transfer of the vehicle, and therefore this user may have a need to enjoy the operational ergonomics provided according to the present invention. In response thereto, a configuration mode for detecting the first (and second) gesture can be automatically provided.

[0014] The touch-sensitive surface may in particular have a substantially planar structure. In other words, the surface is smooth or slightly rough, but does not have a structure that can be understood as a tab or other internal boundary part. In this way, the functions of the touch-sensitive surface can be substantially assigned only by software. With the help of software, it is also possible to respond to subsequently developed user operation concepts without the need for a new input matrix (digitizer) or the addition of operating buttons, wheels, regulators, etc. that do not have to be implemented in hardware. The touch-sensitive surface is in particular placed in the area of the steering wheel between the buffer and the steering wheel rim. In particular, the touch-sensitive surface can be arranged at the height of the nine o'clock position and / or at the height of the three o'clock position. In this way, when the steering wheel is held by the user in the traditional way, particularly ergonomic operation can be achieved with the help of the thumb.

[0015] Since the above steps for developing the model may take some time and the model can be consolidated / verified / modified through a large number of operation steps, this knowledge is thus associated with a significant added value for the user, which is unfortunately lost according to the prior art after changing the means of transportation. Therefore, it is preferably proposed to represent the model by a data set (file, etc.) and send it, for example, by wireless and / or via Internet transmission to a second means of transportation, in which the model can also be used. This only requires that the new means of transportation has a corresponding touch-sensitive surface in the steering wheel and is able to import the data set representing the model. Now, all the efforts that the user has made until now to improve ergonomics can be enjoyed in the new means of transportation. Here, it does not matter whether the model is transplanted or copied into the new means of transportation. In particular, in the case where the user is equipped with different means of transportation (for example, a private fleet or a commercial fleet / car sharing pool), it is also possible to ensure that the model always remains new in all the means of transportation assigned to the user and to update all the means of transportation with the always up-to-date model after the optimization step. The model can be stored in a central database of the vehicle manufacturer, fleet manager, etc. Associating the means of transportation assigned to the user with its reserved ID (account) in the (fixed) database is now sufficient to also automatically assign the latest model for gesture control to this means of transportation at all times. Alternatively or additionally, if possible, in addition to the models assigned to other users of the means of transportation, the model can also be locally reserved in the means of transportation.

[0016] Although gestures are always described as swipe gestures within the scope of the above disclosure, alternatively or in addition, gestures can also be performed as rotational gestures (circular orbits achieved with one or more fingers) and / or two-dimensional gestures and / or static gestures (long-press gestures) and / or finger spreading gestures or finger closing gestures. In other words, all gestures that can be reasonably parsed using a touch-sensitive surface according to the prior art can also be learned and stored as a model in the manner according to the present invention.

[0017] Functions that can be accessed by the user by means of the method according to the invention can be associated, for example, with scrolling and / or view transformation functions. Other possibilities are volume change functions, title jump functions, transmitter switching functions, window lifter / skylight / sliding or panoramic sunroof and roof roller blind operation functions. In addition, the interior lighting intensity, interior lighting color, ambient light pattern and color, external signal emission function, seat comfort settings, and answer / reject call functions can all be operated by means of a learnable model according to the invention.

[0018] According to a second aspect of the invention, there is provided a user interface for a vehicle, the user interface having a data input end, an evaluation unit, and a data output end. The evaluation unit is arranged to detect a first gesture of a user by means of a touch-sensitive surface of the vehicle's steering wheel via the data input end. The detected gesture is mapped via a first reference mapping, and a second gesture is likewise mapped into a second reference. By means of these two references - assuming sufficient similarity or consistency - a data model is created, which can be stored via the data output end. The first reference and the second reference are at least partially within the model and themselves satisfy the model. In addition, if a third gesture that sufficiently conforms to the model is determined via the data input end, a predefined function can be triggered via the data output end. In this way, the user interface according to the invention is arranged to significantly implement the said features, feature combinations, and the advantages resulting therefrom in a corresponding manner. For the sake of avoiding repetition, reference is made to the above-described content.

[0019] According to a third aspect of the invention, there is provided a vehicle having the user interface according to the second aspect of the invention as mentioned. In other words, the vehicle has a steering wheel with a touch-sensitive surface, and the vehicle can perform the steps of the method according to the invention via this steering wheel. In this regard, reference is also made to the features, feature combinations, and advantages of the above aspects. Description of the Drawings

[0020] Other details, features, and advantages of the invention result from the following description and the drawings. Among them:

[0021] Figure 1 A detailed view of an embodiment of the user interface according to the invention of an embodiment of a vehicle according to the invention when performing the method according to the invention is shown;

[0022] Figure 2 An overview diagram showing the transplantation of a model created according to the invention from one vehicle to another vehicle is shown;

[0023] Figure 3 A flowchart illustrating the steps of an embodiment of the method according to the invention for interacting with the steering wheel of a vehicle is shown. Detailed Description

[0024] Figure 1 Shows a steering wheel 17, which has a steering wheel rim 18 and a buffer 19. The user 5 holds the steering wheel at the three o'clock and nine o'clock positions to control the vehicle 10. Between the steering wheel rim 18 and the buffer 19, touch-sensitive surfaces 6, 7 according to the invention are provided on both sides. The touch-sensitive surfaces are connected in terms of information technology to the data input terminal 13 of an electronic controller serving as an evaluation unit 12. The evaluation unit 12 can store, via the data output terminal 14, sufficiently similar gestures 1, 2 performed by the user 5 as a model 8. The model 8 can be understood here as a band or tube, and the gestures 1, 2, as the first gesture and the second gesture, can be adapted to the band or tube. The fourth gesture 9 is so different from the first gesture 1 and the second gesture 2 that it cannot be adapted into the model 8. If the fourth gesture 9 should be executed within the scope of the configuration mode for creating the model 8, a repetition is automatically requested or a feedback is output to the user: the gesture 9 is not similar enough to the first and second gestures 1, 2. Instead, the fourth gesture 9 can be assigned to a configuration mode for triggering an alternative function. For this purpose, an alternative model (not shown) is created in a corresponding manner. In the user mode, the gesture 9 is not assigned to the model 8 and the function associated therewith. This function is not triggered. Only in the case where a model associated with the fourth gesture 9 is stored, the function associated with this model is triggered by the fourth gesture 9.

[0025] Figure 2 Shows two vehicles 10, 11, which have respective steering wheels 17 with touch-sensitive surfaces (not shown), as introduced in connection with Figure 1 the figure with the reference numeral 8). After the model ( Figure 1 in the figure with the reference numeral 8) is successfully defined, a wireless message 20 is sent from the first vehicle 10 to the second vehicle 11. The second vehicle 11 is set via the wireless message to recognize user gestures according to the same model. If possible, the model further formed in the second vehicle 11 can be provided to the first vehicle 10 or other (not shown) vehicles in a corresponding manner.

[0026] Figure 3Shows the steps of an embodiment of the method according to the present invention. In step 100, a predefined driving situation is recognized, which allows for the safety configuration of the user interface according to the present invention. For example, this can be a first driving situation that occurs after the configuration requirement of the user interface and allows for the non-recognition of safety concerns regarding user distraction. For example, the vehicle may be in a parked state. Therefore, in step 200, a configuration mode for detecting a first gesture for creating a model is automatically provided. Subsequently, in step 300, a predefined user input is recognized and, in response thereto, the configuration mode for detecting the first gesture is initiated in step 400. In step 500, the first gesture of the user is now detected by means of the touch-sensitive surface of the vehicle's steering wheel, and in step 600, a first reference representing the first gesture is created by means of the data of the touch-sensitive surface. In step 700, the second gesture of the user is detected in a corresponding manner by means of the touch-sensitive surface of the vehicle's steering wheel, and in step 800, a reference associated with the second gesture is created and stored. In step 900, the sufficient similarity between the first reference and the second reference is now determined, and in response thereto, a model is predefined in step 1000, in which the first gesture and the second gesture are at least partially located. In other words, an applicability set is defined based on the first reference and the second reference, and this applicability set determines whether a corresponding gesture conforms to the model for the purpose of recognizing other gestures in the user mode. Then, in step 1100, if a third gesture conforms to the model, a function of the vehicle is triggered by means of the third gesture. Otherwise, an error message is output if possible, or - if the third gesture conforms to an alternative model - a function associated with the alternative model is triggered. In step 1200, the determined model is transmitted in data form to another vehicle, which is also configured to execute the method according to the present invention. In step 1300, this data set is also used for recognizing a third gesture in another vehicle.

[0027] Therefore, the interaction of the user with one or more vehicles can always be designed to be new and comfortable even after a relatively long usage time.

[0028] List of reference numerals

[0029] 1 First gesture

[0030] 2 Second gesture

[0031] 5 User

[0032] 6, 7 Touch-sensitive surface

[0033] 8 Model

[0034] 9 Fourth gesture

[0035] 10, 11 Vehicle

[0036] 12 Evaluation Unit

[0037] 13 Data Input Terminal

[0038] 14 Data Output Terminal

[0039] 17 Steering Wheel

[0040] 18 Steering Wheel Rim

[0041] 19 Buffer

[0042] 20 Wireless Message

[0043] 100 to 1300 Method Steps

Claims

1. A method for interacting with a steering wheel (17) of a vehicle (10), the method comprising the steps of: - detecting (500) a first gesture (1) of a user (5) by means of a touch-sensitive surface (6, 7) of the steering wheel (17) of the vehicle (10), - creating (600) a first reference for the first gesture (1) by means of data of the surface (6, 7), - detecting (700) a second gesture (2) of the user (5) by means of a touch-sensitive surface (6, 7) of the steering wheel (17) of the vehicle (10), - creating (800) a second reference for the second gesture (2) by means of data of the surface (6, 7), - determining (900) a sufficient similarity between the first reference and the second reference, and in response thereto - predefining (1000) a model (8) in which the first gesture (1) and the second gesture (2) are at least partially located, and - triggering (1100) a function of the vehicle (10) by means of a third gesture (3) if the third gesture (3) conforms to the model (8).

2. The method according to claim 1, the method further comprising automatically outputting the following feedback to the user: the first gesture (1) and the second gesture (2) - have a suitable similarity, or - do not have a suitable similarity.

3. The method according to claim 1 or 2, wherein The touch-sensitive surface (6, 7) is provided in a region adjacent to the steering wheel rim (18) on a buffer (19).

4. The method according to any one of the preceding claims, the method further comprising: Identifying (300) a predefined user input, and in response thereto starting (400) a configuration mode for detecting the first gesture (1).

5. The method according to any one of the preceding claims, the method further comprising: Identifying (100) a predefined driving situation and / or operating situation and / or vehicle situation, and in response thereto automatically providing (200) a configuration mode for detecting the first gesture (1).

6. The method according to any one of the preceding claims, wherein, The touch-sensitive surface has a substantially planar structure, and / or the touch-sensitive surface is provided in a region of the steering wheel (17) located between the buffer and the steering wheel rim (18).

7. The method according to any one of the preceding claims, the method further comprising: - transmitting (1200) a data set representing the model to another vehicle (11), the other vehicle having a corresponding touch-sensitive surface on the steering wheel (17), and - using (1300) the data set in the other vehicle (10) for identifying a third gesture.

8. The method according to any one of the preceding claims, wherein, The first gesture (1), the second gesture (2), the third gesture and the fourth gesture (9) include: - a swipe gesture, and / or - a rotation gesture, and / or- a two-dimensional gesture, and / or- a long-press gesture, and / or- a finger spreading gesture. The functions include: - a volume change function, and / or- a "title jump" function, and / or- a launch pad switching function, and / or- a scrolling function, and / or- a window lifter function, and / or- a sunroof function, and / or- a sliding or panoramic sunroof function, and / or- a roof blind function,- an interior lighting function,- an external signal emission function,- a seat comfort function,- an answer or reject call function.

10. A user interface for a vehicle (10), the user interface comprising:

9. The method according to any one of the preceding claims, wherein, ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ - A data input terminal (13), - An evaluation unit (12), and - A data output terminal (14), wherein the evaluation unit (12) is configured to - Detect a first gesture (1) of a user (5) by means of a touch-sensitive surface of a steering wheel (17) of a vehicle (10), - Create a first reference for the first gesture (1) by means of data of the touch-sensitive surface, - Detect a second gesture (2) of the user (5) by means of touch-sensitive surfaces (6, 7) of the vehicle (10), - Create a second reference for the second gesture (2) by means of data of the touch-sensitive surface, - Determine a sufficient similarity between the first reference and the second reference, and in response thereto - Create a model (8) by means of the data output terminal (14), with the first gesture (1) and the second gesture (2) at least partially within the model, and - If a third gesture conforms to the model (8), trigger a predefined function by means of the data output terminal (14).

11. The user interface according to claim 10, wherein the user interface is configured to perform the method according to any one of the preceding claims 1 to 9.

12. A vehicle comprising the user interface according to the preceding claim 10 or 11.

Images