Means of transportation, user interface, and method for interacting with a steering wheel of a means of transportation

Abstract

The invention relates to a means of transportation (10), to a user interface, and to a method for interacting with a steering wheel (17) of a means of transportation (10). The method has the steps of: detecting (500) a first gesture (1) of a user (5) by means of a touch-sensitive surface (6, 7) of the steering wheel (17) of the means of transportation (10); generating a first reference for the first gesture (1) using data of the surface (6, 7); detecting a second gesture (2) of the user (5) by means of the touch-sensitive surface (6, 7) of the steering wheel (17) of the means of transportation (10); generating a second reference for the second gesture (2) using data of the surface (6, 7); ascertaining a sufficient relatedness between the first reference and the second reference; in response thereto, pre-defining a model (8) within which the first gesture (1) and the second gesture (2) at least partly lie; and triggering a function of the means of transportation (10) by means of a third gesture (3) if the third gesture (3) corresponds to the model (8).

Description

[0001] Means of transport, user interface and method for interacting with a steering wheel of a means of transport

[0002] Description

[0003] The present invention relates to a means of transportation, a user interface, and a method for interacting with a steering wheel of a means of transportation. In particular, the present invention relates to a more flexible design of user interfaces for use by a user across time and means of transportation.

[0004] Modern means of transportation feature a multitude of functions that passengers can access at will. In addition to voice control and touchscreens, gesture-based user inputs, such as those recorded by capacitive sensors, have proven particularly effective as user interfaces. However, the user interfaces known from the prior art have a number of disadvantages: Firstly, there is the problem of false triggers, as different users perform gestures in different ways. In other words, the orientation of a first swipe gesture by a first user may be significantly different from a second swipe gesture by a second user. Furthermore, a specific gesture may have a completely different connotation for a first customer than for a second customer.In other words, a second customer might find performing a swipe gesture to change views insufficiently intuitive and would prefer to change views using an alternative (swipe) gesture. Furthermore, physical limitations can also prevent a user from performing certain gestures, or only to a limited extent. For example, stiff joints can prevent a user from freely spreading their fingers or thumb.

[0005] Furthermore, car-sharing and leasing models remain unbrokenly popular with customers and users. However, given the current state of technology, frequent vehicle changes sometimes require the new means of transportation to be adapted to the user's preferences.

[0006] It is an object of the present invention to alleviate or eliminate the disadvantages identified above in connection with the prior art.

[0007] The above-mentioned object is achieved according to the invention by a method for interacting with a steering wheel of a means of transport. The means of transport can be configured as a car, van, truck, motorcycle, aircraft, and / or watercraft. The interaction can be carried out by a user within the means of transport, who could therefore also be referred to as an occupant, driver, front passenger, or rear passenger. In a first step, a first gesture of a user is detected by a touch-sensitive surface of the steering wheel of the means of transport. In other words, the gesture is (automatically) resolved by sensors or sensor technology and forwarded in data format.

[0008] Subsequently, a first reference for the first gesture is created using data from the surface. The touch-sensitive surface can be understood as a digitizer or touch-sensitive input surface. In other words, a data representation of the (first) gesture actually performed by the user is recorded. The resulting first reference can, for example, represent a time course of a contact point between a user's finger and the touch-sensitive surface. In a further step, a second gesture by the user is also recorded using the (same) touch-sensitive surface of the steering wheel of the vehicle. The second (swipe) gesture preferably corresponds to the first gesture in its basic features and its position on the touch-sensitive surface.To ensure sufficient similarity, the user interface can issue a corresponding instruction to the user, asking them to repeat the first gesture with a slightly modified second gesture that is essentially assigned to an identical function call. After the input has been made, a second reference for the second gesture is automatically created using the data from the touch-sensitive surface. Thus, actual trajectories or time courses of contact points between the user's tissue and the touch-sensitive surface are data-technically represented by the first and second references. Subsequently, a sufficient relationship or identity between the first gesture and the second gesture is determined. This can include a distance and / or a differentiation and / or a spatial offset between the two gestures or corresponding components thereof, etc.to assess the extent to which the nature of the first gesture corresponds to the nature of the second gesture, or whether the first gesture should be performed by the user in a similar or identical manner to the second gesture. Further optional test steps will be discussed later. In response to determining sufficient relatedness, a model is then predefined, within which the first gesture and second gesture lie, at least partially. This step could be understood as determining a boundary area or a “corridor” for the first and second gesture in such a way that the created model sufficiently identically envelops the first gesture and the second gesture, at least in a middle (main) section or core area of ​​the gesture, or forms a type of “union set” which is defined by the planar extension orthe temporal course of the first and second gesture defines a boundary area within which the first gesture and the second gesture are located. The model or the central spatial area suggested above can be used to delimit the first gesture and the second gesture from other gestures, which can thus be defined for other function calls. The model could therefore also be understood as a virtual tube or virtual band (possibly "smeared" over time), the area of ​​which can be defined or at least influenced by the first gesture and the second gesture. In particular, positions lying between corresponding points of the first gesture and the second gesture can also be determined as belonging to the model, while areas lying a predefined amount outside the distance between corresponding points of the first gesture and the second gesture are no longer belonging to the model.Subsequently, a third gesture, which corresponds to the model or maintains a sufficient distance from the model, triggers a function of the means of transport. The user himself may have previously determined which function he wishes to associate with the model determined as above. This can occur before executing the first and second gestures, after executing the first and second gestures, or by reassigning the (new) function of the means of transport to the previously defined gesture, which may have been assigned a different function of the means of transport. In this way, the user can independently define a design of the first / second gesture or the model that he prefers and then use it to trigger a function he has assigned to the desired gesture.This makes physical limitations less relevant for gesture control of a means of transportation, makes the learning and familiarization process significantly more intuitive, and makes the definable gestures more comfortable for the individual user. This increases user acceptance and significantly reduces operating errors and misrecognitions.

[0009] The subclaims show preferred developments of the method according to the invention.

[0010] Preferably, further training steps can be carried out to improve the model. This can be done in an initial training process, whereby the user performs not just two gestures, but three, four, five or more gestures to determine the model. The user can be a customer who has (just) purchased the means of transport and now wishes to personalize it. However, they can also be a customer of a vehicle fleet / car sharing pool who is only borrowing the means of transport for use. However, the model can also be created during use or after the occurrence of a predefined event and / or after a predefined period of time has elapsed since the first gesture or the second gesture was performed. In this case, a fourth gesture is detected using a sensor of the means of transport, and a fourth reference for the fourth gesture is recorded or resolved using the sensor data.These steps correspond so clearly to those described above in connection with the first gesture and the second gesture that, to avoid repetition, reference is made to the above explanations. Now, based on the data from the fourth gesture or the fourth reference, the model can be updated, possibly refined, or generalized.

[0011] All steps in the present disclosure that are not explicitly associated with a human action or perception can be understood as being carried out automatically and / or using sensors. They can be carried out by or with the aid of an evaluation unit (electronic control unit, ECU) and / or by a means of transport or its on-board electronics.

[0012] In a corresponding manner, other types of gestures can also be predefined for triggering a further (second) function in order to facilitate the user's access to the second function in accordance with the invention. The same applies to third functions, fourth functions, and all other functions known in the prior art to be usefully triggered by means of the touch-sensitive surface of the steering wheel.

[0013] If the first gesture and the second gesture are sufficiently related, the means of transport or the user interface can provide the user with appropriate feedback that the input was correct. If it turns out that the first gesture and the second gesture are not sufficiently related, the user can be given appropriate negative feedback and, if necessary, be asked to perform one or both of the gestures again. This can be output in text form, graphically, or acoustically. This can prevent the recorded gestures from being too similar to one another, which would result in a future model recognizing too few correctly executed gestures from the user. On the other hand, it can be prevented that a model that is too "broad" assigns too many different gestures to one and the same function.too few other gestures are sufficiently far away from the current gesture.

[0014] For example, the touch-sensitive surface can be positioned on the steering wheel in such a way that, with a comfortable / ergonomic grip at the three and nine o'clock positions, the user only needs to slightly move their thumb into an unnatural position to manipulate the touch-sensitive surface for gesture input. This reduces the amount of force required and improves operating ergonomics.

[0015] The configuration of gesture input, as described in detail above, can be initiated in response to the detection of a predefined user input. For example, the user can select a menu item in a user menu or make a predefined voice input. A predefined driving or operating situation can also be recognized, in response to which the configuration mode is started. For example, it can be detected that the user has reached a frustration threshold by repeatedly making a user input, in response to which the desired function was obviously triggered. Such a situation can be determined based on repeatedly repeated operating steps and / or based on disapproving comments / sounds / verbal messages from the user.In response to this, the invention can therefore propose to perform a separate first and / or second gesture in order to improve user ergonomics from now on.

[0016] One possible scenario for initializing the method steps according to the invention can occur, for example, in response to a predefined driving and / or operating situation. For example, it can be determined that the user is sitting in the vehicle for the first time. This can be done digitally or using facial recognition / voice recognition or similar. In principle, it can also be recognized that this is the first user since the vehicle was handed over and that they may therefore have a need to enjoy the operating ergonomics provided by the invention. In response to this, the configuration mode for detecting the first (and second) gesture can be automatically offered.

[0017] The touch-sensitive surface can, in particular, essentially have a flat structure. In other words, the surface is smooth or slightly roughened, but does not have any structures that can be understood as ridges or other internal demarcations. In this way, the touch-sensitive surface can essentially be assigned functions using software alone. Software can also be used to respond to later developed user operating concepts without the need for a new input matrix (digitizer) or the need to retrofit hardware control buttons, wheels, controllers, etc. The touch-sensitive surface is, in particular, located in the area of ​​the steering wheel between a baffle and a steering wheel rim. In particular, the touch-sensitive surface can be arranged at the nine o'clock position and / or at the three o'clock position.This results in particularly ergonomic handling using the thumb when the user grips the steering wheel in the conventional way.

[0018] Since the aforementioned steps for developing the model can take a certain amount of time, and the model can be consolidated / verified / corrected through numerous operating steps, the findings provide significant added value for the user and, according to the state of the art, are sorely missed after a vehicle change. Therefore, it is preferably proposed to represent the model using a data set (a file or similar) and to send it, for example, wirelessly and / or via internet-mediated transmission to a second means of transport in which it can also be used. This only requires that the new means of transport has a corresponding touch-sensitive surface in the steering wheel and is capable of importing the model representing the data set. All the efforts previously made by the user to improve ergonomics can now be enjoyed in the new means of transport.It is irrelevant whether the model is ported or copied to the new means of transport. Particularly in the case where different means of transport are assigned to the user (e.g., private fleet or commercial vehicle fleet / car sharing pool), the model can be kept up-to-date for all means of transport assigned to the user and, after optimization steps, updated with the most recent model for all means of transport. The model can be stored in a central database of a vehicle manufacturer, a fleet manager, or similar. Linking a vehicle assigned to the user with its ID (account) stored in a (stationary) database is now sufficient to automatically assign the latest model for gesture control to the means of transport.Alternatively or additionally, the model can also be stored locally in the means of transport (if necessary alongside models assigned to other users of the means of transport).

[0019] Although the gestures were always illustrated as swipe gestures in the above disclosure, the gestures can alternatively or additionally be implemented as rotation gestures (circular path with one or more fingers) and / or two-dimensional gestures and / or static (long press gestures) and / or finger spreading or finger closing gestures. In other words, all gestures that can reasonably be resolved with a touch-sensitive surface according to the prior art can also be learned in accordance with the invention and stored as a model.

[0020] The function that the user can access with a method according to the invention can, for example, be associated with a scrolling and / or view-changing function. Other possibilities include volume adjustment functions, track skip functions, channel change functions, window lift / skylight / sliding and / or panoramic roof and headliner blind control functions. Furthermore, interior lighting intensity, interior lighting color, ambient lighting pattern and color, external signaling functions, seat comfort settings, and call acceptance / rejection functions can be controlled by learnable models according to the invention.

[0021] According to a second aspect of the present invention, a user interface for a means of transport is proposed, which has a data input, an evaluation unit, and a data output. The evaluation unit is configured to detect a first gesture of a user using a touch-sensitive surface of a steering wheel of the means of transport via the data input. The detected gesture is mapped to a first reference, as is a second gesture, which is mapped to a second reference. Using the two references—assuming sufficient relatedness or identity—a data model is created, which can be saved via the data output. The first reference and the second reference are at least partially located within the model and per se fulfill the model.Furthermore, a predefined function can be triggered by means of the data output if a third gesture that sufficiently corresponds to the model is determined by means of the data input. In this way, the user interface according to the invention is configured to implement the features, feature combinations, and the advantages resulting from them in a corresponding manner, so that reference is made to the above statements to avoid repetition. According to a third aspect of the present invention, a means of transport is proposed which has a user interface according to the second aspect of the invention. In other words, the means of transport has a steering wheel with a touch-sensitive surface, by means of which the means of transport is capable of carrying out the steps of the method according to the invention.In this regard, reference is also made to the features, combinations of features and advantages of the aspects described above.

[0022] Further details, features, and advantages of the invention will become apparent from the following description and the figures. They show:

[0023] Figure 1 shows a detailed view of an embodiment of a user interface according to the invention of an embodiment of a means of transport according to the invention when carrying out a method according to the invention;

[0024] Figure 2 is an overview diagram illustrating a porting of a model created according to the invention from one means of transport to another means of transport; and

[0025] Figure 3 is a flowchart illustrating steps of an embodiment of a method according to the invention for interacting with a steering wheel of a means of transport.

[0026] Figure 1 shows a steering wheel 17 with a steering wheel rim 18 and a cushion 19, which a user 5 has grasped at the three o'clock position and the nine o'clock position in order to steer the means of transport 10. Between the steering wheel rim 18 and the cushion 19, touch-sensitive surfaces 6, 7 according to the invention are arranged on both sides. These surfaces are linked for information technology purposes to a data input 13 of an electronic control unit as an evaluation unit 12. Via a data output 14, the evaluation unit 12 can store the gestures 1, 2 performed by the user 5, which are sufficiently similar, as a model 8. The model 8 can be understood as a band or tube into which the gestures 1, 2 can be fitted as the first gesture and the second gesture. A fourth gesture 9 is so far apart from the first gesture 1 and the second gesture 2 that it cannot be fitted into the model 8.If the fourth gesture 9 was performed as part of a configuration mode in order to create the model 8, a repetition is automatically requested or feedback is given to the user that the gesture 9 is not sufficiently related to the first and second gestures 1, 2. On the other hand, the fourth gesture 9 can be assigned to a configuration mode for triggering an alternative function. For this purpose, an alternative (not shown) model would be created accordingly. In a user mode, the gesture 9 would not be assigned to the model 8 and the function assigned to it. This function would not be triggered. Only in the event that a model assigned to the fourth gesture 9 is stored would a function assigned to this model be triggered by the fourth gesture 9.

[0027] Figure 2 shows two means of transportation 10, 11, each having steering wheels 17 with touch-sensitive surfaces (not shown), as presented in connection with Figure 1. After successfully defining a model (reference numeral 8 in Figure 1), a wireless message 20 is sent from the first means of transportation 10 to the second means of transportation 11, which configures the second means of transportation 11 to recognize user gestures based on the same model. Models further developed within the second means of transportation 11, if applicable, can be made available in a corresponding manner to the first means of transportation 10 or to further means of transportation (not shown).

[0028] Figure 3 shows steps of an embodiment of a method according to the invention. In step 100, a predefined driving situation is detected, which allows a safe configuration of the user interface according to the invention. This can, for example, be the first driving situation that occurs after the need for configuration of the user interface and does not indicate any safety concerns regarding user distraction. For example, the vehicle can be parked. In step 200, a configuration mode for detecting the first gesture to create a model is therefore automatically offered. In step 300, a predefined user input is subsequently detected, and in response thereto, the configuration mode for detecting the first gesture is started in step 400.In step 500, a first gesture of the user is detected using a touch-sensitive surface of the steering wheel of the means of transport, and in step 600, a first reference representing the first gesture is created using the data from the touch-sensitive surface. In step 700, a second gesture of the user is detected in a corresponding manner using the touch-sensitive surface of the steering wheel of the means of transport, and in step 800, a reference associated with the second gesture is created and stored. In step 900, a sufficient relationship between the first reference and the second reference is determined, and in response thereto, in step 1000, a model is predefined within which the first gesture and the second gesture lie, at least in part.In other words, based on the first reference and the second reference, a validity set is defined which decides whether the respective gesture corresponds to the model or not for the recognition of further gestures in a user mode. In step 1100, a function of the means of transport is then triggered by a third gesture, provided that the third gesture corresponds to the model. Otherwise, an error message may be output or - if the third gesture corresponds to an alternative model - the function assigned to the alternative model is triggered. In step 1200, the determined model is transmitted in data form to another means of transport which is also configured to carry out the method according to the invention. In step 1300, the data set is also used to recognize third gestures in the other means of transport.

[0029] This means that a user's interaction with one or more vehicles can always be kept up-to-date and convenient, even after a comparatively long service life.

[0030] List of reference symbols:

[0031] 1 first gesture

[0032] 2 second gesture

[0033] 5 users

[0034] 6, 7 touch-sensitive surface

[0035] 8 Model

[0036] 9 fourth gesture

[0037] 10, 11 Means of transport

[0038] 12 Evaluation unit

[0039] 13 Data input

[0040] 14 Data output

[0041] 17 Steering wheel

[0042] 18 Steering wheel rim

[0043] 19 impact pot

[0044] 20 Wireless Message

[0045] 100 to 1300 process steps

Claims

Patent claims:

1. Method for interacting with a steering wheel (17) of a Means of transport (10) comprising the steps: • detecting (500) a first gesture (1) of a user (5) by means of a touch-sensitive surface (6, 7) of the steering wheel (17) of the means of transport (10), • Creating (600) a first reference for the first gesture (1) using data from the surface (6, 7), • detecting (700) a second gesture (2) of the user (5) by means of the touch-sensitive surface (6, 7) of the steering wheel (17) of the means of transport (10), • Creating (800) a second reference for the second gesture (2) using data from the surface (6, 7), • Determining (900) a sufficient relationship between the first reference and the second reference, in response • Predefining (1000) a model (8) within which the first gesture (1) and the second gesture (2) lie at least partially, and • Triggering (1100) a function of the means of transport (10) by a third gesture (3), provided that the third gesture (3) corresponds to the model (8).

2. The method according to claim 1, further comprising automatically outputting feedback to the user that the first gesture (1) and the second gesture (2) - a suitable relationship or - have no suitable relatives.

3. Method according to claim 1 or 2, wherein the touch-sensitive surface (6, 7) is arranged in an area on the impact pot (19) adjacent to a steering wheel rim (18).

4. Method according to one of the preceding claims further comprising Recognizing (300) a predefined user input and in response to it Starting (400) a configuration mode for detecting the first gesture (1). Method according to one of the preceding claims further comprising Recognizing (100) a predefined driving situation and / or operating situation and / or vehicle situation and, in response thereto, automatically offering (200) a configuration mode for detecting the first gesture (1). Method according to one of the preceding claims, wherein the touch-sensitive surface has a substantially planar structure and / or is arranged in a region of the steering wheel (17) located between a collision absorber and a steering wheel rim (18). Method according to one of the preceding claims, further comprising Transferring (1200) a data set representing the model to another means of transport (11) having a corresponding touch-sensitive surface on a steering wheel (17) and using (1300) the data set to recognize third gestures in the other means of transport (10). Method according to one of the preceding claims, wherein the first gesture (1), the second gesture (2), the third gesture and the fourth gesture (9) are a Swipe gesture and / or rotation gesture and / or two-dimensional gesture and / or long press gesture and / or finger spread gesture. Method according to one of the preceding claims, wherein the function comprises a Volume change and / or “Title jump” and / or Channel change and / or Scroll and / or Window regulator and / or Skylight and / or Sliding or panoramic roof and / or Roof liner blind Interior lighting- ext. signaling- Seat comfort, Accept or reject a call function. User interface for a means of transport (10) comprising: - a data input (13), - an evaluation unit (12) and - a data output (14), wherein the evaluation unit (12) is configured to detect, by means of the data input (13), a first gesture (12) of a user (5) by means of a touch-sensitive surface of a steering wheel (17) of the means of transport (10), to create a first reference for the first gesture (1) using data from the touch-sensitive surface, to detect a second gesture (2) of the user (5) by means of the touch-sensitive surface (6, 7) of the means of transport (10), to create a second reference for the second gesture (2) using data from the touch-sensitive surface, to determine a sufficient relationship between the first reference and the second reference, and in response thereto, to create a model (8) by means of the data output (14) within which the first gesture (1) and the second gesture (2) are at least partially located, and to trigger a predefined function by means of the data output (14),if a third gesture corresponds to model (8)., A user interface according to claim 10, which is configured to execute a method according to any one of the preceding claims 1 to 9. A means of transportation comprising a user interface according to any one of the preceding claims 10 or 11.

Images