Vehicle, user interface and method for interacting with a vehicle steering wheel - Patents.com

Abstract

mitigates or eliminates disadvantages associated with the prior art; A method for interacting with a steering wheel (17) of a vehicle (10), comprising: detecting a first gesture 1 of a user 5 using a touch-sensitive surface 6, 7; - creating a first reference for a first gesture 1 using the data of the surfaces 6, 7; detecting a second gesture 2 of a user 5 using a touch-sensitive surface 6, 7; - creating a second reference for a second gesture 2 using the data of the surfaces 6, 7; - identifying a sufficient relationship between the first criterion and the second criterion; In response to the identification, defining a model 8 within which the first gesture and the second gesture reside; activating a function of the vehicle 10 with the third gesture if the third gesture matches the model 8; Includes:

Description

[Technical Field]

[0001] The present invention relates to vehicles, user interfaces and methods for interacting with a vehicle steering wheel. In particular, the present invention relates to more flexible configuration of user interfaces for use by users over time and across vehicles. [Background technology]

[0002] Modern vehicles have multiple functions that passengers can access at will. Besides voice control and touchscreens, user input based on gestures, recorded by capacitive sensor technology, among others, has proven itself as a user interface. However, user interfaces known in the prior art have a number of drawbacks: on the one hand, there are problems of malfunction, since different users perform gestures differently. In other words, the orientation of a first swipe gesture for a first user may be significantly different from a second swipe gesture for a second user. In addition, a given gesture for a first customer may have a completely different meaning than for a second customer. In other words, for a second customer, performing a swipe gesture to change the viewpoint (view) may not be intuitive enough, and the second customer may prefer to bring about a change of viewpoint by an alternative (swipe) gesture. Furthermore, physical disabilities may also prevent a user from performing a given gesture, or may only be able to perform it with limited ability. For example, stiff joints can make it difficult for a user to spread their fingers / thumbs at will.

[0003] Additionally, car sharing and leasing models continue to be popular with customers / users, but the prior art requires frequent vehicle changes to adapt transportation methods to new user preferences. Summary of the Invention [Problem to be solved by the invention]

[0004] SUMMARY OF THE INVENTION It is an object of the present invention to mitigate or eliminate the above-mentioned disadvantages associated with the prior art. [Means for solving the problem]

[0005] The above-mentioned object is achieved by a method for interacting with a steering wheel of a vehicle. The vehicle can be configured as a car, van, truck, motorcycle, aircraft, and / or watercraft. The interaction is performed in the vehicle by a user, who can therefore be a passenger, driver, front-seat passenger, or rear-seat passenger. In a first step, a first gesture of the user is detected using a touch-sensitive surface of the steering wheel of the vehicle. In other words, the gesture is analyzed (translated) sensorily or sensor-technically (automatically) and transferred in a data-technical form. Subsequently, a first reference for the first gesture is created using the surface data. The touch-sensitive surface can be understood as a digitizer or a touch-sensitive input surface. In other words, a data-technical representation of the (first) gesture actually performed by the user is recorded. The resulting first reference can, for example, represent the time course of the contact point between one finger of the user and the touch-sensitive surface. In a further step, a second gesture of the user is also detected using the (identical) touch-sensitive surface of the vehicle's steering wheel. The second (swipe) gesture preferably corresponds to the first gesture in terms of its basic features and location on the touch-sensitive surface. To ensure sufficient similarity, the user interface can output appropriate instructions to the user requesting the user to repeat the first gesture with a slightly modified second gesture that is essentially assigned to the invocation of the same function. After appropriate input, a second reference for the second gesture is created using the touch-sensitive surface data. Thus, the actual trajectory or time course of the contact point between the user's tissue and the touch-sensitive surface is technically represented by the first and second references. A sufficient correlation or identity between the first and second gestures is then determined.The spacing and / or distinction and / or spatial offset of both gestures or their corresponding components can then be evaluated to determine to what extent characteristics of the first gesture correspond to characteristics of the second gesture, or to what extent the first gesture should be performed similarly or identically to the second gesture. Further optional testing steps are described below. Subsequently, in response to identifying sufficient commonality, a model is predefined within which the first and second gestures at least partially reside. This step can be understood as identifying a boundary range or "corridor" for the first and second gestures such that the created model covers the first and second gestures sufficiently identically in at least the central (main) or core range of the gestures, or such that a flat extension or temporal progression of the first and second gestures forms a kind of "common volume" that defines a boundary range within which the first and second gestures reside. The first and second gestures can be distinguished from other gestures that may be defined to invoke other functions by the model or the central spatial range described above. Therefore, the model can also be understood as a virtual tube or virtual band (which may "blur" over time), and the surface of the virtual tube or virtual band can be defined or at least influenced by the first and second gestures. In particular, a position between corresponding points of the first and second gestures can also be identified as being related to the model, while an area outside the interval between corresponding points of the first and second gestures by a predefined amount is not related to the model. A third gesture that corresponds to the model or maintains a sufficient distance from the model subsequently activates a function of the vehicle. The user can initially set the function they want to associate with the model identified above.This can be done before the first and second gestures are performed, or after the first and second gestures, or after a new assignment of a (new) function of the vehicle to a gesture that has been previously defined and possibly assigned to another function of the vehicle. In this way, the user can define their own comfortable configuration of first / second gestures or models, which can then be used to activate the function assigned by the user to the comfortable gesture. Therefore, gesture operation of the vehicle is less dependent on physical disabilities, the learning and familiarization process is much more intuitive, and the prescribable gestures are more comfortable for each individual user. Therefore, user acceptance can be improved and false operation or false detection can be reduced.

[0006] The dependent claims indicate preferred developments of the method according to the invention.

[0007] Preferably, further learning steps can be performed to improve the model. This can be done in an initial learning process, with the user performing not just two gestures, but three, four, five, or more gestures to identify the model. The user can be a customer who has just purchased a vehicle and wants to customize it. However, the user can also be a customer of a carpool / car-sharing pool who uses the vehicle only in a rental manner. However, the formation of the model can also be performed during use or after the occurrence of a predefined event and / or after a predefined period of time has elapsed since the first or second gesture was performed. At this time, a fourth gesture is detected using a sensor on the vehicle, and a fourth criterion for the fourth gesture is recorded or analyzed (translated) using the sensor data. These steps clearly correspond to those described above in relation to the first and second gestures, so reference is made to that description to avoid repetition. The model can be updated, possibly made specific, or generalized based on data from a fourth gesture or a fourth reference.

[0008] All steps in the present disclosure that are not explicitly assigned to human actions or perceptions can be understood to be performed automatically and / or sensor-technically, and can be performed by or with the aid of an evaluation unit (electronic control unit, ECU) and / or by the vehicle or its on-board electronics.

[0009] In a corresponding manner, different gestures for the activation of another (second) function can also be predefined, so that in an embodiment according to the invention access to the second function is facilitated by the user. The same applies to a third function, a fourth function and all other functions known according to the prior art to be meaningfully analyzable (transformable) using the touch-sensitive surface of a steering wheel.

[0010] If the first and second gestures are sufficiently related, the vehicle or user interface can output appropriate feedback to the user that the input was successful. If the first and second gestures are found not to be properly related to each other, appropriate negative feedback can be output to the user, possibly requesting a new execution of the first or both gestures. This can have a textual, graphical, or acoustic nature. It is thus possible to avoid recorded gestures becoming too identical to each other, causing future models to under-recognize gestures that are correctly performed by the user, while also avoiding a "too broad" model, assigning one or the same function to too many different gestures, or too few other gestures that are sufficiently far apart from the gesture in question.

[0011] The touch-sensitive surface can be positioned on a steering wheel such that a user does not have to move their thumbs to less unnatural positions in a comfortable / ergonomic grip at the 3 o'clock and 9 o'clock positions to operate the touch-sensitive surface for gesture input, for example, thereby reducing effort and providing better operating ergonomics.

[0012] The configuration of gesture inputs as detailed above can be initiated in response to the recognition of a predefined user input. For example, for this purpose, the user can select a menu point in a user menu or can provide a predefined voice input. Predefined driving or operating situations can also be recognized, in response to which a setting mode is initiated. For example, it can be recognized that the user has reached a frustration threshold after multiple executions of a user input, and in response, a function desired by the user is explicitly activated. Such a situation can be identified based on multiple repeated operating steps and / or on negative comments / noises / voice notifications in response. Therefore, in response, according to the present invention, the execution of specific first and / or second gestures is suggested in order to subsequently improve user ergonomics.

[0013] Possible scenarios for initializing the method steps according to the present invention can be, for example, in response to predefined driving and operating situations. For example, it can be determined that a user is sitting in the vehicle for the first time. This can be done digitally or based on face / voice recognition or the like. Essentially, this is the first (first) user after delivery of the vehicle, who may therefore have a need to enjoy the operating ergonomics provided by the present invention. In response, a setting mode can be automatically provided that detects the first (and second) gestures.

[0014] The touch-sensitive surface may have a particularly essentially flat structure. In other words, the surface may be smooth or slightly rough, but without structures that could be understood as webs or other internal definitions. In this way, the touch-sensitive surface can be assigned functions essentially solely through software. It may also be possible to use software to respond to subsequently developed user operation concepts, without the need for a new input matrix (digitizer) or the need for additional operating buttons, wheels, controllers, etc. configured in hardware. The touch-sensitive surface is arranged on the steering wheel, particularly in the area between the shock absorber and the steering wheel rim. In particular, the touch-sensitive surface may be arranged at the height of the 9 o'clock position and / or the height of the 3 o'clock position. In this way, particularly ergonomic operation with the thumb is obtained when the steering wheel is conventionally held by the user.

[0015] Since the above steps for developing the model may require some time and the model may be integrated, verified, and corrected through several operational steps, the knowledge associated with a considerable added value for the user would be lost according to the prior art after changing vehicles. Therefore, it is preferably proposed to represent the model by a dataset (file or the like) and transmit it, for example wirelessly and / or via Internet, to a second vehicle that can also use the model. This only presupposes that the new vehicle has a corresponding touch-sensitive surface on its steering wheel and that the model can be imported to represent the dataset. All users can benefit from the efforts made to improve ergonomics in the new vehicle. It does not matter whether the model is imported or copied to the new vehicle. In particular, if different vehicles are assigned to a user (e.g., a private carpool or a commercial vehicle / car-sharing pool), it is also possible to keep the model up to date for all vehicles assigned to the user and to update all vehicles with the latest model after the optimization step. The model can be stored in a central database of the vehicle manufacturer, carpool administrator, or the like. To automatically assign the latest model of gesture manipulations to a vehicle at any time, it is sufficient to link the vehicle assigned to the user to an ID (account) stored in a (stationary) database. Alternatively or additionally, the model can also be stored locally in the vehicle (possibly in addition to models assigned to other users of the vehicle).

[0016] Even if a gesture is always described as a swipe gesture in the above disclosure, the gesture can alternatively or additionally be performed as a rotational gesture (circular orbit with one or more fingers) and / or a two-dimensional gesture and / or a static (long press gesture) and / or a pinch-in or pinch-out gesture. In other words, all gestures that can be advantageously analyzed (translated) on a touch-sensitive surface according to the prior art can also be learned and stored as a model in the embodiments according to the present invention.

[0017] The functions accessible to the user by the method according to the invention can be related to scrolling and / or view changing functions, for example. Other possibilities are volume change, track skipping, channel change, window / roof window / sliding and / or panoramic roof operation and roof lining blind operation. In addition, the trainable model according to the invention may be able to control interior light intensity, ambient light pattern and color, exterior signaling functions, seating comfort functions and call answering / rejecting functions.

[0018] According to a second aspect of the present invention, a user interface for a vehicle is proposed, comprising a data input unit, an evaluation unit, and a data output unit. The evaluation unit is configured to detect a first gesture of a user using the data input unit with a touch-sensitive surface of the vehicle's steering wheel. The detected gesture is indicated by a first criterion, such that a second gesture is indicated by a second criterion. Given a sufficient correlation or identity, both criteria are used to create a data model that can be stored using the data output unit. The first and second criteria are at least partially within the model and themselves satisfy the model. Furthermore, if a third gesture that sufficiently fits the model is identified using the data input unit, a predefined function can be activated using the data output unit. In this way, the user interface according to the present invention is configured to achieve the features, feature combinations, and advantages resulting therefrom in a clearly corresponding manner, to which reference is made to the above description to avoid repetition.

[0019] According to a third aspect of the present invention, a vehicle is proposed that comprises a user interface according to the second inventive aspect, in other words, the vehicle comprises a steering wheel with a touch-sensitive surface, by means of which the vehicle can carry out the steps of the method according to the invention. Reference is again made to the features, feature combinations and advantages of the above-mentioned aspects.

[0020] Further details, features and advantages of the invention are apparent from the following description of embodiments and the drawings. [Brief explanation of the drawings]

[0021] [Figure 1] 3 shows a detailed view of an embodiment of a user interface according to the invention of an embodiment of a vehicle according to the invention during the execution of a method according to the invention; FIG. [Figure 2] FIG. 1 is a schematic diagram illustrating the transfer of a model created by the present invention from one vehicle to another. [Figure 3] FIG. 2 shows a flow chart illustrating the steps of an embodiment of a method according to the invention for interacting with a steering wheel of a vehicle. DETAILED DESCRIPTION OF THE INVENTION

[0022] 1 shows a steering wheel 17 having a steering wheel rim 18 and shock absorbers 19 that a user 5 grips at the 3 o'clock and 9 o'clock positions to steer the vehicle 10. Between the steering wheel rim 18 and the shock absorbers 19, touch-sensitive surfaces 6, 7 according to the invention are arranged on both sides, which are connected in information technology to a data input 13 of an electronic control device as an evaluation unit 12. Via a data output 14, the evaluation unit 12 is able to store sufficiently similar gestures 1, 2 performed by the user 5 as a model 8. Here, the model 8 can be understood as a band or tube to which the gestures 1, 2 can be adapted as a first and a second gesture. The fourth gesture 9 has such a large distance from the first gesture 1 and the second gesture 2 that it cannot be adapted to the model 8. If a fourth gesture is performed in the setup mode to create the model 8, a repetition is automatically requested, or feedback is provided to the user that the gesture 9 is not sufficiently related (similar, common) to the first and second gestures 1 and 2. In response, the fourth gesture 9 can be assigned to the setup mode to activate an alternative function. For this purpose, an alternative model (not shown) is created in an appropriate manner. In the user mode, the gesture 9 is not assigned to the model 8 and the function assigned to that model. The function is not activated. The function assigned to the fourth gesture 9 is activated by the fourth gesture 9 only if the model assigned to that model is stored.

[0023] Figure 2 shows two vehicles 10, 11, each equipped with a steering wheel 17 having a touch-sensitive surface (not shown) as described above in relation to Figure 1. After the model (8 in Figure 1) has been properly defined, a wireless notification 20 is sent from the first vehicle 10 to the second vehicle 11, which is configured by the wireless notification to recognize user gestures based on the same model. The model, possibly further developed (trained) in the second vehicle 11, can be provided to the first vehicle 10 or another vehicle (not shown) in an appropriate manner.

[0024] 3 illustrates the steps of one embodiment of the method according to the present invention. In step 100, a predefined driving situation is recognized that allows reliable configuration of the user interface of the present invention. This may be, for example, a first driving situation that occurs after the need for configuration of the user interface has arisen and in which safety concerns regarding user distraction are not recognized. For example, the vehicle may be parked. Therefore, in step 200, a configuration mode is automatically provided to detect a first gesture for creating a model. Next, in step 300, a predefined user input is recognized, and in response, in step 400, a configuration mode to detect a first gesture is initiated. In step 500, a first user gesture is detected using a touch-sensitive surface of the vehicle's steering wheel, and in step 600, a first criterion representing the first gesture is created using the touch-sensitive surface data. In a corresponding manner, a second user gesture is detected using the touch-sensitive surface of the vehicle steering wheel in step 700, and a criterion assigned to the second gesture is created and stored in step 800. In step 900, a sufficient relationship (similarity, commonality) between the first and second criteria is determined, and in response, in step 1000, a model is predefined within which the first and second gestures at least partially reside. In other words, for recognition of another gesture in the user mode, a significance amount determining whether each gesture fits the model is defined based on the first and second criteria. Subsequently, in step 1100, if a third gesture fits the model, a function of the vehicle is activated by the third gesture. Otherwise, an error notification is output, as the case may be, or if the third gesture matches the alternative model, a function assigned to the alternative model is activated. In step 1200, the identified model is transmitted in the form of data to other vehicles that are also configured to perform the method according to the invention. In step 1300, the data set is similarly used in the other vehicles to recognize a third gesture.

[0025] Thus, a user's interaction with one or more vehicles can be repeatedly updated and comfortably configured even after a relatively long period of time (lifetime). [Explanation of symbols]

[0026] 1 First Gesture 2 Second Gesture 5 users 6,7 Touch-sensitive surfaces 8 models 9 The Fourth Gesture 10,11 Means of transportation 12 evaluation units 13 Data Entry Section 14 Data output section 17. Steering Wheel 18 Steering wheel rim 19 Shock absorber 20 Radio Notification 100~1300 method steps

Claims

1. A method of interacting with the steering wheel (17) of a means of transport (10), - A step (500) of detecting a first gesture (1) of the user (5) using the contact-sensitive surfaces (6, 7) of the steering wheel (17) of the transport means (10), - A step (600) of creating a first criterion for the first gesture (1) using the data of the surfaces (6, 7), - A step (700) of detecting a second gesture (2) of the user (5) using the contact-sensitive surfaces (6, 7) of the steering wheel (17) of the transport means (10), - A step (800) of creating a second criterion for the second gesture (2) using the data of the surfaces (6, 7), - A step (900) of identifying sufficient relevance between the first criterion and the second criterion, In response to the identification, - A step (1000) of predefining a model (8) in which the first gesture (1) and the second gesture (2) are at least partially present inside, - If the third gesture (3) is compatible with the model (8), the third gesture (3) activates the function of the transport means (10) (1100) A method characterized by including the following.

2. The first gesture (1) and the second gesture (2) - Having an appropriate relevance, or - Does not have appropriate relevance The method according to claim 1, further characterized by automatically outputting the following feedback to the user.

3. The method according to 1 or 2, characterized in that the contact-sensitive surfaces (6, 7) are arranged on the shock absorber (19) in a range adjacent to the steering wheel rim (18).

4. - Recognizing predefined user input (300), and In response to the recognition - Start the setting mode for detecting the first gesture (1) (400) The method according to 1 or 2, further comprising:

5. - Recognizing predetermined driving conditions and / or operating conditions and / or vehicle conditions (100), In response to the recognition - To automatically provide a setting mode for detecting the first gesture (1) (200) The method according to 1 or 2, further comprising:

6. The aforementioned contact-sensitive surface, - Having an essentially flat structure, and / or - The steering wheel (17) is positioned in the area between the shock absorber and the steering wheel rim (18). The method according to claim 1 or 2, characterized by the above.

7. - Transmitting the dataset representing the model to another transport means (11) having a corresponding contact-sensitive surface on the steering wheel (17) (1200) and - Using the dataset in the other transport means (10) to recognize a third gesture (1300) The method according to 1 or 2, further comprising:

8. The first gesture (1), the second gesture (2), the third gesture and the fourth gesture (9) are, - Swipe gesture and / or - Rotation gesture and / or - Two-dimensional gestures and / or - Long press gesture and / or - Pinch-in / pinch-out gestures The method according to 1 or 2, characterized by including the following:

9. The aforementioned function, - Volume change function and / or - "Song skip" function and / or - Channel changing function and / or - Scroll function and / or - Window opening and closing function and / or - Roof window function and / or - Sliding roof or panoramic roof function and / or - Roof lining blind function, - Interior lighting function - External signal transmission function - Seating comfort function - Call answering function or call rejecting function The method according to 1 or 2, characterized by including the following:

10. - Data input section (13), - Evaluation unit (12), - Data output unit (14) and A user interface for a means of transport (10), including, The evaluation unit (12) uses the data input unit (13) to: - Using the contact-sensitive surface of the steering wheel (17) of the transport means (10), the first gesture (1) of the user (5) is detected. - Using the data of the touch-sensitive surface, create a first criterion for the first gesture (1), - Using the contact-sensitive surfaces (6, 7) of the transport means (10), the second gesture (2) of the user (5) is detected. - Using the data from the contact-sensitive surface, a second criterion for the second gesture (2) is created. - To identify sufficient relevance between the first criterion and the second criterion, and In response to the identification, - Using the data output unit (14), create a model (8) in which the first gesture (1) and the second gesture (2) are at least partially present internally, and - When the third gesture (3) conforms to the model (8), the data output unit (14) is used to activate a predetermined function. A user interface characterized by its configuration.

11. The user interface according to claim 10, characterized in that it is configured to perform the method described in claim 1 or 2.

12. A means of transport including the user interface described in claim 10.

Images