Operating device and method and computer-readable storage medium with instructions for operating an operating device

Abstract

Method for operating an operating device (20), comprising the steps: - detecting (10) an identification object (60) different from the operating device (20) by means of wireless communication technology; - detecting (11) a user input at a user interface (26) of the operating device (20); and - executing (12) a function determined by the user input if the user input was carried out with the identification object (60).

Description

[0001] The present invention relates to an operating device, a method, and a computer-readable storage medium with instructions for operating an operating device. The invention further relates to a motor vehicle in which an operating device or a method according to the invention is used.

[0002] Today's motor vehicles increasingly provide online functions that users can access via an operating device. Typically, this operating device is an infotainment system with a screen and associated input options. The screen can be touch-sensitive to facilitate user interaction. Alternatively or additionally, mechanical input devices can be provided, for example, in the form of control buttons, a keyboard, or a rotary push-button. Even though operation via a touch-sensitive screen is already very convenient, new HMI (Human Machine Interface) operating concepts are continually being developed to facilitate operation.

[0003] In this context, DE 10 2012 003 777 A1 describes a vehicle key designed as a control element similar to a computer mouse. To detect movements in conjunction with a suitable surface, which can be provided, for example, on the center console of a vehicle, the mouse has an optical device for detecting mouse movements. The key automatically connects to the on-board electronics when entering the vehicle, but can also be used as a computer mouse.

[0004] Often, online functions must be activated or enabled separately, for example, because they incur additional costs or are not intended to be available to every vehicle user. Therefore, solutions are needed to activate or enable various functions in the vehicle. For this purpose, solutions familiar from smartphones or tablets can be adopted and applied in the automotive environment.

[0005] Against this background, DE 10 2015 108 871 A1 describes a vehicle data processing system comprising a control unit that can communicate with a wearable wireless device. The wearable device can be a ring or a bracelet. The wearable device detects gestures and transmits corresponding information to the control unit. Based on the detected gestures, the control unit determines and executes associated commands. The wearable device can also support safety functions, for example, allowing doors to be opened only in conjunction with defined gestures. Depending on the detection of a wearable device, functional restrictions of the vehicle system are released.

[0006] US 2015 / 0 019 873 A1 describes an electronic device that authenticates a user without requiring active input from the user. At least one user interface receives a plurality of user inputs to the electronic device that are not related to an active authentication action by the user of the electronic device. At least one biometric sensor extracts biometric data identifying the user from the plurality of user inputs. A processor authenticates the user in response to the extracted biometric data.

[0007] DE 11 2015 003 882 T5 describes a method for operating a vehicle. In the method, a first input from a user is received on a wearable device, indicating a vehicle function to be performed on a vehicle. A second input is also received, indicating a user gesture for authentication. Based on successful user authentication, a control signal is generated on the wearable device to execute the vehicle function on the vehicle.

[0008] It is an object of the invention to provide solutions for an operating device and for operating an operating device that facilitate the activation or release of functions.

[0009] This object is achieved by a method having the features of claim 1, by a computer-readable storage medium with instructions according to claim 10, and by an operating device having the features of claim 11. Preferred embodiments of the invention are the subject of the dependent claims.

[0010] According to a first aspect of the invention, a method for operating an operating device comprises the steps: - Detecting an identification object different from the operating device by means of wireless communication technology; - capturing a user input at a user interface of the operating device; and - Execute a function determined by the user input if the user input was performed with the identification object.

[0011] According to a further aspect of the invention, a computer-readable storage medium contains instructions which, when executed by a computer, cause the computer to perform the following steps for operating an operating device: - Detecting an identification object different from the operating device by means of wireless communication technology; - capturing a user input at a user interface of the operating device; and - Execute a function determined by the user input if the user input was performed with the identification object.

[0012] The term "computer" should be understood broadly. In particular, it also includes control units and other processor-based data processing devices.

[0013] According to a further aspect of the invention, an operating device comprises: - a detection unit for detecting an identification object different from the operating device by means of wireless communication technology; - an input acquisition unit for capturing a user input at a user interface; and - an execution unit for executing a function determined by the user input if the user input was performed with the identification object.

[0014] According to the invention, an identification object is used to enable the activation or release of functions. For this purpose, the identification object is first detected and a user input is recorded at a user interface. Certain functions are only executed if the user input was made using the identification object. This achieves increased security because the user must be in possession of the identification object at the time of the user input in order to execute the associated functions. The detection of the identification object takes place using wireless communication technology. This has the advantage that no mechanical connection to the identification object needs to be established. Furthermore, it also enables more complex interactions between the identification object and the user interface in a simple manner, for example drawing patterns or moving objects.Examples of suitable wireless communication technologies are NFC (NFC: Near Field Communication) or Bluetooth.

[0015] According to one aspect of the invention, the user interface has a touch-sensitive display. Such a touch-sensitive display is currently already used in a variety of applications, for example, in motor vehicles or in smartphones or tablets. The user is therefore already familiar with its operation, and such a display can be designed to be particularly simple with regard to user interaction. In particular, if necessary, indications can be provided that certain functions require the user interface to be operated with the identification object.

[0016] According to one aspect of the invention, the function determined by the user input comprises user authentication. For this purpose, the user input can be, for example, a PIN code, a password or a pattern. In this way, two-factor authentication of the user can be implemented particularly advantageously. The user must not only be in possession of the identification object, but must also know the correct security feature. There is preferably an individual connection between the identification object and the security feature, i.e. each identification object has exactly one unique security feature. If necessary, an identification object can also be linked to multiple security features. For example, multiple users can use the same identification object, with each user having their own security feature.Likewise, the identification object can be associated with multiple security features for one or more users, such as a pattern, a PIN code, and a password. Depending on the capabilities of the user interface, each user can then use the appropriate security feature. Furthermore, different security features can be used for different applications.

[0017] According to one aspect of the invention, the function determined by user input comprises the activation of options. During interaction with the user, a distinction can be made between actions performed with the identification object and actions not performed with the identification object. In this way, an additional HMI level is provided. For example, user input with the identification object can enable a type of administrator operation with access to configuration settings. Another example is automatic user login to a service, such as a social network or an online shop, if a connection is stored between the identification object and a user account.

[0018] According to one aspect of the invention, the function determined by the user input comprises authorization of a protected action. The protected action can, for example, be a purchase via the operating device. Currently, a PIN code or password is typically required for purchase operations to ensure user authentication. This can be simplified by allowing the user to confirm the purchase by pressing a purchase button with the identification object.

[0019] According to one aspect of the invention, the identification object is a key, a stylus, or an object adapted to a surface of the user interface. Many users are already familiar with input using a stylus from tablets or smartphones, so that no lengthy adjustment period is required. Using a key, on the other hand, has the advantage that keys with integrated electronics are already in use, particularly in the automotive sector, so that the solution according to the invention can be implemented with manageable effort. Of course, other objects can also be used, for example a cylindrical object that is placed on the user interface. With such an object, rotational movements can also be performed particularly advantageously. In the case of a user interface with a curved surface, the contact surface of the object is preferably adapted to the curved surface.An additional user interface can also be provided specifically for such objects, for example in the center console of a vehicle.

[0020] According to one aspect of the invention, the user input includes a rotation of the identification object, a movement of the identification object, a pressure action with the identification object, or an approach of the identification object to the user interface. These user inputs can be used to represent typical user actions, such as keystrokes, scrolling through lists, moving controls or objects, etc.

[0021] According to one aspect of the invention, the operating device is an operating device of a motor vehicle. A method according to the invention or an operating device according to the invention is particularly advantageously used in a vehicle, in particular a motor vehicle. Since a motor vehicle often has other users besides the owner, it is sensible to ensure increased security against unwanted actions, for example, to prevent changes to vehicle settings or purchases at the owner's expense. In addition, the described solutions can also be used in other areas, for example, for touchscreens, tablets, or TV sets.

[0022] Further features of the present invention will become apparent from the following description and the appended claims taken in conjunction with the figures. Fig. 1 schematically shows a method for operating an operating device; Fig. 2 shows a first embodiment of an operating device; Fig. 3 shows a second embodiment of an operating device; Fig. Figure 4 schematically represents a motor vehicle in which a solution according to the invention is implemented; Fig. 5 schematically shows a vehicle interior with an operating device with a touchscreen; Fig. 6 shows authentication of a user via the operating device; Fig. 7 shows a selection of a function via the operating device; Fig. 8 shows an activation of options via the control device; and Fig. 9 shows an authorization of a protected action via the operating device.

[0023] To better understand the principles of the present invention, embodiments of the invention are explained in more detail below with reference to the figures. It is understood that the invention is not limited to these embodiments and that the described features may also be combined or modified without departing from the scope of the invention as defined in the appended claims.

[0024] Fig. 1 schematically shows a method for operating an operating device, for example an operating device in a motor vehicle. In a first step, an identification object is detected 10. This occurs, for example, using wireless communication technology. The identification object can be a key, a stylus, or an object adapted to a surface of a user interface of the operating device. In addition, a user input is detected 11 at a user interface of the operating device. Preferably, the user interface has a touch-sensitive display. The user input can include, for example, a rotation of the identification object, a movement of the identification object, a pressure action with the identification object, or an approach of the identification object to the user interface.A function determined by the user input is executed 12 if the user input was performed with the identification object. The function determined by the user input can, for example, include user authentication. In this case, the user input can be a PIN code, a password, or a pattern. Alternatively, the function determined by the user input can include enabling options or authorizing a protected action.

[0025] Fig. 2 shows a simplified schematic representation of a first embodiment of an operating device 20. The operating device 20 has an input 21 via which data can be received. The operating device 20 also has a detection unit 22 for detecting an identification object and an input acquisition unit 23 for capturing a user input at a user interface 26. The user interface 26 can be, for example, a touchscreen. The identification object can be, for example, a key, a stylus, or an object adapted to a surface of the user interface 26. The user input can be, among other things, a rotation of the identification object, a movement of the identification object, a printing action with the identification object, or an approach of the identification object to the user interface 26.To detect the identification object, the detection unit 22 can be connected to an interface 27, preferably a wireless interface, for example an NFC or Bluetooth interface. Fig. 2, the user interface 26 and the interface 27 are components of the operating device 20. However, they can also be arranged outside the operating device 20 and connected to it via a data connection. The operating device 20 also comprises an execution unit 24 for executing a function determined by the user input when the user input was performed with the identification object. The function determined by the user input can, for example, comprise authentication of a user. In this case, the user input can be a PIN code, a password, or a pattern. Alternatively, the function determined by the user input can comprise activation of options or authorization of a protected action. The detection unit 22, the input acquisition unit 23, and the execution unit 24 can be controlled by a control unit 25.Settings of the detection unit 22, the input acquisition unit 23, the execution unit 24, or the control unit 25 can be changed via the user interface 26, if necessary. The data generated in the operating device 20, for example, the data generated by the execution unit 24, can be output via an output 29 or stored in a memory 28 of the operating device 20, for example, for later evaluation or for use by the components of the operating device 20. The detection unit 22, the input acquisition unit 23, the execution unit 24, and the control unit 25 can be implemented as dedicated hardware, for example, as integrated circuits. Of course, they can also be partially or completely combined or implemented as software running on a suitable processor, for example, a GPU.Input 21 and output 29 can be implemented as separate interfaces or as a combined bidirectional interface. The operating device 20 can be installed, for example, in a motor vehicle.

[0026] Fig. 3 shows a simplified schematic representation of a second embodiment of an operating device 30. In this embodiment, the user interface and the wireless interface are not part of the operating device 30, but are connected to it via a data connection. The operating device 30 has a processor 32 and a memory 31. For example, the operating device 30 is a computer or a control unit. Instructions are stored in the memory 31 which, when executed by the processor 32, cause the operating device 30 to carry out the steps according to one of the described methods. The instructions stored in the memory 31 thus embody a program executable by the processor 32, which implements the method according to the invention.The operating device 30 has an input 33 for receiving information, for example, data acquired by the user interface and the wireless interface of the motor vehicle. Data generated by the processor 32 is provided via an output 34. Furthermore, the data can be stored in the memory 31. The input 33 and the output 34 can be combined to form a bidirectional interface.

[0027] The processor 32 may include one or more processor units, such as microprocessors, digital signal processors, or combinations thereof.

[0028] The memories 28, 31 of the described embodiments can have both volatile and non-volatile memory areas and can comprise a wide variety of storage devices and storage media, for example hard disks, optical storage media or semiconductor memories.

[0029] Fig. 4 schematically illustrates a motor vehicle 40 in which a solution according to the invention is implemented. The motor vehicle 40 has, among other things, an infotainment system 41, with which, for example, multimedia content can be played back. The motor vehicle 40 also has a data transmission unit 42 and a series of driver assistance systems 43, one of which is shown as an example. By means of the data transmission unit 42, a connection to service providers can be established, for example for the purchase or playback of multimedia content. A memory 44 is provided for storing multimedia content or other data. The infotainment system 41 can be accessed via an operating device 20. It can also be provided that settings of the driver assistance systems 43 can be adjusted via the operating device 20.The data exchange between the various components of the motor vehicle 40 takes place via a network 45.

[0030] In the following, a preferred embodiment of the invention will be described with reference to Fig. 5 to 9. In this embodiment, a vehicle key is used as the identification object. Of course, other objects can also be used as identification objects.

[0031] Fig. 5 schematically shows a vehicle interior with an operating device 20 having a touchscreen 50. In this example, the operating device 20 is integrated into a vehicle dashboard. It can of course also be installed in a different position, for example, freestanding on the dashboard. The operating device 20 has a row of additional operating buttons 51 to the side of the touchscreen 50 and below the touchscreen 50, for example, for quickly selecting specific functional areas. In addition, there are two rotary controls 52, such as those typically used for volume control and scrolling within lists. The rotary controls 52 can also be configured as operating buttons. Further operating elements of the operating device 20 are located in the center console, in this example, two rotary push buttons 53.

[0032] Fig. 6 shows user authentication via operating device 20. An authentication field 54 is displayed on touchscreen 50, on which the user draws a pattern 55 with identification object 60, similar to that used on smartphones or tablets. Instead of the pattern, authentication can of course also be performed by entering a PIN code or password using identification object 60 on a displayed keyboard. With this form of authentication, it is not sufficient to know the pattern, PIN code, or password; the entry must also be made using the associated identification object 60. The solution according to the invention thus enables two-factor authentication. Preferably, there is an individual association between identification object 60 and the security feature to be entered.In this way, individual security features can be assigned to different users using individual identification objects 60. This approach makes it easy to implement user-dependent access rights.

[0033] Fig. 7 schematically shows the selection of a function via the operating device 20. A series of station selection fields R1-R5 are displayed on the touchscreen 50, each of which is assigned a radio station. In the example, the user activates one of the station selection fields R1-R5 with their finger, specifically the station selection field R4. Upon activation, the selected station selection field R4 is visually highlighted on the touchscreen 50, here by a slightly enlarged display. The user thus receives immediate feedback that the activation of the station selection field R4 has been recognized. As a result of the activation, playback switches to the selected radio station, which is then displayed in the upper area of the touchscreen 50.

[0034] Fig. 8 shows an activation of options via the operating device 20. As before, the touchscreen 50 displays the Fig. 7 known station selection fields R1-R5 are displayed. The user again presses the station selection field R4, but this time not with their finger, but with the identification object 60. In response to this press, there is no change to the associated radio station, but rather the activation and display of an option selection 56. In the example, the user has two options available; of course, there can also be more or fewer options to choose from. For example, the first option could be deleting the associated radio station from a station list, while the second option could be used to add the radio station to a list of favorites. The identification object 60 thus provides an additional HMI level, i.e. it not only records which user input is made, but also what it is used with.

[0035] Fig. 9 shows an example of an authorization of a protected action via the operating device 20, in this case an authorization of a purchase. A shopping cart 57 with two purchase objects K1, K2 is displayed on the touchscreen 50. The purchase objects can be, for example, multimedia content, such as music tracks, or applications for installation on the infotainment system. Also displayed is a confirmation field 58, via which the user can complete the purchase of the purchase objects. Since the purchase in the present example is a protected action, the user must press the confirmation field 58 with the identification object 60 to complete the purchase. Pressing it with a finger is not sufficient. Preferably, a corresponding notification is displayed to the user if they press the confirmation field 58 with their finger.In addition, a suitable symbol can be used to indicate that the confirmation field 58 triggers a protected action. Fig. 9, this is indicated by a small lock symbol 59 in the confirmation field 58. As an alternative to directly pressing the confirmation field 58 with the identification object 60, the user can also be asked to perform an authentication before completing the purchase, as in connection with Fig. 6. It is also possible that the placement of the purchase objects K1, K2 in the shopping cart 57 is already designed as a protected action. List of reference symbols 10 Detecting an identification object 11 Capturing user input 12 Executing a function determined by user input 20 Operating device 21 Entrance 22 Detection unit 23 Input acquisition unit 24 Execution unit 25 Control unit 26 User interface 27 Interface 28 storage 29 Exit 30 Operating device 31 storage 32 processor 33 Entrance 34 Exit 40 motor vehicles 41 Infotainment system 42 Data transmission unit 43 Driver assistance system 44 storage 45 Network 50 touchscreens 51 control buttons 52 rotary controls 53 rotary push buttons 54 Authentication field 55 patterns 56 Option selection 57 Shopping Cart 58 Confirmation field 59 Lock symbol 60 Identification object K1, K2 purchase objects R1-R5 channel selection fields

Claims

[1] Method for operating an operating device (20), comprising the steps: - detecting (10) an identification object (60) different from the operating device (20) by means of wireless communication technology; - detecting (11) a user input at a user interface (26) of the operating device (20); and - executing (12) a function determined by the user input if the user input was carried out with the identification object (60). [2] The method of claim 1, wherein the user interface (26) comprises a touch-sensitive display. [3] A method according to claim 1 or 2, wherein the function determined by the user input comprises authentication of a user. [4] The method of claim 3, wherein the user input is a PIN code, a password, or a pattern. [5] Method according to claim 1 or 2, wherein the function determined by the user input comprises an activation of options. [6] A method according to claim 1 or 2, wherein the function determined by the user input comprises an authorization of a protected action. [7] Method according to one of the preceding claims, wherein the identification object (60) is a key, an input pen or an object adapted to a surface of the user interface (26). [8] Method according to one of the preceding claims, wherein the user input comprises a rotation of the identification object (60), a displacement of the identification object (60), a printing action with the identification object (60) or an approach of the identification object (60) to the user interface (26). [9] Method according to one of the preceding claims, wherein the operating device (20) is an operating device (20) of a motor vehicle (40). [10] A computer-readable storage medium having instructions which, when executed by a computer, cause the computer to execute the steps of a method according to any one of claims 1 to 9 for operating an operating device (20). [11] Operating device (20) with: - a detection unit (22) for detecting (10) an identification object (60) different from the operating device (20) by means of wireless communication technology; - an input detection unit (23) for detecting (11) a user input at a user interface (26); and - an execution unit (24) for executing (12) a function determined by the user input when the user input was carried out with the identification object (60). [12] Motor vehicle (40), wherein the motor vehicle (40) comprises an operating device (20) according to claim 11 or is configured to carry out a method according to one of claims 1 to 9 for operating an operating device (20).

Images