Method, computer program and device for adapting a system language to a user interface

Abstract

Method for adapting a system language to a user interface (41), comprising the steps: - Capturing (10) information about objects (71, 72) owned by a user (70) from which a language to be used by the user (70) can be derived; - Determine (11) the language to be used based on the information obtained; and - Setting (13) the system language of the user interface (41) to the specific language to be used.

Description

[0001] The present invention relates to a method, a computer program with instructions, and a device for adapting a system language to a user interface. The invention further relates to a means of transportation and a user interaction system in which a method or device according to the invention is used.

[0002] Motor vehicles often feature user interfaces that allow interaction with the user via a menu structure displayed on a screen or via natural language. The language used for the user interface, i.e., the system language, is determined by a language setting for the vehicle.

[0003] For example, DE 10 2007 011 039 A1 describes a hands-free device for communication between the driver and electronic systems in the motor vehicle. The functions of the systems can be controlled by voice commands comprising words, phrases, numbers, and system feedback. The voice commands and system feedback can be stored in other, non-standard languages.

[0004] DE 10 2014 210 716 A1 describes an assistance system that is at least partially controllable by means of voice input, comprising a functional unit and a speech recognition unit. The speech recognition unit has at least a first speech recognition module that assigns meaning to speech input according to a first system of rules, and a second speech recognition module that assigns meaning to speech input according to a second system of rules. Based on the results of each of the two speech recognition modules, the system determines which speech segments are processed by the first speech recognition module and which speech segments are processed by the second speech recognition module.

[0005] In rental vehicles, it can happen that a passenger doesn't speak the language the instruments are set to, or doesn't speak it well. While the language setting can usually be changed, the corresponding menus are often deeply nested and not easy to find, especially with limited knowledge of the currently active language.

[0006] Similar situations arise with point-of-sale or information terminals designed for interaction with a large number of users from diverse backgrounds. In such user interaction systems, the user often has to select a language before the desired interaction can take place. Alternatively, the interaction begins in a predefined system language, but the user has the option to change the language via a prominently placed button.

[0007] Against this background, US 2017 / 0116184 A1 describes an electronic device that can operate with different locales. The device includes a display unit for a graphical user interface, a sensor for capturing input, and a processor. The processor identifies the input language and sets a suitable locale based on the identified input language.

[0008] DE 10 2015 109 204 A1 describes a method for adjusting a device's language setting. In this method, user input is evaluated to determine whether the language context of the user input matches the current language setting. If this is not the case, the language setting is adjusted according to the determined language context.

[0009] DE 20 2012 013 394 U1 describes a system for determining a user's language intent. The system evaluates the text of a user request and the user's location with regard to language. Based on the identified languages, a language is determined to be used for outputting a response to the user request.

[0010] One objective of the invention is to provide improved solutions for adapting a system language to a user interface.

[0011] This problem is solved by a method having the features of claim 1, by a computer program with instructions according to claim 6, and by a device having the features of claim 7. Preferred embodiments of the invention are the subject of the dependent claims.

[0012] According to a first aspect of the invention, a method for adapting a system language to a user interface comprises the following steps: - Capturing information about objects owned by a user, from which a language to be used by the user can be derived; - Determining the language to be used based on the information gathered; and - Setting the system language of the user interface to the specific language to be used.

[0013] According to another aspect of the invention, a computer program contains instructions which, when executed by a computer, cause the computer to perform the following steps for adapting a system language to a user interface: - Capturing information about objects owned by a user, from which a language to be used by the user can be derived; - Determining the language to be used based on the information gathered; and - Setting the system language of the user interface to the specific language to be used.

[0014] The term "computer" is to be understood broadly. In particular, it also includes control units, embedded systems, distributed systems, and other processor-based data processing devices.

[0015] The computer program can, for example, be made available for electronic retrieval or be stored on a computer-readable storage medium.

[0016] According to another aspect of the invention, a device for adapting a system language to a user interface comprises: - a data capture module for capturing information about objects owned by a user, from which a language to be used by the user can be derived; - an evaluation module for determining the language to be used based on the information gathered; and - a control module for setting the system language of the user interface to the specific language to be used.

[0017] In the solution according to the invention, information is collected via various technical methods from which a language actually or likely to be used by the user or multiple users can be determined. This is generally the user's native language or a second language. If the language thus determined differs from the currently set system language of the user interface, the system language is set accordingly to the language used by the user. In this way, there is no need for the user to manually adjust the language settings, thus simplifying the operation of the user interface. The evaluation of the collected information can take place, for example, in a control unit for the user interface or alternatively or additionally in a backend.The evaluation by a backend has the advantage that the control unit only needs to provide reduced computing power for the user interface.

[0018] According to the invention, information about objects in the user's possession is recorded, which, for example, allows conclusions to be drawn about the user's place of origin. The place of origin, in turn, allows conclusions to be drawn about a language presumably used by the user. When evaluating the information, the various information sources can be considered with different weightings.

[0019] According to one aspect of the invention, data from a user's mobile device or smart card is read and compared with information in a database, or speech-related data from the mobile device is queried. Suitable objects in the user's possession for which information can be collected are mobile devices and smart cards. Examples of mobile devices are laptops, tablets, smartphones, and smartwatches. For these devices, hardware addresses (MAC addresses) of Bluetooth or WLAN receivers built into the devices can be passively read. By comparing this data with databases, it is possible to assign it to device manufacturers, countries of production, and countries of sale. Alternatively, speech-related data, such as the language settings of an operating system, can be actively queried via radio communication with these devices.Examples of chip cards include identity documents, credit or bank cards, insurance cards, etc. These can be read, for example, using near-field communication (NFC). The data obtained in this way can be assigned to specific issuing locations or countries and their respective national languages.

[0020] According to one aspect of the invention, booking data available to the user is also evaluated. If the user interface is, for example, that of a rental vehicle, communication with a booking system for the vehicle can take place. From the data stored in the booking system, such as name, address, and, for example, the country of origin of a flight (if a booking was made in this context), the language likely used by the user can be determined. Ideally, the booking system contains an explicit entry for a language used by the user.

[0021] According to one aspect of the invention, a probability value for the language to be used is determined based on the acquired information. The system language of the user interface is then set to the determined language to be used if the probability value exceeds a threshold. Depending on the available information, only assumptions can be made about the language to be used; that is, probability values ​​can be determined. This is particularly the case when a language is inferred from the place of origin, since the language preferred by the user is not necessarily the national language, or there may be several national languages. In such cases, it is useful to define a probability threshold to reduce the risk of erroneous or unnecessary changes to the system language.

[0022] According to one aspect of the invention, before setting the system language of the user interface, a prompt appears asking whether the system language of the user interface should be changed. Preferably, this prompt is provided via an additional menu item or a voice output. The prompt is preferably multilingual, at least in the currently set language and in the language to be used. This ensures that no unintended changes to the system language occur.

[0023] A method or device according to the invention is particularly advantageous when used in a means of transport, e.g., in a motor vehicle. However, the means of transport can also be a rail vehicle, a ship, or an aircraft, e.g., an air taxi, etc. Likewise, a method or device according to the invention can be used in a user interaction system, e.g., in a sales or information terminal or in a voice assistant.

[0024] Further features of the present invention will become apparent from the following description and the attached claims in conjunction with the figures. Fig. Figure 1 schematically shows a procedure for adapting a system language to a user interface; Fig. 2 shows a first embodiment of a device for adapting a system language of a user interface; Fig. Figure 3 shows a second embodiment of a device for adapting a system language of a user interface; Fig. Figure 4 schematically shows a system concept of a solution according to the invention; Fig. Figure 5 schematically represents a means of transport in which a solution according to the invention is implemented; and Fig. Figure 6 schematically represents a user interaction system in which a solution according to the invention is implemented.

[0025] To better understand the principles of the present invention, embodiments of the invention are explained in more detail below with reference to the figures. It is understood that the invention is not limited to these embodiments and that the described features can also be combined or modified without leaving the scope of protection of the invention as defined in the appended claims.

[0026] Fig. Figure 1 schematically illustrates a procedure for adapting a user interface's system language. In a first step, information relating to a user is collected from which a language to be used by the user can be derived. In particular, information about objects owned by the user can be collected. For example, data from a mobile device or a smart card belonging to the user can be read, or language-related data from the mobile device can be queried. Additionally, booking data available to the user can be retrieved. Based on the information gathered, the language to be used is then determined. A comparison can be made between the collected information and information in a database. Subsequently, a query can be performed to determine whether the system language of the user interface should be changed.Finally, the system language of the user interface is set to the specific language to be used. Preferably, as part of the procedure, a probability value for the language to be used is determined based on the acquired information. The system language of the user interface is then set to the specific language to be used if the probability value exceeds a threshold.

[0027] Fig. Figure 2 shows a simplified schematic representation of a first embodiment of a device 20 for adapting a system language of a user interface. The device 20 has an input 21 through which a data acquisition module 22 acquires information relating to a user, from which a language to be used by the user can be derived. In particular, information about objects in the user's possession can be acquired. For example, data from a mobile device or a smart card belonging to the user can be read, or language-related data from the mobile device can be queried. In addition, booking data available to the user can be retrieved. An evaluation module 23 determines the language to be used based on the acquired information. The evaluation module 23 can compare the acquired information with information in a database.A control module 24 then sets the system language of the user interface to the specified language to be used. Corresponding control commands can be provided via an output 27 of the device 20 for this purpose. The control module 24 can also be configured to prompt the user to change the system language of the user interface, for example, via an additional menu item or a voice output. Preferably, the evaluation module 23 determines a probability value for the language to be used based on the acquired information. The control module 24 then sets the system language of the user interface to the specified language to be used if the probability value exceeds a threshold.

[0028] The acquisition module 22, the evaluation module 23, and the control module 24 can be controlled by a control module 25. Settings of the acquisition module 22, the evaluation module 23, the control module 24, or the control module 25 can be changed via a user interface 28. The data generated in the device 20 can be stored in a memory 26 of the device 20 as needed, for example, for later evaluation or for use by the components of the device 20. The acquisition module 22, the evaluation module 23, the control module 24, and the control module 25 can be implemented as dedicated hardware, for example, as integrated circuits. Of course, they can also be partially or fully combined or implemented as software running on a suitable processor, such as a GPU or a CPU.Input 21 and output 27 can be implemented as separate interfaces or as a combined bidirectional interface. In . Fig. In Figure 2, the device 20 is implemented as an independent component. However, it can also be integrated into a control unit for the user interface.

[0029] Fig. Figure 3 shows a simplified schematic representation of a second embodiment of a device 30 for adapting a system language to a user interface. The device 30 comprises a processor 32 and a memory 31. For example, the device 30 is a computer or a control unit. Instructions are stored in the memory 31 which, when executed by the processor 32, cause the device 30 to perform the steps according to one of the described methods. The instructions stored in the memory 31 thus embody a program executable by the processor 32, which implements the method according to the invention. The device 30 has an input 33 for receiving information, in particular information relating to a user, from which a language to be used by the user can be derived. Data generated by the processor 32 is provided via an output 34.Furthermore, they can be stored in memory 31. Input 33 and output 34 can be combined into a bidirectional interface.

[0030] The processor 32 can comprise one or more processor units, such as microprocessors, digital signal processors, or combinations thereof.

[0031] The memory elements 26, 31 of the described embodiments can have both volatile and non-volatile memory areas and can include a wide variety of storage devices and storage media, for example hard disks, optical storage media or semiconductor memory.

[0032] Fig. Figure 4 schematically shows a system concept of a solution according to the invention. A user interface 41 is provided for interaction with a user 70. The user interface 41 is controlled by an associated control unit 42. To facilitate the operation of the user interface 41, language settings are to be automatically configured for the user 70. For this purpose, a device 20 for adapting a system language of the user interface 41 is provided. The device 20 uses information acquired with respect to the user 70, from which a language to be used by the user 70 can be derived. For example, speech utterances of the user 70 can be captured with a microphone 53. A communication module 54 also makes it possible to acquire information about objects in the possession of the user 70, e.g., a mobile device 71 or a chip card 72.The communication module 54 can enable communication via WLAN, Bluetooth, or NFC. For evaluation or partial evaluation of the acquired information, the device 20 can communicate wirelessly or via a wired connection with a backend 60. The backend 60 can then compare the acquired information with information in a database 61. Depending on the configuration, the device 20 can also access the database 61 directly. After the device 20 has determined the language to be used, it sets the system language of the user interface 41 to this language. For example, the device 20 can transmit corresponding control commands to the control unit 42 of the user interface 41.

[0033] Fig. Figure 5 schematically depicts a means of transport 40 in which a solution according to the invention is implemented. In this example, the means of transport 40 is a motor vehicle. The motor vehicle has a user interface 41 with an associated control unit 42. The user interface 41 and the control unit 42 can, for example, be implemented as the motor vehicle's infotainment system. The motor vehicle also has sensors 43 that can acquire information relating to a user, from which a language to be used by the user can be derived. The sensors 43 can, for example, include microphones for acquiring speech utterances or communication modules for acquiring information about objects in the user's possession. The communication modules can, for example, enable communication via WLAN, Bluetooth, or NFC.A device 20 for adapting the system language of the user interface 41 uses the information acquired by the sensor 43 to set the user interface 41 to a suitable system language. The device 20 can also be integrated into the control unit 42 for the user interface 41. A data transmission unit 44 is another component of the vehicle. The data transmission unit 44 can establish a connection to a backend 60, for example, to obtain additional user information or to perform a (partial) evaluation of the acquired information. A memory 45 is provided for storing data. Data exchange between the various components of the vehicle takes place via a network 46.

[0034] Fig.Figure 6 schematically depicts a user interaction system 50 in which a solution according to the invention is implemented. In this case, the user interaction system 50 is a sales terminal or an information terminal, e.g., for passenger information. However, the solution according to the invention can also be used in a voice assistant. The user interaction system 50 has a user interface 41 with a screen 51 on which a menu structure for interaction with a user can be displayed. The user interface 41 is controlled by a control unit 42. Voice output can be provided to the user via a loudspeaker 52. A microphone 53 can be used to capture the user's voice utterances. A communication module 54 also makes it possible to capture information about objects in the user's possession. The communication module 54 can, for example,to enable communication via WLAN, Bluetooth, or NFC. A device 20 for adapting the system language of the user interface 41 uses the information acquired by the microphone 53 or the communication module 54 to set the user interface 41 to a suitable system language. The device 20 can also be integrated into the control unit 42 for the user interface 41. Reference symbol list 10. Gathering information about a user from which a language to be used can be derived. 11. Determining the language to be used 12 prompts asking whether the system language of the user interface should be changed 13. Setting the system language of the user interface 20 Device Entrance 21 22 Data acquisition module 23 Evaluation module 24 Control module 25 Control module 26 storage 27 Exit 28 User interface 30 Device 31 storage 32 processor 33 Entrance 34 Exit 40 means of transport 41 User interface 42 Control unit 43 Sensors 44 Data transmission unit 45 storage 46 Network 50 User Interaction System 51-inch screen 52 speakers 53 Microphone 54 Communication module 60 Backend 61 database 70 users 71 Mobile device 72 chip cards

Claims

[1] Method for adapting a system language to a user interface (41), comprising the steps: - Capturing (10) information about objects (71, 72) owned by a user (70) from which a language to be used by the user (70) can be derived; - Determine (11) the language to be used based on the information obtained; and - Setting (13) the system language of the user interface (41) to the specific language to be used. [2] Method according to claim 1, wherein data from a mobile device (71) or a chip card (72) of the user (70) are read and compared with information in a database (61) or language-related data from the mobile device (71) are queried. [3] Method according to one of the preceding claims, wherein booking data available to the user (70) is additionally evaluated. [4] Method according to one of the preceding claims, wherein, based on the acquired information, a probability value for the language to be used is determined and the system language of the user interface (41) is set to the determined language to be used (13) when the probability value exceeds a threshold. [5] Method according to one of the preceding claims, wherein, prior to setting (13) the system language of the user interface (41), a query (12) is performed to determine whether the system language of the user interface (41) should be changed. [6] Computer program with instructions which, when executed by a computer, cause the computer to perform the steps of a method according to any one of claims 1 to 5 for adapting a system language to a user interface (41). [7] Device (20) for adapting a system language of a user interface (41), comprising: - a capture module (22) for capturing (10) information about objects (71, 72) owned by a user (70), from which a language to be used by the user (70) can be derived; - an evaluation module (23) for determining (11) the language to be used based on the information obtained; and - a control module (24) for setting (13) the system language of the user interface (41) to the specific language to be used. [8] means of transport (40), characterized by that the means of transport (40) has a device (20) according to claim 7 or is configured to perform a method according to any one of claims 1 to 5 for adapting a system language of a user interface (41) of the means of transport (40). [9] User interaction system (50), characterized bythat the user interaction system has or is configured to have a device (20) according to claim 7 to perform a method according to any one of claims 1 to 5 for adapting a system language of a user interface (41) of the user interaction system.

Images