Method for a vehicle user to learn a new language

Abstract

The invention relates to a method for teaching a vehicle user a new language, in which a language learning control system located in the vehicle identifies the user's language level using the vehicle's built-in speech recognition system. In a method that can be easily executed while the vehicle is in motion, the language learning control system for a selected language is integrated into the vehicle's navigation system, and interactive language exercises in the selected language are activated when the vehicle reaches predefined local navigation points.

Description

The invention relates to a method for learning a new language for a vehicle user, in which a language learning controller located in the vehicle identifies a language level of the vehicle user using the speech recognition installed in the vehicle.DE 10 2006 049 561 A1 discloses a speech recognition-based device control device which can correctly determine the speech utterance learning level of a user and permits effective interaction. It comprises a voice input unit for receiving speech input, a speech recognition unit for recognizing the speech input, a response output unit for outputting a response to the user, and a device control unit for controlling a device based on a recognition result of the speech recognition unit. The vehicle-mounted controller of the voice recognition unit includes a determination unit for determining the speech learning degree of the user based on a comparison between the number of items identified from the recognized speech and a set reference value.WO 2022003104 A1 describes a system and method for assisting a user in learning a target non-native speech comprising a processor executing instructions stored on a computer readable medium, the executed instructions causing the processor to provide the user with an audible presentation of a word or phrase, the target non-native speech, and prompting the user to audibly respond with speech data. The system senses the acoustic response and converts the acoustic response to input text data. It then evaluates the text data for accuracy by comparing text characters in the text data with expected text data in a database. The system calculates the number of erroneous characters in the text data, then converts the evaluated text data into an output audio file, and prereads the audio file to the user. The feedback provided by the system provides the user with acoustic feedback about the correctness of the text data evaluated.DE 102020209453 A1 discloses a method for augmented reality display for users in a motor vehicle. It is provided that a target language selected by a user is provided, an environment of the motor vehicle is mapped, at least one object contained in the environment is recognized and classified, an object designation is determined in the selected target language, a virtual highlight of the determined object of the environment is displayed, and the object designation is displayed in the target language as virtual information according to the user's preference.From DE 102019115504 A1 a question-answer system for a motor vehicle is known, wherein the question-answer system comprises an output unit configured to output visual and / or acoustic information to a user via one or more output means of the motor vehicle, and an input unit configured to receive an input of a user via one or more input means of the motor vehicle. The question-answer system comprises a data memory, wherein the data memory is configured to store any storable content in the form of questions and associated answers. The question-answer system comprises a processing unit configured to output a question of the stored content as visual and / or acoustic information via the output unit, to receive an input of the user in response via the input unit and to output further visual and / or acoustic information to the user in response to the input.DE 102021003343 A1 discloses a method for individually adapting information to be optically and / or acoustically output on the vehicle side to a speech level of an occupant of a vehicle. According to the invention, it is provided that it is determined on the basis of spoken persons recorded on the vehicle side whether the speaking person is a vehicle user as occupant or a further occupant of the vehicle, the spoken language is evaluated by the occupant and an individual language level of the occupant is determined on the basis of words used, including a printout and addressed topic fields, and the output of the vehicle-side optical and / or acoustic information is output in a manner adapted to the determined individualized and personalized language pattern of the occupant.It is an object of the invention to specify a method for learning a new language for a vehicle user, which method can be executed easily during the journey of the vehicle.The invention results from the features of the independent claims. Advantageous refinements and refinements are the subject matter of the dependent claims. Further features, possible applications and advantages of the invention are evident from the following description and from the explanation of exemplary embodiments of the invention which are illustrated in the figure.The object is achieved by the subject matter of claim 1.In the method explained at the beginning for learning a new language for a vehicle user, in which a language learning control located in the vehicle identifies a language level of the vehicle user using the speech recognition installed in the vehicle, the language learning control for a selected language is introduced in a navigation system of the vehicle, wherein interactive speech trainings in the selected language are activated when predefined local navigation points are reached by the vehicle. This has the advantage that drivers and / or passengers can use the navigation in the vehicle in a meaningful manner during the trip in order to learn a speech without these being distracted from the current driving situation. By means of the navigation guidance, a player learning of a language becomes possible.Advantageously, speech trainings are triggered by the speech learning control at the local navigation points in accordance with the identified speech level of the vehicle user. By recognizing the speech level of the vehicle user, the speech learning controller can automatically adjust to the vehicle user. This eliminates the need for a second-expensive setting or setting procedure. Installation Operations in Vehicle.In one embodiment, the voice training varies depending on the voice level of the vehicle user between the crosstalk or translation of individual words until complete conversations are carried by a voice assistant of the vehicle. Thus, the speech learning control is to be used for vehicle users from the beginner to a learner with approximately mother-speech knowledge.In one variant, when errors of the vehicle user are identified, the speech exercises of the speech level are adaptively adjusted. By means of such intelligent speech learning control, the speech training is improved and further speech training can be carried out in accordance with the errors.In one embodiment, the words or phrases that are detected during the voice exercise are typed into an operating unit of the vehicle by the vehicle user. Thus, the state of the jurisdiction and / or the composition of the vehicle user can be simultaneously checked.It is advantageous if the local navigation points along the travel route of the vehicle are displayed to the vehicle user in a digital map of the navigation system. The activation of the speech exercise can then also take place when the vehicle reaches the local navigation point, so that a spatial relationship to a speech exercise is established. Such local navigation points can be, for example, points of interest, such as locks, churches, museums and the like, or infrastructure nodes, such as railroad stations and airports.In a further embodiment, the navigation points displayed in the digital map correspond to the content of a vocabulary of the voice training. Thus, the vocabulary is visualized on the digital map, promoting the speech learning process.In a further variant, the selected speech to be learned is set independently of a speech region in which the vehicle is moving. That is, in a travel through spain, French and vice versa can be learned.In a further embodiment, the speech level reached by the vehicle user during the journey is stored in a learning profile of a user profile of the vehicle user, which is stored in a vehicle backend. The user profile can thus be retrieved by the vehicle user in another vehicle and the learning process can be continued in the other vehicle.Further advantages, features and details are evident from the following description, in which--possibly with reference to the drawing--at least one exemplary embodiment is described in detail. Features described and / or depicted in the figures can form the subject matter of the invention on their own or in any meaningful combination, optionally also independently of the claims, and can in particular additionally also be the subject matter of one or more separate application / s. Identical, similar and / or functionally identical parts are provided with the same reference numerals.It shows: FIG. 1 shows an exemplary embodiment of a vehicle for carrying out the method according to the invention.FIG. 1 shows an exemplary embodiment of a vehicle 1 for carrying out the method according to the invention. The vehicle 1 comprises a navigation system 3, which is used for route planning of the vehicle 1. The navigation system 3 is coupled to a voice assistant 5, which has a voice output unit 7 and a voice input unit 9. Furthermore, the navigation system 3 is connected to a display and operating unit 11, which is designed, for example, as a touchscreen. The navigation system 3 wirelessly communicates with a server of a vehicle backend 15 via a transmitting / receiving unit 13.Stored in the voice assistant 5 is control software for learning languages, for example French, which is designed for different language levels of the vehicle user. A plurality of miniselections are provided for each voice level, which miniselections are installed in a selected route when the vehicle 1 is being driven.The driver inputs his destination into the navigation system 3 at the beginning of the trip, as is customary, and the navigation system 3 establishes a route for the vehicle. At the same time, the vehicle user who wishes to improve his French voice knowledge notifies the voice assistant 5 of his identity. Via the navigation system 3, the voice assistant 5 queries the vehicle backend 15 for the user profile of the identified vehicle user. A learning profile for the desired language is stored in the user profile, from which the voice assistant 5 determines the voice level of the vehicle user. At the start of the route, miniselections corresponding to the speech level are called and assigned to various points of the digital map which are displayed on the display and operating element 11 and installed in the route.If the vehicle 1 travels past a kirch, for example, at the set lowest speech level, the speech output unit 7 first provides individual vocabulary that is reproved by the vehicle user, which is recorded by the speech recording unit 9 and is examined by the speech assistant 5 for possible errors. If errors have been detected, the speech strokes are repeated until the pronunciation is almost errorless. Subsequently, these words are used to form phrases which are likewise reproved and / or translated by the vehicle user. If the vehicle reaches the next point on the digital map, where a museum is located, for example, comparable voice training is performed with voice cables around the museum. This procedure is repeated at further points identified on the digital map.In the case of a further minilection of the next speech level, the speech assistant 5 attempts to come into conversation with the vehicle user. In this case, a dialogue is carried out with questions and answers between the voice assistant 5 and the vehicle user. In this case, further passengers of the vehicle 1 can also be included by the voice assistant 5. There is also the possibility that post-trial words or phrases are input by the vehicle user into the display and control unit 11 in order to check the jurisdiction. Errors detected in this case are also corrected in the subsequent speech exercises.The completion of the speech strokes can be, for example, the starting of a drive-in switch of a fast food chain, where the vehicle user orders a menu in the learned speech. The call is checked by the voice assistant.The voice assistant 5 recognizes when the vehicle user has reached such a voice level that he can make a voice-patient completion A 1 to C 2 It then proposes a final test run with corresponding miniselections, which can end at a corresponding test point, such as a people school.List of reference characters1 Vehicle 3 Navigation system 5 Voice assistant 7 Voice output unit 9 Voice input unit 11 Display and operating unit 13 Transmission / reception unit 15 Vehicle backend

Claims

Method for learning a new language for a vehicle user, in which a speech learning controller located in the vehicle identifies a speech level of the vehicle user using the speech recognition installed in the vehicle, characterized in that the speech learning controller for a selected language is introduced into a navigation system of the vehicle, wherein interactive speech trainings in the selected language are activated when predetermined local navigation points are reached by the vehicle.Method according to Claim 1, characterized in that the speech learning controller triggers speech exercises at the local navigation points in accordance with the identified speech level of the vehicle user.Method according to Claim 1 or 2, characterized in that the voice training varies depending on the voice level of the vehicle user between the crosstalk or translation of individual words until complete conversations are carried by a voice assistant of the vehicle.Method according to Claim 1, 2 or 3, characterized in that, in the event of identification of faults of the vehicle user, the speech exercises of the selected speech level are adaptively adjusted.Method according to at least one of the preceding claims, characterized in that the words or phrases which are satisfied during the speech exercise are typed into an operating unit of the vehicle.Method according to at least one of the preceding claims, characterized in that the local navigation points along the travel route of the vehicle are displayed to the vehicle user in a digital map of the navigation system.Method according to claim 6, characterised in that the navigation points displayed in the digital map correspond to the content of a vocabulary.Method according to at least one of the preceding claims, characterized in that the selected speech to be learned is set independently of a speech region in which the vehicle is moving.Method according to at least one of the preceding claims, characterized in that the speech level reached by the vehicle user during the journey is stored in a learning profile of a user profile of the vehicle user, which learning profile is stored in a vehicle backend.

Images