Method and apparatus for automatically identifying vehicle system language based on vehicle and user information

Abstract

The present application belongs to the technical field of vehicle human-computer interaction, and provides a method and device for automatically identifying vehicle-machine system language based on vehicle and user information. The method for automatically identifying vehicle-machine system language based on vehicle and user information comprises judging whether voice information is received before the vehicle starts, and determining the vehicle-machine system language according to the judgment result; when voice information is received before the vehicle starts, and it is judged that the voice information comes from the driver, the language to which the driver voice information belongs is taken as the vehicle-machine system language; when no voice information is received before the vehicle starts, the official language of the region to which the vehicle belongs before starting is taken as the vehicle-machine system language. With the help of the original sensor setting of the vehicle, no additional sensor hardware needs to be installed, and a new method can realize automatic setting of the system language.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of vehicle human-computer interaction, and particularly relates to a method and device for automatically identifying a vehicle-machine system language based on vehicle and user information. BACKGROUND

[0002] The statements in this section merely provide background information related to the present application and do not necessarily constitute prior art.

[0003] The system language of current automobile instruments and large-screen displays is manually selected and set by a user, which brings some use troubles to the user, and the settings are fixed. If the language system of the user is different, some use troubles may be caused.

[0004] Meanwhile, for vehicle manufacturers, when the vehicle needs to be exported to different countries or regions, the general practice is to pre-set the system language options for the export region through fixed configuration. When the export region changes, the configuration needs to be changed. On the one hand, the configuration program needs to be changed, which produces additional workload. On the other hand, the current system language settings are manually set or selected according to geographic location information to set a language, which is single in form and cannot accurately achieve the way required by the current user. When the vehicle-machine system voice does not match, the user experience is poor. SUMMARY

[0005] In order to solve the technical problems in the background art, the present application provides a method and device for automatically identifying a vehicle-machine system language based on vehicle and user information, which can realize automatic setting of the system language without installing additional sensor hardware by means of the original vehicle equipped sensor settings.

[0006] In order to achieve the above purpose, the present application adopts the following technical solutions:

[0007] The first aspect of the present application provides a method for automatically identifying a vehicle-machine system language based on vehicle and user information.

[0008] In one or more embodiments, a method for automatically identifying a vehicle-machine system language based on vehicle and user information includes:

[0009] determining whether voice information is received before the vehicle starts, and determining the vehicle-machine system language according to the determination result;

[0010] when voice information is received before the vehicle starts and it is determined that the voice information comes from the driver, the language to which the driver voice information belongs is taken as the vehicle-machine system language;

[0011] When the voice information is not received before the vehicle starts, the official language of the region where the vehicle belongs before starting is taken as the car system language.

[0012] The above technical solution has the advantages that without increasing additional sensor hardware, whether the voice information is received before the vehicle starts is analyzed and determined, whether the voice information is from the driver is determined, the car system language is further determined, the configuration program does not need to be changed, thus no additional workload is generated; the car system language required by the current user can be automatically and accurately realized, and the problem of poor user experience caused by the mismatch of the car system voice is avoided.

[0013] As an implementation mode, when the car system language is the official language of the region where the vehicle belongs before starting, during the running of the vehicle, whether the voice information is received is dynamically determined, when the voice information is received and it is determined that the voice information is from the driver, the car system language is immediately updated, and the language of the driver voice information is taken as the car system language.

[0014] The above technical solution has the advantages that during the running of the vehicle, the driver voice information is dynamically determined and analyzed, the language of the driver voice information is taken as the highest priority to set the car system language, the individualization of the car system voice is realized, and the experience of the vehicle user is improved.

[0015] As an implementation mode, the process of determining whether the current voice information is from the driver is:

[0016] The voice information and the driver video information in the vehicle are obtained, and the voice features and the driver facial features are extracted respectively;

[0017] The extracted voice features are compared with the known voice features of the driver, and the driver facial features are combined to determine whether the current voice information is from the driver.

[0018] The above technical solution has the advantages that the owner of the voice information is determined by the voice features and the driver facial features, the accuracy of the determination is improved, and a data foundation is laid for the subsequent accurate setting of the car system language.

[0019] As an implementation mode, if the current voice information is not from the driver, the official language of the region where the current geographical position of the vehicle belongs is taken as the car system language.

[0020] The above technical solution has the advantages that under the premise that the driver voice information is not detected, the official language of the region where the current geographical position of the vehicle belongs is taken as the initial language of the car system, the vehicle can be matched with the current regional language, and the uniformization of the car system language is met.

[0021] The second aspect of the present application provides a device for automatically identifying the language of an in-vehicle infotainment system based on vehicle and user information.

[0022] In one or more embodiments, a device for automatically identifying the language of an in-vehicle infotainment system based on vehicle and user information comprises:

[0023] a voice information receiving judgment module for judging whether voice information is received before the vehicle is started;

[0024] an in-vehicle infotainment system language determination module for determining the language of the in-vehicle infotainment system according to the judgment result;

[0025] The in-vehicle infotainment system language determination module is further configured to:

[0026] when voice information is received before the vehicle is started and it is judged that the voice information is from the driver, the language of the driver's voice information is taken as the language of the in-vehicle infotainment system;

[0027] when no voice information is received before the vehicle is started, the official language of the region to which the vehicle belongs before the vehicle is started is taken as the language of the in-vehicle infotainment system.

[0028] As an implementation, in the in-vehicle infotainment system language determination module:

[0029] when the language of the in-vehicle infotainment system is the official language of the region to which the vehicle belongs before the vehicle is started, during the operation of the vehicle, it is dynamically judged whether voice information is received, and when voice information is received and it is judged that the voice information is from the driver, the language of the in-vehicle infotainment system is immediately updated, and the language of the driver's voice information is taken as the language of the in-vehicle infotainment system.

[0030] As an implementation, in the in-vehicle infotainment system language determination module:

[0031] the process of judging whether the current voice information is from the driver comprises:

[0032] acquiring voice information and driver video information in the vehicle, and extracting voice features and driver facial features, respectively;

[0033] comparing the extracted voice features with known voice features of the driver, and combining the driver facial features to judge whether the current voice information is from the driver.

[0034] As an implementation, in the in-vehicle infotainment system language determination module:

[0035] if the current voice information is not from the driver, the official language of the region to which the current geographical position of the vehicle belongs is taken as the language of the in-vehicle infotainment system.

[0036] In one or more embodiments, an apparatus for automatically identifying a car-machine system language based on vehicle and user information comprises an audio receiver, a positioning controller, a video information collector and a voice setting processor.

[0037] The audio receiver is configured to detect voice information in real time and transmit the voice information to the voice setting processor.

[0038] The video information collector is configured to collect driver video information and transmit the driver video information to the voice setting processor.

[0039] The positioning controller is configured to obtain geographical position information of a region where the vehicle is located before the vehicle is started and transmit the geographical position information to the voice setting processor.

[0040] The voice setting processor is configured to perform the steps of the method for automatically identifying a car-machine system language based on vehicle and user information as described above.

[0041] A third aspect of the present application provides a computer-readable storage medium.

[0042] In one or more embodiments, a computer-readable storage medium has a computer program stored thereon, the computer program being executed by a processor to implement the steps of the method for automatically identifying a car-machine system language based on vehicle and user information as described above.

[0043] Compared with the prior art, the present application has the following beneficial effects:

[0044] Without adding additional sensor hardware, the present application analyzes and determines whether voice information is received before the vehicle is started, determines whether the voice information is from the driver, further determines the car-machine system language, and does not need to change the configuration program, so that no additional workload is generated. The car-machine system language required by the current user can be automatically and accurately implemented, and the problem of poor user experience caused by the mismatch of the car-machine system voice is avoided.

[0045] The advantages of the additional aspects of the present application will be partially given in the following description, partially will become apparent from the following description, or will be understood by the practice of the present application. BRIEF DESCRIPTION OF DRAWINGS

[0046] The drawings constituting a part of the specification of the present application are used to provide a further understanding of the present application, the illustrative embodiments of the present application and the description thereof serve to explain the present application and do not constitute an improper limitation of the present application.

[0047] Figure 1 is a flow of a method for automatically identifying a car-machine system language based on vehicle and user information according to the first embodiment of the present application;

[0048] Figure 2is a device structure schematic diagram of the embodiment two of the present application;

[0049] Figure 3 is a device structure schematic diagram of the embodiment three of the present application. DETAILED DESCRIPTION

[0050] The present application will be further described below in conjunction with the accompanying drawings and embodiments.

[0051] It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the present application. Unless otherwise indicated, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present application pertains.

[0052] It should be noted that the terms used herein are only for the purpose of describing specific embodiments and are not intended to limit the exemplary embodiments according to the present application. As used herein, the singular form is intended to include the plural form unless the context clearly indicates otherwise, and it should also be understood that when the terms "comprise" and / or "include" are used in the specification, there is a presence of a feature, step, operation, device, component and / or combinations thereof.

[0053] Embodiment one

[0054] The specific implementation process of the method for automatically identifying the car machine system language based on vehicle and user information will be described in detail below in conjunction with Figure 1

[0055] According to Figure 1 , the method for automatically identifying the car machine system language based on vehicle and user information specifically comprises the following steps: judging whether voice information is received before the vehicle is started, and determining the car machine system language according to the judgment result.

[0056] It should be noted here that the voice information may include driver-only voice information, passenger-only voice information, or mixed voice information of the driver and the passenger.

[0057] Among them, the voice information can be collected by using the audio receiver possessed by the vehicle itself.

[0058] Specifically, when voice information is received before the vehicle is started, and it is judged that the voice information comes from the driver, the language to which the driver voice information belongs is taken as the car machine system language.

[0059] When no voice information is received before the vehicle is started, the official language of the region to which the vehicle belongs before the vehicle is started is taken as the car machine system language.

[0060] For example:​

[0061] When the voice information is received before the vehicle starts, and it is determined that the voice information is from the driver, assuming that the language of the driver voice information belongs to English, then English is taken as the car machine system language.

[0062] When the voice information is not received before the vehicle starts, the current geographical position of the vehicle is obtained, assuming that the current geographical position of the vehicle is Paris, France, and the official language of Paris, France is French, then French is taken as the car machine system language.

[0063] It should be noted here that the current geographical position of the vehicle can be obtained by the positioning controller provided by the vehicle.

[0064] In some specific implementations, the process of determining whether the current voice information is from the driver is:

[0065] The voice information and the driver video information in the vehicle are obtained, and the voice features and the driver facial features are extracted respectively;

[0066] The extracted voice features are compared with the known voice features of the driver, and the driver facial features are combined to determine whether the current voice information is from the driver.

[0067] In this way, the owner of the voice information is determined by combining the voice features and the driver facial features, which improves the accuracy of the determination and lays a data foundation for subsequent accurate setting of the car machine system language.

[0068] If the current voice information is not from the driver, the official language of the region to which the current geographical position of the vehicle belongs is taken as the car machine system language. Under the premise that the driver voice information is not detected, the official language of the region to which the current geographical position of the vehicle belongs is taken as the initial language of the car machine system, which can make the vehicle match the current regional language and meet the unified setting of the car machine system language.

[0069] In some specific implementations, when the car machine system language is the official language of the region to which the vehicle belongs before starting, during the operation of the vehicle, it is dynamically determined whether voice information is received, when the voice information is received and it is determined that the voice information is from the driver, the car machine system language is immediately updated, and the language of the driver voice information is taken as the car machine system language. In this way, during the operation of the vehicle, the language of the driver voice information is taken as the highest priority to set the car machine system language by dynamically determining and analyzing the voice information, which realizes the personalized setting of the car machine system voice and improves the user experience of the vehicle.

[0070] The embodiment can automatically and accurately realize the language mode of the vehicle machine system required by the current user without additional workload, and avoid the problem of poor user experience caused by the mismatch of the vehicle machine system voice.

[0071] Embodiment two

[0072] With reference to Figure 2 The embodiment provides a device for automatically identifying the language of a vehicle machine system based on vehicle and user information, which comprises a voice information receiving judgment module and a vehicle machine system language determination module.

[0073] The voice information receiving judgment module is used to judge whether voice information is received before the vehicle is started.

[0074] The vehicle machine system language determination module is used to determine the language of the vehicle machine system according to the judgment result.

[0075] The vehicle machine system language determination module is also used to:

[0076] When voice information is received before the vehicle is started, and it is judged that the voice information comes from the driver, the language of the driver's voice information is taken as the language of the vehicle machine system.

[0077] When no voice information is received before the vehicle is started, the official language of the region to which the vehicle belongs before being started is taken as the language of the vehicle machine system.

[0078] In the specific implementation process, in the vehicle machine system language determination module:

[0079] When the language of the vehicle machine system is the official language of the region to which the vehicle belongs before being started, during the operation of the vehicle, it is dynamically judged whether voice information is received, and when voice information is received and it is judged that the voice information comes from the driver, the language of the vehicle machine system is immediately updated, and the language of the driver's voice information is taken as the language of the vehicle machine system.

[0080] Specifically, in the vehicle machine system language determination module:

[0081] The process of judging whether the current voice information comes from the driver is:

[0082] Voice information and driver video information in the vehicle are obtained, and voice features and driver facial features are extracted, respectively;

[0083] The extracted voice features are compared with known voice features of the driver, and the driver facial features are combined to judge whether the current voice information comes from the driver.

[0084] In the car system language determination module, the official language of the region to which the current geographic position of the vehicle belongs is determined as the car system language if the current voice information is not from the driver.

[0085] If the current voice information is not from the driver, the official language of the region to which the current geographic position of the vehicle belongs is determined as the car system language.

[0086] It should be noted that the various modules in this embodiment correspond one-to-one to the various steps in Embodiment One, and the specific implementation process is the same, which will not be repeated here.

[0087] The embodiment further determines the car system language by analyzing and determining whether voice information is received before the vehicle starts and whether the voice information is from the driver without adding additional sensor hardware, without the need to change the configuration program, thus without additional workload; the current user's required car system language mode can be automatically and accurately achieved, and the problem of poor user experience caused by mismatching of the car system voice is avoided.

[0088] Embodiment Three

[0089] Referring to Figure 3 The embodiment provides a device for automatically identifying a car system language based on vehicle and user information, which comprises an audio receiver, a positioning controller, a video information collector, and a voice setting processor.

[0090] In the device, the audio receiver is configured to detect voice information in real time and transmit the voice information to the voice setting processor.

[0091] The audio receiver is configured to detect voice information in real time and transmit the voice information to the voice setting processor.

[0092] The video information collector is configured to collect driver video information and transmit the driver video information to the voice setting processor.

[0093] The positioning controller is configured to obtain geographic position information of the region to which the vehicle belongs before the vehicle starts and transmit the geographic position information to the voice setting processor.

[0094] The voice setting processor is configured to perform the steps of the method for automatically identifying a car system language based on vehicle and user information as described above.

[0095] In the device, the specific implementation process of the method for automatically identifying a car system language based on vehicle and user information is as described in Embodiment One, which will not be described in detail here.

[0096] The embodiment can automatically and accurately realize the vehicle machine system language mode required by the current user without increasing additional sensor hardware, without changing the configuration program, and without generating additional workload, thereby avoiding the problem of poor user experience caused by the mismatch of the vehicle machine system voice.

[0097] Embodiment Four

[0098] The embodiment provides a computer readable storage medium, which stores a computer program, and the program is executed by a processor to realize the steps in the method for automatically identifying a vehicle machine system language based on vehicle and user information.

[0099] The specific implementation process of the method for automatically identifying a vehicle machine system language based on vehicle and user information is described in Embodiment One, and will not be described in detail here.

[0100] The embodiment can automatically and accurately realize the vehicle machine system language mode required by the current user without increasing additional sensor hardware, without changing the configuration program, and without generating additional workload, thereby avoiding the problem of poor user experience caused by the mismatch of the vehicle machine system voice.

[0101] The present application is described with reference to flowcharts and / or block diagrams of the method, device (system) and computer program product according to the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of the flows and / or blocks in the flowcharts and / or block diagrams can be realized by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing devices to produce a machine, so that the instructions executed by the computer or other programmable data processing devices produce a device for realizing the functions specified in the flowcharts and / or block diagrams. Figure 1 The device for realizing the functions specified in one flow or multiple flows and / or blocks. Figure 1 The device for realizing the functions specified in one flow or multiple flows and / or blocks.

[0102] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by a computer program instructing relevant hardware, and the program can be stored in a computer readable storage medium. When the program is executed, the program can include the processes of the above-mentioned embodiment methods. The storage medium can be a magnetic disc, an optical disc, a read-only memory (ROM), a random access memory (RAM) or the like.

[0103] The above only describes the preferred embodiments of the present application and is not used to limit the present application. For those skilled in the art, the present application can have various modifications and changes. Any modification, equivalent replacement, improvement and the like within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A method for automatically recognizing the language of an in-vehicle infotainment system based on vehicle and user information, characterized in that, The method comprises the following steps: determining whether voice information is received before the vehicle starts, and determining the car system language according to the determination result; when voice information is received before the vehicle starts, and it is determined that the voice information comes from the driver, the language of the driver's voice information is taken as the car system language; when voice information is not received before the vehicle starts, the official language of the region where the vehicle is located before starting is taken as the car system language; when the car system language is the official language of the region where the vehicle is located before starting, during the operation of the vehicle, it is dynamically determined whether voice information is received, the language of the driver's voice information is taken as the highest priority to set the car system language, when voice information is received and it is determined that the voice information comes from the driver, the car system language is immediately updated, and the language of the driver's voice information is taken as the car system language.

2. The method for automatically identifying a system language of a vehicle based on vehicle and user information according to claim 1, wherein, The process of determining whether the current voice information comes from the driver comprises the following steps: acquiring voice information and driver video information in the vehicle, and extracting voice features and driver facial features respectively; comparing the extracted voice features with known voice features of the driver, and combining the driver facial features to determine whether the current voice information comes from the driver.

3. The method for automatically recognizing the language of a vehicle infotainment system based on vehicle and user information as described in claim 1, characterized in that, If the current voice information does not come from the driver, the official language of the region where the vehicle is currently located is taken as the car system language.

4. An apparatus for automatically identifying a language of an in-vehicle system based on vehicle and user information, employing the method for automatically identifying a language of an in-vehicle system based on vehicle and user information according to any one of claims 1 to 3, characterized by The method comprises the following steps: a voice information receiving determination module is used to determine whether voice information is received before the vehicle starts; a car system language determination module is used to determine the car system language according to the determination result; the car system language determination module is further used to: when voice information is received before the vehicle starts, and it is determined that the voice information comes from the driver, the language of the driver's voice information is taken as the car system language; when voice information is not received before the vehicle starts, the official language of the region where the vehicle is located before starting is taken as the car system language.

5. The apparatus for automatically identifying a system language of a vehicle based on vehicle and user information according to claim 4, wherein, In the car system language determination module: when the car system language is the official language of the region where the vehicle is located before starting, during the operation of the vehicle, it is dynamically determined whether voice information is received, when voice information is received and it is determined that the voice information comes from the driver, the car system language is immediately updated, and the language of the driver's voice information is taken as the car system language.

6. The apparatus for automatically identifying a system language of a vehicle based on vehicle and user information according to claim 4 or 5, wherein, In the car system language determination module: the process of determining whether the current voice information comes from the driver comprises the following steps: acquiring voice information and driver video information in the vehicle, and extracting voice features and driver facial features respectively; comparing the extracted voice features with known voice features of the driver, and combining the driver facial features to determine whether the current voice information comes from the driver.

7. The apparatus for automatically identifying a system language of a vehicle based on vehicle and user information according to claim 4 or 5, wherein, In the car system language determination module: if the current voice information does not come from the driver, the official language of the region where the vehicle is currently located is taken as the car system language.

8. A device for automatically recognizing the language of a vehicle infotainment system based on vehicle and user information, characterized in that, The method comprises the following steps: an audio receiver, a positioning controller, a video information collector and a voice setting processor; the audio receiver is used to detect voice information in real time and transmit it to the voice setting processor; the video information collector is used to collect driver video information and transmit it to the voice setting processor; The positioning controller is used to acquire geographical position information of the region before the vehicle starts and transmit to the voice setting processor; The voice setting processor is used to execute the steps in the method for automatically identifying the vehicle system language based on vehicle and user information according to any one of claims 1-3.

9. A computer readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor to implement the steps in the method for automatically identifying the vehicle system language based on vehicle and user information according to any one of claims 1-3.

Images