Vehicle control method, device and storage medium based on personalized voice

Through the binding and storage of user-defined personalized voice and control commands, the problem that existing vehicle voice control functions cannot be expanded and multiple control functions are solved, achieving personalized car use needs and higher user experience.

CN111883118BActive Publication Date: 2025-01-07ZHEJIANG GEELY AUTOMOBILE RES INST CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202010656466.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-07-09
Publication Date
2025-01-07
Estimated Expiration
2040-07-09

AI Technical Summary

Technical Problem

The voice control function of existing vehicles cannot meet users' personalized vehicle needs, cannot expand the control function, and cannot execute multiple control functions simultaneously through simple voice commands.

Method used

By guiding users to customize the binding of personalized voice and vehicle control commands, it is stored in the personalized voice repository, and corresponding control commands are executed when the vehicle safety control logic allows, user-defined voice interaction is realized.

Benefits of technology

It meets the needs of user-defined voice commands, allows users to add personalized voice commands to undefined functions, and execute multiple control functions through one voice command, improving user experience and convenience of use.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111883118B_ABST
    Figure CN111883118B_ABST
Patent Text Reader

Abstract

The present invention relates to a vehicle control method, device and storage medium based on personalized voice, which guides the user to complete the customized setting of personalized voice and at least one vehicle control command bound to the personalized voice; collects the voice information input by the user according to the voice recognition result; processes and recognizes the voice information to obtain the voice recognition result; retrieves the target personalized voice matching the voice information according to the voice recognition result; obtains at least one vehicle control command bound to the target personalized voice; executes at least one vehicle control command when the safety control logic allows, and interacts with the user's voice through the vehicle entertainment system. The method of the present invention realizes specific control of the vehicle through simple and personalized voice commands, providing users with more autonomous control experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicle control, and in particular to a vehicle control method, device and storage medium based on personalized voice. Background Art

[0002] With the continuous development of automotive electronics and vehicle network technology, the technology of in-vehicle human-computer interaction has also achieved rapid development. Among them, voice control technology has been widely used in human-computer interaction with the continuous evolution of machine language recognition algorithms. Voice control does not require the driver to manually operate buttons or the central control screen, nor does it require the driver to move his or her sight, which minimizes the distraction of the driver's attention. It has very significant advantages in various ways of human-computer interaction.

[0003] The voice control function on current mass-produced vehicles must use voice commands with specific meanings to achieve specific functions. For example, to open the sunroof, you must give a voice command similar to "open the sunroof" or something similar that is consistent with the function content to achieve a specific control function. The voice command is relatively fixed. In addition, users cannot expand the control functions of the vehicle. If a function does not define a voice control function, users cannot use voice commands to achieve the corresponding control function. In addition, most vehicles with voice control functions on the market currently do not support users entering voice commands corresponding to multiple control functions. If the user includes multiple control commands in a voice command, the vehicle will not be able to execute the corresponding control command or can only execute the first control command.

[0004] The above shortcomings affect the user experience of using the voice control function and cannot meet the user's personalized use needs. A voice interaction method or system that can personalize voice control commands, allow users to expand control functions, and implement multiple control functions simultaneously through simple voice commands is very meaningful for meeting the personalized car needs of different users and establishing a trendy brand image, reflecting care for users. Summary of the invention

[0005] The technical problem to be solved by the present invention is to further meet the personalized car-using habits of different users in voice interaction, expand the voice control function to the vehicle control function, and realize multiple control functions through simple voice commands.

[0006] In order to solve the above technical problems, the present invention discloses a vehicle control method, device and storage medium based on personalized voice. The specific technical solution is as follows:

[0007] In a first aspect, the present invention discloses a vehicle control method based on personalized voice, the method comprising:

[0008] Guiding the user to complete custom settings of the personalized voice and at least one vehicle control command bound to the personalized voice, and storing the personalized voice and at least one vehicle control command bound to the personalized voice in a personalized voice storage repository;

[0009] When the personalized voice control function is turned on, collect the voice information input by the user;

[0010] Processing and recognizing the voice information to obtain a voice recognition result;

[0011] According to the speech recognition result, a target personalized speech matching the speech information is retrieved from the personalized speech storage library;

[0012] Acquire at least one vehicle control command bound to the target personalized voice;

[0013] Under the premise that the vehicle safety control logic allows, execute the at least one vehicle control command and conduct voice interaction with the user through the vehicle entertainment system.

[0014] Further, guiding the user to complete customized settings of the personalized voice and at least one vehicle control command bound to the personalized voice includes:

[0015] In response to the user's demand for creating a new personalized voice, the personalized voice information input by the user is collected through the vehicle microphone;

[0016] Performing information processing and speech recognition on the personalized speech signal to obtain a first speech recognition result;

[0017] After the user confirms that the first voice recognition result is correct, at least one vehicle control command selected by the user for the personalized voice information is obtained.

[0018] Further, guiding the user to complete the customized setting of the personalized voice and at least one vehicle control command bound to the personalized voice also includes:

[0019] In response to the user's demand for creating a new personalized voice, the content of the personalized voice input by the user and at least one vehicle control command bound to the personalized voice are obtained through the personalized voice setting interface of the vehicle entertainment system or through a smart mobile device that is communicatively connected to the vehicle entertainment system.

[0020] Further, completing the customized setting of at least one vehicle control command bound to the personalized voice also includes:

[0021] Based on the vehicle control commands open to the user displayed on the personalized voice setting interface, obtaining at least one vehicle control command selected by the user for the personalized voice in the personalized voice setting interface, the at least one vehicle control command corresponding to at least one vehicle control function;

[0022] And / or, based on the user's direct control operation on the vehicle, the controller of the vehicle entertainment system collects and records the user's operation instructions as at least one vehicle control command bound to the personalized voice.

[0023] Furthermore, the method further comprises:

[0024] Controlling the turning on and off of the personalized voice control function through a preset voice control function of the vehicle or through a mobile smart terminal connected to the vehicle entertainment system;

[0025] When the personalized voice control function is turned off, the user's voice commands are recognized and processed according to the voice control logic preset by the vehicle entertainment system at the factory.

[0026] Furthermore, the method further comprises:

[0027] When the target personalized voice matching the voice recognition result is not retrieved in the personalized voice storage library, matching failure information is fed back, and recognition processing is performed according to the voice processing logic preset by the vehicle entertainment system at the factory.

[0028] Further, based on the vehicle safety control logic, judging whether to allow the execution of the at least one vehicle control command according to the current vehicle driving state;

[0029] When the at least one vehicle control command is not allowed to be executed, execution failure information is fed back, and voice interaction is performed with the user through the vehicle entertainment system.

[0030] In a second aspect, the present invention discloses a vehicle control device based on personalized voice, the device comprising:

[0031] A command input module, used to guide the user to complete the customized setting of the personalized voice and at least one vehicle control command bound to the personalized voice;

[0032] And, when the personalized voice control function is turned on, collect personalized voice information input by the user;

[0033] A speech recognition module, used to process and recognize the personalized speech information to obtain a speech recognition result;

[0034] A personalized voice processing module, configured to retrieve a target personalized voice matching the personalized voice information from the personalized voice storage repository according to the voice recognition result;

[0035] A personalized voice storage library, used to store the personalized voice and at least one vehicle control command bound to the personalized voice;

[0036] A vehicle controller, configured to obtain and make a judgment on at least one vehicle control command bound to the target personalized voice;

[0037] The actuator is used to execute the at least one vehicle control command under the premise that the vehicle safety control logic allows.

[0038] Furthermore, the instruction input module includes:

[0039] Microphone, used to collect user's voice information;

[0040] A voice collection and processing module, used for performing audio processing on the voice information;

[0041] And / or, an interactive interface of the vehicle entertainment system is used to obtain control instructions input by the user through a virtual keyboard.

[0042] In a third aspect, the present invention discloses a computer device, comprising a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement a personalized voice-based vehicle control method as described in the first aspect.

[0043] In a fourth aspect, the present invention discloses a computer storage medium, in which at least one instruction or at least one program is stored, and the at least one instruction or at least one program is loaded and executed by a processor to implement a personalized voice-based vehicle control method as described in the first aspect.

[0044] By adopting the above technical scheme, the personalized voice-based vehicle control method, device and storage medium described in the present invention have the following beneficial effects: the method provided by the present invention can meet the needs of users to customize voice commands, rather than completely following the voice command format set by the host manufacturer; at the same time, for vehicle control functions that do not have matching voice control functions, users can also add personalized voice commands to them; in addition, the method provided by the present invention realizes the execution of multiple control functions through simple voice commands, and is not limited to one voice command corresponding to one control function, which greatly meets the usage habits and usage needs of different users, especially for young customer groups. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0046] Figure 1 is a flow chart of a vehicle control method based on personalized voice provided by an embodiment of the present invention;

[0047] Figure 2 This is a flow chart of a user customizing and setting personalized voice provided by an embodiment of the present invention;

[0048] Figure 3 This is a schematic diagram of a system for implementing a customized personalized voice according to an embodiment of the present invention;

[0049] Figure 4 is a flow chart of a user using personalized voice control provided by an embodiment of the present invention;

[0050] Figure 5 is a schematic diagram of a system implementation using personalized voice control provided by an embodiment of the present invention;

[0051] Figure 6 is a structural schematic diagram of a vehicle control device based on personalized voice provided by an embodiment of the present invention;

[0052] Figure 7 The present invention provides a hardware structure block diagram of a computer device for running a vehicle control method based on personalized voice according to an embodiment of the present invention. DETAILED DESCRIPTION

[0053] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0054] "One embodiment" or "embodiment" referred to herein refers to a specific feature, structure or characteristic that may be included in at least one implementation of the present invention. In the description of the present invention, it should be understood that the terms "first", "second", "third" and "fourth" in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units that are inherent to these processes, methods, products or devices.

[0055] Embodiment 1

[0056] Figure 1 It is a flowchart of a personalized voice-based vehicle control method provided by an embodiment of the present invention. This specification provides method operation steps as described in the embodiment or flowchart, but may include more or fewer operation steps based on conventional or non-creative labor. The order of steps listed in the embodiment is only one way of executing the steps among many orders, and does not represent the only order of execution. When the actual system or server product is executed, it can be executed in sequence or in parallel (for example, in a parallel processor or multi-threaded processing environment) according to the method shown in the embodiment or the accompanying drawings. Specifically, Figure 1 As shown, the personalized voice-based vehicle control method may include:

[0057] S110: guiding the user to complete customized settings of the personalized voice and at least one vehicle control command bound to the personalized voice, and storing the personalized voice and at least one vehicle control command bound to the personalized voice in a personalized voice storage repository.

[0058] It is understandable that the voice control function on mass-produced cars currently requires preset specific language content and language form to realize the corresponding vehicle control function, and the preset voice commands are generally mechanical and fixed, and one voice command corresponds to one vehicle control function. For the user group pursuing fashion trends, it is impossible to meet their personalized needs for voice commands and personalized car-using habits. Therefore, the method provided by the present invention can enable users to set personalized voice according to their own preferences, such as adding buzzwords to voice commands, and at the same time correspond personalized voice to multiple vehicle control commands, providing users with personalized car-using experience.

[0059] In some feasible implementations, guiding the user to complete the customized setting of the personalized voice and at least one vehicle control command bound to the personalized voice may include the following steps:

[0060] S111: In response to the user's demand for creating a new personalized voice, the personalized voice information input by the user is collected through the vehicle-mounted microphone.

[0061] It can be understood that based on the personalized voice setting interface of the car entertainment system or the preset voice control function of the vehicle, the user's demand for creating a new personalized voice is obtained, and in response to the user's new demand, the voice collection function of the vehicle microphone is activated.

[0062] S112: Perform information processing and voice recognition on the personalized voice signal to obtain a first voice recognition result.

[0063] Specifically, endpoint detection is performed on the personalized voice signal to accurately determine the start and end time points of the personalized voice; then, voice enhancement processing is performed on the personalized language signal. Preferably, filtering can be used to eliminate the influence of environmental noise.

[0064] Specifically, the processed personalized voice signal is recognized based on feature extraction technology, pattern matching criteria, model training technology, etc. to obtain a first recognition result, which includes text content obtained after converting the personalized voice signal.

[0065] S113: After the user confirms that the first voice recognition result is correct, obtaining at least one vehicle control command selected by the user for the personalized voice information.

[0066] Preferably, the user can confirm whether the first voice recognition result is correct in the personalized voice setting interface of the vehicle entertainment system, and can also confirm whether the first recognition result is correct by the vehicle entertainment system reading and broadcasting the first voice recognition result.

[0067] Further, completing the customized setting of at least one vehicle control command bound to the personalized voice also includes:

[0068] Based on the vehicle control commands open to the user displayed on the personalized voice setting interface, obtaining at least one vehicle control command selected by the user for the personalized voice in the personalized voice setting interface, the at least one vehicle control command corresponding to at least one vehicle control function;

[0069] And / or, based on the user's direct control operation on the vehicle, the controller of the vehicle entertainment system collects and records the user's operation instructions as at least one vehicle control command bound to the personalized voice.

[0070] It is understandable that the voice commands in the preset voice control functions of the car entertainment system correspond to some vehicle control functions. On current mass-produced vehicles, users cannot add voice commands to other vehicle control functions and then control certain functions of the vehicle by voice. In the method provided in the embodiment of the present invention, in the process of user-defined personalized voice settings, all vehicle control functions that can be controlled by the user are opened to the user, making the scope of voice control larger and giving the user more vehicle autonomy; in addition, the user can combine multiple vehicle control functions into a control mode and add a personalized voice command to the mode, so that a simple voice command controls multiple complex commands or command sets, which improves the efficiency of the voice interaction system and the user experience.

[0071] Furthermore, in response to the user's demand for creating a new personalized voice, in addition to using the personalized voice setting interface of the car entertainment system, the user can also obtain the content of the personalized voice input by the user and at least one vehicle control command bound to the personalized voice through a smart mobile device that is communicated with the car entertainment system.

[0072] S120: When the personalized voice control function is turned on, voice information input by the user is collected.

[0073] Preferably, the method further comprises:

[0074] Controlling the turning on and off of the personalized voice control function through a preset voice control function of the vehicle or through a mobile smart terminal connected to the vehicle entertainment system;

[0075] When the personalized voice control function is turned off, the user's voice commands are recognized and processed according to the voice control logic preset by the vehicle entertainment system at the factory.

[0076] It is understandable that in order to avoid false triggering caused by users or other passengers, a personalized voice control function is set to be turned on and off in the car entertainment system. Users can avoid false triggering by turning off the personalized voice control recognition function; when a false triggering occurs, the user can use voice keywords such as "cancel" and other corresponding personalized voice commands to restore the vehicle to the state before the personalized voice command took effect.

[0077] S130: Processing and recognizing the voice information to obtain a voice recognition result.

[0078] Preferably, endpoint detection is performed on the voice information to accurately determine the start and end time points of the voice information; then, voice enhancement processing is performed on the voice information, and filtering can be used to eliminate the influence of environmental noise.

[0079] Preferably, the processed voice information is recognized based on feature extraction technology, pattern matching criteria, model training technology, etc. to obtain a voice recognition result, which includes text content obtained after converting the voice information.

[0080] S140: According to the speech recognition result, a target personalized speech matching the speech information is retrieved from the personalized speech storage library.

[0081] In some feasible implementations, the factory preset voice commands are searched to see if there is a voice command that matches the voice recognition result, and if not, the personalized voice storage library is searched to see if there is a target personalized voice that matches the voice information. Alternatively, the personalized voice storage library is preferentially searched for a target personalized voice that matches the voice information.

[0082] Preferably, the method further comprises:

[0083] When the target personalized voice matching the voice recognition result is not retrieved in the personalized voice storage library, matching failure information is fed back, and recognition processing is performed according to the voice processing logic preset by the vehicle entertainment system at the factory.

[0084] S150: Acquire at least one vehicle control command bound to the target personalized voice.

[0085] Specifically, at least one vehicle control command bound to the target personalized voice is obtained in the personalized voice repository, and the at least one vehicle control command is returned to the controller of the vehicle entertainment system, and the controller of the vehicle entertainment system sends the at least one vehicle control command to the corresponding controller of the entire vehicle.

[0086] S160: Under the premise that the vehicle safety control logic allows, execute the at least one vehicle control command and perform voice interaction with the user through the vehicle entertainment system.

[0087] Preferably, after the corresponding controller of the vehicle receives the vehicle control command, the current state of the actuator is sent back to the controller of the vehicle entertainment system, and the vehicle control command is responded to. The controller of the vehicle entertainment system stores the state information returned by the corresponding controller of the vehicle, so that the vehicle can return to the previous state after the user issues a cancel command. Under the premise that the safety control logic of the vehicle allows, the corresponding controller of the vehicle directly executes the corresponding vehicle control command, and after the execution is completed, the completion status is fed back to the controller of the vehicle entertainment system. The vehicle entertainment system interacts with the user through voice to inform the user that the corresponding function is successfully activated.

[0088] In some feasible implementations, the method further includes:

[0089] Based on the vehicle safety control logic, judging whether to allow execution of the at least one vehicle control command according to the current vehicle driving state;

[0090] When the at least one vehicle control command is not allowed to be executed, execution failure information is fed back, and voice interaction is performed with the user through the vehicle entertainment system.

[0091] Embodiment 2

[0092] The vehicle control method based on personalized voice provided by the present invention mainly includes two links: one is the link of user customizing and setting personalized voice, and the other is the link of using personalized voice to control the vehicle.

[0093] Figure 2 is a flow chart of a user customizing and setting personalized voice provided by an embodiment of the present invention, Figure 4 This is a schematic diagram of a system implementation for customizing personalized voice settings provided by an embodiment of the present invention. This specification provides method operation steps as described in the embodiment or flowchart, but more or fewer operation steps may be included based on routine or non-creative labor. The order of steps listed in the embodiment is only one of many step execution orders and does not represent the only execution order. Specific combination Figure 2 and Figure 4 As shown, the process of user-defined setting of personalized voice in the personalized voice-based vehicle control method may include:

[0094] S210: Based on the personalized voice setting interface pre-added in the vehicle entertainment system, the user enters the interface and selects to create a new voice control command.

[0095] S220: The personalized voice input by the user is collected by the microphone in the vehicle through voice input and transmitted to the voice collection processing module, which sends the processed voice signal to the voice recognition module in the vehicle entertainment controller in each vehicle entertainment system for voice recognition. The voice result recognized by the voice recognition module is sent to the personalized voice processing module in the vehicle entertainment controller, and the personalized voice processing module stores the corresponding voice input in the personalized voice storage library. Figure 4 The dotted-line box portion can also be implemented through the keyboard on the vehicle system or a personal mobile device connected to the vehicle system.

[0096] S230: The user confirms in the interactive interface of the vehicle entertainment system whether the personalized voice command recognized and displayed by the vehicle entertainment system is correct.

[0097] S240: Selecting a corresponding vehicle control instruction or instruction set for the personalized voice instruction.

[0098] Preferably, one selection method is to provide all vehicle control instructions opened to users by the OEM in the human-machine interaction interface of the vehicle, and the user can select one or more control instructions corresponding to the personalized voice instruction and make corresponding detailed operation definitions; another method is that the user directly performs the corresponding operation in the vehicle, and the controller of the vehicle entertainment system records all the user's operation instructions and displays them in the interactive interface for the user to confirm. After the user finally confirms the corresponding control instruction, the personalized voice processing module saves the corresponding control instruction and associates it with the corresponding personalized voice instruction and stores it in the personalized voice library, and the personalized voice instruction is successfully created.

[0099] Figure 3 is a flow chart of a user using personalized voice control provided by an embodiment of the present invention, Figure 5 This is a schematic diagram of a system implementation using personalized voice control provided by an embodiment of the present invention. This specification provides method operation steps as described in the embodiment or flow chart, but more or fewer operation steps may be included based on routine or non-creative labor. The order of steps listed in the embodiment is only one way of executing the steps among many, and does not represent the only execution order. Specific combination Figure 3 and Figure 5 As shown, the process of using personalized voice to control the vehicle in the personalized voice-based vehicle control method may include:

[0100] S310: When the personalized voice command is successfully set and in the function activation state, the voice command issued by the user is transmitted to the voice acquisition processing module through the vehicle microphone for filtering and noise reduction, and the voice acquisition processing module sends the processed voice signal to the voice recognition module in the vehicle entertainment controller. The voice result recognized by the voice recognition module is transmitted to the personalized voice processing module in the vehicle entertainment controller. Figure 5 The dotted-line frame portion can also be realized through a personal mobile device connected to the vehicle computer.

[0101] S320: The personalized voice processing module first searches for the personalized voice stored in the personalized voice storage library. If there is no matching voice command, it feeds back information that no personalized voice matching signal is found to the vehicle entertainment controller, so that it is processed according to the general vehicle voice processing logic.

[0102] S330: If there is a matching personalized voice command, the personalized voice processing module obtains the control command corresponding to the personalized voice from the personalized voice storage library, and feeds it back to the vehicle entertainment controller, which sends the control command to the corresponding vehicle controller of the entire vehicle.

[0103] S340: After receiving the control command, the vehicle controller sends the current state of the actuator or control function back to the vehicle entertainment controller and responds to the control command. The vehicle entertainment controller stores the state information returned by the corresponding vehicle controller so as to return to the previous state when the user cancels the personalized voice command.

[0104] S350: For safety reasons, the corresponding controller of the vehicle will have a set of logic inside to determine whether to execute specific control instructions based on the current driving status of the vehicle. If it is determined that the control instruction cannot be executed, a signal that the car entertainment controller cannot execute the instruction will be directly fed back, and the car entertainment controller will interact with the user through voice to inform the user that the control function cannot be activated in the current vehicle status; if it is determined that the control instruction can be executed, the control instruction will be directly executed, and after the instruction is executed, feedback will be given to the car entertainment controller, and the car entertainment controller will interact with the user through voice to inform the user that the corresponding control function has been successfully activated.

[0105] For example, after selecting a new voice control command, the user can input "Burn, my little universe!", then select the driving mode as "Sports" in the interactive interface, adjust the color of the interior ambient light to "red", adjust the audio volume to 50%, and store the voice command. After activating the personalized voice function, when the user issues the voice command "Burn, my little universe" in the car, the entire vehicle will automatically adjust the driving mode, the color of the ambient light and the volume; after issuing the command "Cancel: Burn, my little universe", the entire vehicle will automatically adjust and restore to the state before the personalized command takes effect.

[0106] Embodiment 3

[0107] The embodiment of the present invention also provides a vehicle control device based on personalized voice, such as Figure 6 As shown, the personalized voice-based vehicle control device includes:

[0108] The command input module 610 is used to guide the user to complete the customized setting of the personalized voice and at least one vehicle control command bound to the personalized voice;

[0109] And, when the personalized voice control function is turned on, the personalized voice information input by the user is collected.

[0110] Furthermore, the instruction input module may include:

[0111] Microphone, used to collect user's voice information;

[0112] The voice collection and processing module 620 is used to perform audio processing on the voice information;

[0113] And / or, an interactive interface of the vehicle entertainment system is used to obtain control instructions input by the user through a virtual keyboard.

[0114] The speech recognition module 630 is used to process and recognize the personalized speech information to obtain a speech recognition result.

[0115] The personalized voice processing module 640 is used to retrieve a target personalized voice matching the personalized voice information from the personalized voice storage library according to the voice recognition result.

[0116] The personalized voice storage library 650 is used to store the personalized voice and at least one vehicle control command bound to the personalized voice.

[0117] In some feasible implementations, the voice recognition module 630, the personalized voice processing module 640 and the personalized voice storage library 650 are integrated in the vehicle entertainment system or other controllers on the vehicle, or the personalized voice processing module 640 and the personalized voice storage library 650 are integrated in an independent controller.

[0118] The vehicle controller 660 is used to obtain at least one vehicle control command bound to the target personalized voice and make a judgment.

[0119] The actuator 670 is used to execute the at least one vehicle control command under the premise that the vehicle safety control logic allows.

[0120] The personalized voice-based vehicle control device and method embodiment described in the embodiment of the present invention are based on the same inventive concept. For details, please refer to the method embodiment, which will not be described again here.

[0121] An embodiment of the present invention also provides a computer device, comprising: a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement a vehicle control method based on personalized voice as in an embodiment of the present invention.

[0122] The memory can be used to store software programs and modules, and the processor executes various functional applications by running the software programs and modules stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, application programs required for functions, etc.; the data storage area can store data created according to the use of the device, etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory can also include a memory controller to provide the processor with access to the memory.

[0123] The method embodiments provided in the embodiments of the present invention may be executed in a computer terminal, a server or a similar computing device, that is, the above-mentioned computer device may include a computer terminal, a server or a similar computing device. Figure 7 is a hardware structure block diagram of a computer device for running a vehicle control method based on personalized voice provided by an embodiment of the present invention, such as Figure 7 As shown, the internal structure of the computer device may include but is not limited to: a processor, a network interface and a memory. The processor, network interface and memory in the computer device may be connected via a bus or other means. Figure 7 The example of connecting through bus is taken in the following.

[0124] Among them, the processor (or CPU (Central Processing Unit)) is the computing core and control core of the computer device. The network interface may optionally include a standard wired interface, a wireless interface (such as WI-FI, a mobile communication interface, etc.). Memory is a memory device in a computer device for storing programs and data. It is understandable that the memory here can be a high-speed RAM storage device or a non-volatile memory device (non-volatile memory), such as at least one disk storage device; optionally, it can also be at least one storage device located away from the aforementioned processor. The memory provides a storage space, which stores the operating system of the electronic device, which may include but is not limited to: Windows system (an operating system), Linux (an operating system), Android (Android, a mobile operating system) system, IOS (a mobile operating system) system, etc., and the present invention is not limited to this; and, in the storage space, one or more instructions suitable for being loaded and executed by the processor are also stored, and these instructions may be one or more computer programs (including program codes). In the embodiment of this specification, the processor loads and executes one or more instructions stored in the memory to implement the vehicle control method based on personalized voice provided in the above method embodiment.

[0125] An embodiment of the present invention also provides a computer storage medium, in which at least one instruction or at least one program is stored. The at least one instruction or the at least one program is loaded and executed by the processor to implement a personalized voice-based vehicle control method as described in an embodiment of the present invention.

[0126] Optionally, in this embodiment, the above-mentioned storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store program codes.

[0127] It should be noted that the sequence of the embodiments of the present invention described above is for description only and does not represent the advantages and disadvantages of the embodiments. The above describes specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0128] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device, system and server embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0129] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0130] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A vehicle control method based on personalized voice, characterized in that: The method comprises: Guiding the user to complete custom settings of the personalized voice and at least one vehicle control command bound to the personalized voice, and storing the personalized voice and at least one vehicle control command bound to the personalized voice in a personalized voice storage repository; When the personalized voice control function is turned on, collect the voice information input by the user; Processing and recognizing the voice information to obtain a voice recognition result; According to the speech recognition result, a target personalized speech matching the speech information is retrieved from the personalized speech storage library; Acquire at least one vehicle control command bound to the target personalized voice; Under the premise that the vehicle safety control logic allows, execute the at least one vehicle control command and perform voice interaction with the user through the vehicle entertainment system; The step of guiding the user to complete the customized setting of the personalized voice and at least one vehicle control command bound to the personalized voice includes: In response to the user's demand for creating a new personalized voice, the personalized voice information input by the user is collected through the vehicle microphone; Performing information processing and voice recognition on the personalized voice information to obtain a first voice recognition result; the first voice recognition result includes text content obtained after converting the personalized voice information; After the user confirms that the first voice recognition result is correct, obtaining at least one vehicle control command selected by the user for the personalized voice information; The completing the customized setting of at least one vehicle control command bound to the personalized voice further includes: Based on the vehicle control commands open to the user displayed on the personalized voice setting interface, obtaining at least one vehicle control command selected by the user for the personalized voice in the personalized voice setting interface, the at least one vehicle control command corresponding to at least one vehicle control function; And / or, based on the user's direct control operation on the vehicle, the controller of the vehicle entertainment system collects and records the user's operation instructions as at least one vehicle control command bound to the personalized voice.

2. The vehicle control method based on personalized voice according to claim 1, characterized in that: The step of guiding the user to complete the customized setting of the personalized voice and at least one vehicle control command bound to the personalized voice further includes: In response to the user's demand for creating a new personalized voice, the content of the personalized voice input by the user and at least one vehicle control command bound to the personalized voice are obtained through the personalized voice setting interface of the vehicle entertainment system or through a smart mobile device that is communicatively connected to the vehicle entertainment system.

3. The vehicle control method based on personalized voice according to claim 1, characterized in that: The method further comprises: Controlling the turning on and off of the personalized voice control function through a preset voice control function of the vehicle or through a mobile smart terminal connected to the vehicle entertainment system; When the personalized voice control function is turned off, the user's voice commands are recognized and processed according to the voice control logic preset by the vehicle entertainment system at the factory.

4. The vehicle control method based on personalized voice according to claim 1, characterized in that: The method further comprises: When the target personalized voice matching the voice recognition result is not retrieved in the personalized voice storage library, matching failure information is fed back, and recognition processing is performed according to the voice processing logic preset by the vehicle entertainment system at the factory.

5. The vehicle control method based on personalized voice according to claim 1, characterized in that: The method further comprises: Based on the vehicle safety control logic, judging whether to allow execution of the at least one vehicle control command according to the current vehicle driving state; When the at least one vehicle control command is not allowed to be executed, execution failure information is fed back, and voice interaction is performed with the user through the vehicle entertainment system.

6. A vehicle control device based on personalized voice, characterized in that: The device comprises: A command input module, used to guide the user to complete the customized setting of the personalized voice and at least one vehicle control command bound to the personalized voice; And, when the personalized voice control function is turned on, the personalized voice information input by the user is collected; the voice recognition module is used to process and recognize the personalized voice information to obtain a voice recognition result; A personalized voice processing module, configured to retrieve a target personalized voice matching the personalized voice information from a personalized voice storage repository when the voice recognition result indicates that the personalized voice information is a personalized voice; A personalized voice storage library, used to store the personalized voice and at least one vehicle control command bound to the personalized voice; A vehicle controller, used to obtain and make a judgment on at least one vehicle control command bound to the target personalized voice; An actuator, configured to execute the at least one vehicle control command under the premise that the vehicle safety control logic permits; The device is also used for: In response to the user's demand for creating a new personalized voice, the personalized voice information input by the user is collected through the vehicle microphone; Performing information processing and voice recognition on the personalized voice information to obtain a first voice recognition result; the first voice recognition result includes text content obtained after converting the personalized voice signal; After the user confirms that the first voice recognition result is correct, obtaining at least one vehicle control command selected by the user for the personalized voice information; Based on the vehicle control commands open to the user displayed on the personalized voice setting interface, obtaining at least one vehicle control command selected by the user for the personalized voice in the personalized voice setting interface, the at least one vehicle control command corresponding to at least one vehicle control function; And / or, based on the user's direct control operation on the vehicle, the controller of the vehicle entertainment system collects and records the user's operation instructions as at least one vehicle control command bound to the personalized voice.

7. The vehicle control device based on personalized voice according to claim 6, characterized in that: The instruction input module comprises: Microphone, used to collect user's voice information; A voice collection and processing module, used for performing audio processing on the voice information; And / or, an interactive interface of the vehicle entertainment system is used to obtain control instructions input by the user through a virtual keyboard.

8. A computer storage medium, characterized in that The computer storage medium stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement a personalized voice-based vehicle control method as described in any one of claims 1 to 5.

Citation Information

Patent Citations

  • Vehicle-mounted speech control method and device

    CN105989841A

  • Vehicle-mounted voice interaction method, server, vehicle and storage medium

    CN111002996A