Voice assistant interaction method and device, equipment and storage medium

Abstract

The invention relates to a voice assistant interaction method and device, equipment and a storage medium, and relates to the technical field of vehicle intelligent control. At least the technical problems of low efficiency, poor accuracy and poor user experience of voice assistant interaction in related technologies are solved, and the method comprises the steps that under the condition that a vehicle-mounted device in a vehicle is powered on, character features corresponding to a target user in the vehicle are collected, and the character features are any one of facial features and voiceprint features; the vehicle machine comprises a plurality of pre-created exclusive voice sprite, and each exclusive voice sprite is bound with at least one of the following items: facial features and voiceprint features; identifying character features corresponding to the target user, determining a target exclusive voice sprite bound with the character features corresponding to the target user from the plurality of exclusive voice sprite, activating the target exclusive voice sprite, and displaying an image of the target exclusive voice sprite in a screen of the vehicle-mounted terminal; and performing voice interaction with the target user based on the target exclusive voice elf.

Description

Technical Field

[0001] The present application relates to the field of vehicle intelligent control technology, and specifically to a voice assistant interaction method, device, equipment and storage medium. Background Art

[0002] With the development and popularization of intelligent networked cars, car entertainment functions have diversified. Cars are no longer a simple means of transportation. Smart cars have been deeply integrated into every family and have gradually become the second family in people's hearts. Car voice assistants play an irreplaceable role. Car owners can communicate with their cars through voice assistants, and voice assistants have become car owners' intimate companions. At present, car voice assistants can be roughly divided into two categories. One is to enable drivers or passengers to control basic vehicle functions (such as air conditioning, windows, seats, ambient lights, music, etc.) through voice assistants; the other can assist in realizing human-computer interactive dialogues and provide good suggestions based on the current time, location and other preferences of users to arrange the itinerary reasonably.

[0003] However, when the voice assistant is activated, it can respond to the voice control commands of multiple users (multiple passengers or drivers in the car) at the same time. That is, when the voice assistant is activated, if there are multiple users speaking in the car, the voice assistant needs to recognize the voices of multiple users at the same time. However, in this case, the voice assistant will most likely fail to recognize. Therefore, the current voice assistant interaction efficiency is low, the accuracy is poor, and the user experience is poor. Summary of the invention

[0004] The present application provides a voice assistant interaction method, device, equipment and storage medium to at least solve the technical problems of low efficiency, poor accuracy and poor user experience of voice assistant interaction in the related art. The technical solution of the present application is as follows:

[0005] According to a first aspect of the present application, a voice assistant interaction method is provided, including: when a vehicle computer in a vehicle is powered on, collecting character features corresponding to a target user in the vehicle, the character features being any of the following: facial features and voiceprint features, the vehicle computer including a plurality of pre-created exclusive voice elves, each of the plurality of exclusive voice elves being bound to at least one of the following: facial features and voiceprint features; identifying the character features corresponding to the target user, determining a target exclusive voice elf bound to the character features corresponding to the target user from the plurality of exclusive voice elves, activating the target exclusive voice elf and displaying the image of the target exclusive voice elf on the screen of the vehicle computer; performing voice interaction with the target user based on the target exclusive voice elf, the voice interaction including at least one of the following: intelligent dialogue, vehicle computer control and vehicle function control.

[0006] According to the above technical means, the present application can collect the character features corresponding to the target user in the vehicle and identify the character features corresponding to the target user, thereby determining the target exclusive voice wizard bound to the character features corresponding to the target user from the multiple pre-created exclusive voice wizards based on the facial features and / or voiceprint features bound to each exclusive voice wizard, so as to activate the target exclusive voice wizard and display the image of the target exclusive voice wizard on the screen of the vehicle computer; thereby voice interaction with the target user can be performed based on the target exclusive voice wizard. The above method can be used to activate the exclusive voice wizard corresponding to the user based on the character features corresponding to the user, so as to perform voice interaction with the target user through the exclusive voice wizard corresponding to the user. Thereby, the efficiency and accuracy of the interaction between the voice assistant and the user can be improved, and the user experience can be enhanced.

[0007] In a possible implementation, the method further includes: for any user, collecting character features corresponding to any user, and creating an exclusive voice elf corresponding to any user based on a creation request; setting an image of an exclusive voice elf corresponding to any user, wherein the image corresponding to each exclusive voice elf includes at least one of the following: voice features, gender features, appearance features, and clothing features; binding the character features corresponding to any user with the exclusive voice elf corresponding to any user, and determining the corresponding relationship between the character features corresponding to any user and the exclusive voice elf corresponding to any user.

[0008] According to the above-mentioned technical means, the present application can, for any user, by collecting the character features corresponding to any user, creating an exclusive voice elf corresponding to any user, and setting the image of the exclusive voice elf corresponding to any user, bind the character features corresponding to any user with the exclusive voice elf corresponding to any user, and determine the correspondence between the character features corresponding to any user and the exclusive voice elf corresponding to any user, so that after identifying the character features corresponding to any user, the exclusive voice elf corresponding to any user can be activated to perform voice interaction with the any user, thereby improving the efficiency and accuracy of the interaction between the voice assistant and the user, and enhancing the user experience.

[0009] In a possible implementation, each of the multiple exclusive voice elves corresponds to a task level, and different task levels correspond to different control permissions, and the higher the task level, the higher the control permission; the above method also includes: determining the target task corresponding to the target exclusive voice elf, the target task is any one of the following: landmark check-in, parent-child travel, travel tasks, number of conversations and number of vehicle control; when the target user completes the target task based on the target exclusive voice elf, unlock the target resource corresponding to the target exclusive voice elf, and the target resource is any one of the following: sound characteristics, appearance characteristics and clothing characteristics; prompting the target user that the target exclusive voice elf has unlocked the target resource, allowing the image of the target exclusive voice elf to be adjusted based on the target resource; when the task level corresponding to the target exclusive voice elf is upgraded, unlocking the control permission corresponding to the upgraded task level of the target exclusive voice elf.

[0010] According to the above-mentioned technical means, the present application can set the task level corresponding to each exclusive voice elf, and different task levels correspond to different control permissions, so that after determining the target task corresponding to the target exclusive voice elf, the target user can complete the target task based on the target exclusive voice elf, thereby unlocking the target resources corresponding to the target exclusive voice elf, so that the target user can adjust the image of the target exclusive voice elf based on the target resources, and when the task level corresponding to the target exclusive voice elf is upgraded, the control permission corresponding to the upgraded task level of the target exclusive voice elf is unlocked, thereby improving the user experience.

[0011] In a possible implementation, each of the multiple exclusive voice elves is also bound to an exclusive nickname, and the above method also includes: for any exclusive voice elf among the multiple exclusive voice elves, if the exclusive nickname corresponding to any exclusive voice elf is recognized when the character features bound to any exclusive voice elf are not recognized, then any exclusive voice elf is activated and the image of any exclusive voice elf is displayed on the screen of the vehicle computer.

[0012] According to the above-mentioned technical means, the present application can activate any exclusive voice elf among multiple exclusive voice elves by identifying the exclusive nickname corresponding to the any exclusive voice elf, so that other users can activate any exclusive voice elf through the exclusive nickname corresponding to the any exclusive voice elf and perform voice interaction with the any exclusive voice elf, thereby improving the flexibility of interaction between the voice assistant and the user.

[0013] According to the second aspect provided by the present application, a voice assistant interaction device is provided, including an acquisition module, a processing module and an interaction module; the acquisition module is used to collect the character features corresponding to the target user in the vehicle when the vehicle computer is powered on, the character features being any of the following: facial features and voiceprint features, the vehicle computer includes a plurality of pre-created exclusive voice elves, each of the plurality of exclusive voice elves is bound to at least one of the following: facial features and voiceprint features; the processing module is used to identify the character features corresponding to the target user, determine the target exclusive voice elf bound to the character features corresponding to the target user from the plurality of exclusive voice elves, activate the target exclusive voice elf and display the image of the target exclusive voice elf on the screen of the vehicle computer; the interaction module is used to perform voice interaction with the target user based on the target exclusive voice elf, the voice interaction includes at least one of the following: intelligent dialogue, vehicle computer control and vehicle function control.

[0014] In a possible implementation, the acquisition module is also used to collect the character features corresponding to any user; the processing module is also used to create an exclusive voice elf corresponding to any user based on the creation request; the processing module is also used to set the image of the exclusive voice elf corresponding to any user, and the image corresponding to each exclusive voice elf includes at least one of the following: voice features, gender features, appearance features and clothing features; the processing module is also used to bind the character features corresponding to any user with the exclusive voice elf corresponding to any user, and determine the corresponding relationship between the character features corresponding to any user and the exclusive voice elf corresponding to any user.

[0015] In a possible implementation, each of the multiple exclusive voice elves corresponds to a task level, and different task levels correspond to different control permissions. The higher the task level, the higher the control permission. The processing module is also used to determine the target task corresponding to the target exclusive voice elf, and the target task is any one of the following: landmark check-in, parent-child travel, travel tasks, number of conversations, and number of vehicle control times. The processing module is also used to unlock the target resources corresponding to the target exclusive voice elf when the target user completes the target task based on the target exclusive voice elf. The target resources are any one of the following: sound characteristics, appearance characteristics, and clothing characteristics. The processing module is also used to prompt the target user that the target exclusive voice elf has unlocked the target resources, and allows the image of the target exclusive voice elf to be adjusted based on the target resources. The processing module is also used to unlock the control permission corresponding to the upgraded task level of the target exclusive voice elf when the task level corresponding to the target exclusive voice elf is upgraded.

[0016] In a possible implementation, each of the multiple exclusive voice elves is also bound to an exclusive nickname; the processing module is also used to activate any exclusive voice elf among the multiple exclusive voice elves and display the image of any exclusive voice elf on the screen of the vehicle computer if the exclusive nickname corresponding to any exclusive voice elf is recognized when the character features bound to any exclusive voice elf are not recognized.

[0017] According to the third aspect provided by the present application, an electronic device is provided, comprising: a processor; a memory for storing processor executable instructions; wherein the processor is configured to execute instructions to implement the method of the above-mentioned first aspect and any possible implementation manner thereof.

[0018] According to the fourth aspect provided by the present application, a computer-readable storage medium is provided. When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method in the above-mentioned first aspect and any possible implementation method thereof.

[0019] According to the fifth aspect provided by the present application, a vehicle is provided, which includes a voice assistant interaction device as described in the second aspect, and the vehicle is used to implement the method as described in the first aspect.

[0020] According to the sixth aspect provided by the present application, a computer program product is provided, the computer program product comprising computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method of the above-mentioned first aspect and any possible implementation manner thereof.

[0021] Therefore, the above technical features of the present application have the following beneficial effects:

[0022] (1) The present application can collect the character features corresponding to the target user in the vehicle and identify the character features corresponding to the target user, thereby determining the target exclusive voice wizard bound to the character features corresponding to the target user from the multiple pre-created exclusive voice wizards based on the facial features and / or voiceprint features bound to each exclusive voice wizard, so as to activate the target exclusive voice wizard and display the image of the target exclusive voice wizard on the screen of the vehicle computer; thereby, voice interaction with the target user can be performed based on the target exclusive voice wizard. The above method can be used to activate the exclusive voice wizard corresponding to the user based on the character features corresponding to the user, so as to perform voice interaction with the target user through the exclusive voice wizard corresponding to the user. Thereby, the efficiency and accuracy of the interaction between the voice assistant and the user can be improved, and the user experience can be enhanced.

[0023] (2) The present application can collect the character features corresponding to any user, create an exclusive voice wizard corresponding to any user, and set the image of the exclusive voice wizard corresponding to any user, and then bind the character features corresponding to any user with the exclusive voice wizard corresponding to any user, determine the corresponding relationship between the character features corresponding to any user and the exclusive voice wizard corresponding to any user, so that after identifying the character features corresponding to any user, the exclusive voice wizard corresponding to any user can be activated to interact with the user by voice, thereby improving the efficiency and accuracy of the interaction between the voice assistant and the user and enhancing the user experience.

[0024] (3) The present application can set the task level corresponding to each exclusive voice elf, and different task levels correspond to different control permissions. After determining the target task corresponding to the target exclusive voice elf, the target user can complete the target task based on the target exclusive voice elf, thereby unlocking the target resources corresponding to the target exclusive voice elf, so that the target user can adjust the image of the target exclusive voice elf based on the target resources, and when the task level corresponding to the target exclusive voice elf is upgraded, the control permission corresponding to the upgraded task level of the target exclusive voice elf is unlocked, thereby improving the user experience.

[0025] (4) The present application can activate any exclusive voice elf among multiple exclusive voice elves by identifying the exclusive nickname corresponding to the exclusive voice elf, so that other users can activate any exclusive voice elf through the exclusive nickname corresponding to the exclusive voice elf and perform voice interaction with the exclusive voice elf, thereby improving the flexibility of interaction between the voice assistant and the user.

[0026] It should be noted that the technical effects brought about by any implementation method in the second to sixth aspects can refer to the technical effects brought about by the corresponding implementation method in the first aspect, and will not be repeated here.

[0027] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application, and do not constitute an improper limitation on the present application.

[0029] Figure 1 is a structural diagram of a voice assistant interaction system according to an exemplary embodiment;

[0030] Figure 2is a flow chart of a voice assistant interaction method according to an exemplary embodiment;

[0031] Figure 3 is a flowchart of another voice assistant interaction method according to an exemplary embodiment;

[0032] Figure 4 is a structural diagram of another voice assistant interaction system according to an exemplary embodiment;

[0033] Figure 5 is a flowchart of another voice assistant interaction method according to an exemplary embodiment;

[0034] Figure 6 is a flowchart of another voice assistant interaction method according to an exemplary embodiment;

[0035] Figure 7 is a block diagram of a voice assistant interaction device according to an exemplary embodiment;

[0036] Figure 8 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0037] In order to enable ordinary persons in the art to better understand the technical solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings.

[0038] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.

[0039] With the rapid development of electric vehicles, the image of car voice assistants has become more lively, personalized, and intelligent, and the virtual image of voice assistants has become more dynamic and realistic. At present, the diversified forms of voice assistants have basically met the needs of drivers or passengers, but the applicable groups of voice assistants tend to be drivers or passengers. When the voice assistant is activated, it can respond to the voice control commands of multiple users, and it is impossible to provide services to a single person.

[0040] As a second home, the car's voice assistant should not only be able to communicate with the driver without obstacles and meet the driver's driving needs, but also tend to become the driver's soul mate. The vehicle can provide the driver with a voice wizard that is exclusive to him or her, or provide an exclusive voice wizard to accompany the child to grow up together. Currently, car voice wizards generally realize basic auxiliary vehicle control functions through voice assistants and users, but the functions of voice assistants are often fixed and cannot be changed, and the handover between the user and the user lacks exclusivity and entertainment.

[0041] The voice assistant interaction method provided in the embodiment of the present application can be applied to the voice assistant interaction system. Figure 1 A structural diagram of the voice assistant interaction system is shown. Figure 1 As shown, the voice assistant interaction system 10 includes: a vehicle 11 and a server 12, wherein the vehicle 11 includes a vehicle computer, which includes a variety of entertainment functions and control functions for controlling some functions of the vehicle and interacting intelligently with the user; the server 12 is a server corresponding to the vehicle, which can update the system corresponding to the vehicle computer and realize functions such as remote control of the vehicle computer.

[0042] Specifically, when the vehicle computer in the vehicle 11 is powered on, the character features corresponding to the target user in the vehicle can be collected and identified, and the target exclusive voice elf bound to the character features corresponding to the target user can be determined from multiple exclusive voice elves, the target exclusive voice elf can be activated and the image of the target exclusive voice elf can be displayed on the screen of the vehicle computer; and voice interaction can be performed with the target user based on the target exclusive voice elf.

[0043] For ease of understanding, the voice assistant interaction method provided in this application is specifically introduced below with reference to the accompanying drawings.

[0044] Figure 2 is a flow chart of a voice assistant interaction method according to an exemplary embodiment. Figure 2 As shown, the voice assistant interaction method includes the following S201-S203:

[0045] S201. When a vehicle computer in a vehicle is powered on, collect character features corresponding to a target user in the vehicle.

[0046] Among them, the character feature is any one of the following: facial features and voiceprint features. The car computer includes multiple pre-created exclusive voice elves, and each of the multiple exclusive voice elves is bound to at least one of the following: facial features and voiceprint features.

[0047] Optionally, the present application can intelligently determine and identify whether the bound user is in the car based on the in-car camera and voice print.

[0048] S202, identifying the character features corresponding to the target user, determining the target exclusive voice elf bound to the character features corresponding to the target user from multiple exclusive voice elves, activating the target exclusive voice elf and displaying the image of the target exclusive voice elf on the screen of the vehicle computer.

[0049] Optionally, based on the facial features of multiple bound users recorded in the vehicle system (i.e., face recognition results), the in-vehicle camera is used to identify whether the bound user is in the car. When it is detected that the bound user is in the car, the facial features can be sent to the exclusive voice elf control module through the camera acquisition and recognition module. After the exclusive voice elf control module receives the authenticated facial features, it activates the target exclusive voice elf and displays the image of the target exclusive voice elf on the screen of the vehicle.

[0050] Optionally, when the facial features of the bound user are not detected, the different voiceprint information collected can be sent to the voiceprint recognition authentication module through the voice assistant. When the voiceprint recognition authentication module passes the authentication, the voice authentication result is sent to the exclusive voice elf control module, and the exclusive voice elf module wakes up the exclusive voice elf.

[0051] Optionally, after the target exclusive voice wizard in the present application is activated (i.e., woken up), it will not be used by other users. The voice wizard can intelligently identify whether the current conversation user is a bound user (i.e., the target user). If it is detected that the user is not a bound user, the exclusive voice wizard will not be activated (i.e., it will not respond to the voices of other users).

[0052] S203: Perform voice interaction with the target user based on the target-specific voice wizard.

[0053] Among them, voice interaction includes at least one of the following: intelligent dialogue, vehicle computer control and vehicle function control.

[0054] Optionally, when the bound user is recognized in the car, it can automatically wake up and send a caring greeting. The exclusive voice wizard can also support the adjustment of its own voice wizard image, and can also support the control of basic vehicle functions (such as air conditioning, music library, interior ambient lighting, watching video animations).

[0055] In the embodiment of the present application, the character features corresponding to the target user in the vehicle can be collected and identified, so as to determine the target exclusive voice wizard bound to the character features corresponding to the target user from the multiple pre-created exclusive voice wizards based on the facial features and / or voiceprint features bound to each exclusive voice wizard, so as to activate the target exclusive voice wizard and display the image of the target exclusive voice wizard on the screen of the vehicle computer; thereby, voice interaction with the target user can be performed based on the target exclusive voice wizard. The above method can be used to activate the exclusive voice wizard corresponding to the user based on the character features corresponding to the user, so as to perform voice interaction with the target user through the exclusive voice wizard corresponding to the user. Thereby, the efficiency and accuracy of the interaction between the voice assistant and the user can be improved, and the user experience can be enhanced.

[0056] In some embodiments, in order to determine the correspondence between the character features corresponding to any user and the exclusive voice wizard corresponding to any user, such as Figure 3 As shown, a voice assistant interaction method provided in an embodiment of the present application may further include S301-S303:

[0057] S301. For any user, collect the character features corresponding to any user, and create an exclusive voice wizard corresponding to any user based on the creation request.

[0058] Optionally, a dedicated voice wizard is an intelligent voice assistant independent of the voice assistant. After creating the image of the dedicated voice wizard, the user is bound to the voice wizard. The purpose of binding is to increase the exclusivity and uniqueness of the voice wizard, such as Figure 4 As shown, it can be achieved through a camera face acquisition and authentication module, a voiceprint recognition and authentication module, a vehicle voice assistant, an exclusive voice elf control module, a voice command execution module, etc.

[0059] Optionally, when the user needs to create his own exclusive voice wizard in the car computer, he can initiate a creation request in the car computer to create the exclusive voice wizard and determine the image logo of the exclusive voice wizard.

[0060] Optionally, a message channel is established between the voice assistant and the exclusive voice elf based on the image identification of the exclusive voice elf. When the wake-up command of the exclusive voice elf is received, the three-dimensional (3D) virtual image of the exclusive voice elf can be automatically popped up on the vehicle display screen based on the set program.

[0061] It should be noted that the exclusive voice wizard can serve as a close companion for the driver during travel, and can also be an exclusive friend for children. The exclusive voice wizard can grow and travel together with the bound person, making the car more than just a means of transportation.

[0062] S302: Set an image of a dedicated voice wizard corresponding to any user.

[0063] Among them, the image corresponding to each exclusive voice elf includes at least one of the following: voice characteristics, gender characteristics, appearance characteristics and clothing characteristics.

[0064] Optionally, the image of the exclusive voice elf is independent of the voice assistant. You can choose to set the voice elf's character voice, gender, appearance decoration, etc. The voice of the voice elf supports synthesis through voiceprint recording, and you can customize the elf image's clothing decoration.

[0065] Optionally, the exclusive voice wizard creates a 3D voice wizard image on the vehicle system's creative interface, and the 3D voice wizard model can be previewed during the creation process.

[0066] Optionally, the exclusive voice elf image after creation can be saved in the cloud data. After binding the created exclusive voice elf, the exclusive voice elf can be activated and the image of the exclusive voice elf can be published and saved in the cloud. At the same time, it can be displayed in the car system in 3D image form.

[0067] S303: Bind the character features corresponding to any user with the exclusive voice wizard corresponding to any user, and determine the corresponding relationship between the character features corresponding to any user and the exclusive voice wizard corresponding to any user.

[0068] Optionally, after creating an exclusive voice wizard corresponding to any user, you can collect the character features of any user, and bind the character features of any user to the exclusive voice wizard corresponding to any user, so that after collecting the character features of any user, you can activate the exclusive voice wizard corresponding to any user to achieve voice interaction.

[0069] In an embodiment of the present application, for any user, by collecting the character features corresponding to any user, creating an exclusive voice elf corresponding to any user, and setting the image of the exclusive voice elf corresponding to any user, the character features corresponding to any user can be bound to the exclusive voice elf corresponding to any user, and the correspondence between the character features corresponding to any user and the exclusive voice elf corresponding to any user can be determined. After identifying the character features corresponding to any user, the exclusive voice elf corresponding to any user can be activated to perform voice interaction with the any user, thereby improving the efficiency and accuracy of the interaction between the voice assistant and the user, and enhancing the user experience.

[0070] In some embodiments, each of the multiple dedicated voice wizards corresponds to a task level, and different task levels correspond to different control permissions. The higher the task level, the higher the control permission. In order to improve the user experience, such as Figure 5 As shown, in a voice assistant interaction method provided in an embodiment of the present application, specifically, S401-S404 may also be included:

[0071] S401, determining a target task corresponding to a target-specific voice wizard.

[0072] Among them, the target task is any of the following: landmark check-in, parent-child travel, travel tasks, number of conversations and number of vehicle-computer control.

[0073] S402: When the target user completes the target task based on the target exclusive voice wizard, unlock the target resource corresponding to the target exclusive voice wizard.

[0074] The target resource is any one of the following: sound features, appearance features, and clothing features.

[0075] Optionally, the exclusive voice wizard in the embodiment of the present application can issue growth tasks (i.e., target tasks). When the driver accompanies the child to complete growth tasks such as landmark check-in, parent-child travel, and picking up the child from school, the driver can obtain different images, clothing, growth levels, and experience accumulation of the exclusive voice wizard. When the task is completed, the task reward is automatically collected and placed in the virtual image equipment library.

[0076] Optionally, when an update to equipment (i.e. image, clothing, etc.) is detected and the bound user is detected in the car, it can intelligently communicate with the user whether to change the equipment, and when the exclusive voice elf experience accumulation reaches a certain value, the level of the exclusive voice elf will be automatically upgraded and the corresponding vehicle control function control authority will be automatically unlocked.

[0077] It can be understood that the exclusive voice wizard of this application can grow together with the bound person, and the user can receive tasks in the task center of the exclusive voice wizard. The exclusive voice wizard task publishing and receiving function modules of this application include at least the vehicle-side task center, cloud platform, cloud task manager, and local storage. The vehicle's tasks in the exclusive voice wizard are obtained from the cloud and displayed in the vehicle-side task center. Task collection and reward distribution are managed through the cloud task manager of the cloud platform. The cloud backs up the level and growth tasks of the exclusive wizard. Its task rewards are sent to the vehicle-side through the cloud, and are downloaded by the vehicle-side and saved to the local storage.

[0078] Optionally, the growth of the exclusive voice wizard includes the growth of skill experience value and the update of the exclusive voice wizard image. When the vehicle is powered on normally, users can view and receive tasks in the task center.

[0079] S403, prompting the target user that the target exclusive voice elf has unlocked the target resource, allowing the image of the target exclusive voice elf to be adjusted based on the target resource.

[0080] Optionally, the vehicle computer can prompt the target user through voice or screen pop-up window that the target exclusive voice elf has unlocked the target resource, and the user can adjust the image of the exclusive voice elf at will.

[0081] S404. When the task level corresponding to the target exclusive voice wizard is upgraded, unlock the control authority corresponding to the upgraded task level of the target exclusive voice wizard.

[0082] Optionally, after completing the task, you will get experience and task rewards based on the difficulty of the task. When the accumulated experience value reaches the set value, the level of the exclusive voice elf can be automatically upgraded. The system automatically assigns different levels of functions based on the level of the voice elf, such as dividing the intelligent vehicle control instructions according to the elf level, and unlocking different vehicle control functions when reaching different levels. At the same time, when the task is completed, there will be task prizes issued, which can be used to enrich the image of the exclusive voice elf or to upgrade the level of the exclusive voice elf.

[0083] In an embodiment of the present application, by setting the task level corresponding to each exclusive voice elf, and different task levels corresponding to different control permissions, after determining the target task corresponding to the target exclusive voice elf, the target user can complete the target task based on the target exclusive voice elf, thereby unlocking the target resources corresponding to the target exclusive voice elf, so that the target user can adjust the image of the target exclusive voice elf based on the target resources, and when the task level corresponding to the target exclusive voice elf is upgraded, the control permission corresponding to the upgraded task level of the target exclusive voice elf is unlocked, thereby improving the user experience.

[0084] In some embodiments, each of the multiple exclusive voice wizards is also bound to an exclusive nickname; in order to enhance the flexibility of the voice assistant's interaction with the user, such as Figure 6 As shown, a voice assistant interaction method provided in an embodiment of the present application may further include S501:

[0085] S501. For any exclusive voice elf among multiple exclusive voice elves, if the character features bound to any exclusive voice elf are not recognized, if the exclusive nickname corresponding to any exclusive voice elf is recognized, any exclusive voice elf is activated and the image of any exclusive voice elf is displayed on the screen of the vehicle computer.

[0086] Optionally, if the facial features and voiceprint features of the bound person are not detected at the same time, it can also be awakened by a pre-set specific wake-up word (i.e., an exclusive nickname). When the voice assistant recognizes the specific wake-up word, the wake-up instruction is passed to the exclusive voice elf control module, which will be awakened by the exclusive voice elf control module. When the exclusive voice elf is awakened, it can execute feedback based on the voice command of any user to achieve voice interaction.

[0087] It can be understood that the present application provides an exclusive and growable voice wizard, the purpose of which is to enrich the user's enjoyment of using the car, increase the fun of the vehicle, and provide the user with a voice wizard control method that is exclusive to the user, unique, and can grow with the user.

[0088] In an embodiment of the present application, any exclusive voice elf among multiple exclusive voice elves can be activated by identifying the exclusive nickname corresponding to the any exclusive voice elf, so that other users can activate any exclusive voice elf through the exclusive nickname corresponding to the any exclusive voice elf and perform voice interaction with the any exclusive voice elf, thereby improving the flexibility of interaction between the voice assistant and the user.

[0089] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to achieve the above functions, the voice assistant interaction device or electronic device includes a hardware structure and / or software module corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0090] The embodiment of the present application can exemplarily divide the functional modules of the voice assistant interaction device or the electronic device according to the above method. For example, the voice assistant interaction device or the electronic device may include various functional modules corresponding to the various functional divisions, or two or more functions may be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation.

[0091] Figure 7 is a block diagram of a voice assistant interaction device according to an exemplary embodiment. Figure 7The voice assistant interaction device 700 includes: an acquisition module 701, a processing module 702 and an interaction module 703.

[0092] The acquisition module 701 is used to collect the character features corresponding to the target user in the vehicle when the vehicle computer is powered on. The character features are any of the following: facial features and voiceprint features. The vehicle computer includes multiple pre-created exclusive voice elves, and each of the multiple exclusive voice elves is bound to at least one of the following: facial features and voiceprint features; the processing module 702 is used to identify the character features corresponding to the target user, determine the target exclusive voice elf bound to the character features corresponding to the target user from the multiple exclusive voice elves, activate the target exclusive voice elf and display the image of the target exclusive voice elf on the screen of the vehicle computer; the interaction module 703 is used to perform voice interaction with the target user based on the target exclusive voice elf, and the voice interaction includes at least one of the following: intelligent dialogue, vehicle computer control and vehicle function control.

[0093] In a possible implementation, the acquisition module 701 is also used to collect the character features corresponding to any user; the processing module 702 is also used to create an exclusive voice elf corresponding to any user based on the creation request; the processing module 702 is also used to set the image of the exclusive voice elf corresponding to any user, and the image corresponding to each exclusive voice elf includes at least one of the following: voice features, gender features, appearance features and clothing features; the processing module 702 is also used to bind the character features corresponding to any user with the exclusive voice elf corresponding to any user, and determine the corresponding relationship between the character features corresponding to any user and the exclusive voice elf corresponding to any user.

[0094] In one possible implementation, each of the multiple exclusive voice elves corresponds to a task level, and different task levels correspond to different control permissions, and the higher the task level, the higher the control permission; the processing module 702 is also used to determine the target task corresponding to the target exclusive voice elf, and the target task is any one of the following: landmark check-in, parent-child travel, travel tasks, number of conversations and number of vehicle control; the processing module 702 is also used to unlock the target resources corresponding to the target exclusive voice elf when the target user completes the target task based on the target exclusive voice elf, and the target resources are any one of the following: sound characteristics, appearance characteristics and clothing characteristics; the processing module 702 is also used to prompt the target user that the target exclusive voice elf has unlocked the target resources, and allows the image of the target exclusive voice elf to be adjusted based on the target resources; the processing module 702 is also used to unlock the control permission corresponding to the upgraded task level of the target exclusive voice elf when the task level corresponding to the target exclusive voice elf is upgraded.

[0095] In a possible implementation, each of the multiple exclusive voice elves is also bound to an exclusive nickname; the processing module 702 is also used to activate any exclusive voice elf among the multiple exclusive voice elves and display the image of any exclusive voice elf on the screen of the vehicle computer if the exclusive nickname corresponding to any exclusive voice elf is recognized when the character features bound to any exclusive voice elf are not recognized.

[0096] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0097] Figure 8 FIG. 1 is a block diagram of an electronic device according to an exemplary embodiment. Figure 8 As shown, the electronic device 800 includes but is not limited to: a processor 801 and a memory 802 .

[0098] The memory 802 is used to store executable instructions of the processor 801. It can be understood that the processor 801 is configured to execute instructions to implement the voice assistant interaction method in the above embodiment.

[0099] It should be noted that those skilled in the art can understand that Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and the electronic device may include Figure 8 More or fewer components may be shown, or certain components may be combined, or the components may be arranged differently.

[0100] The processor 801 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 802, and calling data stored in the memory 802, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. The processor 801 may include one or more processing units. Optionally, the processor 801 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 801.

[0101] The memory 802 can be used to store software programs and various data. The memory 802 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application program required by at least one functional module (such as an acquisition module, a processing module, etc.), etc. In addition, the memory 802 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0102] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 802 including instructions, and the above instructions can be executed by a processor 801 of an electronic device 800 to implement the voice assistant interaction method in the above embodiment.

[0103] In actual implementation, Figure 7 The functions of the acquisition module 701, the processing module 702 and the interaction module 703 in Figure 8 The processor 801 in the embodiment calls the computer program stored in the memory 802. The specific execution process can refer to the description of the voice assistant interaction method in the above embodiment, which will not be repeated here.

[0104] Optionally, the computer-readable storage medium may be a non-temporary computer-readable storage medium, for example, the non-temporary computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0105] In an exemplary embodiment, the present application also provides a computer program product including one or more instructions, which can be executed by the processor 801 of the electronic device 800 to complete the voice assistant interaction method in the above embodiment.

[0106] It should be noted that when the instructions in the above-mentioned computer-readable storage medium or one or more instructions in the computer program product are executed by the processor of the electronic device, the various processes of the above-mentioned voice assistant interaction method embodiment are implemented, and the same technical effect as the above-mentioned voice assistant interaction method can be achieved. To avoid repetition, they will not be repeated here.

[0107] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0108] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0109] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0110] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0111] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or the full classification part or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute the full classification part or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, ROM, RAM, disk or CD and other media that can store program code.

[0112] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A voice assistant interaction method, characterized in that: include: When the vehicle computer in the vehicle is powered on, collect the character features corresponding to the target user in the vehicle, the character features are any one of the following: facial features and voiceprint features, the vehicle computer includes a plurality of pre-created exclusive voice wizards, each of the plurality of exclusive voice wizards is bound to at least one of the following: facial features and voiceprint features; Identify the character features corresponding to the target user, determine the target exclusive voice elf bound to the character features corresponding to the target user from the multiple exclusive voice elves, activate the target exclusive voice elf and display the image of the target exclusive voice elf on the screen of the vehicle computer; Based on the target-specific voice wizard, voice interaction is performed with the target user, and the voice interaction includes at least one of the following: intelligent dialogue, vehicle computer control and vehicle function control.

2. The method according to claim 1, characterized in that The method further comprises: For any user, collect the character features corresponding to the any user, and create an exclusive voice wizard corresponding to the any user based on the creation request; Setting an image of a dedicated voice elf corresponding to any one of the users, wherein the image corresponding to each dedicated voice elf includes at least one of the following: voice characteristics, gender characteristics, appearance characteristics, and clothing characteristics; The character features corresponding to any one of the users are bound to the exclusive voice elf corresponding to any one of the users, and the corresponding relationship between the character features corresponding to any one of the users and the exclusive voice elf corresponding to any one of the users is determined.

3. The method according to claim 1 or 2, characterized in that: Each of the multiple exclusive voice wizards corresponds to a task level, and different task levels correspond to different control permissions. The higher the task level, the higher the control permission. The method also includes: Determine the target task corresponding to the target exclusive voice wizard, the target task being any one of the following: landmark check-in, parent-child travel, travel task, number of conversations, and number of vehicle control; When the target user completes the target task based on the target exclusive voice wizard, unlock the target resource corresponding to the target exclusive voice wizard, where the target resource is any one of the following: voice feature, appearance feature and clothing feature; Prompt the target user that the target exclusive voice elf has unlocked the target resource, allowing the image of the target exclusive voice elf to be adjusted based on the target resource; When the task level corresponding to the target exclusive voice elf is upgraded, the control authority corresponding to the upgraded task level of the target exclusive voice elf is unlocked.

4. The method according to claim 1 or 2, characterized in that: Each of the multiple exclusive voice elves is also bound to an exclusive nickname, and the method further includes: For any exclusive voice elf among the multiple exclusive voice elves, if the character features bound to any exclusive voice elf are not recognized, if the exclusive nickname corresponding to any exclusive voice elf is recognized, any exclusive voice elf will be activated and the image of any exclusive voice elf will be displayed on the screen of the vehicle computer.

5. A voice assistant interaction device, characterized in that: The voice assistant interaction device comprises: an acquisition module, a processing module and an interaction module; The acquisition module is used to collect the character features corresponding to the target user in the vehicle when the vehicle computer in the vehicle is powered on, and the character features are any one of the following: facial features and voiceprint features. The vehicle computer includes a plurality of pre-created exclusive voice wizards, and each of the plurality of exclusive voice wizards is bound to at least one of the following: facial features and voiceprint features; The processing module is used to identify the character features corresponding to the target user, determine the target exclusive voice elf bound to the character features corresponding to the target user from the multiple exclusive voice elves, activate the target exclusive voice elf and display the image of the target exclusive voice elf on the screen of the vehicle computer; The interaction module is used to perform voice interaction with the target user based on the target-specific voice wizard, and the voice interaction includes at least one of the following: intelligent dialogue, vehicle computer control and vehicle function control.

6. The voice assistant interaction device according to claim 5, characterized in that: The acquisition module is further used to collect the character features corresponding to any user; The processing module is further used to create an exclusive voice wizard corresponding to any one of the users based on the creation request; The processing module is further used to set an image of a dedicated voice elf corresponding to any one of the users, wherein the image corresponding to each dedicated voice elf includes at least one of the following: voice characteristics, gender characteristics, appearance characteristics, and clothing characteristics; The processing module is also used to bind the character features corresponding to any user with the exclusive voice elf corresponding to any user, and determine the corresponding relationship between the character features corresponding to any user and the exclusive voice elf corresponding to any user.

7. The voice assistant interaction device according to claim 5 or 6, characterized in that: Each of the multiple exclusive voice wizards corresponds to a task level, and different task levels correspond to different control permissions. The higher the task level, the higher the control permission. The processing module is further used to determine the target task corresponding to the target exclusive voice wizard, and the target task is any one of the following: landmark check-in, parent-child travel, travel tasks, number of conversations, and number of vehicle control; The processing module is further configured to unlock a target resource corresponding to the target exclusive voice wizard when the target user completes the target task based on the target exclusive voice wizard, wherein the target resource is any one of the following: Voice characteristics, appearance characteristics and clothing characteristics; The processing module is further used to prompt the target user that the target-specific voice elf has unlocked the target resource, allowing the image of the target-specific voice elf to be adjusted based on the target resource; The processing module is also used to unlock the control authority corresponding to the upgraded task level of the target exclusive voice elf when the task level corresponding to the target exclusive voice elf is upgraded.

8. The voice assistant interaction device according to claim 5 or 6, characterized in that: Each of the multiple exclusive voice elves is also bound to an exclusive nickname; The processing module is also used to activate any exclusive voice elf among the multiple exclusive voice elves and display the image of any exclusive voice elf on the screen of the vehicle computer if an exclusive nickname corresponding to any exclusive voice elf is recognized when the character features bound to the any exclusive voice elf are not recognized.

9. A computer-readable storage medium, characterized in that: When the computer-executable instructions stored in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device can perform the method as claimed in any one of claims 1 to 4.

10. A vehicle, characterized in that: The vehicle includes a voice assistant interaction device as described in any one of claims 5-8, and the vehicle is used to implement the method as described in any one of claims 1 to 4.

Images