Voice interaction method, device and equipment, storage medium and vehicle

Abstract

The invention discloses a voice interaction method, device and equipment, a storage medium and a vehicle. The method comprises the steps that first voiceprint information corresponding to a voice control instruction is acquired, the first voiceprint information is voiceprint information of a first user, and the first user is a user sending the voice control instruction; based on a first user corresponding to the first voiceprint information and a semantic recognition result of the voice control instruction, a second user is determined, first position information of the second user is acquired, the second user is a user associated with the control instruction in the voice control instruction, and the first position information of the second user is acquired; the first position information is predetermined position information having a mapping relationship with the second user; and determining a target execution operation corresponding to the voice control instruction based on the semantic recognition result, and executing the target execution operation in a position area corresponding to the first position information. According to the embodiment of the invention, the voice interaction efficiency between the user and the vehicle can be improved.

Description

Technical Field

[0001] The present application belongs to the field of intelligent automobile technology, and in particular, relates to a voice interaction method, device, equipment, storage medium and vehicle. Background Art

[0002] At present, in order to achieve natural and convenient interaction between the driver or passengers in the vehicle, the voice control function in modern vehicles allows the driver or passengers to control some functions inside the vehicle through voice commands, such as adjusting the air conditioning temperature, opening the windows, switching driving modes, etc.

[0003] However, the voice interaction in the related art only recognizes the semantics in the voice command and executes the corresponding function according to the semantics. In this interaction mode, the user needs to provide detailed and specific information in the voice control command so that the system can correctly understand and meet the user's needs. This interaction mode does not conform to the user's daily communication habits, thus reducing the efficiency of voice interaction. Summary of the invention

[0004] The embodiments of the present application provide a voice interaction method, apparatus, device, storage medium and vehicle, which can solve the problem of poor efficiency of existing voice interaction between users and vehicles.

[0005] In a first aspect, an embodiment of the present application provides a voice interaction method, the method comprising:

[0006] Acquire first voiceprint information corresponding to the voice control instruction, wherein the first voiceprint information is voiceprint information of a first user, and the first user is the user who issues the voice control instruction;

[0007] Determine a second user based on the first user corresponding to the first voiceprint information and the semantic recognition result of the voice control instruction, and obtain first location information of the second user, wherein the second user is a user associated with the control instruction in the voice control instruction, and the first location information is predetermined location information that has a mapping relationship with the second user;

[0008] A target execution operation corresponding to the voice control instruction is determined based on the semantic recognition result, and the target execution operation is performed in a position area corresponding to the first position information.

[0009] In some embodiments, before obtaining the first voiceprint information corresponding to the voice control instruction, the method further includes:

[0010] In the case of receiving a voiceprint registration signal of a third user, determining the second location information of the third user based on the voiceprint registration signal, wherein the third user is any user in the vehicle;

[0011] Acquire second voiceprint information of the third user based on the voiceprint registration signal;

[0012] A mapping relationship is generated between the second location information and the second voiceprint information.

[0013] In some embodiments, after generating a mapping relationship between the second location information and the second voiceprint information, the method further includes:

[0014] When receiving the wake-up signal of the third user, obtaining the location information of the sound source of the wake-up signal,

[0015] The second location information of the third user in the mapping relationship is updated based on the location information of the sound source, wherein the wake-up signal is used to wake up the voice system of the vehicle.

[0016] In some embodiments, the voiceprint registration signal includes at least one target speech signal, and the second voiceprint information includes a voiceprint model;

[0017] The acquiring the second voiceprint information of the third user based on the voiceprint registration signal includes:

[0018] In the case where a first target voice signal of the third user is detected, determining a voiceprint registration state corresponding to the first target voice signal, wherein the first target voice signal is any one of the at least one target voice signal;

[0019] Obtaining the voiceprint algorithm corresponding to the voiceprint registration status;

[0020] Extracting speech features from the first target speech signal by using the voiceprint algorithm;

[0021] A voiceprint model of the third user is constructed based on the voice features.

[0022] In some embodiments, after acquiring the second voiceprint information of the third user based on the voiceprint registration signal, the method further includes:

[0023] Displaying the registration result of the second voiceprint information of the third user on a display interface of the vehicle;

[0024] receiving a target input, wherein the target input is used to enter or update characteristic information of the third user;

[0025] An association relationship is generated between the second voiceprint information of the third user and the feature information of the third user.

[0026] In some embodiments, after obtaining the first voiceprint information corresponding to the voice control instruction, the method further includes:

[0027] Acquire target feature information associated with the first voiceprint information, wherein the target feature information includes at least one reply template;

[0028] Generating a personalized reply sentence corresponding to the voice control instruction based on the target feature information;

[0029] The interaction with the first user is performed according to the personalized reply statement.

[0030] In some embodiments, performing the interaction with the first user according to the personalized reply statement includes:

[0031] determining an age range to which the first user belongs;

[0032] The personalized reply sentence is broadcast according to the voice corresponding to the age range.

[0033] In some embodiments, performing the target execution operation in the location area corresponding to the first location information includes:

[0034] Acquire the execution permission of the first user, where the execution permission includes at least one first execution operation that is allowed to be executed;

[0035] In a case where the at least one first execution operation includes the target execution operation, the target execution operation is performed in a location area corresponding to the first location information.

[0036] In a second aspect, an embodiment of the present application provides a voice interaction device, the device comprising:

[0037] A first acquisition module, configured to acquire first voiceprint information corresponding to the voice control instruction, wherein the first voiceprint information is voiceprint information of a first user, and the first user is a user who issues the voice control instruction;

[0038] a second acquisition module, configured to determine a second user based on the first user corresponding to the first voiceprint information and a semantic recognition result of the voice control instruction, and acquire first location information of the second user, wherein the second user is a user associated with the control instruction in the voice control instruction, and the first location information is predetermined location information that has a mapping relationship with the second user;

[0039] An execution module is used to determine a target execution operation corresponding to the voice control instruction based on the semantic recognition result, and execute the target execution operation in a position area corresponding to the first position information.

[0040] In a third aspect, an embodiment of the present application provides a voice interaction device, the device comprising: a processor and a memory storing computer program instructions;

[0041] The above voice interaction method is implemented when the processor executes the computer program instructions.

[0042] In a fourth aspect, an embodiment of the present application provides a computer storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the above-mentioned voice interaction method is implemented.

[0043] In a fifth aspect, an embodiment of the present application provides a vehicle, which includes computer program instructions, and the computer program instructions implement the above voice interaction method when executed by a processor.

[0044] In the present application, when a voice control instruction is received, the first voiceprint information corresponding to the voice control instruction is obtained, wherein the first voiceprint information is the voiceprint information of the first user, and the first user is the user who issues the voice control instruction; based on the first user corresponding to the first voiceprint information and the semantic recognition result of the voice control instruction, the second user is determined, and the first location information of the second user is obtained, wherein the second user is the user associated with the control instruction in the voice control instruction, and the first location information is the predetermined location information that has a mapping relationship with the second user; based on the semantic recognition result, the target execution operation corresponding to the voice control instruction is determined, and the target execution operation is performed in the location area corresponding to the first location information. In this way, through voiceprint recognition, the vehicle can quickly determine the identity of the second user associated with the control instruction in the voice control instruction and locate the second user, so that the first user does not need to clearly express the identity and location of the second user. The vehicle can determine the location of the second user based on the identity of the first user and the semantics of the voice control instruction, and respond to the voice control instruction based on the personalized settings related to the second user, thereby improving the real-time and efficiency of voice interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0046] Figure 1 It is a flowchart of a voice interaction method provided by an embodiment of the present application;

[0047] Figure 2 is a flowchart of a voice interaction method provided by another embodiment of the present application;

[0048] Figure 3 It is a schematic diagram of the hardware structure of a voice interaction device provided in an embodiment of the present application;

[0049] Figure 4 It is a structural diagram of a voice interaction device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0050] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.

[0051] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0052] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The embodiments will be described in detail below in conjunction with the accompanying drawings.

[0053] Specifically, in order to solve the problems of the prior art, the embodiments of the present application provide a voice interaction method, device, equipment, storage medium and vehicle. The voice interaction method provided by the embodiments of the present application is first introduced below.

[0054] Figure 1 A flow chart of a voice interaction method provided by an embodiment of the present application is shown. The method comprises the following steps:

[0055] S110, obtaining first voiceprint information corresponding to the voice control instruction, wherein the first voiceprint information is voiceprint information of a first user, and the first user is a user who issues the voice control instruction.

[0056] In this embodiment, the voice control command is a command conveyed by the user to the vehicle through sound signals, which is used to control various functions and operations of the vehicle, such as adjusting the air-conditioning temperature, opening the windows, switching the driving mode, etc.

[0057] The voiceprint information is composed of a series of feature vectors extracted from the user's voice signal, which reflect the user's voice characteristics. The voiceprint information is a unique identifier for each user similar to a fingerprint or iris. Based on the voice control instruction, the voiceprint information of the first user who issued the voice control instruction can be determined.

[0058] S120, determining a second user based on the first user corresponding to the first voiceprint information and the semantic recognition result of the voice control instruction, and obtaining first location information of the second user, wherein the second user is a user associated with the control instruction in the voice control instruction, and the first location information is predetermined location information that has a mapping relationship with the second user.

[0059] In this embodiment, since the second user is the user associated with the control instruction in the voice control instruction, it is necessary to determine the identity of the second user. Specifically, the identity of the first user can be determined through the first voiceprint information, and the vehicle stores a complete intelligent cockpit personnel memory table, which stores the relationship between each user related to the vehicle. Therefore, the voice control instruction can be semantically recognized to obtain a semantic recognition result, and then the second user can be searched in the intelligent cockpit personnel memory table based on the semantic recognition result of the voice control instruction and the first user.

[0060] For example, some voice control commands have no associated users, such as "open all windows" or "adjust the air conditioning temperature to 24°C", while other voice control commands are associated with specific users. For example, the voice control command "open the windows for my son" can determine that "I" in the voice control command is the first user, and "my son" can be searched in the smart cockpit crew memory table and my son can be used as the second user.

[0061] After the identity of the second user associated with the voice control instruction is determined, the first location information of the second user may be queried from a database of the vehicle.

[0062] For example, the voiceprint information and location information of each user may have a mapping relationship in the vehicle, so the voiceprint information of the user may be queried first, and then the location information having a mapping relationship with the voiceprint information may be obtained based on the mapping relationship.

[0063] S130, determining a target execution operation corresponding to the voice control instruction based on the semantic recognition result, and executing the target execution operation in a location area corresponding to the first location information.

[0064] In this embodiment, semantic recognition is performed on the voice control instruction to obtain a semantic recognition result, and the target execution operation indicated by the first user can be determined by the semantic recognition result. In addition, in the vehicle, the first position information of the second user can include the position area to which the second user belongs, that is, the voice zone of the second user. After determining the voice zone to which the second user belongs, the functional unit associated with the voice zone can be further determined, such as the window in the voice zone, the seat in the voice zone, etc.

[0065] Then, the intention of the voice control instruction can be identified based on the first position information, and a target execution operation corresponding to the voice control instruction can be determined, and then the target execution operation can be executed in the position area corresponding to the first position information.

[0066] For example, if the voice control instruction is "lay down the second user's seat", then the seat in the location area where the second user is located can be determined based on the first location information, and the seat can be laid down.

[0067] In the present application, when a voice control instruction is received, the first voiceprint information corresponding to the voice control instruction is obtained, wherein the first voiceprint information is the voiceprint information of the first user, and the first user is the user who issues the voice control instruction; based on the first user corresponding to the first voiceprint information and the semantic recognition result of the voice control instruction, the second user is determined, and the first location information of the second user is obtained, wherein the second user is the user associated with the control instruction in the voice control instruction, and the first location information is the predetermined location information that has a mapping relationship with the second user; based on the semantic recognition result, the target execution operation corresponding to the voice control instruction is determined, and the target execution operation is performed in the location area corresponding to the first location information. In this way, through voiceprint recognition, the vehicle can quickly determine the identity of the second user associated with the control instruction in the voice control instruction and locate the second user, so that the first user does not need to clearly express the identity and location of the second user. The vehicle can determine the location of the second user based on the identity of the first user and the semantics of the voice control instruction, and respond to the voice control instruction based on the personalized settings related to the second user, thereby improving the real-time and efficiency of voice interaction.

[0068] As an optional embodiment, before obtaining the first voiceprint information corresponding to the voice control instruction, the method further includes:

[0069] In the case of receiving a voiceprint registration signal of a third user, determining the second location information of the third user based on the voiceprint registration signal, wherein the third user is any user in the vehicle;

[0070] Acquire second voiceprint information of the third user based on the voiceprint registration signal;

[0071] A mapping relationship is generated between the second location information and the second voiceprint information.

[0072] In this embodiment, the third user is any user who registers a voiceprint in the vehicle, and the voiceprint registration signal is the sample voice of the third user that needs to be collected. The voiceprint registration signal can be a wake-up signal of the voice system in the vehicle, or it can be the content that the user is required to read aloud in the voiceprint registration process.

[0073] During the voiceprint registration process, the voice system can collect the voiceprint registration signal of the third user, and then generate second voiceprint information corresponding to the third user based on the voiceprint registration signal, and the second voiceprint information is used to identify the voice of the third user.

[0074] In addition, the voice system in the vehicle includes multiple microphone arrays, and the voice system can infer the location of the sound source of the voiceprint registration signal based on the signal difference of the voiceprint registration signal received on the microphone array, that is, the second location information of the third user.

[0075] After determining the second location information and the second voiceprint information of the second user, a mapping relationship can be generated between the second location information and the second voiceprint information. In this way, once the second voiceprint information of the third user is determined, the second location information can be immediately queried to facilitate the execution of voice control instructions related to the third user.

[0076] As an optional embodiment, after generating a mapping relationship between the second location information and the second voiceprint information, the method further includes:

[0077] When receiving a wake-up signal from the third user, obtaining location information of a sound source of the wake-up signal;

[0078] The second location information of the third user in the mapping relationship is updated based on the location information of the sound source, wherein the wake-up signal is used to wake up the voice system of the vehicle.

[0079] In this embodiment, any third user can be the second user. Since the position of the third user in the vehicle can change in real time, a wake-up signal needs to be sent in advance to wake up the voice system before sending a voice control command to the vehicle's voice system.

[0080] Therefore, the second location information of the third user can be reconfirmed based on the wake-up signal. Specifically, after receiving the wake-up signal from the third user, the vehicle can determine the location information of the wake-up signal sound source, and then update the location information of the signal sound source to the second location information of the third user. For example, the face of the user in the car can be recognized by the in-car camera, and the chat audio of the user in the car can be collected. Then, based on the chat audio and the result of face recognition, the location information of the wake-up signal sound source can be determined, and the second location information of the third user in the mapping relationship can be updated in real time, so as to ensure the accuracy of the target execution operation corresponding to the voice control instruction.

[0081] As an optional embodiment, the voiceprint registration signal includes at least one target speech signal, and the second voiceprint information includes a voiceprint model;

[0082] The acquiring the second voiceprint information of the third user based on the voiceprint registration signal includes:

[0083] In the case where a first target voice signal of the third user is detected, determining a voiceprint registration state corresponding to the first target voice signal, wherein the first target voice signal is any one of the at least one target voice signal;

[0084] Obtaining the voiceprint algorithm corresponding to the voiceprint registration status;

[0085] Extracting speech features from the first target speech signal by using the voiceprint algorithm;

[0086] A voiceprint model of the third user is constructed based on the voice features.

[0087] In this embodiment, in the process of registering the voiceprint information of the third user, the user needs to read aloud at least one target voice signal, which can be a wake-up signal of the voice system, or a specific phrase, number or password. When the user reads aloud different target voice signals, the voiceprint registration process is in different voiceprint registration states, and different voiceprint algorithms need to be applied to extract voice features in different voiceprint registration states.

[0088] Taking the first target voice signal as an example, when the user reads the first target voice signal, the voice system first needs to determine whether the first target voice signal is the specified target voice signal. If it is the specified target voice signal, the first target voice signal is preprocessed, including removing noise, adjusting audio quality, etc. Then, a voiceprint algorithm corresponding to the voiceprint registration state is selected, and the voiceprint algorithm is used to extract voice features from the preprocessed first target voice signal, and the extracted voiceprint features are converted into feature vectors, and the voiceprint model of the third user is constructed using the feature vectors.

[0089] The voiceprint model can be used to convert the user's voice characteristics into mathematical representations, thereby realizing the recognition and identification of the user's voiceprint.

[0090] As an optional embodiment, after acquiring the second voiceprint information of the third user based on the voiceprint registration signal, the method further includes:

[0091] Displaying the registration result of the second voiceprint information of the third user on a display interface of the vehicle;

[0092] receiving a target input, wherein the target input is used to enter or update characteristic information of the third user;

[0093] An association relationship is generated between the second voiceprint information of the third user and the feature information of the third user.

[0094] In this embodiment, after the third user completes voiceprint registration, the registration result of the third user's second voiceprint information can be displayed on the display interface of the vehicle's dashboard or center console to remind the third user that the voiceprint registration has been successfully completed.

[0095] After completing the voiceprint registration, the third user can also make a target input to the vehicle to enter or update the third user's feature information, and then generate an association relationship between the third user's second voiceprint information and the third user's feature information.

[0096] For example, the target input can be a touch screen input, a knob / controller input, a voice input, or a gesture control input; the characteristic information can include the nickname, age, gender, and family relationship of the third user with other users, etc. The characteristic information of the third user and the second voiceprint information can be saved together.

[0097] In this way, the user's characteristic information can be obtained through the user's voiceprint information, and a personalized user portrait and memory map can be established for each user, thereby achieving a variety of technical effects such as more convenient user experience, multi-scenario applications and personalized services.

[0098] As an optional embodiment, after obtaining the first voiceprint information corresponding to the voice control instruction, the method further includes:

[0099] Acquire target feature information associated with the first voiceprint information, wherein the target feature information includes at least one reply template;

[0100] Generating a personalized reply sentence corresponding to the voice control instruction based on the target feature information;

[0101] The interaction with the first user is performed according to the personalized reply statement.

[0102] In this embodiment, after receiving the voice control instruction, in addition to generating a target execution operation corresponding to the voice control instruction and implementing the target execution operation, a reply to the voice control instruction can also be made.

[0103] Specifically, after determining the first voiceprint information of the first user, the target feature information of the first user may be acquired based on the association relationship, and reply information of the voice control command may be generated and played based on the target feature information.

[0104] For example, the target feature information includes at least one reply template. After obtaining at least one reply template associated with the first voiceprint information, it is also possible to select a suitable reply template from the at least one reply template based on the semantic recognition result of the voice control instruction, and then expand the reply template into a suitable personalized reply sentence, and then broadcast the personalized reply sentence.

[0105] As an optional embodiment, the performing interaction with the first user according to the personalized reply statement includes:

[0106] determining an age range to which the first user belongs;

[0107] The personalized reply sentence is broadcast according to the voice corresponding to the age range.

[0108] In this embodiment, the vehicle can broadcast the generated personalized reply statement to the user in different voices according to the age range of the user interacting with the vehicle. Specifically, a variety of different age ranges can be set in advance in the vehicle, and each age range corresponds to a voice. After determining the age range to which the first user interacting with the user belongs, the personalized reply statement is broadcast according to the voice corresponding to the age range. For example, the voice corresponding to the age range of 0-14 years old can be a child's voice, and the voice corresponding to the age range of 40-70 years old can be a more formal adult voice.

[0109] As an optional embodiment, after the first user issues a voice control command to the vehicle, the vehicle can obtain first voiceprint information corresponding to the voice control command, and input the first voiceprint information into a pre-trained age range prediction model to extract the voiceprint features of the first user from the first voiceprint information, use the voiceprint features to determine the age range to which the first user belongs, and broadcast the generated personalized reply sentence according to the voice corresponding to the age range.

[0110] As another optional embodiment, the age of each user may be pre-stored in the vehicle's database. After the first user issues a voice control command to the vehicle, the vehicle may obtain the first voiceprint information corresponding to the voice control command, and determine the first user corresponding to the first voiceprint information, and then query the database for the age of the first user, and then further determine the age range to which the age of the first user belongs, and broadcast the generated personalized reply sentence according to the voice corresponding to the age range.

[0111] In this embodiment, the user experience can be enhanced by analyzing the age range of the user and providing different voice responses according to the age range of the user to meet their needs and interests.

[0112] As an optional embodiment, the above S130 includes:

[0113] Acquire the execution permission of the first user, where the execution permission includes at least one first execution operation that is allowed to be executed;

[0114] In a case where the at least one first execution operation includes the target execution operation, the target execution operation is performed in a location area corresponding to the first location information.

[0115] In this embodiment, the execution authority of each user may be pre-stored in the database of the vehicle. After receiving the voice control instruction of the first user, the target execution operation corresponding to the voice control instruction may be determined, and the execution authority of the first user and at least one first execution operation allowed to be executed under the execution authority may be queried in the database.

[0116] If at least one of the first execution operations allowed to be executed under the execution authority includes the target execution operation, it means that the target execution operation can be executed according to the execution authority of the first user, and the target execution operation can be directly executed. If at least one of the first execution operations allowed to be executed under the execution authority does not include the target execution operation, it means that the target execution operation cannot be executed according to the execution authority of the first user, and the target execution operation will not be executed, and a voice broadcast will be given indicating that it cannot be executed.

[0117] In this embodiment, by setting different execution permissions for different users and determining whether to execute the target execution operation corresponding to the user's voice control instruction based on the execution permissions, the safety of the vehicle can be better improved.

[0118] As an optional embodiment, Figure 2 As shown, the voice interaction method is applied to a voice system, which includes a display page module, an acoustic front-end module, a software algorithm module, and an acoustic back-end module.

[0119] Among them, in the voiceprint registration process, the display page module is responsible for the development of interactive logic and UI interface. Specifically, it can receive the voice signal and location information of the user when registering the voiceprint.

[0120] The acoustic front-end module can provide voiceprint registration capabilities. Specifically, it can interact with the software algorithm module to wake up the algorithm, and detect related voice signals based on the algorithm to determine whether the recording is successful. It can also interact with the display page module to record the process status of the schedule voiceprint registration, and can also store the voiceprint information and recorded voice signals.

[0121] The software algorithm module is used to synchronize the status and data of the voice signal and the algorithm model.

[0122] The acoustic backend module can be used to maintain the collected voiceprint information, location information, and feature information for cloud-based calls.

[0123] During the voiceprint registration process, the display page module receives the input of the voice signal, then determines the current registration status based on the voice signal, and sends the registration status to the acoustic front-end module. The acoustic front-end module starts the voiceprint recognition algorithm by calling the software algorithm module, converts the voice signal into a text signal, and calls the algorithm corresponding to the text through the software algorithm module to complete the voice signal recognition. After recognizing the voice signal, the acoustic front-end module calls back the recognition result to the display page module, and the display page module displays the recognition result. The acoustic front-end module and the acoustic back-end module jointly save the voiceprint information.

[0124] Based on the voice interaction method provided in the above embodiment, the present application also provides a specific implementation of the voice interaction device. Please refer to the following embodiment.

[0125] See first Figure 3 The voice interaction device 300 provided in the embodiment of the present application includes the following modules:

[0126] A first acquisition module 301 is used to acquire first voiceprint information corresponding to the voice control instruction, wherein the first voiceprint information is the voiceprint information of a first user, and the first user is the user who issues the voice control instruction;

[0127] A second acquisition module 302 is used to determine a second user based on the first user corresponding to the first voiceprint information and the semantic recognition result of the voice control instruction, and obtain first location information of the second user, wherein the second user is a user associated with the control instruction in the voice control instruction, and the first location information is predetermined location information that has a mapping relationship with the second user;

[0128] The execution module 303 is used to determine the target execution operation corresponding to the voice control instruction based on the semantic recognition result, and execute the target execution operation in the position area corresponding to the first position information.

[0129] The device can obtain the first voiceprint information corresponding to the voice control instruction when receiving the voice control instruction, wherein the first voiceprint information is the voiceprint information of the first user, and the first user is the user who issued the voice control instruction; determine the second user based on the first user corresponding to the first voiceprint information and the semantic recognition result of the voice control instruction, and obtain the first location information of the second user, wherein the second user is the user associated with the control instruction in the voice control instruction, and the first location information is the predetermined location information that has a mapping relationship with the second user; determine the target execution operation corresponding to the voice control instruction based on the semantic recognition result, and perform the target execution operation in the location area corresponding to the first location information. In this way, through voiceprint recognition, the vehicle can quickly determine the identity of the second user associated with the control instruction in the voice control instruction and locate the second user, so that the first user does not need to clearly express the identity and location of the second user. The vehicle can determine the location of the second user based on the identity of the first user and the semantics of the voice control instruction, and respond to the voice control instruction based on the personalized settings related to the second user, thereby improving the real-time and efficiency of voice interaction.

[0130] As an implementation of the present application, the above-mentioned voice interaction device 300 may further include:

[0131] a positioning module, configured to determine, upon receiving a voiceprint registration signal of a third user, second location information of the third user based on the voiceprint registration signal, wherein the third user is any user in the vehicle;

[0132] A third acquisition module, configured to acquire second voiceprint information of the third user based on the voiceprint registration signal;

[0133] A mapping module is used to generate a mapping relationship between the second location information and the second voiceprint information.

[0134] As an implementation of the present application, the above-mentioned voice interaction device 300 may further include:

[0135] a wake-up module, configured to obtain location information of a sound source of the wake-up signal when receiving a wake-up signal from the third user;

[0136] An updating module is used to update the second location information of the third user in the mapping relationship based on the location information of the sound source, wherein the wake-up signal is used to wake up the voice system of the vehicle.

[0137] As an implementation of the present application, the third acquisition module may further include:

[0138] a determining unit, configured to determine, when a first target voice signal of the third user is detected, a voiceprint registration state corresponding to the first target voice signal, wherein the first target voice signal is any one of the at least one target voice signal;

[0139] An acquiring unit, configured to acquire a voiceprint algorithm corresponding to the voiceprint registration state;

[0140] An extraction unit, configured to extract voice features from the first target voice signal by using the voiceprint algorithm;

[0141] A construction unit is used to construct a voiceprint model of the third user based on the speech feature.

[0142] As an implementation of the present application, the above-mentioned voice interaction device 300 can also be used for:

[0143] Displaying the registration result of the second voiceprint information of the third user on a display interface of the vehicle;

[0144] receiving a target input, wherein the target input is used to enter or update characteristic information of the third user;

[0145] An association relationship is generated between the second voiceprint information of the third user and the feature information of the third user.

[0146] As an implementation of the present application, the voice interaction device 300 may also be used for:

[0147] Acquire target feature information associated with the first voiceprint information, wherein the target feature information includes at least one reply template;

[0148] Generating a personalized reply sentence corresponding to the voice control instruction based on the target feature information;

[0149] The interaction with the first user is performed according to the personalized reply statement.

[0150] As an implementation of the present application, the voice interaction device 300 may also be used for:

[0151] determining an age range to which the first user belongs;

[0152] The personalized reply sentence is broadcast according to the voice corresponding to the age range.

[0153] As an implementation of the present application, the execution module 303 may also be used to:

[0154] Acquire the execution permission of the first user, where the execution permission includes at least one first execution operation that is allowed to be executed;

[0155] In a case where the at least one first execution operation includes the target execution operation, the target execution operation is performed in a location area corresponding to the first location information.

[0156] The voice interaction device provided in the embodiment of the present invention can implement each step in the above method embodiment, and will not be described again here to avoid repetition.

[0157] Figure 4 A schematic diagram of the hardware structure of the voice interaction device provided in an embodiment of the present application is shown.

[0158] The voice interaction device may include a processor 401 and a memory 402 storing computer program instructions.

[0159] Specifically, the processor 401 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0160] Memory 402 may include a large capacity memory for data or instructions. By way of example and not limitation, memory 402 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, memory 402 may include a removable or non-removable (or fixed) medium. In appropriate cases, memory 402 may be inside or outside of an integrated gateway disaster recovery device. In a specific embodiment, memory 402 is a non-volatile solid-state memory.

[0161] The memory may include read-only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical or other physical / tangible memory storage devices. Thus, typically, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to an aspect of the present disclosure.

[0162] The processor 401 implements any one of the voice interaction methods in the above embodiments by reading and executing computer program instructions stored in the memory 402.

[0163] In one example, the voice interaction device may further include a communication interface 403 and a bus 410. Figure 4 As shown, the processor 401, the memory 402, and the communication interface 403 are connected via a bus 410 and communicate with each other.

[0164] The communication interface 403 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0165] Bus 410 includes hardware, software or both, and the parts of voice interaction device are coupled to each other.For example, but not limitation, bus may include accelerated graphics port (AGP) or other graphics bus, enhanced industrial standard architecture (EISA) bus, front side bus (FSB), hypertransport (HT) interconnection, industrial standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 410 may include one or more buses. Although the present application embodiment describes and shows a specific bus, the present application considers any suitable bus or interconnection.

[0166] The voice interaction device can be based on the above embodiment, thereby realizing the combination of the above voice interaction method and device.

[0167] In addition, in combination with the voice interaction method in the above embodiment, the embodiment of the present application may provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when the computer program instructions are executed by the processor, any one of the voice interaction methods in the above embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here. Among them, the above-mentioned computer-readable storage medium may include a non-transitory computer-readable storage medium, such as a read-only memory (Read-Only Memory, referred to as ROM), a random access memory (Random Access Memory, referred to as RAM), a disk or an optical disk, etc., which is not limited here.

[0168] In addition, an embodiment of the present application also provides a vehicle, including computer program instructions, which, when executed by a processor, can implement the steps and corresponding contents of the aforementioned method embodiment.

[0169] It should be clear that the present application is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present application is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present application.

[0170] The functional blocks shown in the above block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present application are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0171] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be performed simultaneously.

[0172] Aspects of the present disclosure are described above with reference to the flowcharts and / or block diagrams of the methods, devices and vehicles according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field programmable logic circuit. It can also be understood that each box in the block diagram and / or flowchart and the combination of boxes in the block diagram and / or flowchart can also be implemented by dedicated hardware that performs a specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0173] The above are only specific implementation methods of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the protection scope of this application.

Claims

1. A voice interaction method, characterized in that: The method comprises: Acquire first voiceprint information corresponding to the voice control instruction, wherein the first voiceprint information is voiceprint information of a first user, and the first user is a user who issues the voice control instruction; Determine a second user based on the first user corresponding to the first voiceprint information and the semantic recognition result of the voice control instruction, and obtain first location information of the second user, wherein the second user is a user associated with the control instruction in the voice control instruction, and the first location information is predetermined location information that has a mapping relationship with the second user; A target execution operation corresponding to the voice control instruction is determined based on the semantic recognition result, and the target execution operation is performed in a position area corresponding to the first position information.

2. The voice interaction method according to claim 1, characterized in that: Before obtaining the first voiceprint information corresponding to the voice control instruction, the method further includes: In the case of receiving a voiceprint registration signal of a third user, determining the second location information of the third user based on the voiceprint registration signal, wherein the third user is any user in the vehicle; Acquire second voiceprint information of the third user based on the voiceprint registration signal; A mapping relationship is generated between the second location information and the second voiceprint information.

3. The voice interaction method according to claim 2, characterized in that: After generating a mapping relationship between the second location information and the second voiceprint information, the method further includes: When receiving a wake-up signal from the third user, obtaining location information of a sound source of the wake-up signal; The second location information of the third user in the mapping relationship is updated based on the location information of the sound source, wherein the wake-up signal is used to wake up the voice system of the vehicle.

4. The voice interaction method according to claim 2, characterized in that: The voiceprint registration signal includes at least one target voice signal, and the second voiceprint information includes a voiceprint model; The acquiring the second voiceprint information of the third user based on the voiceprint registration signal includes: In the case where a first target voice signal of the third user is detected, determining a voiceprint registration state corresponding to the first target voice signal, wherein the first target voice signal is any one of the at least one target voice signal; Obtaining the voiceprint algorithm corresponding to the voiceprint registration status; Extracting speech features from the first target speech signal by using the voiceprint algorithm; A voiceprint model of the third user is constructed based on the voice features.

5. The voice interaction method according to claim 2, characterized in that: After acquiring the second voiceprint information of the third user based on the voiceprint registration signal, the method further includes: Displaying the registration result of the second voiceprint information of the third user on a display interface of the vehicle; receiving a target input, wherein the target input is used to enter or update characteristic information of the third user; An association relationship is generated between the second voiceprint information of the third user and the feature information of the third user.

6. The voice interaction method according to claim 1, characterized in that: After obtaining the first voiceprint information corresponding to the voice control instruction, the method further includes: Acquire target feature information associated with the first voiceprint information, wherein the target feature information includes at least one reply template; Generating a personalized reply sentence corresponding to the voice control instruction based on the target feature information; The interaction with the first user is performed according to the personalized reply statement.

7. The voice interaction method according to claim 6, characterized in that: The performing interaction with the first user according to the personalized reply statement includes: determining an age range to which the first user belongs; The personalized reply sentence is broadcast according to the voice corresponding to the age range.

8. The voice interaction method according to claim 1, characterized in that: The performing the target execution operation in the location area corresponding to the first location information includes: Acquire the execution permission of the first user, where the execution permission includes at least one first execution operation that is allowed to be executed; In a case where the at least one first execution operation includes the target execution operation, the target execution operation is performed in a location area corresponding to the first location information.

9. A voice interaction device, characterized in that: The device comprises: A first acquisition module, configured to acquire first voiceprint information corresponding to the voice control instruction, wherein the first voiceprint information is voiceprint information of a first user, and the first user is a user who issues the voice control instruction; a second acquisition module, configured to determine a second user based on the first user corresponding to the first voiceprint information and a semantic recognition result of the voice control instruction, and acquire first location information of the second user, wherein the second user is a user associated with the control instruction in the voice control instruction, and the first location information is predetermined location information that has a mapping relationship with the second user; An execution module is used to determine a target execution operation corresponding to the voice control instruction based on the semantic recognition result, and execute the target execution operation in a position area corresponding to the first position information.

10. A voice interaction device, characterized in that: The voice interaction device includes: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, the voice interaction method according to any one of claims 1 to 6 is implemented.

11. A computer storage medium, characterized in that: The computer storage medium stores computer program instructions, which, when executed by a processor, implement the voice interaction method according to any one of claims 1 to 8.

12. A vehicle, characterized in that: The vehicle includes computer program instructions, and when the computer program instructions are executed by a processor, the voice interaction method according to any one of claims 1 to 8 is implemented.

Images