Voice interaction method and vehicle

Abstract

The invention relates to a voice interaction method and a vehicle, and relates to the technical field of information, and the method comprises the steps: obtaining a voice sent by a user, and carrying out the interaction with a target user located in a locked voice region, the locked voice region is a voice region allowing the voice interaction, and because the object of the voice interaction is the user located in the locked voice region, the voice interaction is not allowed. The locked voice area is a voice interaction allowing area, so that interference of voice of the non-locked voice area on voice interaction can be avoided, the voice interaction function is improved, and better user experience can be obtained.

Description

[0001] This application is a divisional application of the invention patent application with the application number 202210260445.8, the application date of March 16, 2022, and the invention creation name of "Multi-region Speech Recognition Method, Device, Vehicle and Storage Medium", which was submitted to the China National Patent Office. Technical Field

[0002] The present disclosure relates to the field of information technology, and in particular, to a voice interaction method and a vehicle. Background Art

[0003] Nowadays, in-vehicle voice assistants have become increasingly popular, and users can perform voice interactions with in-vehicle voice assistants to achieve functions such as navigation, playing voice, and vehicle control.

[0004] There is still room for improvement in the current in-vehicle voice interaction function. Summary of the Invention

[0005] To solve the above technical problems, the present disclosure provides a voice interaction method and a vehicle.

[0006] The first aspect of the embodiments of the present disclosure provides a voice interaction method, including:

[0007] Obtain the voice emitted by the user;

[0008] Interact with the target user located in the locked sound region; the locked sound region is the sound region where voice interaction is allowed.

[0009] The second aspect of the embodiments of the present disclosure provides a voice interaction method, including:

[0010] Receive a locking setting operation for the first sound region, and set the first sound region as the locked sound region, where the locked sound region is the sound region where voice interaction is allowed.

[0011] The third aspect of the embodiments of the present disclosure provides a voice interaction method, including:

[0012] Receive a sound region suppression operation and set it to the sound region suppression mode, where the sound region suppression mode is used to prohibit the voice interaction function of the sound region; and / or, receive a sound region suppression cancellation operation and set it to the non-sound region suppression mode.

[0013] The fourth aspect of the embodiments of the present disclosure provides a voice interaction method, including:

[0014] Obtain the voice emitted by the user;

[0015] In the non-sound region suppression mode, interact with the target user located in the locked sound region; the locked sound region is the sound region where voice interaction is allowed.

[0016] The fifth aspect of the embodiments of the present disclosure provides a vehicle, which includes a memory and a processor. Among them, a computer program is stored in the memory. When the computer program is executed by the processor, the voice interaction method as described in the first aspect, the second aspect, the third aspect, or the fourth aspect above is implemented.

[0017] The sixth aspect of the embodiments of the present disclosure provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by the processor, the voice interaction method as described in the first aspect, the second aspect, the third aspect, or the fourth aspect above is implemented.

[0018] The technical solution provided by this application has the following advantages compared with the prior art:

[0019] Obtain the voice issued by the user and interact with the target user located in the locked sound area. The locked sound area is the sound area where voice interaction is allowed. Since the object of voice interaction is the user located in the locked sound area and the locked sound area is the area where voice interaction is allowed, it is possible to avoid the interference of sounds in the non-locked sound area on voice interaction, improve the voice interaction function, and obtain a better user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings here are incorporated into the description and form a part of this description, showing the embodiments that conform to the present disclosure, and are used together with the description to explain the principles of the present disclosure.

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0022] Figure 1 It is a schematic diagram of a vehicle cockpit of a multi-zone voice recognition method provided by an embodiment of the present disclosure;

[0023] Figure 2 It is a flowchart of a multi-zone voice recognition method provided by an embodiment of the present disclosure;

[0024] Figure 3 It is a schematic diagram of a sound area setting interface of a multi-zone voice recognition provided by an embodiment of the present disclosure;

[0025] Figure 4 It is a flowchart of another multi-zone voice recognition method provided by an embodiment of the present disclosure;

[0026] Figure 5 It is a schematic structural diagram of a multi-zone voice recognition device provided by an embodiment of the present disclosure;

[0027] Figure 6 It is a schematic structural diagram of a vehicle provided by an embodiment of the present disclosure;

[0028] Figure 7 It is a flowchart of a voice interaction method provided by an embodiment of the present disclosure. Detailed implementation manners

[0029] In order to be able to more clearly understand the above-mentioned objects, features, and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that, without conflict, the embodiments of the present disclosure and the features in the embodiments may be combined with each other.

[0030] Many specific details are set forth in the following description in order to fully understand the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only a part of the embodiments of the present disclosure, rather than all the embodiments.

[0031] It should be understood that the various steps recorded in the method embodiments of the present disclosure may be executed in different orders and / or executed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this regard.

[0032] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, the element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including the said element.

[0033] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive. Those skilled in the art should understand that, unless clearly specified otherwise in the context, it should be understood as "one or more".

[0034] The multi-zone speech recognition method provided by the embodiments of the present disclosure can be applied to a vehicle cockpit. To enable all members in the cockpit to use voice services, one or more microphones can be set in the vehicle cockpit. The range within which a microphone receives sound is called a zone. One zone can correspond to one or more seat areas. The microphones can divide the vehicle interior space into multiple independent zones, and can independently collect voice signals for each zone. The microphones ensure sufficient isolation between each zone, isolating sounds from other zones. The microphones can send the collected voice signals to the multi-zone speech recognition device. The multi-zone speech recognition device can process the voice signals of each zone to achieve speech recognition and voice interaction, and can also send the results of speech recognition to the in-vehicle screen, and the in-vehicle screen displays the results, visualizing the process of speech recognition. Among them, the microphone mainly consists of multiple digital microphones, a digital signal processing (DSP) chip, and an automotive audio bus (A2B) chip.

[0035] For example, Figure 1 FIG. is a schematic diagram of a vehicle cockpit for the multi-zone speech recognition method provided by the embodiments of the present disclosure. The cockpit space 100 is divided into six zones in the direction from the front of the vehicle to the rear. 101 is the driver's zone, with the range being the driver's seat area; 102 is the front passenger's zone, with the range being the front passenger's seat area; 103 is the second row left zone, with the range being the left seat area in the second row; 104 is the second row right zone, with the range being the right seat area in the second row; 105 is the third row left zone, with the range being the left seat area in the third row; 106 is the third row right zone, with the range being the right seat area in the third row. Each zone is equipped with a microphone with a corresponding sound pickup range. The six zones can achieve independent sound pickup and can automatically block sound sources from other zones. For example, if someone is making a call in a certain zone, at this time, normal speech recognition can be carried out in other zones without being interfered. 107 is the in-vehicle screen on the center console, which can visualize the process of speech recognition. Figure 1 It is only an exemplary illustration of the vehicle cockpit for the multi-zone speech recognition method, rather than the only illustration.

[0036] In related technologies, to meet the needs of users, in-vehicle voice assistants can already implement full-member voice services in the vehicle cockpit. However, full-member voice services continuously allow people at various positions in the vehicle cockpit to simultaneously interact with the in-vehicle voice assistant through voice. If users only hope that people at certain positions in the vehicle cockpit can interact with the in-vehicle voice assistant in some situations, this cannot meet the users' needs.

[0037] In view of the deficiencies in the related art in the voice interaction function, the embodiments of the present disclosure provide a multi-zone voice recognition method, apparatus, vehicle, and storage medium, which can lock the area for voice control according to the user's needs in advance, that is, lock the zone for voice control of the target vehicle according to the user's needs in advance, and only perform voice recognition on the voice from the locked zone, which can avoid interference caused by sounds in other zones and improve the user experience.

[0038] To better understand the inventive concept of the embodiments of the present disclosure, the technical solutions of the embodiments of the present disclosure will be described below in conjunction with exemplary embodiments.

[0039] Figure 2 is a flowchart of a multi-zone voice recognition method provided by an embodiment of the present disclosure. This method can be executed by a multi-zone voice recognition device disposed in a target vehicle. As Figure 2 shown, the multi-zone voice recognition method provided in this embodiment includes the following steps:

[0040] Step 201, obtain the voice emitted by the user located in the cockpit of the target vehicle.

[0041] In the embodiments of the present disclosure, when the user located in the cockpit of the target vehicle wants to perform voice interaction with the in-vehicle voice assistant in the target vehicle, the user can emit a voice, and the multi-zone voice recognition device can obtain the voice emitted by the user.

[0042] Optionally, the microphone installed in the target vehicle can collect the voice emitted by the user in the cockpit and send it to the multi-zone voice recognition device, so that the multi-zone voice recognition device can obtain the voice emitted by the user.

[0043] Step 202, determine whether the source zone of the voice is a pre-set locked zone, and the locked zone is the zone allowed to perform voice control on the target vehicle.

[0044] In the embodiments of the present disclosure, after the multi-zone voice recognition device obtains the voice emitted by the user, it can determine whether the source zone of the voice is a pre-set locked zone.

[0045] The source zone in the embodiments of the present disclosure can be understood as the zone where the user who emits the voice is located. Since a zone is the range of sound received by a microphone, that is, the microphone and the zone are in one-to-one correspondence, therefore, the zone where the user is located, that is, the source zone of the voice, can be determined by the zone corresponding to the microphone that receives the voice.

[0046] In some embodiments, before step 202, the multi-zone voice recognition method may further include: determining the target microphone that collects the voice; determining the zone to which the target microphone belongs as the source zone.

[0047] Specifically, the multi-zone voice recognition device may first determine the microphone that collects the user's voice, then determine the microphone that collects the user's voice as the target microphone, and then determine the sound zone to which the target microphone belongs according to the sound reception range of the target microphone, and determine the sound zone to which the target microphone belongs as the source sound zone.

[0048] Among them, each sound zone may have a unique sound zone identifier, and the target vehicle may pre-store the sound zone identifiers of each sound zone corresponding to the sound reception range of each microphone. Thus, when the target vehicle determines the target microphone, it can obtain the sound zone identifier corresponding to the target microphone pre-stored, and then use the sound zone corresponding to the obtained sound zone identifier as the source sound zone.

[0049] The locked sound zone in the embodiments of the present disclosure can be understood as the sound zone that allows voice control of the target vehicle. The user can speak in the locked sound zone to achieve voice control of the target vehicle through voice interaction. The non-locked sound zone can be understood as the sound zone that prohibits voice control of the target vehicle. Even if the user speaks in the non-locked sound zone, they cannot achieve voice control of the target vehicle through voice interaction.

[0050] Since each sound zone may have a unique sound zone identifier, therefore, to determine whether the source sound zone of the voice is a pre-set locked sound zone, the sound zone identifier of the source sound zone can be compared with the sound zone identifier of the pre-set locked sound zone. If the sound zone identifiers are the same, it is determined that the source sound zone is the locked sound zone; otherwise, it is determined that the source sound zone is not the locked sound zone.

[0051] Step 203: If the source sound zone is the locked sound zone, perform voice recognition on the voice.

[0052] In some embodiments of the present disclosure, after the multi-zone voice recognition device determines whether the source sound zone of the voice is a pre-set locked sound zone, if it is determined that the source sound zone is the locked sound zone, it means that the user speaks in the locked sound zone. Therefore, the target vehicle can perform voice recognition on the obtained voice signal.

[0053] Specifically, the multi-zone voice recognition device may first perform voice recognition on the voice to obtain the voice text corresponding to the voice, and then perform semantic recognition on the voice text to obtain the semantics corresponding to the voice. If the semantics corresponding to the voice is a control instruction, execute the control instruction; if the semantics corresponding to the voice is the conversation content between the user and the in-vehicle voice assistant, an answer can be generated for the conversation content and the answer can be broadcast or displayed.

[0054] In the embodiments of the present disclosure, after obtaining the voice emitted by a user in the cockpit of a target vehicle, it is determined whether the source sound zone of the voice is the locked sound zone of the sound zone that is pre-set to allow voice control of the target vehicle. If the source sound zone is the locked sound zone, voice recognition is performed on the voice. If a user only wishes that people in certain positions in the vehicle cockpit can perform voice interaction with the in-vehicle voice assistant in some cases, the area for voice control can be locked according to the user's needs, that is, the locked sound zone of the sound zone that is pre-set to allow voice control of the target vehicle is set according to the user's needs, and voice recognition is only performed on the voice from the locked sound zone, which can avoid interference caused by sounds in other sound zones and improve the user experience.

[0055] In some other embodiments of the present disclosure, if it is determined that the source sound zone is not the locked sound zone, the multi-sound zone voice recognition device can output a prompt message, and the prompt message can be used to prompt that the source sound zone is a sound zone where voice control of the target vehicle is prohibited.

[0056] In some embodiments, the prompt message can be a graphic and text prompt message displayed on the screen. For example, the text "The source sound zone is not the locked sound zone" or "The source sound zone is a sound zone where voice control of the target vehicle is prohibited" can be displayed on the in-vehicle screen.

[0057] In some embodiments, the prompt message can be a voice prompt message played through a speaker. For example, the voice "The source sound zone is not the locked sound zone" or "The source sound zone is a sound zone where voice control of the target vehicle is prohibited" can be played through the speaker on the target vehicle.

[0058] After the user receives the prompt message, if the user wants to continue the voice interaction in this sound zone, the user can perform a locking setting operation on the source sound zone to set the source sound zone as the locked sound zone.

[0059] In still some other embodiments of the present disclosure, the user can also set the target vehicle to the sound zone suppression mode according to needs.

[0060] Among them, the sound zone suppression mode can be understood as that all sound zones of the target vehicle cannot perform voice control on the target vehicle, that is, the voice recognition function of the target vehicle cannot be used at all. Only when the target vehicle is not in the sound zone suppression mode, the microphone of the target vehicle can obtain the voice emitted by the user in the cockpit of the target vehicle.

[0061] In some embodiments, when the target vehicle is not in the sound zone suppression mode, the multi-sound zone voice recognition device can obtain the voice emitted by the user in the cockpit of the target vehicle. When the target vehicle is in the sound zone suppression mode, the multi-sound zone voice recognition device cannot obtain the voice emitted by the user in the cockpit of the target vehicle.

[0062] Thus, it can be ensured that the target vehicle acquires the voice emitted by the user in the cockpit of the target vehicle in the non-zone suppression mode.

[0063] In some other embodiments, after the multi-zone voice recognition device acquires the voice emitted by the user in the cockpit of the target vehicle, it can determine whether the target vehicle is in the zone suppression mode, and when the target vehicle is not in the zone suppression mode, determine whether the source zone of the voice is a preset locked zone; when the target vehicle is in the zone suppression mode, the step of determining whether the source zone of the voice is a preset locked zone cannot be performed.

[0064] Thus, it can be ensured that the step of determining whether the source zone of the voice is a preset locked zone is performed in the non-zone suppression mode.

[0065] In these embodiments, optionally, after all users in the cockpit have ended the voice interaction with the target vehicle, or when all users in the cockpit temporarily do not need to perform voice control on the target vehicle, the user can input a zone suppression operation on the target vehicle to the multi-zone voice recognition device, so that the multi-zone voice recognition device can respond to the zone suppression operation on the target vehicle and set the target vehicle to the zone suppression mode.

[0066] Among them, the zone suppression operation may include a click operation on the virtual zone suppression button in the in-vehicle computer screen, and may also include a click operation on the physical zone suppression button on the target vehicle, which is not limited here. The multi-zone voice recognition device of the target vehicle responds to the zone suppression operation on the target vehicle and sets the target vehicle to the zone suppression mode, and can achieve one-key switching of the zone suppression mode.

[0067] Furthermore, when the target vehicle is in the zone suppression mode and the user in the cockpit needs to perform voice control on the target vehicle, the user can input a zone suppression cancellation operation on the target vehicle to the multi-zone voice recognition device, so that the target vehicle exits the zone suppression mode.

[0068] Among them, the zone suppression cancellation operation may include a click operation on the virtual zone suppression cancellation button in the in-vehicle computer screen, and may also include a click operation on the physical zone suppression cancellation button on the target vehicle, which is not limited here. The multi-zone voice recognition device of the target vehicle responds to the zone suppression cancellation operation on the target vehicle, can cancel the zone suppression mode with one key, so that the multi-zone voice recognition device can respond to the zone suppression cancellation operation on the target vehicle and make the target vehicle enter the non-zone suppression mode.

[0069] Thus, the user can switch between the zone suppression mode and the non-zone suppression mode according to actual needs, improving the user experience.

[0070] In some further embodiments of the present disclosure, the user can also set a locked sound zone and an unlocked sound zone according to needs.

[0071] In some embodiments, when the user wants to allow the sound in the first sound zone among multiple sound zones to perform voice control on the target vehicle, the user can input a locking setting operation for the first sound zone to the multi-zone voice recognition device, so that the multi-zone voice recognition device can, in response to detecting the locking setting operation for the first sound zone, set the first sound zone as the locked sound zone.

[0072] The first sound zone can be the sound zone where the user wants to allow voice control of the target vehicle, and the first sound zone can include one or more sound zones of the target vehicle.

[0073] The locking setting operation can include a click operation on the virtual sound zone locking button in the vehicle head unit screen, and can also include a click operation on the physical sound zone locking button on the target vehicle. There is no limitation here. The multi-zone voice recognition device of the target vehicle, in response to detecting the locking setting operation for the first sound zone, sets the first sound zone as the locked sound zone and sets the sound zones other than the first sound zone as the unlocked sound zones.

[0074] In some other embodiments, when the user wants to prohibit the sound in the second sound zone among multiple sound zones from performing voice control on the target vehicle, the user can input an unlocking operation for the second sound zone to the multi-zone voice recognition device, so that the multi-zone voice recognition device can, in response to detecting the unlocking operation for the second sound zone, set the second sound zone as the unlocked sound zone.

[0075] The second sound zone can be the sound zone where the user wants to prohibit voice control of the target vehicle, and the second sound zone can include one or more locked sound zones of the target vehicle.

[0076] The unlocking operation can include a click operation on the virtual unlocking button in the vehicle head unit screen, and can also include a click operation on the physical unlocking button on the target vehicle. There is no limitation here. The multi-zone voice recognition device of the target vehicle, in response to detecting the unlocking operation for the second sound zone, sets the second sound zone as the unlocked sound zone.

[0077] Optionally, the second sound zone can be the same as the first sound zone, that is, after the user sets the first sound zone as the locked sound zone, before, during, or after the voice interaction between the sound in the first sound zone and the target vehicle, that is, at any time after the user sets the first sound zone as the locked sound zone, if the user wants to prohibit the sound in the first sound zone from performing voice control on the target vehicle, the first sound zone can be switched from the locked sound zone to the unlocked sound zone.

[0078] In some examples, the in-vehicle screen or physical buttons can be installed on the center console of the target vehicle. The center console can be understood as the vehicle control area in front of the driver and passenger areas. Users can perform operations such as voice zone suppression, cancellation of voice zone suppression, voice zone locking, and cancellation of locking through the in-vehicle screen or physical buttons on the center console.

[0079] In some other examples, in addition to being installed on the center console of the target vehicle, the in-vehicle screen or physical buttons can also be installed in each voice zone of the target vehicle respectively. That is, each voice zone has a corresponding in-vehicle screen or physical button for that voice zone. Users can perform operations such as voice zone suppression, voice zone locking, and cancellation of locking through the in-vehicle screen or physical buttons on the center console, and can also perform operations such as voice zone suppression, cancellation of voice zone suppression, voice zone locking, and cancellation of locking through the in-vehicle screen or physical buttons in the voice zone where the user is located.

[0080] Figure 3 FIG. shows a schematic diagram of a voice zone setting interface for multi-zone voice recognition provided by an embodiment of the present disclosure. As shown in the figure, this interface can perform interface operations and displays on the in-vehicle screen. 301 is a virtual button for voice zone suppression, 302 is a virtual button for cancellation of suppression, 303 is a virtual button for voice zone locking, 304 is a virtual button for cancellation of locking, and 305 is a voice zone selection area. When the user needs to perform a voice zone suppression operation, the user can directly click the voice zone suppression button on the interface. The multi-zone voice recognition device responds to the voice zone suppression operation and enters the voice zone suppression mode. When the user needs to perform a cancellation of suppression operation, the user can directly click the cancellation of suppression button on the interface. The multi-zone voice recognition device responds to the cancellation of voice zone operation and enters the non-voice zone suppression mode. When the user needs to perform a voice zone locking operation, the user can select the voice zone to be locked in the voice zone selection interface, click the confirm selection button after selection, and then click the voice zone locking button. The multi-zone voice recognition device responds to the voice zone locking operation and can lock the confirmed selected voice zone. When the user needs to perform a cancellation of locking operation, the user can select the voice zone to cancel the locking in the voice zone selection interface, click the confirm selection button after selection, and then click the cancellation of locking button. The multi-zone voice recognition device responds to the cancellation of locking operation and can cancel the locking of the confirmed selected voice zone.

[0081] In still some other embodiments of the present disclosure, the multi-zone voice recognition device can directly determine the source voice zone of the collected voice based on the microphone, or can correct the determined source voice zone to more accurately determine the source of the voice.

[0082] In some embodiments, after obtaining the voice uttered by a user located inside the cockpit of a target vehicle, the multi-zone voice recognition device may determine the target microphone that collected the voice, determine the zone to which the target microphone belongs as the source zone, and then determine whether the source zone of the voice is a pre-set locked zone. If the source zone is the locked zone, voice recognition is performed on the voice.

[0083] In some other embodiments, before determining whether the source zone of the voice is a pre-set locked zone, the multi-zone voice recognition device may also perform zone correction on the source zone, and then determine whether the corrected source zone is a pre-set locked zone. If the source zone is the locked zone, voice recognition is performed on the voice, as Figure 4 shown.

[0084] Figure 4 is a flowchart of another multi-zone voice recognition method provided by an embodiment of the present disclosure. As Figure 4 shown, the multi-zone voice recognition method provided by this embodiment includes the following steps:

[0085] Step 401: Obtain the voice uttered by a user located inside the cockpit of a target vehicle.

[0086] Step 402: Determine the target microphone that collected the voice, and determine the zone to which the target microphone belongs as the source zone.

[0087] Steps 401-402 in the embodiments of the present disclosure may refer to the above steps 201-202, and will not be elaborated here.

[0088] Step 403: Perform zone correction on the source zone.

[0089] In the embodiments of the present disclosure, correcting the sound zone of the source sound zone can be understood as correcting the position of the sound zone of the source sound zone. The target vehicle can arrange at least one in-vehicle screen in front of the sound zone to which each row of seats belongs, or arrange an in-vehicle screen at the rear of the front-row seat back of each sound zone. The in-vehicle screen can display the commands and results of voice recognition in the sound zone where it is located, facilitating the user's voice interaction with the vehicle. When the seat is reclined or the user turns their face to speak, causing the head and buttocks to be separated, the source sound zone determined based on the target microphone that collects the voice does not match the actual requirement, resulting in the commands displayed on the in-vehicle screen corresponding to the sound zone not being in front of the speaker. For example, when the user sits on the driver's seat and reclines the driver's seat to the left of the second row, and then conducts voice interaction, the microphone in the sound zone on the left of the second row will collect the user's voice and display the voice on the in-vehicle screen in the sound zone to which the second row belongs or the in-vehicle screen at the rear of the driver's seat back, making it difficult for the user on the driver's seat to see the voice commands displayed on the in-vehicle screen. Therefore, it is necessary to correct the sound zone of the source sound zone so that the commands displayed on the in-vehicle screen in the source sound zone are always in front of the speaker, meeting the actual usage requirements.

[0090] In some embodiments, the sound zone of the source sound zone can be corrected based on the seat data, which may include steps 4031-4032:

[0091] Step 4031: Receive the seat data, where the seat data includes at least one of seat pressure data and seat pose data.

[0092] In the embodiments of the present disclosure, the multi-sound zone voice recognition device of the target vehicle receives the seat data of all seats. Among them, the seat pressure data can be understood as the pressure on the seat surface and can be obtained through the pressure sensors inside the seat. The seat pose data can include the seat back angle in the longitudinal direction of the vehicle from the front of the vehicle to the rear.

[0093] Step 4032: Correct the sound zone of the source sound zone based on the seat data.

[0094] In the embodiments of the present disclosure, the position of the sound zone can be divided according to the position of the sound zone seats. Taking a vehicle with three rows of seats as an example, the row position of the sound zone includes the first row, the second row, and the third row in the direction from the vehicle head to the vehicle tail. The preset sound zone correction coefficients of the sound zones in the same row position are the same. The first preset sound zone correction coefficient of the first row is greater than the second preset sound zone correction coefficient of the second row, and the second preset sound zone correction coefficient of the second row is greater than the third preset sound zone correction coefficient of the third row. Among them, the preset sound zone correction coefficient can be understood as the weight of the sound zone correction. The weight of each row of seats for the sound zone correction in this embodiment can be understood as summarized according to the number of actual application scenarios. Assuming that there are two seats in each row, the position of one seat in the first row is the first position, and the position of the other seat is the second position. The position of one seat in the second row is the third position, and the position of the other seat is the fourth position. The position of one seat in the third row is the fifth position, and the position of the other seat is the sixth position.

[0095] In some examples, based on the seat pressure data, the source sound zone can be corrected, which may include:

[0096] Optionally, when the pressure of the seat in the source sound zone is greater than the preset pressure threshold and the pressure of the seats at any other position is less than the preset pressure threshold, the source sound zone is not corrected.

[0097] Optionally, when the position of the source sound zone is the first position in the first row and the pressure of the seat at the first position is less than the preset pressure threshold, if the pressure of the seat at the second position in the first row is greater than or equal to the preset pressure threshold and the pressure of the remaining seats is less than the preset pressure threshold, the sound zone at the second position is determined as the corrected sound zone. For example, when the position of the source sound zone is the driver's area and the pressure of the driver's seat is less than the preset pressure threshold, if the pressure of the co-driver's seat is greater than or equal to the preset pressure threshold and the pressure of the remaining seats is less than the preset pressure threshold, the sound zone at the co-driver's position is determined as the corrected sound zone;

[0098] If the pressure of the seats at any position in the second row and the third row is greater than or equal to the preset pressure threshold and the pressure of the remaining seats is less than the preset pressure threshold, the source sound zone is not corrected.

[0099] Optionally, when the position of the source sound zone is the third position in the second row and the pressure of the seat at the third position is less than the preset pressure threshold, if the pressure of the seat at the first position in the first row is greater than or equal to the preset pressure threshold and the pressures of the remaining seats are less than the preset pressure threshold, the first position is determined as the corrected sound zone. For example, if the position of the source sound zone is the left area of the second row and the pressure of the seat in the left area of the second row is less than the preset pressure threshold, and if the pressure of the driver's seat is greater than or equal to the preset pressure threshold and the pressures of the remaining seats are less than the preset pressure threshold, the sound zone at the driver's seat position is determined as the corrected sound zone; if the pressure of the seat at the fourth position in the second row is greater than or equal to the preset pressure threshold and the pressures of the remaining seats are less than the preset pressure threshold, the sound zone at the fourth position is determined as the corrected sound zone.

[0100] If the pressures of the seats at the fourth position and any position in the third row are greater than or equal to the preset pressure threshold and the pressures of the remaining seats are less than the preset pressure threshold, the sound zone at the third position is determined as the corrected sound zone.

[0101] Optionally, when the position of the source sound zone is the fifth position in the third row and the pressure of the seat at the fifth position is less than the preset pressure threshold, if the pressure of the seat at the fourth position in the second row is greater than or equal to the preset pressure threshold and the surface pressures of the remaining seats are less than the preset pressure threshold, the sound zone at the fourth position is determined as the corrected sound zone.

[0102] In some other examples, the source sound zone can be corrected based on the seat pressure data and the seat pose data, which may include:

[0103] Optionally, when the position of the source sound zone is the third position in the second row and the pressure of the seat at the third position is less than the preset pressure threshold, if the pressures of the seat at the front row position corresponding to the third position and the seat at the fourth position in the second row are both greater than or equal to the preset pressure threshold, the pressures of the remaining seats are less than the preset pressure threshold, and the seat back angle of the front row position is greater than or equal to the preset angle threshold, the sound zone at the front row position is determined as the corrected sound zone. For example, when the position of the source sound zone is the left area of the second row and the pressure of the seat in the left area of the second row is less than the preset pressure threshold, if the pressures of the driver's seat and the seat on the right side of the second row are both greater than or equal to the preset pressure threshold and the pressures of the remaining seats are less than the preset pressure threshold, the sound zone at the driver's seat position is determined as the corrected sound zone. The scenario at this time is that the driver's seat is reclined to the left of the second row, the user is speaking in the left area of the second row, there is someone in the right area of the second row, the source sound zone is the left of the second row, and after the sound zone correction, the sound zone at the driver's seat position is determined as the final source sound zone.

[0104] Optionally, when the position of the source sound zone is the fifth position in the three rows and the pressure of the seat at the fifth position is less than the preset pressure threshold, if the pressures of the seats at the front row position and the rear row position corresponding to the fifth position are both greater than or equal to the preset pressure threshold, the pressures of the remaining seats are less than the preset pressure threshold, and the seat back angle of the front row position is greater than or equal to the preset angle threshold, determine the sound zone at the front row position as the corrected sound zone.

[0105] The preset pressure threshold and the preset angle threshold in the embodiments of the present disclosure can be set as needed and are not specifically limited here. When the pressure of the seat is greater than or equal to the preset pressure threshold, it can be considered that there is someone on the seat. When the pressure of the seat is less than the preset pressure threshold, it can be considered that there is no one on the seat; when the seat back angle is greater than or equal to the preset angle threshold, it can be considered that the seat back is tilted towards the rear row area. When the seat back angle is less than the preset angle threshold, it can be considered that the seat back is tilted towards the area where it is located.

[0106] In some other embodiments, the source sound zone can be corrected based on the image data, which may include steps 4033-4034:

[0107] Step 4033: Receive the image data inside the cockpit.

[0108] The image data in the embodiments of the present disclosure can be understood as the image data sent by the camera to the multi-sound zone voice recognition device. Specifically,

[0109] The target vehicle can arrange at least one camera in front of the sound zone to which each row of seats belongs, or arrange a camera at the rear of the front row seat back of each sound zone, or arrange a camera at the very front of the cockpit, so that the camera can capture the image of any sound zone inside the cockpit of the target vehicle. After converting the captured image into image data, the camera sends the image data to the multi-sound zone voice recognition device.

[0110] Step 4034: Correct the sound zone of the source sound zone based on the seat data and the image data.

[0111] In some embodiments, the sound zone of the source sound zone can be corrected based on the image data:

[0112] Optionally, detect the portrait within the range of the seat corresponding to the source sound zone in the image. If one human head is detected within the range of this seat in the image, determine the sitting posture of this person. If the sitting posture is that the human head is in the sound zone corresponding to this seat area, but the body is in other sound zones, where the body here refers to other parts of the human body except the human head, then use the sound zone where the position of the body is located as the corrected source sound zone. If the sitting posture is that both the human head and the body are in the sound zone corresponding to this seat area, no correction is required; if two human heads are detected within the range of this seat in the image, no correction is required.

[0113] In some other embodiments, the source sound area can be corrected based on seat data and image data:

[0114] Optionally, the multi - sound - area voice recognition device can obtain seat data and image data simultaneously, or obtain image data after correcting the second source sound area based on seat data. The multi - sound - area voice recognition device can first correct the source sound area based on seat data to obtain the first - confirmed source sound area, and then analyze the image data to determine whether there is someone in the first - confirmed source sound area. If there is someone in the first - confirmed source sound area, no further correction is performed, and the first - confirmed source sound area is determined as the final source sound area; if there is no one in the first - confirmed source sound area, the source sound area before the first confirmation is determined as the final source sound area.

[0115] Step 404: Determine whether the source sound area of the voice is a pre - set locked sound area.

[0116] Step 405: If the source sound area is a locked sound area, perform voice recognition on the voice.

[0117] Steps 404 - 405 in the embodiments of the present disclosure can refer to the above - mentioned steps 202 - 203, and will not be elaborated here.

[0118] In the embodiments of the present disclosure, by obtaining the voice emitted by a user in the cockpit of a target vehicle, determining the target microphone that collects the voice, and determining the sound area to which the target microphone belongs as the source sound area; correcting the sound area of the source sound area; determining whether the source sound area of the voice is a pre - set locked sound area; if the source sound area is a locked sound area, performing voice recognition on the voice, correcting the sound area of the source sound area, making the voice control command displayed on the in - vehicle screen in the source sound area always in front of the speaker, meeting the actual usage needs of the user, and allowing the area for voice control to be locked according to the user's needs in advance, that is, setting the locked sound area of the sound area where voice control of the target vehicle is allowed according to the user's needs in advance, and only performing voice recognition on the voice from the locked sound area, which can avoid interference caused by sounds in other sound areas and improve the user experience.

[0119] Figure 5 It is a schematic structural diagram of a multi - sound - area voice recognition device provided by the embodiments of the present disclosure. This device can be understood as some functional modules of the above - mentioned vehicle. As Figure 5 shown, the multi - sound - area voice recognition device 500 includes:

[0120] An acquisition module 501, configured to acquire the voice emitted by a user in the cockpit of a target vehicle;

[0121] A judgment module 502, configured to judge whether the source sound area of the voice is a pre-set locked sound area, where the locked sound area is a sound area that allows voice control of the target vehicle;

[0122] An identification module 503, configured to perform voice recognition on the voice if the source sound area is the locked sound area.

[0123] In the embodiment of the present disclosure, after the acquisition module acquires the voice emitted by the user in the cockpit of the target vehicle, the judgment module judges whether the source sound area of the voice is a locked sound area of the sound area that is pre-set to allow voice control of the target vehicle. If the source sound area is the locked sound area, the identification module performs voice recognition on the voice. If the user only hopes that people in certain positions in the vehicle cockpit can perform voice interaction with the in-vehicle voice assistant in some cases, the area for voice control can be locked according to the user's needs, that is, the locked sound area of the sound area that is pre-set to allow voice control of the target vehicle is set according to the user's needs, and only the voice from the locked sound area is subjected to voice recognition, which can avoid interference caused by sounds in other sound areas and improve the user experience.

[0124] Optionally, the above multi-sound area voice recognition device 500 includes:

[0125] An output module, configured to output a prompt message if the source sound area is not the locked sound area, where the prompt message is used to prompt that the source sound area is a sound area where voice control of the target vehicle is prohibited.

[0126] Optionally, the above multi-sound area voice recognition device 500 includes:

[0127] A first determination module, configured to determine the target microphone for collecting the voice;

[0128] A second determination module, configured to determine the sound area to which the target microphone belongs as the source sound area.

[0129] Optionally, the above multi-sound area voice recognition device 500 includes:

[0130] A first receiving module, configured to receive seat data, where the seat data includes at least one of seat pressure data and seat pose data;

[0131] A first correction module, configured to perform sound area correction on the source sound area based on the seat data.

[0132] Optionally, the above multi-sound area voice recognition device 500 includes:

[0133] A second receiving module, configured to receive image data in the cockpit;

[0134] A second correction module, configured to perform sound area correction on the source sound area based on the image data.

[0135] Optionally, the above multi-zone voice recognition device 500 includes:

[0136] A first setting module, configured to set the first sound zone as a locked sound zone in response to detecting a locking setting operation on the first sound zone.

[0137] Optionally, the above multi-zone voice recognition device 500 includes:

[0138] A second setting module, configured to set the second sound zone as an unlocked sound zone in response to detecting an unlocking cancellation operation on the second sound zone, where the unlocked sound zone is a sound zone where voice control of the target vehicle is prohibited.

[0139] The multi-zone voice recognition device provided in this embodiment can execute the method described in any of the above embodiments, and its execution manner and beneficial effects are similar, which will not be elaborated here.

[0140] Figure 6 FIG. shows a schematic structural diagram of a vehicle provided in an embodiment of the present disclosure.

[0141] As Figure 6 shown, the vehicle may include a processor 601 and a memory 602 storing computer program instructions.

[0142] Specifically, the above processor 601 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0143] The memory 602 may include a mass memory for information or instructions. By way of example and not limitation, the memory 602 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. Where appropriate, the memory 602 may include removable or non-removable (or fixed) media. Where appropriate, the memory 602 may be internal or external to the integrated gateway device. In a particular embodiment, the memory 602 is a non-volatile solid-state memory. In a particular embodiment, the memory 602 includes a read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically alterable ROM (EAROM), or a flash memory, or a combination of two or more of these.

[0144] The processor 601 reads and executes the computer program instructions stored in the memory 602 to perform the steps of the multi-zone speech recognition method provided by the embodiments of the present disclosure.

[0145] In one example, the vehicle may further include a transceiver 603 and a bus 604. Among them, as Figure 6 shown, the processor 601, the memory 602, and the transceiver 603 are connected through the bus 604 and complete communication with each other.

[0146] The bus 604 includes hardware, software, or both. By way of example and not limitation, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side BUS (FSB), a Hyper Transport (HT) interconnect, an Industrial Standard Architecture (ISA) bus, an InfiniBand interconnect, a Low Pin Count (LPC) bus, a memory bus, a MicroChannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local Bus (VLB) bus, or other suitable bus or a combination of two or more of these. Where appropriate, the bus 404 may include one or more buses. Although the embodiments of the present application describe and illustrate specific buses, the present application contemplates any suitable bus or interconnect.

[0147] Further, the vehicle may further include a human-machine interaction device, such as a car machine screen, which can communicate with the processor through a bus. The human-machine interaction device can display voice control instructions and corresponding execution results to the user, making voice interaction visual and improving the user's voice interaction experience.

[0148] The embodiments of the present disclosure also provide a computer-readable storage medium that can store a computer program. When the computer program is executed by a processor, the processor is caused to implement the multi-zone voice recognition method provided by the embodiments of the present disclosure.

[0149] The above storage medium may include, for example, a memory 602 storing computer program instructions, and the above instructions can be executed by a processor 601 of the voice control device to implement the multi-zone voice recognition method provided by the embodiments of the present disclosure. Optionally, the storage medium may be a non-transitory computer-readable storage medium. For example, the non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, and an optical data storage device, etc. The above computer program can be written in any combination of one or more programming languages to write program code for performing the operations of the embodiments of the present disclosure. The programming languages include object-oriented programming languages such as Java, C++, etc., and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, executed as an independent software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0150] Figure 7 A voice interaction method provided by an embodiment of the present application is different from the above embodiment in that it is mainly described from a visualization perspective. Figure 7 It includes the following steps:

[0151] S701. Obtain the voice issued by the user.

[0152] A microphone can be used to collect the voice of the user. In one example, as before, one or more microphones can be arranged in the vehicle cockpit. The microphone can send the collected voice signal to the multi-zone voice recognition device, and the multi-zone voice recognition device can process the voice signals of each zone to implement voice interaction.

[0153] The user can be one or more users. In combination with the vehicle cockpit scenario, the user can be a user on at least one seat located in the cockpit.

[0154] S702. Interact with the target user in the locked zone, where the locked zone is the zone allowed for voice interaction.

[0155] The range within which a microphone receives sound is called a zone, and one zone can correspond to one or more seat areas. The correspondence between the seat area and the zone is taken as an example. Figure 1 Among them, the locked zone is a preset voice interaction area, that is to say, the locked zone is the zone allowed for voice interaction with the vehicle.

[0156] The sound zone where the user is located can be determined by the sound zone corresponding to the microphone that receives the voice. The target user is the user located in the locked sound zone. That is to say, the user in the locked sound zone is called the target user.

[0157] In one example, the user is in the locked sound zone inside the cockpit, which can be understood as the seat area where voice interaction is allowed. For example, there are two people in the cockpit, one is in the driver's sound zone taking Figure 1 as an example, and the other is in the co-driver's sound zone. Assuming that the driver's sound zone is the locked sound zone, if the user in the driver's sound zone emits a voice, the vehicle will perform voice interaction based on this voice. If the user in the co-driver's sound zone emits a voice, the vehicle will not perform voice interaction for the voice of the user in the co-driver's sound zone.

[0158] In this embodiment, some examples of interaction are: performing speech recognition on the obtained voice signal to obtain the semantics corresponding to the voice. If the semantics corresponding to the voice is a control instruction, execute the control instruction; if the semantics corresponding to the voice is the conversation content between the user and the in-vehicle voice assistant, an answer can be generated for this conversation content and the answer can be broadcast or displayed.

[0159] For the voice interaction method provided in this embodiment, since the object of voice interaction is the voice of the user in the locked sound zone, and the locked sound zone is a pre-set voice interaction area, it can avoid the interference of sounds in non-locked sound zones on voice interaction, improve the voice interaction function, and obtain a better user experience.

[0160] Next, an explanation is given for the Figure 7 specific implementation in the shown embodiment. In the following specific implementation manners, the execution subject can be the vehicle, or a preset module in the vehicle, such as the aforementioned multi-sound zone speech recognition device.

[0161] In some implementation manners, Figure 7 the method shown also includes: receiving a locking setting operation for the first sound zone and setting the first sound zone as the locked sound zone. This step can be executed before S702. Among them, the locking setting operation can be a manual operation or a voice operation.

[0162] The locking setting operation can include a click operation on the virtual sound zone locking button in the vehicle console screen, and can also include a click operation on the physical sound zone locking button on the target vehicle.

[0163] Taking Figure 3For example, on the tone zone setting interface, a tone zone selection area 305 and a virtual tone zone lock button 303 are displayed. Multiple tone zones are shown in the tone zone selection area 305. The user selects a tone zone, such as the driver's seat tone zone, in the displayed tone zone selection area 305, clicks the confirm selection button, and then clicks the virtual tone zone lock button 303. The driver's seat tone zone is then set as the locked tone zone.

[0164] It can be understood that Figure 3 only as an example. In alternative examples, the tone zone selection area 305 and the virtual tone zone lock button 303 can be displayed on different interfaces, and these interfaces all belong to the tone zone setting interface. In alternative examples, the confirm selection button may not be set either.

[0165] In some implementation manners, when in the non-tone zone suppression mode, the first tone zone is set as the locked tone zone. That is to say, when the device such as a vehicle is in the non-tone zone suppression mode, the first tone zone can be set as the locked tone zone based on the locking setting operation for the first tone zone.

[0166] The tone zone suppression mode can be understood as that all tone zones of the target vehicle cannot perform voice control on the target vehicle, that is, the voice recognition function of the target vehicle cannot be used at all. The non-tone zone suppression mode is the mode in which the voice control and voice recognition functions can be used.

[0167] In this embodiment, it is assumed that the tone zone suppression mode is currently in effect. In this case, the non-tone zone suppression mode can be achieved through a tone zone suppression cancellation operation, which can include a click operation on the virtual tone zone suppression cancellation button within the in-vehicle computer screen, and can also include a click operation on the physical tone zone suppression cancellation button on the vehicle.

[0168] Take Figure 3 as an example. When the user needs to perform a suppression cancellation operation, the user can directly click the suppression cancellation button on the interface, and the vehicle responds to the tone zone cancellation operation and enters the non-tone zone suppression mode.

[0169] It can be understood that the current being in the tone zone suppression mode is not an inevitable prerequisite for setting the non-tone zone suppression mode. For example, the non-tone zone suppression mode can also be set again in the non-tone zone suppression mode.

[0170] In some implementation manners, the locked tone zone is at least one of multiple tone zones. Multiple tone zones can be preset. Examples of multiple tone zones are Figure 3 as an example. In some optional manners, the multiple tone zones are divided based on the distribution of seats, as shown in Figure 1 . The number of locked tone zones can be one or multiple. The user can select at least one tone zone from multiple tone zones as the locked tone zone, and the selection method will be described in combination with the following embodiment Figure 3 as an example.

[0171] In some implementations, Figure 7 the method shown further includes: for a user not in the locked sound zone, outputting a prompt message, where the prompt message is used to prompt that the sound zone where the user is located is a sound zone where voice interaction is prohibited. The prompt message can be a graphic and text prompt message displayed on the screen, or a voice prompt message played through a speaker. Examples can be seen in the above embodiments.

[0172] In some implementations, Figure 7 the method shown further includes: displaying voice interaction data on the screen corresponding to the locked sound zone. That is, visualizing the voice interaction process, the vehicle can arrange at least one in-vehicle screen in front of the sound zone to which each row of seats belongs, or can also set at least one in-vehicle screen on the center console. Display the voice interaction data on at least one of these in-vehicle screens.

[0173] Optionally, the voice interaction data includes: the recognition result of voice recognition of the voice of the target user; and / or, the response result of the control instruction.

[0174] As described above, if the semantics corresponding to the voice is a control instruction, then execute the control instruction; if the semantics corresponding to the voice is the conversation content between the user and the in-vehicle voice assistant, then an answer can be generated for the conversation content and the answer can be broadcast or displayed. Therefore, the voice interaction data includes at least one of the recognition result of voice recognition of the voice of the target user and the response result of the control instruction. That is, visualizing the voice interaction process.

[0175] In some implementations, before interacting with the target user in the locked sound zone, it further includes:

[0176] Based on at least one of the seat data and image data in the cockpit, correcting the sound zone where the user is located, and the seat data includes at least one of seat pressure data and seat pose data. The specific process of correction can be seen in Figure 4 the relevant embodiments and will not be elaborated here.

[0177] In some implementations, the specific way of interacting with the target user in the locked sound zone is: when not in the sound zone suppression mode, determining the source sound zone of the voice; when the source sound zone of the voice is the locked sound zone, interacting with the target user in the locked sound zone.

[0178] Specifically, determine whether the vehicle is in the sound zone suppression mode. When the vehicle is not in the sound zone suppression mode, determine the source sound zone of the voice and determine whether the source sound zone of the voice is the locked sound zone. When the source sound zone of the voice is the locked sound zone, interact with the target user in the locked sound zone.

[0179] As described above, the source sound zone can be understood as the sound zone where the user who emits the voice is located. Since a sound zone is the range of sound received by a microphone, that is, there is a one-to-one correspondence between the microphone and the sound zone, therefore, the sound zone where the user is located, that is, the source sound zone of the voice, can be determined by the sound zone corresponding to the microphone that receives the voice.

[0180] In some implementation manners, the specific manner of interacting with the target user located in the locked sound zone is as follows: recognize the voice in the locked sound zone; perform interaction according to the recognition result. Specifically, the voice can be first recognized by voice recognition to obtain the voice text corresponding to the voice, and then the voice text can be semantically recognized to obtain the semantics corresponding to the voice. If the semantics corresponding to the voice is a control instruction, the control instruction is executed; if the semantics corresponding to the voice is the conversation content between the user and the in-vehicle voice assistant, an answer can be generated for the conversation content and the answer can be broadcast or displayed.

[0181] An embodiment of the present application also discloses a voice interaction method, which can be applied to a vehicle or a multi-sound zone voice recognition device in a vehicle. The method includes the following steps: receiving a locking setting operation for a first sound zone, and setting the first sound zone as a locked sound zone, where the locked sound zone is a sound zone allowing voice interaction.

[0182] In some implementation manners, this embodiment further includes: receiving an unlocking operation for a second sound zone, and setting the second sound zone as an unlocked sound zone, where the unlocked sound zone is a sound zone not allowing voice interaction.

[0183] The unlocking operation may include a click operation on an unlocking virtual button in the in-vehicle screen, and may also include a click operation on an unlocking physical button on the vehicle.

[0184] Optionally, the second sound zone may be the same as the first sound zone. For example, after the user sets the driver's sound zone as the locked sound zone through the locking setting operation, the driver's sound zone is set as the unlocked sound zone through the unlocking operation. The second sound zone may also be different from the first sound zone.

[0185] The setting method may also be Figure 3 For example, when the user needs to perform an unlocking operation, the sound zone to be unlocked can be selected in the sound zone selection interface, and after selection, the confirm selection button is clicked, and then the unlock button is clicked. The vehicle responds to the unlocking operation and can unlock the selected sound zone.

[0186] In an alternative example, the sound zone selection area 305 and the unlocking virtual button 304 may be displayed on different interfaces, and these interfaces all belong to the sound zone setting interface. In an alternative example, the confirm selection button may not be set either.

[0187] In some implementations, the specific manner of receiving the locking setting operation for the first tone region includes: receiving the locking setting operation for the first tone region based on the tone region setting interface.

[0188] Exemplarily, the tone region setting interface includes: a tone region selection area, and the tone region selection area includes at least one tone region button, for Figure 3 example.

[0189] Based on this, the specific implementation manner of receiving the locking setting operation for the first tone region based on the tone region setting interface is: receiving the operation of selecting the tone region button of the first tone region in the tone region selection area.

[0190] Further, the tone region setting interface further includes: a tone region locking button. Based on this, receiving the locking setting operation for the first tone region based on the tone region setting interface further includes: receiving the operation on the tone region locking button.

[0191] In some implementations, the method provided in this embodiment further includes: receiving the locking cancellation operation on the tone region setting interface. The locking cancellation operation includes: the operation of selecting the tone region button of the second tone region in the tone region selection area, and setting the second tone region as the non-locked tone region. That is to say, the locking cancellation operation can also be implemented based on the tone region selection area.

[0192] Further, the tone region setting interface further includes: a locking cancellation button. Based on this, the locking cancellation operation further includes: the operation on the locking cancellation button of the tone region setting interface. That is Figure 3 for example, the user first selects a region in the tone region selection area, and then clicks the locking cancellation button to implement setting the selected region as the non-locked tone region.

[0193] Combining the above manners of performing various operations based on the tone region setting interface in this embodiment, one example Figure 3 is as follows: When the user needs to perform the tone region locking operation, the tone region to be locked can be selected in the tone region selection interface. After selection, click the confirm selection button, and then click the tone region locking button. In response to the tone region locking operation, the vehicle can lock the confirmed selected tone region. When the user needs to perform the locking cancellation operation, the tone region to be cancelled from locking can be selected in the tone region selection interface. After selection, click the confirm selection button, and then click the cancellation locking button. In response to the locking cancellation operation, the vehicle can cancel the locking of the confirmed selected tone region.

[0194] It can be understood that Figure 3 only for example, alternatively, the tone region selection area 305 and the tone region suppression operation buttons (including the tone region suppression virtual button 301 and the suppression cancellation virtual button 302) can belong to the same interface (such as Figure 3As shown, they can belong to the same interface (which can be called the first interface), or they can belong to different interfaces (which can be called the second interface). Both the first interface and the second interface can belong to the sound zone setting interface.

[0195] Similarly, the sound zone suppression virtual button and the suppression cancellation virtual button can also belong to different interfaces. The interfaces for displaying the above buttons all belong to the sound zone setting interface.

[0196] In another alternative implementation, the sound zone lock button and the sound zone selection area may not be on the same interface, and the lock cancellation button and the sound zone selection area may also not be on the same interface. The interfaces for displaying the above buttons all belong to the sound zone setting interface.

[0197] In some implementations, the sound zone setting interface is displayed on at least one screen. As mentioned above, the at least one screen can be at least one in-vehicle screen arranged on the center console, or at least one in-vehicle screen arranged in front of the sound zone to which each row of seats belongs, or at least one in-vehicle screen arranged at the rear of the front row seat back of each sound zone.

[0198] In some implementations, the locked sound zone is at least one of multiple sound zones.

[0199] In some implementations, for users not in the locked sound zone, a prompt message is output, and the prompt message is used to prompt that the sound zone where they are located is a sound zone where voice interaction is prohibited. For details, reference can be made to the above-mentioned embodiments.

[0200] In some implementations, it further includes: displaying voice interaction data on the screen corresponding to the locked sound zone.

[0201] In some implementations, the implementation method for interacting with the target user in the locked sound zone includes: determining the source sound zone of the voice when not in the sound zone suppression mode; when the source sound zone of the voice is the locked sound zone, interacting with the target user in the locked sound zone.

[0202] In some implementations, the implementation method for interacting with the target user in the locked sound zone includes: recognizing the voice in the locked sound zone; and performing interaction according to the recognition result.

[0203] For the detailed description of the above specific implementation methods, reference can be made to the foregoing embodiments.

[0204] Another voice interaction method disclosed in the embodiments of the present application includes: receiving a voice zone suppression operation, setting it to the voice zone suppression mode, where the voice zone suppression mode is used to prohibit the voice interaction function in the voice zone; and / or, receiving a voice zone suppression cancellation operation, and setting it from the voice zone suppression mode to the non-voice zone suppression mode. The voice zone suppression operation can be a voice operation or a manual operation, and the voice zone suppression cancellation operation can be a voice operation or a manual operation.

[0205] The voice zone suppression operation may include a click operation on the virtual voice zone suppression button in the in-vehicle screen, and may also include a click operation on the physical voice zone suppression button on the target vehicle. The vehicle responds to the voice zone suppression operation and is set to the voice zone suppression mode. The non-voice zone suppression mode can be achieved through the voice zone suppression cancellation operation, and the voice zone suppression cancellation operation may include a click operation on the virtual voice zone suppression cancellation button in the in-vehicle screen, and may also include a click operation on the physical voice zone suppression cancellation button on the vehicle.

[0206] In some implementation manners, in the non-voice zone suppression mode, voice interaction is performed with the target user in the locked voice zone. For the specific implementation manners, reference may be made to the above embodiments.

[0207] In some implementation manners, the implementation manner of receiving the voice zone suppression operation includes: receiving an operation on the voice zone suppression button in the voice zone setting interface; the implementation manner of receiving the voice zone suppression cancellation operation includes: receiving an operation on the suppression cancellation button in the voice zone setting interface. For the specific details, reference may be made to the above embodiments.

[0208] It can be understood that it is also possible to achieve a one-key switch of the voice zone suppression mode, such as switching between the voice zone suppression mode and the non-voice zone suppression mode through a button.

[0209] In some implementation manners, the method in this embodiment further includes: receiving a locking setting operation, where the locking setting operation includes an operation of selecting a first voice zone in the voice zone selection area of the voice zone setting interface; setting the first voice zone as the locked voice zone.

[0210] Furthermore, the locking setting operation further includes: an operation on the voice zone locking button in the voice zone setting interface.

[0211] That is to say, the locking setting operation can be implemented based on the operation of selecting a voice zone in the voice zone selection area, or can be jointly implemented based on the operation of selecting a voice zone in the voice zone selection area and the operation on the virtual button. For the specific details, reference may be made to the above embodiments and will not be elaborated here.

[0212] In some implementations, the method of this embodiment further includes: receiving an unlocking operation, where the unlocking operation includes an operation of selecting a second sound zone in the sound zone selection area of the sound zone setting interface; setting the second sound zone as an unlocked sound zone. Optionally, the unlocking operation further includes: an operation on the unlocking button of the sound zone setting interface. Similarly, the unlocking operation can be implemented based on the operation of selecting a sound zone in the sound zone selection area, or can be jointly implemented based on the operation of selecting a sound zone in the sound zone selection area and the operation on a virtual button. For details, refer to the above embodiments.

[0213] Combined with the above ways of performing various operations based on the sound zone setting interface in this embodiment, one example is as follows Figure 3 For example: when the user needs to perform a sound zone suppression operation, they can directly click the sound zone suppression button on the interface, and the multi-sound zone speech recognition device responds to the sound zone suppression operation and enters the sound zone suppression mode. When the user needs to perform a suppression cancellation operation, they can directly click the suppression cancellation button on the interface, and the multi-sound zone speech recognition device responds to the sound zone cancellation operation and enters the non-sound zone suppression mode; the operations of setting the locked sound zone and the unlocked sound zone can refer to the above embodiments.

[0214] As mentioned above, Figure 3 For example only, the sound zone suppression virtual button and the suppression cancellation virtual button can also be displayed on different interfaces. The sound zone suppression virtual button and the suppression cancellation virtual button, together with the sound zone selection interface, the sound zone locking virtual button, and the unlocking button, can be respectively displayed on different interfaces, or can be arbitrarily combined and displayed on the same interface. This embodiment does not make any limitations, and the interface used for display can all be referred to as the sound zone setting interface.

[0215] In some implementations, the locked sound zone is at least one sound zone among multiple sound zones.

[0216] In some implementations, for a user not located in the locked sound zone, a prompt message is output, and the prompt message is used to prompt that the sound zone where the user is located is a sound zone where voice interaction is prohibited. For details, refer to the above embodiments.

[0217] In some implementations, it further includes: displaying voice interaction data on the screen corresponding to the locked sound zone.

[0218] In some implementations, the implementation manner of interacting with a target user located in the locked sound zone includes: determining the source sound zone of the voice when not in the sound zone suppression mode; when the source sound zone of the voice is the locked sound zone, interacting with the target user located in the locked sound zone.

[0219] In some implementations, the implementation manner of interacting with a target user located in the locked sound zone includes: recognizing the voice in the locked sound zone; performing interaction according to the recognition result.

[0220] For the detailed description of each of the above specific implementation manners, reference may be made to the foregoing embodiments.

[0221] An embodiment of the present application further provides another voice interaction method, which is executed by a system including a microphone and a multi-zone voice recognition device. It can be understood that the system may further include other modules, which are not limited herein.

[0222] The method of this embodiment includes the following steps:

[0223] A1. Obtain the voice issued by the user.

[0224] In some examples, the system may call the microphone to collect the voice issued by the user in the vehicle cockpit.

[0225] A2. In the non-zone suppression mode, interact with the target user located in the locked zone; the locked zone is the zone where voice interaction is allowed.

[0226] For the description of the zone suppression mode and the non-zone suppression mode, reference may be made to the above embodiments.

[0227] Specifically, in the non-zone suppression mode, the system sends the voice to the multi-zone voice recognition device, and the multi-zone voice recognition device interacts with the target user located in the locked zone by recognizing the voice of the target user in the locked zone.

[0228] In some implementation manners, the system determines whether it is in the zone suppression mode. If it is not in the zone suppression mode, the system sends the voice to the multi-zone voice recognition device, and the multi-zone voice recognition device recognizes the voice in the locked zone and performs interaction according to the recognition result.

[0229] A3. In the zone suppression mode, do not send the voice to the multi-zone voice recognition device.

[0230] That is to say, even if the system calls the microphone to collect the voice of the user, but because in the zone suppression mode, the zone suppression mode can be understood as that no voice interaction can be performed in all zones, so the system does not send the voice to the multi-zone voice recognition device.

[0231] In the case of the zone suppression mode, the multi-zone voice recognition device cannot obtain the voice issued by the user and thus cannot perform voice interaction.

[0232] In some implementation manners, the locked zone is at least one of multiple zones. Specifically, reference may be made to the above embodiments.

[0233] In some implementations, for a user not in the locked sound zone, a prompt message is output, and the prompt message is used to prompt that the sound zone where the user is located is a sound zone where voice interaction is prohibited. For details, refer to the above embodiments.

[0234] In some implementations, it further includes: displaying voice interaction data on the screen corresponding to the locked sound zone.

[0235] In some implementations, the implementation of interacting with a target user in the locked sound zone includes: when not in the sound zone suppression mode, determining the source sound zone of the voice; when the source sound zone of the voice is the locked sound zone, interacting with the target user in the locked sound zone.

[0236] In some implementations, the implementation of interacting with a target user in the locked sound zone includes: recognizing the voice in the locked sound zone; and performing interaction according to the recognition result.

[0237] For the detailed description of each of the above specific implementations, refer to the foregoing embodiments.

[0238] The voice interaction method provided in this embodiment can implement interaction with a target user in the locked sound zone in the non-sound zone suppression mode, can reduce the interference of sounds in other sound zones on the interaction, and, correspondingly, can achieve the purpose of using the sound zone suppression mode to prohibit voice interaction in all sound zones.

[0239] An embodiment of the present application also discloses a voice interaction device, including: an acquisition module and an interaction module, where the acquisition module is used to acquire the voice issued by the user, and the interaction module is used to interact with a target user in the locked sound zone; the locked sound zone is a sound zone where voice interaction is allowed.

[0240] In some implementations, the voice interaction device disclosed in this embodiment further includes a setting module, which is used to implement at least one function of setting the locked sound zone, non-locked sound zone, sound zone suppression mode, and non-sound zone suppression mode. For example, receiving a locking setting operation for the first sound zone; setting the first sound zone as the locked sound zone. For details, refer to the above method embodiments.

[0241] In some implementations, the voice interaction device disclosed in this embodiment further includes: a display module, which is used to display at least one of the prompt message and the voice interaction information. For details, refer to the above method embodiments.

[0242] In some implementations, the voice interaction device disclosed in this embodiment further includes: a correction module, which is used to correct the sound zone where the user is located based on at least one of the seat data and the image data. For details, refer to the above method embodiments.

[0243] For the specific implementation of the functions of each of the above modules, reference may be made to the method embodiments described above.

[0244] The voice interaction device provided in this embodiment can implement the voice interaction function for a specific area in the vehicle, while shielding the interference of sounds in other areas on the voice interaction, thereby obtaining a better user experience.

[0245] An embodiment of the present application also discloses a voice interaction device, including a setting module. The setting module is configured to receive a locking setting operation for a first sound area, and set the first sound area as a locked sound area, where the locked sound area is a sound area allowing voice interaction. Optionally, it may further include an interaction module, and the interaction module is configured to interact with the target user in the locked sound area.

[0246] Among them, the setting module may further be configured to implement at least one of the functions of setting a non-locked sound area, setting a sound area suppression mode, and setting a non-sound area suppression mode. For details, reference may be made to the above embodiments.

[0247] For the specific implementation of the function of the interaction module, reference may be made to the above embodiments.

[0248] The voice interaction device provided in this embodiment can set a locked sound area and interact with the target user in the locked sound area, thereby providing a technology that can meet the voice interaction needs of some users.

[0249] An embodiment of the present application also discloses another voice interaction device, including a setting module, configured to receive a sound area suppression operation and set it to a sound area suppression mode, where the sound area suppression mode is used to prohibit the voice interaction function of the sound area; and / or, receive a sound area suppression cancellation operation and set it from the sound area suppression mode to a non-sound area suppression mode. Optionally, the setting module may further be configured to set at least one of a locked sound area and a non-locked sound area. For details, reference may be made to the above embodiments.

[0250] The above voice interaction device is beneficial for users to flexibly set the voice interaction function. For the implementation of the functions of each of the above modules, reference may be made to the above method embodiments.

[0251] An embodiment of the present application also discloses another voice interaction device, including an acquisition module and an interaction module. The acquisition module is configured to acquire the voice emitted by the user, and the interaction module is configured to interact with the target user located in the locked sound area in the non-sound area suppression mode; the locked sound area is a sound area allowing voice interaction. For the specific implementation of the function of the interaction module, reference may be made to the above embodiments.

[0252] In some implementation manners, the voice interaction device disclosed in this embodiment further includes a setting module, configured to implement at least one of the functions of setting a sound area suppression mode, a non-sound area suppression mode, a locked sound area, and a non-locked area. For the specific implementation, reference may be made to the above embodiments.

[0253] Embodiments of the present application also disclose a vehicle. For the specific structure, reference can be made to Figure 6 As shown, the processor realizes the voice interaction method provided by the embodiments of the present application by running computer program instructions stored in the memory.

[0254] Embodiments of the present application also disclose a computer-readable storage medium. The storage medium can store a computer program. When the computer program is executed by the processor, the processor realizes the voice interaction method provided by the embodiments of the present disclosure.

[0255] The technical features in the above different embodiments can all be applied to other embodiments. For example, in the specific implementation manner of the above voice interaction, the specific implementation manner of displaying prompt information or interaction data on the screen, and also for example, the specific implementation manner of realizing functions such as sound zone locking or sound zone suppression by operating based on the interface. That is to say, the technical features in different embodiments can be cross-used.

[0256] The above are only the specific implementation manners of the present disclosure, enabling those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be obvious to those skilled in the art. The general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to these embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A voice interaction method, characterized in that, it includes: Obtain the voice emitted by the user; Interact with the target user located in the locked sound area; the locked sound area is the sound area where voice interaction is allowed.

2. The method according to claim 1, characterized in that, it further includes: Receive the locking setting operation of the first sound area; Set the first sound area as the locked sound area.

3. The method according to claim 2, characterized in that, The setting the first sound area as the locked sound area includes: When in the non-sound area suppression mode, set the first sound area as the locked sound area.

4. The method according to any one of claims 1-3, characterized in that, The locked sound area is at least one sound area among multiple sound areas.

5. The method according to any one of claims 1-4, characterized in that, it further includes: Output a prompt message to the user not located in the locked sound area, and the prompt message is used to prompt that the sound area where the user is located is a sound area where voice interaction is prohibited.

6. The method according to any one of claims 1-5, characterized in that, it further includes: Display voice interaction data on the screen corresponding to the locked sound area.

7. The method according to claim 6, characterized in that, The voice interaction data includes: the recognition result of voice recognition of the voice of the target user; and / or, the response result of the control instruction.

8. The method according to any one of claims 1-7, characterized in that, Before the interacting with the target user located in the locked sound area, it further includes: Based on at least one of seat data and image data, correct the sound area where the user is located, and the seat data includes at least one of seat pressure data and seat pose data.

9. The method according to any one of claims 1-8, characterized in that, The interacting with the target user located in the locked sound area includes: When not in the sound area suppression mode, determine the source sound area of the voice; When the source sound area of the voice is the locked sound area, interact with the target user located in the locked sound area.

10. The method according to any one of claims 1-9, characterized in that, The interacting with the target user located in the locked sound area includes: Recognize the voice in the locked sound area; Interact according to the recognition result.

11. A voice interaction method, characterized in that, it includes: Receive the locking setting operation of the first sound area, and set the first sound area as the locked sound area, and the locked sound area is the sound area where voice interaction is allowed.

12. The method according to claim 11, characterized in that, it further includes: Receive the unlocking cancellation operation of the second sound area, and set the second sound area as the non-locked sound area, and the non-locked sound area is the sound area where voice interaction is not allowed.

13. The method according to any one of claims 11-12, characterized in that, The receiving the locking setting operation of the first sound area includes: Receive the locking setting operation of the first sound area based on the sound area setting interface.

14. The method according to claim 13, characterized in that, The pitch range setting interface includes: a pitch range selection area, and the pitch range selection area includes at least one pitch range button; The receiving of the locking setting operation for the first pitch range based on the pitch range setting interface includes: Receiving an operation of selecting the pitch range button of the first pitch range in the pitch range selection area.

15. The method according to claim 14, wherein, The pitch range setting interface further includes: a pitch range locking button; The receiving of the locking setting operation for the first pitch range based on the pitch range setting interface further includes: Receiving an operation on the pitch range locking button.

16. The method according to any one of claims 11-15, wherein, It further includes: Receiving an unlocking operation on the pitch range setting interface, and the unlocking operation includes: an operation of selecting the pitch range button of the second pitch range in the pitch range selection area of the pitch range setting interface; Setting the second pitch range as an unlocked pitch range.

17. The method according to claim 16, wherein, The unlocking operation further includes: An operation on the unlocking button of the pitch range setting interface.

18. The method according to any one of claims 14-17, wherein, The pitch range setting interface is displayed on at least one screen.

19. A voice interaction method, wherein, It includes: Receiving a pitch range suppression operation and setting it to a pitch range suppression mode, and the pitch range suppression mode is used to prohibit the voice interaction function of the pitch range; and / or, Receiving a pitch range suppression cancellation operation and setting it to a non-pitch range suppression mode.

20. The method according to claim 19, wherein, In the non-pitch range suppression mode, performing voice interaction with the target user in the locked pitch range.

21. The method according to any one of claims 19-20, wherein, The receiving of the pitch range suppression operation includes: receiving an operation on the pitch range suppression button in the pitch range setting interface; The receiving of the pitch range suppression cancellation operation includes: receiving an operation on the suppression cancellation button in the pitch range setting interface.

22. The method according to any one of claims 19-21, wherein, The method further includes: Receiving a locking setting operation, and the locking setting operation includes an operation of selecting the first pitch range in the pitch range selection area of the pitch range setting interface; Setting the first pitch range as a locked pitch range.

23. The method according to any one of claims 19-22, wherein, The method further includes: Receiving a locking cancellation operation, and the locking cancellation operation includes an operation of selecting the second pitch range in the pitch range selection area of the pitch range setting interface; Setting the second pitch range as an unlocked pitch range.

24. A voice interaction method, wherein, It includes: Obtaining the voice issued by the user; In the non-pitch range suppression mode, interacting with the target user located in the locked pitch range; The locked pitch range is the pitch range allowing voice interaction.

25. The method according to claim 24, wherein, The interacting with the target user located in the locked pitch range in the non-pitch range suppression mode includes: In the non-pitch range suppression mode, sending the voice to a multi-pitch range voice recognition device; The multi - zone voice recognition device interacts with the target user located in the locked zone by recognizing the target user's voice in the locked zone; The method further includes: In the zone suppression mode, the voice is not sent to the multi - zone voice recognition device.

26. A vehicle, Characterized in that, It includes: A memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the voice interaction method as described in any one of claims 1 - 25 is implemented.

Images