Directional output method, apparatus and device for TTS in multi-tone-area interaction scene, and medium

Abstract

The invention relates to a TTS directional output method, device and equipment in a multi-tone-area interaction scene and a medium, and is applied to the technical field of voice interaction, and the method comprises the steps: obtaining voice assistant setting information of a target vehicle; determining a sound area division result of the target vehicle based on the voice assistant setting information; obtaining TTS request information; generating a directional output scheme based on the TTS request information and the sound area division result; and executing the TTS request information based on the directional output scheme. The TTS interaction feedback method and device have the effect of improving the TTS interaction feedback fluency.

Description

Technical Field

[0001] The present application relates to the technical field of voice interaction, and in particular to a method, device, equipment and medium for directional output of TTS in a multi-audio zone interaction scenario. Background Art

[0002] The multi-zone interaction of the in-car voice assistant means that the voice assistant can be independently woken up and interacted with in different positions of the car, such as the main driver, co-driver, back seat, etc.

[0003] At present, in order to make voice assistants more comprehensive and accurate, general in-vehicle voice assistants all use TTS functions. The existing multi-zone interaction outputs the TTS feedback content in one audio channel. However, since audio playback needs to occupy the channel for a long time, TTS feedback in different audio zones interrupts and overlaps each other.

[0004] In order to avoid the mutual interference of TTS feedback from different voice zones, existing in-vehicle voice assistants all use a queue waiting method to solve this problem. Although this queue waiting method avoids the problem of mutual interference between different voice zones, it will also cause TTS feedback delays when multiple commands appear at the same time, causing interference to TTS feedback and a negative impact on the overall smoothness of the interaction. Summary of the invention

[0005] In order to improve the fluency of TTS interactive feedback, the present application provides a directional output method, device, equipment and medium of TTS in a multi-audio zone interaction scenario.

[0006] In the first aspect, the present application provides a directional output method of TTS in a multi-audio zone interaction scenario, which adopts the following technical solution:

[0007] A directional output method of TTS in a multi-audio zone interaction scenario, comprising:

[0008] Get the voice assistant setting information of the target vehicle;

[0009] Determine the sound zone division result of the target vehicle based on the voice assistant setting information;

[0010] Get TTS request information;

[0011] Generate a directional output solution based on the TTS request information and the audio zone division result;

[0012] The TTS request information is executed based on the directional output scheme.

[0013] By adopting the above technical solution, the vehicle is divided into multiple sound zones according to the voice assistant setting information of the vehicle. The voice assistant can be summoned in the sound zone to serve the sound zone. Then, a directional output plan is generated for the TTS information according to the TTS request information and the divided sound zone. When the TTS is broadcast, it is broadcast based on the directional output plan. The generated directional output plan is set based on the sound zone and TTS, which can avoid interruptions and the like, thereby improving the fluency of TTS interactive feedback.

[0014] Optionally, determining the sound zone division result of the target vehicle based on the voice assistant setting information includes:

[0015] Acquiring function setting information of the target vehicle;

[0016] Dividing the target vehicle into sound zones based on the voice assistant setting location information, and generating a first division result;

[0017] Dividing the target vehicle into sound zones based on the function setting information to generate a second division result;

[0018] A sound zone division result is generated based on the first division result and the second division result.

[0019] Optionally, the generating a directional output solution based on the TTS request information and the audio zone division result includes:

[0020] Analyze and process the TTS request information to generate analysis results;

[0021] Determining whether the TTS request information includes a specified audio zone based on the analysis result;

[0022] If the TTS request information includes a designated audio zone, generating a directional output solution based on a preset execution process, the TTS request information and the designated audio zone;

[0023] If the TTS request information does not include the designated audio zone, a directional output solution is generated based on the TTS request information and a preset execution process.

[0024] Optionally, the generating a directional output solution based on a preset execution process, the TTS request information and the designated audio zone includes:

[0025] Determine the request type of the TTS request information based on the analysis result;

[0026] Acquire the audio zone information of the specified audio zone;

[0027] Determining an execution order of the TTS request information based on the request type, the voice zone information, and the preset execution process;

[0028] A directional output scheme is generated based on the execution order and the designated sound zone.

[0029] Optionally, the generating a directional output solution based on the TTS request information and a preset execution process includes:

[0030] Determine the request type of the TTS request information based on the analysis result;

[0031] Determining whether the TTS request information needs to be localized based on the request type;

[0032] If the TTS request information needs to be localized, then obtaining the sound source information of the TTS request information;

[0033] Generate a sound zone positioning result based on the sound source information;

[0034] Determine the execution order of the TTS request information based on the sound zone positioning result, the request type and the preset execution process;

[0035] generating a directional output scheme based on the execution order and the designated sound zone;

[0036] If the TTS request information does not require voice zone positioning, determining the execution order of the TTS request information based on the request type and the preset execution process;

[0037] A directional output scheme is generated based on the execution order and the designated sound zone.

[0038] Optionally, the method further includes:

[0039] In response to a setting instruction of a user, obtaining personalized information of the setting instruction and a sound zone position selected by the user;

[0040] Determine a parameter adjustment object and a target adjustment parameter based on the personalized information;

[0041] Obtaining the current adjustment parameters of the parameter adjustment object;

[0042] Determine an estimated adjustment parameter and a target adjustment object based on the target adjustment parameter and the current adjustment parameter;

[0043] The target adjustment object is personalized adjusted based on the estimated adjustment parameters to generate a personalized sound zone.

[0044] Optionally, the method further includes:

[0045] Acquire the audio zone to which the TTS request information belongs and passenger information of the audio zone to which the TTS request information belongs;

[0046] Determining whether the corresponding audio zone is the personalized audio zone;

[0047] If the corresponding audio zone is the personalized audio zone, obtaining the personalized broadcast style of the personalized audio zone;

[0048] Perform TTS broadcast based on the personalized broadcast style;

[0049] If the audio zone is not the personalized audio zone, generating a recommended broadcast style based on the passenger information;

[0050] The TTS announcement is performed based on the recommended announcement style.

[0051] In the second aspect, the present application provides a directional output device of TTS in a multi-audio zone interaction scenario, which adopts the following technical solution:

[0052] A directional output device of TTS in a multi-audio zone interaction scenario, comprising:

[0053] An assistant information acquisition module is used to obtain the voice assistant setting information of the target vehicle;

[0054] A vehicle audio zone division module, used to determine the audio zone division result of the target vehicle based on the voice assistant setting information;

[0055] A request information acquisition module is used to obtain TTS request information;

[0056] A directional solution generating module, used for generating a directional output solution based on the TTS request information and the audio zone division result;

[0057] A directional scheme execution module is used to execute the TTS request information based on the directional output scheme.

[0058] By adopting the above technical solution, the vehicle is divided into multiple sound zones according to the voice assistant setting information of the vehicle. The voice assistant can be summoned in the sound zone to serve the sound zone. Then, a directional output plan is generated for the TTS information according to the TTS request information and the divided sound zone. When the TTS is broadcast, it is broadcast based on the directional output plan. The generated directional output plan is set based on the sound zone and TTS, which can avoid interruptions and the like, thereby improving the fluency of TTS interactive feedback.

[0059] In a third aspect, the present application provides an electronic device, which adopts the following technical solution:

[0060] An electronic device comprises a processor, wherein the processor is coupled to a memory;

[0061] The processor is used to execute the computer program stored in the memory, so that the electronic device executes the computer program of the directional output method of TTS in the multi-audio zone interaction scenario described in any one of the first aspects.

[0062] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution:

[0063] A computer-readable storage medium stores a computer program that can be loaded by a processor and executes the directional output method of TTS in a multi-audio zone interaction scenario as described in any one of the first aspects.

[0064] In summary, this application includes the following beneficial technical effects:

[0065] According to the vehicle's voice assistant setting information, the vehicle is divided into multiple audio zones. In the audio zone, the voice assistant can be summoned to serve the audio zone. Then, according to the TTS request information and the divided audio zone, a directional output plan is generated for the TTS information. When TTS is broadcast, it is broadcast based on the directional output plan. The generated directional output plan is set based on the audio zone and TTS, which can avoid interruptions and the like, thereby improving the fluency of TTS interactive feedback. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] Figure 1 It is a flow chart of a directional output method of TTS in a multi-audio zone interaction scenario provided by an embodiment of the present application.

[0067] Figure 2 It is a structural block diagram of a directional output device of TTS in a multi-audio zone interaction scenario provided by an embodiment of the present application.

[0068] Figure 3 It is a structural block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0069] The present application is further described in detail below in conjunction with the accompanying drawings.

[0070] The embodiment of the present application provides a directional output method of TTS in a multi-audio zone interaction scenario, which can be executed by an electronic device, which can be a server or a terminal device, wherein the server can be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The terminal device can be a smart phone, a tablet computer, a desktop computer, etc., but is not limited thereto.

[0071] Figure 1A flowchart of a directional output method of TTS in a multi-zone interaction scenario provided in an embodiment of the present application.

[0072] like Figure 1 As shown, the main process of the method is described as follows (steps S101 to S105):

[0073] Step S101, obtaining the voice assistant setting information of the target vehicle.

[0074] In this embodiment, due to different vehicle settings, not every seating area of ​​every vehicle is equipped with a voice assistant. Some vehicles do not have voice assistant sensing areas in the seating areas other than the main driver's seat and the co-driver's seat, some vehicles have voice assistant sensing areas in each position, and some vehicles have independent voice assistant sensing areas for the two driver's seats but all the rear seating areas share one voice assistant sensing area. The voice assistant setting information is the sensing area of ​​the voice assistant, including the area location, startup order, etc.

[0075] Step S102, determining the sound zone division result of the target vehicle based on the voice assistant setting information.

[0076] For step S102, obtain function setting information of the target vehicle; divide the target vehicle into audio zones based on the voice assistant setting location information to generate a first division result; divide the target vehicle into audio zones based on the function setting information to generate a second division result; generate an audio zone division result based on the first division result and the second division result.

[0077] In this embodiment, as mentioned above, the target vehicle is divided according to the number of settings and the setting position information of the voice assistant to obtain a first division result. The function setting information of the target vehicle includes the functions of each seat position, such as seat heating, seat massage, seat ventilation, etc. First, all the seats of the vehicle are divided into sound zones according to the functions of each seat and the number of seats to generate a second division result. For example, if the driver and the co-driver both have comprehensive seat functions, the driver and the co-driver are divided into two independent sound zones. If other rear seats also have corresponding functions, the number of rear seats is divided into as many independent sound zones as the number of rear seats. Then, the first division result and the second division result are merged. For example, the first division result is the driver's voice zone, the co-driver's voice zone, the left rear sound zone, and the right rear sound zone. The second division result is the driver's voice zone, the co-driver's voice zone, and the rear sound zone. After merging, the driver's voice zone, the co-driver's voice zone, the left rear sound zone, and the right rear sound zone are taken, that is, the one with the largest number of the two division results is the final sound zone division result.

[0078] Step S103, obtaining TTS request information.

[0079] In this embodiment, the TTS request information is all TTS requests from various audio zones, including but not limited to the request generation time, request content, and the audio zone to which the request belongs.

[0080] Step S104: Generate a directional output solution based on the TTS request information and the audio zone division result.

[0081] For step S104, the TTS request information is analyzed and processed to generate an analysis result; based on the analysis result, it is determined whether the TTS request information contains a specified sound zone; if the TTS request information contains a specified sound zone, a directional output solution is generated based on the preset execution process, the TTS request information and the specified sound zone; if the TTS request information does not contain a specified sound zone, a directional output solution is generated based on the TTS request information and the preset execution process.

[0082] In this embodiment, the TTS request information is parsed and analyzed to determine the specific content of the TTS request information. The specific content obtained by the analysis is used as the analysis result, and the sound zone extraction is performed on the analysis result. The sound zone extraction here refers to searching for sound zone related content in the analysis result. For example, the analysis result is to turn on the co-pilot seat massage, and the extracted sound zone content is the co-pilot. If the analysis result is to turn on the seat massage, the extracted sound zone content is empty. When the sound zone content is not empty, the sound zone in the extracted sound zone content is used as the designated sound zone, and the judgment result is that the designated sound zone is included. When the sound zone content is empty, the designated sound zone does not exist, and the judgment result is that the designated sound zone is not included.

[0083] When generating a directional output plan, it is necessary to combine the specific audio zone situation and the preset execution process. The processing steps for the designated audio zone and the non-designated audio zone voice assistant are not the same. At the same time, the preset execution process is set with a corresponding execution priority. It is necessary to analyze and sort the TTS request information according to the execution priority and the audio zone situation that issued the TTS request information to generate the final directional output plan so that the generated directional output plan can be used.

[0084] Furthermore, based on the analysis results, the request type of the TTS request information is determined; the audio zone information of the specified audio zone is obtained; the execution order of the TTS request information is determined based on the request type, the audio zone information and the preset execution process; and a directional output solution is generated based on the execution order and the specified audio zone.

[0085] In this embodiment, the TTS request information includes multiple request types, including reply types that require a voice assistant to reply, such as how long it takes to travel from the current location to location A, what time it is now, how much oil is left, how much electricity is left, etc. The request type also includes an execution type that is directly executed without a reply, such as turning on seat heating, turning on seat ventilation, turning on seat massage, etc. The request type also includes a response type that requires both execution and reply, such as playing a certain song, navigating to a certain place, etc. The preset execution process sets different execution priorities for different types of requests, and also sets different execution priorities for different sound zones. The preset execution process is provided with an execution priority table. After determining the request type and sound zone information, the execution priority table is searched for the corresponding one to obtain the execution order of the TTS request information. After obtaining the execution order, the specified sound zone is marked according to the serial number in the execution order to obtain a directional output solution.

[0086] It should be noted that for execution-type TTS request information, the voice assistant can directly execute it without replying. That is to say, when two TTS request information are received at the same time, one TTS request information is of reply type and the other TTS request information is of execution type. The two TTS request information can be executed at the same time, thereby further reducing the execution waiting process and improving the fluency of TTS interactive feedback.

[0087] Furthermore, based on the analysis results, the request type of the TTS request information is determined; based on the request type, it is determined whether the TTS request information needs to be located in the sound zone; if the TTS request information needs to be located in the sound zone, the sound source information of the TTS request information is obtained; the sound zone positioning result is generated based on the sound source information; based on the sound zone positioning result, the request type and the preset execution process, the execution order of the TTS request information is determined; based on the execution order and the specified sound zone, a directional output plan is generated; if the TTS request information does not need to be located in the sound zone, the execution order of the TTS request information is determined based on the request type and the preset execution process; the directional output plan is generated based on the execution order and the specified sound zone.

[0088] In this embodiment, the request type and preset execution process here are consistent with the above-mentioned request type and preset execution process, and no further description is given here. After obtaining the request type, it is further determined whether the TTS request information needs to be positioned in the sound zone. In the above-mentioned sound zone type example, the sound zone type of the reply type does not need to be positioned in the sound zone, but the sound zone type of the execution type needs to be positioned in the sound zone because it needs to determine the specific execution position. Therefore, it is necessary to first determine whether positioning is required. If sound zone positioning is not required, the execution order of the TTS request information will be directly determined according to the request type and the preset execution process, and then a directional output solution will be generated according to the execution order and the specified sound zone. If sound zone positioning is required, the sound source information of the TTS request information will need to be collected, and the sound zone will be inferred based on the sound source information, that is, a sound zone positioning result will be generated and confirmed to the user. After obtaining an affirmative answer, the execution order of the TTS request information is determined using the sound zone positioning result, request type and preset execution process in a similar manner to the above, and a directional output plan is generated. If the answer obtained is a negative answer, the user is prompted to state the exact sound zone, and the execution order of the TTS request information is determined based on the sound zone, request type and preset execution process provided by the user, and a directional output plan is generated.

[0089] Step S105: executing the TTS request information based on the directional output scheme.

[0090] In this embodiment, the TTS request information is executed according to the directional output scheme generated according to the above content. The generated directional output scheme can generate the most suitable directional output scheme according to the actual audio zone setting and the actual request type, thereby reducing the interruption of TTS broadcast or long queues, so as to improve the fluency of TTS broadcast.

[0091] In this embodiment, in response to the user's setting instructions, personalized information of the setting instructions and the sound zone position selected by the user are obtained; the parameter adjustment object and the target adjustment parameters are determined based on the personalized information; the current adjustment parameters of the parameter adjustment object are obtained; the expected adjustment parameters and the target adjustment object are determined based on the target adjustment parameters and the current adjustment parameters; the target adjustment object is personalized adjusted based on the expected adjustment parameters to generate a personalized sound zone.

[0092] In order to improve the convenience of TTS broadcasts, that is, users can quickly respond to their requests through the voice assistant's broadcast sound and other information, or to improve user comfort, etc., users can make personalized settings. When the user makes personalized settings, it is necessary to determine the sound zone position that needs to be personalized and the personalized information that needs to be set for the sound zone position, wherein the personalized settings are the feedback volume, feedback pitch, feedback timbre, wake-up name, whether to reply when executing instructions, execution speed and instruction limit level of the voice assistant during playback, etc. The personalized information set by the user is analyzed and processed to obtain the parameter adjustment object and the target adjustment parameter corresponding to the parameter adjustment object. After determining that the parameter adjustment object is obtained, the existing parameter data of the parameter adjustment object is collected, and the collected data is used as the current adjustment parameter. The current adjustment parameter is compared with the target adjustment parameter to find out whether there are parameters that are consistent and do not need to be adjusted. If there are parameters that do not need to be adjusted, the parameter adjustment object corresponding to the parameter is removed, and the parameter adjustment object corresponding to the parameter that needs to be adjusted is used as the target adjustment object, and the parameter difference between the current adjustment parameter and the target adjustment parameter is calculated, and the parameter adjustment difference is used as the estimated adjustment parameter. The corresponding target adjustment object is adjusted using the estimated adjustment parameter, and the adjusted sound zone is used as the personalized sound zone.

[0093] In this embodiment, the audio zone to which the TTS request information belongs and the passenger information of the audio zone are obtained; it is determined whether the audio zone to which the TTS request information belongs is a personalized audio zone; if the audio zone to which the TTS request information belongs is a personalized audio zone, the personalized broadcast style of the personalized audio zone is obtained; TTS broadcast is performed based on the personalized broadcast style; if the audio zone to which the TTS request information belongs is not a personalized audio zone, a recommended broadcast style is generated based on the passenger information; and TTS broadcast is performed based on the recommended broadcast style.

[0094] In order to further improve the convenience and comfort of user use, after obtaining the TTS request information, the sound zone to which the TTS request information is issued is determined, and the passenger information of the sound zone is collected. The passenger information is the inferred age and inferred gender obtained by analyzing the voice. After obtaining the sound zone and the passenger information, first determine whether the sound zone is a personalized sound zone. If the sound zone is a personalized sound zone, TTS broadcast is performed according to the set personalized broadcast style when performing TTS broadcast. If the sound zone is not a personalized sound zone, a search and match is performed in the preset recommendation table according to the passenger information to generate a broadcast style suitable for the current passenger. When performing TTS broadcast, TTS broadcast is performed according to the generated recommended broadcast style. The recommendation table is set with recommended timbres of different genders at different ages. For example, the timbre of a 3-year-old girl is set to Barbie sound, and the timbre of a 3-year-old boy is set to Transformers sound, etc.

[0095] Figure 2 A structural block diagram of a directional output device 200 for TTS in a multi-audio zone interaction scenario provided in an embodiment of the application.

[0096] like Figure 2 As shown, the directional output device 200 of TTS in the multi-audio zone interaction scenario mainly includes:

[0097] The assistant information acquisition module 201 is used to acquire the voice assistant setting information of the target vehicle;

[0098] The vehicle audio zone division module 202 is used to determine the audio zone division result of the target vehicle based on the voice assistant setting information;

[0099] The request information acquisition module 203 is used to acquire TTS request information;

[0100] A directional output solution generating module 204, configured to generate a directional output solution based on the TTS request information and the audio zone division result;

[0101] The directional scheme execution module 205 is used to execute the TTS request information based on the directional output scheme.

[0102] As an optional implementation of this embodiment, the vehicle sound zone division module 202 is specifically used to obtain function setting information of the target vehicle; divide the sound zone of the target vehicle based on the voice assistant setting location information to generate a first division result; divide the sound zone of the target vehicle based on the function setting information to generate a second division result; generate a sound zone division result based on the first division result and the second division result.

[0103] As an optional implementation of this embodiment, the directional solution generation module 204 includes:

[0104] An analysis result generation module is used to analyze and process TTS request information and generate analysis results;

[0105] A sound zone inclusion judgment module is used to judge whether the TTS request information contains a specified sound zone based on the analysis result;

[0106] A first solution generating module is used to generate a directional output solution based on a preset execution process, TTS request information and a specified audio zone;

[0107] The second solution generating module is used to generate a directional output solution based on the TTS request information and the preset execution process.

[0108] In this optional embodiment, the first solution generation module is specifically used to determine the request type of the TTS request information based on the analysis results; obtain the sound zone information of the specified sound zone; determine the execution order of the TTS request information based on the request type, the sound zone information and the preset execution process; and generate a directional output solution based on the execution order and the specified sound zone.

[0109] In this optional embodiment, the second solution generation module is specifically used to determine the request type of the TTS request information based on the analysis results; determine whether the TTS request information needs to be located in the sound zone based on the request type; if the TTS request information needs to be located in the sound zone, obtain the sound source information of the TTS request information; generate the sound zone positioning result based on the sound source information; determine the execution order of the TTS request information based on the sound zone positioning result, the request type and the preset execution process; generate a directional output solution based on the execution order and the specified sound zone; if the TTS request information does not need to be located in the sound zone, determine the execution order of the TTS request information based on the request type and the preset execution process; generate a directional output solution based on the execution order and the specified sound zone.

[0110] As an optional implementation of this embodiment, the directional output device 200 of TTS in the multi-audio zone interaction scenario further includes:

[0111] A user information acquisition module, for responding to a setting instruction of a user, acquiring personalized information of the setting instruction and a sound zone position selected by the user;

[0112] An adjustment parameter determination module, used to determine a parameter adjustment object and a target adjustment parameter based on personalized information;

[0113] A current parameter acquisition module is used to obtain the current adjustment parameters of the parameter adjustment object;

[0114] An estimated adjustment determination module, used to determine an estimated adjustment parameter and a target adjustment object based on the target adjustment parameter and the current adjustment parameter;

[0115] The personalized sound zone generation module is used to perform personalized adjustment on the target adjustment object based on the expected adjustment parameters to generate a personalized sound zone.

[0116] As an optional implementation of this embodiment, the directional output device 200 of TTS in the multi-audio zone interaction scenario further includes:

[0117] A bearer information acquisition module, used to obtain the audio zone to which the TTS request information belongs and the passenger information of the audio zone;

[0118] A personalized sound zone judgment module is used to judge whether the sound zone is a personalized sound zone;

[0119] A personalized information acquisition module, used to obtain the personalized broadcast style of the personalized audio zone;

[0120] Personalized style broadcast module, used for TTS broadcast based on personalized broadcast style;

[0121] A recommended style generation module, used to generate a recommended broadcast style based on passenger information;

[0122] The recommended style announcement module is used to perform TTS announcement based on the recommended announcement style.

[0123] In one example, the module in any of the above devices can be one or more integrated circuits configured to implement the above methods, such as: one or more application specific integrated circuits (ASICs), or, one or more digital signal processors (DSPs), or, one or more field programmable gate arrays (FPGAs), or a combination of at least two of these integrated circuit forms.

[0124] For another example, when the modules in the device can be implemented in the form of a processing element scheduling program, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call a program. For another example, these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0125] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0126] Figure 3 This is a structural block diagram of an electronic device 300 provided in an embodiment of the present application.

[0127] like Figure 3 As shown, the electronic device 300 includes a processor 301 and a memory 302 , and may further include an information input / information output (I / O) interface 303 , one or more of a communication component 304 , and a communication bus 305 .

[0128] The processor 301 is used to control the overall operation of the electronic device 300 to complete all or part of the steps of the directional output method of TTS in the above-mentioned multi-tone zone interaction scenario; the memory 302 is used to store various types of data to support the operation of the electronic device 300, and these data may include, for example, instructions for any application or method used to operate on the electronic device 300, and application-related data. The memory 302 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), erasable programmable read-only memory (Erasable Programmable Read-Only Memory, EPROM), programmable read-only memory (Programmable Read-Only Memory, PROM), read-only memory (Read-Only Memory, ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0129] The I / O interface 303 provides an interface between the processor 301 and other interface modules, and the above-mentioned other interface modules can be keyboards, mice, buttons, etc. These buttons can be virtual buttons or physical buttons. The communication component 304 is used for wired or wireless communication between the electronic device 300 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G or 4G, or a combination of one or more of them, so the corresponding communication component 104 can include: Wi-Fi components, Bluetooth components, NFC components.

[0130] The electronic device 300 can be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), controllers, microcontrollers, microprocessors or other electronic components to execute the directional output method of TTS in the multi-audio zone interaction scenario given in the above embodiment.

[0131] The communication bus 305 may include a path to transmit information between the above components. The communication bus 305 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The communication bus 305 may be divided into an address bus, a data bus, a control bus, etc.

[0132] The electronic device 300 may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc., and may also be servers, etc.

[0133] The present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the directional output method of TTS in the above-mentioned multi-tone zone interaction scenario are implemented.

[0134] The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0135] The terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not expressly listed, or also includes elements inherent to such process, method, article, or apparatus.

[0136] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of application involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the aforementioned application concept. For example, the above features are replaced with (but not limited to) technical features with similar functions applied in the present application.

Claims

1. A directional output method of TTS in a multi-audio zone interaction scenario, characterized in that: include: Get the voice assistant setting information of the target vehicle; Determine the sound zone division result of the target vehicle based on the voice assistant setting information; Get TTS request information; Generate a directional output solution based on the TTS request information and the audio zone division result; The TTS request information is executed based on the directional output scheme.

2. The method according to claim 1, characterized in that The determining of the sound zone division result of the target vehicle based on the voice assistant setting information includes: Acquiring function setting information of the target vehicle; Dividing the target vehicle into sound zones based on the voice assistant setting location information, and generating a first division result; Dividing the target vehicle into sound zones based on the function setting information to generate a second division result; A sound zone division result is generated based on the first division result and the second division result.

3. The method according to claim 1, characterized in that The generating of a directional output solution based on the TTS request information and the sound zone division result comprises: Analyze and process the TTS request information to generate analysis results; Determining whether the TTS request information includes a specified audio zone based on the analysis result; If the TTS request information includes a designated audio zone, generating a directional output solution based on a preset execution process, the TTS request information and the designated audio zone; If the TTS request information does not include the designated audio zone, a directional output solution is generated based on the TTS request information and a preset execution process.

4. The method according to claim 3, characterized in that The generating of the directional output scheme based on the preset execution process, the TTS request information and the designated audio zone includes: Determine the request type of the TTS request information based on the analysis result; Acquire the audio zone information of the specified audio zone; Determining an execution order of the TTS request information based on the request type, the voice zone information, and the preset execution process; A directional output scheme is generated based on the execution order and the designated sound zone.

5. The method according to claim 3, characterized in that: The generating of a directional output solution based on the TTS request information and the preset execution process includes: Determine the request type of the TTS request information based on the analysis result; Determining whether the TTS request information needs to be localized based on the request type; If the TTS request information needs to be localized, then obtaining the sound source information of the TTS request information; Generate a sound zone positioning result based on the sound source information; Determine the execution order of the TTS request information based on the sound zone positioning result, the request type and the preset execution process; generating a directional output scheme based on the execution order and the designated sound zone; If the TTS request information does not require voice zone positioning, determining the execution order of the TTS request information based on the request type and the preset execution process; A directional output scheme is generated based on the execution order and the designated sound zone.

6. The method according to claim 1, characterized in that The method further comprises: In response to a setting instruction of a user, obtaining personalized information of the setting instruction and a sound zone position selected by the user; Determine a parameter adjustment object and a target adjustment parameter based on the personalized information; Obtaining the current adjustment parameters of the parameter adjustment object; Determine an estimated adjustment parameter and a target adjustment object based on the target adjustment parameter and the current adjustment parameter; The target adjustment object is personalized adjusted based on the estimated adjustment parameters to generate a personalized sound zone.

7. The method according to claim 6, characterized in that The method further comprises: Acquire the audio zone to which the TTS request information belongs and passenger information of the audio zone to which the TTS request information belongs; Determining whether the corresponding audio zone is the personalized audio zone; If the corresponding audio zone is the personalized audio zone, obtaining the personalized broadcast style of the personalized audio zone; Perform TTS broadcast based on the personalized broadcast style; If the audio zone is not the personalized audio zone, generating a recommended broadcast style based on the passenger information; The TTS announcement is performed based on the recommended announcement style.

8. A directional output device for TTS in a multi-audio zone interaction scenario, characterized in that: include: An assistant information acquisition module is used to obtain the voice assistant setting information of the target vehicle; A vehicle audio zone division module, used to determine the audio zone division result of the target vehicle based on the voice assistant setting information; A request information acquisition module is used to obtain TTS request information; A directional solution generating module, used for generating a directional output solution based on the TTS request information and the audio zone division result; A directional scheme execution module is used to execute the TTS request information based on the directional output scheme.

9. An electronic device, characterized in that: comprising a processor coupled to a memory; The processor is configured to execute a computer program stored in the memory, so that the electronic device executes the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The method comprises a computer program or an instruction, which, when executed on a computer, causes the computer to execute the method according to any one of claims 1 to 7.

Images