Vehicle-mounted pronunciator synthesis system and method, electronic equipment and storage medium

Abstract

The invention relates to / belongs to the technical field of vehicle-mounted voices, and particularly relates to a vehicle-mounted speaker synthesis system and method, electronic equipment and a storage medium. The objective of the invention is to solve the technical problems that in an existing voice interaction system in the prior art, a speaker can only perform limited selection according to several customized speakers provided when a vehicle leaves a factory, user definition is not supported, and personalized requirements of a user cannot be met. Comprising a mobile networking device used for acquiring a sound source data packet generated by recording a sound sample of a user; the cloud server communicates with the mobile networking device and is used for receiving the sound source data packet uploaded by the mobile networking device and inputting the sound source data packet into a voice synthesis model for voice synthesis processing to obtain a voice synthesis data packet; and the vehicle-mounted multimedia host is used for receiving the speech synthesis data packet and importing the speech synthesis data packet into a speech module of the vehicle-mounted multimedia host to obtain a user-defined speaker.

Description

Technical Field

[0001] The present invention belongs to the field of vehicle-mounted speech technology, and in particular relates to a vehicle-mounted speaker synthesis system, method, electronic equipment and storage medium. Background Art

[0002] With the rapid development of the automobile industry, cars are becoming more and more intelligent, and the human-computer interaction capabilities have been greatly improved. The in-vehicle multimedia host is an important part of human-computer interaction. The in-vehicle multimedia host is equipped with a voice interaction system. The driver or passenger can interact with the voice interaction system through voice commands. The voice interaction system can process the user's voice commands and perform corresponding operations, including but not limited to navigation settings, music playback control, phone dialing / answering, information query, etc.

[0003] In the prior art, voice interaction systems include online voice functions and offline voice functions. Online voice functions require an Internet connection to process complex voice commands and generally provide more accurate responses and services. Offline voice functions work without an Internet connection and are suitable for basic functional operations, but may perform poorly on complex tasks.

[0004] The prior art has the following technical problems:

[0005] In the existing voice interaction system, the speaker can only make limited choices based on several customized speakers provided when the vehicle leaves the factory. It does not support user customization and cannot meet the user's personalized needs. Summary of the invention

[0006] The present invention provides a vehicle-mounted speaker synthesis system, method, electronic device and storage medium, aiming to solve the technical problem that in the existing voice interaction system in the above-mentioned prior art, the speaker can only make limited choices based on several customized speakers provided when the vehicle leaves the factory, does not support user customization, and cannot meet the user's personalized needs.

[0007] The technical solution of the present invention to solve the above technical problem is as follows: a vehicle-mounted speaker synthesis system, comprising:

[0008] A mobile network-connected device for acquiring a sound source data packet generated by recording a voice sample of a user;

[0009] A cloud server, communicating with the mobile networking device, is used to receive the sound source data packet uploaded by the mobile networking device, input the sound source data packet into a speech synthesis model for speech synthesis processing, and obtain a speech synthesis data packet;

[0010] The vehicle-mounted multimedia host is used to receive the speech synthesis data packet, import the speech synthesis data packet into the voice module of the vehicle-mounted multimedia host, and obtain a custom speaker.

[0011] By adopting the above technical solution, the beneficial effect of the present invention is that the user of the present invention can generate a customized speaker by recording his own voice sample, which greatly increases the personalized selection of the voice interaction system and meets the needs of different users.

[0012] Further, the above includes:

[0013] The mobile networking device is also used to record the user's voice sample through its own recording device to obtain the sound source data packet.

[0014] Furthermore, the above also includes:

[0015] The mobile networking device is further used to download the speech synthesis data packet from the cloud server and upload it to a mobile storage device;

[0016] The mobile storage device is also used to upload the speech synthesis data packet to the vehicle-mounted multimedia host.

[0017] Further, the above includes:

[0018] The mobile storage device is connected to the mobile networking device and is also used to upload the pre-stored sound source data packet to the mobile networking device.

[0019] Further, the above includes:

[0020] The vehicle-mounted multimedia host is also used to record the user's voice sample through its own recording device to obtain the sound source data packet;

[0021] The mobile storage device is used to download the sound source data packet from the vehicle-mounted multimedia host.

[0022] Furthermore, the audio of the above-mentioned sound source data packet is a single-person audio of the user, and the sound content is a preset speech.

[0023] Furthermore, the cloud server mentioned above includes:

[0024] An audio processing module, used for preprocessing the sound source data packet and performing feature extraction to obtain feature extraction data;

[0025] An audio analysis module, used to compare the feature extraction data with a preset voice database to obtain a comparison result, and to perform personalized adjustment of the audio features based on the comparison result to obtain personalized audio data;

[0026] The speech synthesis module is used to input the personalized audio data into the speech synthesis model, perform speech synthesis processing, and obtain a speech synthesis data packet.

[0027] In a second aspect, in order to solve the above technical problems, the present invention also provides a vehicle-mounted speaker synthesis method, comprising:

[0028] Acquire a sound source data packet generated by recording a user's voice sample;

[0029] Inputting the sound source data packet into a speech synthesis model for speech synthesis processing to obtain a speech synthesis data packet;

[0030] The speech synthesis data packet is imported into the vehicle-mounted multimedia host, and the speech synthesis data packet is configured on the main interface of the vehicle-mounted multimedia host to obtain a custom speaker.

[0031] In a third aspect, in order to solve the above-mentioned technical problem, the present invention also provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the in-vehicle speaker synthesis method of the present application is implemented.

[0032] In a fourth aspect, in order to solve the above-mentioned technical problem, the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the in-vehicle speaker synthesis method of the present application is implemented.

[0033] Compared with the prior art, the present invention has the following advantages:

[0034] 1. Users can generate customized speakers by recording their own voice samples, which greatly increases the personalized options of the voice interaction system and meets the needs of different users.

[0035] 2. The system of the present invention supports multiple devices (mobile networking devices, vehicle-mounted multimedia hosts) to record sound samples, thereby improving the flexibility and convenience of the system.

[0036] 3. The cloud server of the present invention ensures that the generated custom speaker has high-quality speech synthesis effect through advanced audio processing and speech synthesis technology.

[0037] 4. The user of the present invention can complete the recording of sound samples and the generation of a custom speaker with simple operations, and the operation is simple and convenient.

[0038] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures pointed out in the description, claims and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0040] Figure 1 A schematic diagram of a process flow of a vehicle-mounted speaker synthesis system according to Embodiment 1 of the present invention is shown;

[0041] Figure 2 A schematic diagram of a process flow of a vehicle-mounted speaker synthesis system according to Embodiment 2 of the present invention is shown;

[0042] Figure 3 A schematic diagram of a process flow of a vehicle-mounted speaker synthesis system according to Embodiment 3 of the present invention is shown;

[0043] Figure 4 A schematic flow chart of a vehicle-mounted speaker synthesis method according to an embodiment of the present invention is shown;

[0044] Figure 5 A schematic structural diagram of an electronic device according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0045] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0046] Example 1

[0047] Figure 1 FIG. 4 shows a flow chart of a vehicle-mounted speaker synthesis system according to Embodiment 1 of the present invention. Figure 1 As shown, the vehicle-mounted speaker synthesis system of the embodiment of the present invention includes:

[0048] A mobile network-connected device for acquiring a sound source data packet generated by recording a voice sample of a user;

[0049] A cloud server, communicating with the mobile networking device, is used to receive the sound source data packet uploaded by the mobile networking device, input the sound source data packet into a speech synthesis model for speech synthesis processing, and obtain a speech synthesis data packet;

[0050] The vehicle-mounted multimedia host is used to receive the speech synthesis data packet, import the speech synthesis data packet into the voice module of the vehicle-mounted multimedia host, and obtain a custom speaker.

[0051] Preferably, the cloud server includes:

[0052] An audio processing module, used for preprocessing the sound source data packet and performing feature extraction to obtain feature extraction data;

[0053] An audio analysis module, used to compare the feature extraction data with a preset voice database to obtain a comparison result, and to perform personalized adjustment of the audio features based on the comparison result to obtain personalized audio data;

[0054] The speech synthesis module is used to input the personalized audio data into the speech synthesis model, perform speech synthesis processing, and obtain a speech synthesis data packet.

[0055] Optionally, the mobile networking device is further used to record the user's voice sample through its own recording device to obtain the sound source data packet.

[0056] In summary, in this embodiment 1, first of all, high-quality audio materials need to be prepared. These audio materials should be single-person, noise-free and background-free, and need to be recorded in a quiet environment. Therefore, in this embodiment 1, a mobile networking device is used for recording, such as a mobile phone. The user uses a mobile networking device to record a sound, and requires the use of a specific paragraph of words to ensure that the various parameters of the sound can be accurately identified. Finally, a sound source data packet is obtained.

[0057] In this embodiment 1, the vehicle multimedia host directly downloads the speech synthesis data packet from the cloud server through the network. Then, select to use a custom speaker on the main interface to complete the setting.

[0058] Example 2

[0059] Figure 2 FIG. 4 shows a flow chart of a vehicle-mounted speaker synthesis system according to Embodiment 2 of the present invention. Figure 2 As shown, the vehicle-mounted speaker synthesis system of the embodiment of the present invention includes:

[0060] A mobile network-connected device for acquiring a sound source data packet generated by recording a voice sample of a user;

[0061] A cloud server, communicating with the mobile networking device, is used to receive the sound source data packet uploaded by the mobile networking device, input the sound source data packet into a speech synthesis model for speech synthesis processing, and obtain a speech synthesis data packet;

[0062] The vehicle-mounted multimedia host is used to receive the speech synthesis data packet and export the speech synthesis data packet as a custom speaker for user selection.

[0063] Preferably, the cloud server includes:

[0064] An audio processing module, used for preprocessing the sound source data packet and performing feature extraction to obtain feature extraction data;

[0065] An audio analysis module, used to compare the feature extraction data with a preset voice database to obtain a comparison result, and to perform personalized adjustment of the audio features based on the comparison result to obtain personalized audio data;

[0066] The speech synthesis module is used to input the personalized audio data into the speech synthesis model, perform speech synthesis processing, and obtain a speech synthesis data packet.

[0067] Optionally, the mobile networking device is further used to download the speech synthesis data packet from the cloud server and upload it to a mobile storage device;

[0068] The mobile storage device is also used to upload the speech synthesis data packet to the vehicle-mounted multimedia host.

[0069] In summary, in this embodiment 2, first of all, high-quality audio materials need to be prepared. These audio materials should be single-person, noise-free and background-free, and need to be recorded in a quiet environment. Therefore, in this embodiment 2, a mobile networking device is used for recording, such as a mobile phone. The user uses a mobile networking device to record a sound, and requires the use of a specific paragraph of words to ensure that the various parameters of the sound can be accurately identified. Finally, a sound source data packet is obtained.

[0070] In this embodiment 2, after the cloud server generates a speech synthesis data packet, the mobile network device downloads the speech synthesis data packet from the cloud server through the network. Then the mobile network device is connected to the mobile storage device to import the speech synthesis data packet into the mobile storage device; the mobile storage device is connected to the vehicle multimedia host, and the speaker is selected on the vehicle multimedia host to import the speech synthesis data packet into the vehicle multimedia host. Then select to use a custom speaker on the main interface to complete the setting.

[0071] Example 3

[0072] Figure 3 FIG. 4 shows a flow chart of a vehicle-mounted speaker synthesis system according to Embodiment 3 of the present invention. Figure 3 As shown, the vehicle-mounted speaker synthesis system of the embodiment of the present invention includes:

[0073] A mobile network-connected device for acquiring a sound source data packet generated by recording a voice sample of a user;

[0074] A cloud server, communicating with the mobile networking device, is used to receive the sound source data packet uploaded by the mobile networking device, input the sound source data packet into a speech synthesis model for speech synthesis processing, and obtain a speech synthesis data packet;

[0075] The vehicle-mounted multimedia host is used to receive the speech synthesis data packet and export the speech synthesis data packet as a custom speaker for user selection.

[0076] Among them, both the on-board multimedia host and the cloud server can add speaker parameter adjustment settings (such as volume, intonation, speaking speed and other parameter settings). If the user is not satisfied with the speaker automatically synthesized by the cloud server, he or she can customize the sound parameters and save them to achieve the ideal speaker state that he or she needs.

[0077] Preferably, the cloud server includes:

[0078] An audio processing module, used for preprocessing the sound source data packet and performing feature extraction to obtain feature extraction data;

[0079] An audio analysis module, used to compare the feature extraction data with a preset voice database to obtain a comparison result, and to perform personalized adjustment of the audio features based on the comparison result to obtain personalized audio data;

[0080] The speech synthesis module is used to input the personalized audio data into the speech synthesis model, perform speech synthesis processing, and obtain a speech synthesis data packet.

[0081] Among them, if it is not possible to use the cloud server, you can also use local computer equipment to build a synthesis platform for processing.

[0082] Optionally, the mobile networking device is further used to download the speech synthesis data packet from the cloud server and upload it to a mobile storage device;

[0083] The mobile storage device is also used to upload the speech synthesis data packet to the vehicle-mounted multimedia host.

[0084] Optionally, the mobile storage device is connected to the mobile networking device, and is also used to upload the pre-stored sound source data packet to the mobile networking device.

[0085] Optionally, the vehicle-mounted multimedia host is further used to record the user's voice sample through its own recording device to obtain the sound source data packet;

[0086] The mobile storage device is used to download the sound source data packet from the vehicle-mounted multimedia host.

[0087] When uploading sound source data packets, multiple sound source data packets can be uploaded at one time. The cloud server can generate multiple speech synthesis data packets in parallel, reducing duplication of work and saving time. The user interface on the in-vehicle multimedia host can reserve multiple custom speaker options and add custom names to make it easier for users to choose.

[0088] In summary, in this embodiment 3, first of all, high-quality audio materials need to be prepared. These audio materials should be single-person, noise-free and background-free, and need to be recorded in a quiet environment. In this embodiment 3, a vehicle-mounted multimedia host is used for recording. When preparing audio materials, recording pens, recording studios and other equipment can also be used for recording. As long as the audio requirements can be met in the end, a specific paragraph of speech is required to ensure that the various parameters of the sound can be accurately identified. Finally, a sound source data packet is obtained, and then the sound source data packet is transferred to a mobile networking device through a mobile storage device, and the sound source data packet is uploaded to a cloud server through the mobile networking device for speech synthesis processing.

[0089] In this embodiment 3, after the cloud server generates a speech synthesis data packet, the mobile network device downloads the speech synthesis data packet from the cloud server through the network. Then the mobile network device is connected to the mobile storage device to import the speech synthesis data packet into the mobile storage device; the mobile storage device is connected to the vehicle multimedia host, and the speaker is selected on the vehicle multimedia host to import the speech synthesis data packet into the vehicle multimedia host. Then select to use a custom speaker on the main interface to complete the setting.

[0090] Based on the same principle as the above system, the embodiment of the present invention also provides a vehicle-mounted speaker synthesis method, such as Figure 4 As shown in, including:

[0091] Acquire a sound source data packet generated by recording a user's voice sample;

[0092] Inputting the sound source data packet into a speech synthesis model for speech synthesis processing to obtain a speech synthesis data packet;

[0093] The speech synthesis data packet is imported into the vehicle-mounted multimedia host, and the speech synthesis data packet is configured on the main interface of the vehicle-mounted multimedia host to obtain a custom speaker.

[0094] The in-vehicle speaker synthesis method of the embodiment of the present invention can execute the in-vehicle speaker synthesis system provided by the embodiment of the present invention, and its implementation principle is similar. The actions performed by each module and unit in the in-vehicle speaker synthesis method in each embodiment of the present invention correspond to the steps in the in-vehicle speaker synthesis system in each embodiment of the present invention. For the detailed functional description of each module of the in-vehicle speaker synthesis method, please refer to the description in the corresponding in-vehicle speaker synthesis system shown in the previous text, which will not be repeated here.

[0095] Based on the same principle as the method shown in the embodiments of the present invention, an electronic device is also provided in the embodiments of the present invention, which may include but is not limited to: a processor and a memory; the memory is used to store a computer program; the processor is used to execute the method shown in any embodiment of the present invention by calling the computer program.

[0096] In an alternative embodiment, an electronic device is provided, such as Figure 5 As shown, Figure 5 The electronic device shown includes: a processor and a memory. The processor and the memory are connected, such as through a bus. Optionally, the electronic device may also include a transceiver, which may be used for data exchange between the electronic device and other electronic devices, such as data transmission and / or data reception. It should be noted that in actual applications, the transceiver is not limited to one, and the structure of the electronic device does not constitute a limitation on the embodiments of the present invention.

[0097] The memory is used to store the application code (computer program) for executing the solution of the present invention, and the execution is controlled by the processor. The processor is used to execute the application code stored in the memory to implement the content shown in the above method embodiment.

[0098] An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer can execute the corresponding contents of the aforementioned method embodiment.

[0099] According to another aspect of the present invention, a computer program product or a computer program is also provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the implementation modes of the above-mentioned various embodiments.

[0100] It should be understood that the flow charts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the module, the program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0101] The computer-readable storage medium provided by the embodiment of the present invention may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, device, or device.

[0102] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0103] The above description is only a preferred embodiment of the present invention and an explanation of the technical principles used. Those skilled in the art should understand that the disclosure scope involved in the present invention is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present invention (but not limited to) to form a technical solution.

Claims

1. A vehicle-mounted speaker synthesis system, characterized in that: include: A mobile network-connected device for acquiring a sound source data packet generated by recording a voice sample of a user; A cloud server, communicating with the mobile networking device, is used to receive the sound source data packet uploaded by the mobile networking device, input the sound source data packet into a speech synthesis model for speech synthesis processing, and obtain a speech synthesis data packet; The vehicle-mounted multimedia host is used to receive the speech synthesis data packet, import the speech synthesis data packet into the voice module of the vehicle-mounted multimedia host, and obtain a custom speaker.

2. The vehicle-mounted speaker synthesis system according to claim 1, characterized in that: include: The mobile networking device is also used to record the user's voice sample through its own recording device to obtain the sound source data packet.

3. The vehicle-mounted speaker synthesis system according to claim 1, characterized in that: Also includes: The mobile networking device is further used to download the speech synthesis data packet from the cloud server and upload it to a mobile storage device; The mobile storage device is also used to upload the speech synthesis data packet to the vehicle-mounted multimedia host.

4. The vehicle-mounted speaker synthesis system according to claim 3, characterized in that: include: The mobile storage device is connected to the mobile networking device and is also used to upload the pre-stored sound source data packet to the mobile networking device.

5. The vehicle-mounted speaker synthesis system according to claim 4, characterized in that: include: The vehicle-mounted multimedia host is also used to record the user's voice sample through its own recording device to obtain the sound source data packet; The mobile storage device is used to download the sound source data packet from the vehicle-mounted multimedia host.

6. The vehicle-mounted speaker synthesis system according to claim 1, characterized in that: The audio of the sound source data packet is the user's single-person audio, and the sound content is a preset segment of speech.

7. The vehicle-mounted speaker synthesis system according to claim 1, characterized in that: The cloud server includes: An audio processing module, used for preprocessing the sound source data packet and performing feature extraction to obtain feature extraction data; An audio analysis module, used to compare the feature extraction data with a preset voice database to obtain a comparison result, and perform personalized adjustment of the audio features based on the comparison result to obtain personalized audio data; The speech synthesis module is used to input the personalized audio data into the speech synthesis model, perform speech synthesis processing, and obtain a speech synthesis data packet.

8. A method for synthesizing a vehicle-mounted speaker, characterized in that: include: Acquire a sound source data packet generated by recording a user's voice sample; Inputting the sound source data packet into a speech synthesis model for speech synthesis processing to obtain a speech synthesis data packet; The speech synthesis data packet is imported into the vehicle-mounted multimedia host, and the speech synthesis data packet is configured on the main interface of the vehicle-mounted multimedia host to obtain a custom speaker.

9. An electronic device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the method according to claim 8 is implemented when the processor executes the computer program.

10. A computer storage medium, characterized in that: The computer storage medium stores a computer program, and when the computer program is executed by a processor, the method according to claim 8 is implemented.

Images