Speech synthesis method and device based on style description and electronic equipment

CN119694289APending Publication Date: 2025-03-25NANJING SILICON INTELLIGENCE TECH CO LTD

Patent Information

Application Number
CN202411793321.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-06
Publication Date
2025-03-25

Smart Images

  • Figure CN119694289A_ABST
    Figure CN119694289A_ABST
Patent Text Reader

Abstract

The invention discloses a speech synthesis method and device based on style description and electronic equipment. The method comprises the steps of obtaining target text data and style description data of a target speaker; the style description data comprises text data describing the acoustic type of the target synthetic speech data; and inputting the target text data and the style description data into a pre-trained speech synthesis model, and outputting target synthesized speech data corresponding to the target speaker, the pre-trained speech synthesis model being obtained by performing adversarial training on an initial speech synthesis model based on an SLM discriminator, the SLM discriminator is used for discriminating SLM features of the sample synthesis voice data and the sample adversarial voice data of the initial voice synthesis model; the SLM feature is generated by an SLM discriminator. According to the invention, under the condition that the voice data of the specific duration of the target speaker cannot be obtained, it can be ensured that the synthesized voice data finally output by the voice synthesis model is consistent with the voice features of the target speaker.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Generative adversarial network training method, audio style migration method and devices

    CN112562728A

  • Audio synthesis method and device, training method and device, equipment and storage medium

    CN117373431A

  • Speech synthesis model training method and device based on comparative learning and synthesis method

    CN117392972A

  • Audio processing method and device

    CN117711427A

  • Anti-strong generalization speech emotion recognition method fusing uncertainty

    CN118887977A

Cited By

  • Speech synthesis sample set construction method and device and speech synthesis model training method and device

    CN119889278A