Method and device for dyeing subtitles corresponding to TTS voice and storage medium

A subtitle and voice technology, applied in the field of TTS voice corresponding subtitle coloring method, device and storage medium, can solve the problems of inability to set the subtitle coloring progress time in advance, unable to color subtitles, etc.

Pending Publication Date: 2022-07-19
北京中关村科金技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present disclosure provide a method, device, and storage medium for coloring subtitles corresponding to TTS voice, to at least solve the problem existing in the prior art because TTS voice files are temporarily generated according to text conversion, and cannot be set in advance to match TTS voice. The coloring progress time of the subtitles corresponding to the file, so that the technical problem that the subtitles corresponding to the TTS audio files cannot be accurately dyed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for dyeing subtitles corresponding to TTS voice and storage medium
  • Method and device for dyeing subtitles corresponding to TTS voice and storage medium
  • Method and device for dyeing subtitles corresponding to TTS voice and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] According to this embodiment, an embodiment of a method for coloring subtitles corresponding to TTS voice is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, Also, although a logical order is shown in the flowcharts, in some cases, steps shown or described may be performed in an order different from that herein.

[0024] The method embodiments provided in this embodiment may be executed in a mobile terminal, a computer terminal, a server, or a similar computing device. figure 1 A hardware structural block diagram of a computing device for a method for coloring subtitles corresponding to TTS speech is shown. like figure 1 As shown, a computing device may include one or more processors (the processors may include, but are not limited to, processing means such as a microprocessor MCU or a programmable logic device FPGA, etc.), memory for s...

Embodiment 2

[0063] Figure 5 An apparatus 500 for coloring subtitles corresponding to TTS speech according to this embodiment is shown, and the apparatus 500 corresponds to the method according to the first aspect of Embodiment 1. refer to Figure 5 As shown, the apparatus 500 includes: a first determining module 510, configured to determine, from the audio file obtained by the text-to-speech technology, the corresponding subtitle of each row of subtitles according to the ratio of the row width of each row of subtitles to the sum of the row widths of all subtitles audio clip; the second determination module 520 is used to determine the audio playback progress of the audio file at the moment of completing the display of each row of subtitles according to the audio position of the audio clip corresponding to each row of subtitles in the audio file; the third determination module 530, for determining the current playback progress of the audio file when the screen image of the current frame ...

Embodiment 3

[0072] Image 6 An apparatus 600 for coloring subtitles corresponding to TTS speech according to this embodiment is shown, and the apparatus 600 corresponds to the method according to the first aspect of Embodiment 1. refer to Image 6 As shown, the apparatus 600 includes: a processor 610; and a memory 620, connected to the processor 610, for providing the processor 610 with instructions for processing the following processing steps: according to the line width of each line of subtitles and the sum of the line widths of all subtitles Determine the audio segment corresponding to each line of subtitles from the audio file obtained via the text-to-speech technology; According to the audio position of the audio segment corresponding to each line of subtitles in the audio file, determine the moment when the display of each line of subtitles is completed The audio playback progress of the lower audio file; in the case of drawing the screen image of the current frame, determine the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and device for dyeing subtitles corresponding to TTS voice and a storage medium. The method comprises the following steps: determining an audio clip corresponding to each row of subtitles from an audio file obtained by a text-to-speech technology according to the ratio of the row width of each row of subtitles to the sum of the row widths of all subtitles; according to the audio position of the audio clip corresponding to each row of subtitles in the audio file, determining the audio playing progress of the audio file at the moment when the display of each row of subtitles is completed; under the condition that the screen picture of the current frame is drawn, determining the current playing progress of the audio file; according to the audio playing progress and the current playing progress, determining a dyeing range of subtitles displayed in the screen picture of the current frame; and dyeing the subtitles displayed in the screen picture of the current frame according to the determined dyeing range.

Description

technical field [0001] The present application relates to the technical field of subtitle processing, and in particular, to a method, device and storage medium for coloring subtitles corresponding to TTS voices. Background technique [0002] TTS, short for Text To Speech, or "text to speech", is part of the human-machine dialogue that enables machines to speak. TTS voice, generally speaking, is the voice obtained through text-to-speech technology. In some special scenarios, when playing such a TTS voice file, the corresponding subtitles need to be displayed. However, since the TTS voice files in these scenarios are temporarily generated based on text conversion, it cannot be set in advance for the progress and time of subtitle coloring like songs. Therefore, it is impossible to accurately colorize the subtitles corresponding to the TTS voice files. [0003] In view of the above-mentioned prior art, because the TTS voice file is temporarily generated according to the text ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N21/488H04N21/435G10L13/08G10L13/04
CPCH04N21/4884H04N21/435G10L13/08
Inventor 杨磊蒋宁夏溧王洪斌吴海英刘腾腾
Owner 北京中关村科金技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap