Unlock instant, AI-driven research and patent intelligence for your innovation.

Method, system and device for automatically scrolling subtitles based on voice rhythm

A technology of scrolling subtitles and voice, applied in the field of automatic scrolling subtitles, can solve problems such as increasing costs

Active Publication Date: 2021-06-01
杭州小众圈科技有限公司
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Currently on the market, subtitles need to be scrolled manually, which requires additional human resources and increases the cost of production

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, system and device for automatically scrolling subtitles based on voice rhythm
  • Method, system and device for automatically scrolling subtitles based on voice rhythm
  • Method, system and device for automatically scrolling subtitles based on voice rhythm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0069] A method for automatically scrolling subtitles based on voice rhythm, such as figure 1 shown, including the following steps:

[0070] S100. Acquire the voice data of the subtitles to be rolled, and perform sentence segmentation processing when the voice blank gap time exceeds a preset value;

[0071] S200. Perform frame-by-frame extraction feature processing on the voice data after sentence segmentation processing, so that each frame has a fixed length, and convert each frame into a feature vector;

[0072] S300. Input the feature vector into the speech recognition model, and convert the speech data after sentence segmentation processing into human voice speech feature symbols;

[0073] S400. Comparing the feature symbols of the human voice with the preset feature symbols extracted from the subtitle text, if the similarity is higher than the threshold, the matching is successful;

[0074] S500. Dynamically calculate a smooth scrolling speed, and scroll the correspondi...

Embodiment 2

[0122] A system for automatic subtitle scrolling based on voice rhythm, such as figure 2 As shown, it includes a speech acquisition module 100, a speech extraction module 200, a speech feature conversion module 300, a feature symbol matching module 400 and a text scrolling module 500;

[0123] The voice acquisition module 100 is used to acquire the voice data of the subtitles to be scrolled, and when the voice blank gap time exceeds a preset value, sentence segmentation processing is performed;

[0124] The speech extraction module 200 is used to perform frame extraction feature processing on the speech data after sentence segmentation processing, so that each frame is a fixed length, and each frame is converted into a feature vector;

[0125] The speech feature conversion module 300 is used to input the feature vector into the speech recognition model, and convert the speech data after sentence segmentation processing into human voice speech feature symbols;

[0126] The fe...

Embodiment 3

[0140] A computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following method steps are implemented:

[0141] Obtain the voice data of the subtitles to be rolled, and perform sentence segmentation processing when the voice blank gap time exceeds the preset value;

[0142] The speech data after sentence segmentation processing is subjected to frame-by-frame extraction feature processing, so that each frame is a fixed length, and each frame is converted into a feature vector;

[0143] Input the feature vector into the speech recognition model, and convert the speech data after sentence segmentation processing into human voice speech feature symbols;

[0144] Comparing the feature symbols of the vocal speech with the preset feature symbols extracted from the subtitle text, if the similarity is higher than the threshold, the matching is successful;

[0145] Dynamically calc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for automatically scrolling subtitles based on voice rhythm, which comprises the following steps of: acquiring voice data of subtitles to be scrolled, and performing sentence segmentation processing when voice blank gap time exceeds a preset value; performing framing feature extraction processing on the speech data after sentence segmentation processing so as to enable each frame to have a fixed length, and converting each frame into a feature vector; inputting the feature vectors into a speech recognition model, and converting the speech data after sentence segmentation into human voice feature symbols; comparing the human voice feature symbols with feature symbols extracted from preset caption characters, and if the similarity is higher than a threshold value, determining that matching succeeds; and dynamically calculating a smooth rolling speed, and rolling the corresponding subtitles upwards. According to the method, the function that a user freely controls subtitle word extraction can be achieved, automatic subtitle word extraction is achieved while manpower resources are not increased, and a series of conditions such as word forgetting and word mistaking are avoided.

Description

technical field [0001] The invention relates to the technical field of subtitle control, in particular to a method, system and device for automatically scrolling subtitles based on voice rhythm. Background technique [0002] With the rise of new media such as online live broadcast, live teaching, online classroom, and short video production, more and more fields need to use the subtitle prompt function, and the subtitle file that is synchronized with the voice will be generated later, such as in teaching, When giving a speech, preparing subtitles can avoid a series of situations such as forgetting words and wrong words. [0003] Currently on the market, subtitles need to be scrolled manually, which requires additional human resources and increases the cost of production. Therefore, there is an urgent need for a program that can recognize the rhythm of speech and automatically scroll subtitles following the rhythm to solve this problem. Contents of the invention [0004] ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/431H04N21/485H04N21/488G10L15/02G10L15/16G10L15/22G10L25/03G10L25/30G10L25/57
CPCH04N21/4858H04N21/4884H04N21/431G10L15/22G10L15/02G10L25/57G10L25/03G10L25/30G10L15/16
Inventor 殷明周见光周凯峰
Owner 杭州小众圈科技有限公司