Subtitle generation method, device and equipment and storage medium

A subtitle and text technology, applied in the fields of subtitle generation method, device, equipment and storage medium, can solve the problems of inaccurate recognition, inaccurate subtitle, inaudible, etc., to improve accuracy, avoid influence, and accurate speech recognition results Effect

Active Publication Date: 2020-11-06
BEIJING BYTEDANCE NETWORK TECH CO LTD
View PDF8 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the audio data on each audio track may affect each other, for example, there may be audio data on multiple audio tracks at the same time period, from the perspective of auditory experience, there may be a problem of unclear hearing, and if For the overall recognition of the audio data on all audio tracks in this time period, there may be inaccurate recognition problems, which may lead to inaccurate subtitles generated for audio and video files

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Subtitle generation method, device and equipment and storage medium
  • Subtitle generation method, device and equipment and storage medium
  • Subtitle generation method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] In order to more clearly understand the above objects, features and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0047] In the following description, many specific details are set forth in order to fully understand the present disclosure, but the present disclosure can also be implemented in other ways than described here; obviously, the embodiments in the description are only some of the embodiments of the present disclosure, and Not all examples.

[0048] At present, the subtitles of audio and video files are the recognition results obtained after performing overall speech recognition on the audio data on all audio tracks in the audio and video files. However, the audio data on each audio track may affect each other, resulting in There may...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a subtitle generation method and device, equipment and a storage medium. The method comprises the following steps: when receiving a subtitle generation triggering operation forat least one audio track in a target audio and video file, respectively carrying out voice recognition on audio data on each audio track in the at least one audio track to obtain a text fragment corresponding to each audio track; and then, based on the text fragment corresponding to each audio track, generating subtitles of the target audio and video file. Compared with the whole voice recognitionfor the audio data on all the audio tracks, the recognition precision is improved; according to the embodiment of the invention, independent voice recognition is carried out on the audio data on eachaudio track, the influence between the audio tracks is avoided, a more accurate voice recognition result can be obtained, and the accuracy of subtitles generated based on the voice recognition resultis further improved.

Description

technical field [0001] The present disclosure relates to the field of data processing, and in particular to a subtitle generation method, device, equipment and storage medium. Background technique [0002] Generating subtitles for audio and video files refers to performing speech recognition on audio and video files, and using the recognition results as subtitles for the audio and video files. [0003] At present, the subtitles of the audio and video files are the recognition results obtained after performing overall speech recognition on the audio data on all audio tracks in the audio and video files. Since the audio data on each audio track may affect each other, for example, there may be audio data on multiple audio tracks at the same time period, from the perspective of auditory experience, there may be a problem of unclear hearing, and if If the overall recognition is performed on the audio data on all audio tracks in the time period, the problem of inaccurate recognit...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N5/278H04N21/439H04N21/488H04N21/81
CPCH04N5/278H04N21/4396H04N21/8106H04N21/4884H04N21/47205H04N21/4394H04N21/440236G06F16/3344G06F40/166G10L15/26
Inventor 曾衍常为益付平非郑起凡林兆钦
Owner BEIJING BYTEDANCE NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products