Method and apparatus for generating mixed-language-based subtitle file

A file generation and language technology, applied in the computer field, can solve the problems of high cost, low efficiency in generating mixed-language subtitle files, and inability to provide a method for generating mixed-language subtitle files, etc., so as to reduce the generation cost and improve the recognition accuracy.

Inactive Publication Date: 2017-06-20
GUANGDONG XIAOTIANCAI TECH CO LTD
View PDF6 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The object of the present invention is to provide a method and device for generating mixed-language subtitle files, aiming to solve the problem of low generation efficiency and high cost of mixed-language subtitle files due to the inability of the prior art to provide an effective method for generating mixed-language subtitle files question

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus for generating mixed-language-based subtitle file
  • Method and apparatus for generating mixed-language-based subtitle file
  • Method and apparatus for generating mixed-language-based subtitle file

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] figure 1 It shows the implementation flow of the mixed language subtitle file generation method provided by Embodiment 1 of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown, and the details are as follows:

[0024] In step S101, an audio and video file input by a user is received, and audio in the audio and video file is extracted.

[0025] The embodiments of the present invention are applicable to audio and video playback devices such as computers, mobile phones, and tablet computers that support audio and video playback. Audio and video files are audio files or video files without subtitles, and multiple languages ​​may appear in the audio or video, for example, Chinese and English appear simultaneously in one sentence, or one or more Chinese and English sentences appear simultaneously in a paragraph. Specifically, when the audio-video file is a video file, the audio stream in the v...

Embodiment 2

[0043] figure 2 The structure of the mixed-language subtitle file generation device provided by the second embodiment of the present invention is shown. For the convenience of description, only the parts related to the embodiment of the present invention are shown, including:

[0044] The audio extraction module 21 is configured to receive audio and video files input by the user, and extract audio from the audio and video files.

[0045] In the embodiment of the present invention, when the audio and video file is a video file, the audio stream in the video file needs to be separated, and the audio stream is saved as an audio file for operations such as audio segmentation and language recognition in subsequent steps .

[0046] Preferably, after extracting the audio in the audio and video file, the audio can be preprocessed. The preprocessing method can include audio signal denoising, decibel value setting, etc., to remove noise interference and weaken the background sound in ...

Embodiment 3

[0062] image 3 The preferred structure of the mixed language subtitle file generation structure provided by the third embodiment of the present invention is shown. For the convenience of description, only the parts related to the embodiment of the present invention are shown, including:

[0063] The audio extraction module 31 is configured to receive audio and video files input by the user, and extract audio from the audio and video files.

[0064] In the embodiment of the present invention, when the audio and video file is a video file, the audio stream in the video file needs to be separated, and the audio stream is saved as an audio file for operations such as audio segmentation and language recognition in subsequent steps .

[0065] The audio segmentation module 32 is configured to divide the audio into multiple audio segments, and store the time information corresponding to each audio segment.

[0066] In the embodiment of the present invention, the voice pause interva...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention, which is applicable to the field of the computer technology, provides a method and apparatus for generating a mixed-language-based subtitle file. The method comprises: receiving an audio/video file inputted by a user and extracting an audio part in the audio/video file; segmenting the audio part into a plurality of audio segments and storing time information corresponding to each audio segment; carrying out language identification on the plurality of audio segments to obtain the language types corresponding to the audio segments; according to the language types, carrying out voice identification on the plurality of audio segments and obtaining text contents after the voice identification of the audio segments; and according to the time information of the audio segments and the text contents, generating a mixed-language-based subtitle file. Therefore, on the basis of language identification and voice identification, automatic generation of a mixed-language-based subtitle file can be realized, so that the accuracy of mixed-language voice recognition and the generation efficiency of the mixed-language-based subtitle file can be improved and the generation cost of the mixed-language-based subtitle file can be reduced.

Description

technical field [0001] The invention belongs to the technical field of computers, in particular to a method and device for generating mixed-language subtitle files. Background technique [0002] In videos such as film and television dramas or online classrooms, subtitles can help the audience understand the plot of the program or the meaning of the characters, so subtitles have become an indispensable part of all kinds of videos. Because in these videos, characters may use multiple languages ​​when speaking, for example, in English classroom teaching, teachers usually mix English and Chinese, so this type of video involves the generation of mixed language subtitles. At present, in the prior art, for the generation of mixed-language subtitles, the audio and speech of the video is usually recognized as a separate language, and then the corresponding part is manually changed to another language. It can be seen that this method not only consumes The time is long, the efficiency...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/439H04N21/488H04N21/81
CPCH04N21/4394H04N21/4884H04N21/8106
Inventor 王金龙
Owner GUANGDONG XIAOTIANCAI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products