Video subtitle determining method and video subtitle determining device

Abstract

The embodiments of the invention provide a video subtitle determining method and a video subtitle determining device. The method comprises the following steps: acquiring one or more video frame images containing original subtitles of a target video clip and audio information corresponding to the multiple video frame images, and selecting one video frame image as a target video frame image from the multiple video frame images; converting the audio information into corresponding text information; converting the original subtitle of the target video frame image into corresponding text information; under the condition that the text information corresponding to the audio information is not the same with the text information corresponding to the original subtitle of the target video frame image, using a neural network language model to predict the text information corresponding to the audio information and the text information corresponding to the original subtitle of the target video frame image for each different character; and determining the target subtitles of the target video clip according to the prediction result. By implementing the embodiments of the invention, the accuracy of target video subtitles is improved.

Description

technical field [0001] The invention relates to the technical field of video analysis, in particular to a method and device for determining video subtitles. Background technique [0002] Subtitles refer to the dialogue in TV, movies, and stage works displayed in the form of text, and usually refer to the text processed in the post-processing of film and television works. Most of the existing videos on the Internet have subtitles, and it is impossible to directly obtain the original subtitles of the video due to problems such as administrator rights. For a video, obtaining subtitles of the video is helpful for analyzing the content or highlights of the video. [0003] In the prior art, the method of acquiring video subtitles is: acquiring audio information corresponding to a video segment, and using speech analysis technology to convert the audio information into corresponding text information as target subtitles of the video. The disadvantage of this method is that the aud...

AI Technical Summary

Problems solved by technology

The disadvantage of this method is: audio information is easily affected by environmental noise and video background noise, and the text corresponding to the audio information obtained through speech analysis technology has a higher error rate than the original subtitle of the video.

Images