Technology for realizing real-time subtitle overlay during video call and applications of technology

Abstract

The invention discloses a technology for realizing real-time subtitle overlay during a video call and applications of the technology. The technology comprises subtitle software, and comprises the following steps: S1, a voice recognition algorithm, namely, through a machine learning algorithm, capturing audio data in a video in real time, and converting the audio data into language data with practical meaning; S2, a character converting algorithm, namely, carrying out algorithm processing on the acquired voice data so that character information is obtained through converting in real time; S3, asubtitle display algorithm, namely, carrying out real-time character-by-character or word-by-word display on the character information; S4, an automatic sentence punctuating algorithm, namely, analyzing an audio file, so that the starting and pausing points of one sentence are acquired; and S5, a character and audio / video overlay method, namely, directly displaying characters to a video interfacein an overlay manner, so that video captions are formed, wherein the video interface does not assign the display positions of the character subtitles. Through the technology for realizing real-time subtitle overlay during a video call and the applications of the technology, after the complete sentence is acquired, all the displayed characters can be updated according to the meaning of the complete sentence.

Description

technical field [0001] The invention relates to the technical field of video calls, in particular to a technology for superimposing subtitles in real time during a video call and an application thereof. Background technique [0002] The times are advancing, and the way we communicate is constantly changing. The 2G era of long-distance communication using only SMS and telephone voice has become history. With the emergence of 3G communication, people's communication methods have entered the era of video long-distance communication, followed by the explosion of smart devices and the development of 4G communication, until now With the advent of the 5G era, the frequency of video communication has become extremely widespread, and people are increasingly dependent on video communication. [0003] Although video communication has gradually replaced only text and voice communication, there are often some disadvantages and unsatisfactory places in video communication. Due to the li...

AI Technical Summary

Problems solved by technology

Due to the limitations of the form of the smartphone, both the speaker and the microphone are on the body. If you do not use headphones or other equipment, if you need the camera to capture the user's head, or you need to look at the other party on the screen and speak, you need to put the device on the If the place is far away from the ear, but you need to hear the other party’s voice clearly, you have to put the sound out, that is, turn on the speaker. This has the following disadvantages: If you are in a noisy place, you can’t hear the other party’s voice clearly even if you turn on the speaker , the other party may not be able to hear your own voice clearly, so both parties may need to face the embarrassment of repeating back and forth, and the communication efficiency is greatly reduced

[0004] In addition, for some special groups, such as the deaf, they cannot obtain the voice information of the other party during video calls, making it difficult for video calls to benefit these groups

Images