Method, system and device for realizing audio and video conference

Abstract

The invention provides a method, a system and a device for realizing an audio and video conference. A speaker terminal strikes a time stamp for an audio and a video and marks the same time stamp in a text which is synchronous with the audio; and video frame sequence codes of corresponding video characteristic information are marked and then the codes are packaged to be sent to a participant terminal. The participant terminal decodes a data packet, and the audio and the video are played according to the time stamp of the audio and the video; the text is read according to a time stamp sequence of the text and the video frame sequence codes of the read text are compared with a sequence code of the played video; if the video frame sequence codes and the sequence code of the played video are the same, the sequence codes are embedded into the video to be displayed; if the video frame sequence codes and the sequence code of the played video are different, a subsequent video frame is continually read until the sequence codes of the read subsequent video frame are the same; or the subsequent text is read until the played video sequence codes and the sequence codes of the read subsequent text are the same; and the text is embedded into the video to be displayed. According to the method, the system and the device for realizing the audio and video conference, during a video conference, the audio and the corresponding text which is embedded into the video are synchronously played in a simple and short-time manner.

Description

technical field [0001] The invention relates to a processing technology of audio and video data, in particular to a method, system and device for realizing an audio and video conference. Background technique [0002] At present, remote audio and video conferencing has become an indispensable management communication method in modern enterprises. When conducting a remote audio-video conference, the speaker terminal collects the speaker's audio-video, and then packs and encodes the collected audio-video into data packets, and sends them to the participant terminals of the audio-video conference. After receiving the data packet, the terminal of the participant party performs decoding processing locally to obtain audio and video for playback. With the development of audio and video conferences, audio and video conferences also have many functions. One function is text embedding technology, that is, the speaker terminal adds corresponding text to the collected speaker's audio, a...

AI Technical Summary

Problems solved by technology

[0008] There are problems in the above two methods. In the first method, when the speaker terminal stamps the audio and video of the collected speaker, it is based on the time of the audio, the time of the video, or the time of the speaker terminal. This makes When the audio and video are played, the audio and video may be out of sync due to the different encoding and decoding speeds and time bases of the audio and video, which will cause the text embedded in the video to be based on the audio and video timestamp. The audio playback is not synchronized, and it is not easy to correct; the second method is to synchronize the text according to the speaker's video feature information, which needs to recognize each frame of the video, and the recognition process is relatively long and complex to implement

Images