Image synthesis method and device, electronic equipment and storage medium

Abstract

The invention relates to the technical field of audio and video communication, in particular to an image synthesis method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining background image information collected at a first frame rate and foreground image information collected at a second frame rate, the first frame rate being smaller than the second frame rate; expanding the background image collected at the first frame rate based on a second frame rate to obtain a background image corresponding to the second frame rate; synthesizing the background image corresponding to the second frame rate and the foreground image information collected at the second frame rate to determine a first synthesized image; and sending the first composite image. For the background image and foreground image information acquired at different frame rates, the background image acquired at a smaller acquisition frame rate is expanded, so that the expanded background image corresponds to the second frame rate, the background image and foreground image information with the same acquisition frame rate can be obtained, and the background image and foreground image information are synthesized and then sent. The display synchronization of the background image and the foreground image information at the receiving end can be ensured.

Description

technical field [0001] 本发明涉及音视频通信技术领域,具体涉及图像合成方法、装置、电子设备及存储介质。 Background technique [0002] 在视频会议、远程教育等实时音视频通信过程中,往往需要将电脑的整个屏幕(或某个应用程序窗口)共享给与会方,比如播放文档或讲稿。在屏幕共享的过程中,除了共享播放文档或讲稿之类的背景图像之外,还需要将变化的前景图像,例如鼠标、笔迹等实时传输给与会方。目前常规的做法就是在采集屏幕图像的同时采集鼠标信息,并将两者叠加在一起作为一帧图像发送出去。当连续采集该图像发送的时候,就形成了动态的视频。 [0003] 如果采集的频率较高(比如30帧 / 秒),则对电脑屏幕采集和视频编码的性能以及网络传输的带宽都提出了很高的要求。比如1080p的桌面分辨率,按30帧 / 秒的话,为保证文字清晰,至少需要4~8Mbps的网络传输带宽。因此,很多实际应用中就降低屏幕采集的帧率至5帧 / 秒。因为屏幕共享主要用于文档或讲稿等背景图像的观看,画面变化不大,因此帧率低一点问题也不大。但是若屏幕上的前景图像也按5帧 / 秒传输的话,就会明显感觉到前景图像的位置跳跃晃动,给视觉上带来非常严重的不适感。 Contents of the invention [0004] 有鉴于此,本发明实施例提供了一种图像合成方法、装置、电子设备及存储介质,以解决采集帧率不同导致的背景图像与前景图像的显示问题。 [0005] 根据第一方面,本发明实施例提供了一种图像合成方法,包括: [0006] 获取第一帧率采集的背景图像以及第二帧率采集的前景图像信息,所述第一帧率小于所述第二帧率; [0007] 基于所述第二帧率对所述第一帧率采集的背景图像进行扩展,得到对应于所述第二帧率的背景图像; [0008] 将对应于所述第二帧率的背景图像与所述第二帧率采集的前景图像信息进行合成,确定第一合成图像; [0009] 发送所述第一合成图像。 [0010] 本发明实施例提供的图像合成方法,对于不同帧率采集的背景图像与前景图像信息,通过对较小采集帧率采集到的背景图像进行扩展,使得扩展后的背景图像是与第二帧率对应的,从而就可以得到采集帧率相同的背景图像与前景图像信息,将两者合成之后再发送,一方面可以保证在接...

AI Technical Summary

Problems solved by technology

[0004] In view of this, an embodiment of the present invention provides an image synthesis method, device, electronic equipment, and storage medium to solve the problem of displaying background images and foreground images caused by different acquisition frame rates

Images