Unlock instant, AI-driven research and patent intelligence for your innovation.

Video conference background virtualization processing method and device

A video conferencing and virtualization technology, applied in the field of video conferencing background virtualization processing, can solve problems such as inability to achieve high-precision separation

Active Publication Date: 2021-09-07
TERMINUSBEIJING TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method usually cannot achieve high-precision separation when separating background images and foreground images.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video conference background virtualization processing method and device
  • Video conference background virtualization processing method and device
  • Video conference background virtualization processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0053] This embodiment provides a video conference background virtualization processing method, such as figure 1 shown, including the following steps:

[0054] S1. Obtain the first sound information within the first preset time period of the video conference, mark the first sound information according to the pre-built first deep learning network model, and obtain the first meeting content keywords; preferably, The first sound information may be collected by a sound sensor.

[0055] S2. Obtain the first conference theme set according to the keyword identification of the first meeting content, and output a message containing the content of the first meeting theme set; the display module displays the message for the user to choose, and the user can choose to better meet his needs One of the first conference topics in the first conference topic set of .

[0056] S3. Obtain a response message of the message, where the response message includes the content of a first conference to...

Embodiment 2

[0123] This embodiment provides a video conference background virtualization processing device, such as Figure 4 As shown, it includes: a smart interactive screen control system, a display module, a video codec transmission module, a 3D TOF three-dimensional measurement module, an image acquisition module and a fusion processing module; The module is connected with the fusion processing module; the fusion processing module is connected with the 3D TOF three-dimensional measurement module and the image acquisition module respectively; the display module is connected with the video codec transmission module;

[0124] The smart interactive screen control system is used to obtain the first sound information within the first preset time period of the video conference, mark the first sound information according to the pre-built first deep learning network model, and obtain the first conference content keywords; identify and obtain the first conference topic set according to the fir...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video conference background virtualization processing method and device, and relates to the technical field of three-dimensional computer vision, and the method comprises the steps: obtaining first sound information of a video conference, marking the first sound information according to a first deep learning network model, obtaining a first conference content keyword, and carrying out the recognition according to the first conference content keyword to obtain a first conference theme set; after obtaining a first conference theme element content in the first conference theme set, querying to obtain a first background matched with the first conference theme element content; generating a minimum external cuboid of the target according to the target space positioning data, and selecting the size of a first background according to the minimum external cuboid; and synthesizing the selected first background and the target space positioning data to obtain the video conference content after the background virtualization, and outputting the video conference content. Through 3D TOF measurement, target detection and image extraction technologies, a video conference display space and a characteristic background can be customized in a preset distance range by taking participants as a center, and background virtualization of a smart screen video conference is realized.

Description

technical field [0001] The invention relates to the technical field of three-dimensional computer vision, in particular to a method and device for virtualizing the background of a video conference. Background technique [0002] With the development of the mobile Internet, people generally start to conduct video communication on the Internet, such as video conferencing. Existing video conferences directly broadcast the multi-party conference scene in real time, so the conference background needs to be cleaned up. In addition to watching the main participants, tables and chairs and other conference scenes, the conference background also affects the conference. Redundant information about the environment. The display of these backgrounds greatly affects the mobility and scope of application of the video conference, so it is necessary to replace these redundant backgrounds with specific background content, so as to achieve different conference effects and purposes. For example...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T17/00G06T5/50G06T7/33G06T7/73G06T7/00G06F16/2455G06F16/35G06F40/279G06K9/46G06N3/04G06N3/08
CPCG06T17/005G06T5/50G06T7/33G06T7/0002G06T7/73G06F16/353G06N3/04G06N3/08G06F40/279G06F16/24564G06T2207/10024G06T2207/10028G06T2207/30196G06T2207/10016
Inventor 尹志诚
Owner TERMINUSBEIJING TECH CO LTD