System for automatically capturing and tracking speaker

Abstract

The invention relates to a system for automatically capturing and tracking a speaker, which comprises a microphone array, a camera module, a central processing unit, a display module and a rotary table, and is characterized in that the camera module is mounted on the rotary table, the rotary table can drive the camera module to rotate, the microphone array comprises a plurality of microphones, the microphones send a sound signal to the central processing unit, the central processing unit identifies the received sound signal, calculates the rotation angle of the camera module and sends a control instruction to the rotary table according to the rotation angle, the rotary table adjusts the position of the camera module according to the control instruction, the camera module captures video data and sends the video data to the central processing unit and the display module, and the central processing unit analyzes whether a face is captured in a captured picture in real time by using a face recognition algorithm according to the received video data, and the display module displays the video captured by the camera. According to the invention, the current speaker in a video call can be automatically, quickly and effectively positioned, the capturing and tracking are accurate, and the precision is high.

Description

technical field [0001] The invention relates to the technical field of fusion of sound and image information, in particular to a system for automatically capturing and tracking speakers. Background technique [0002] Currently, in common video call systems, the position and direction of the camera are fixed. In order to achieve an ideal video call effect, the two or more parties in the call must face the camera within a specified range to facilitate the camera to capture images. However, in actual use, there are often some application scenarios that cannot meet this requirement, such as: [0003] (1) One party of the video call cannot master the knowledge of the video call. For example, underage children and left-behind elderly people cannot master the essentials of video calling due to their limited knowledge. Children are restless by nature and cannot stay fixed in one fixed position. However, video calls for these two types of groups are often more urgent needs. [00...

AI Technical Summary

Problems solved by technology

[0004] (2) The party on the call itself is in a state of motion and cannot be fixed at a certain position

The solution first requires additional manpower to carry out this operation

Secondly, the speed of manual adjustment is slow and the accuracy is poor. It is difficult to quickly capture the speaker and keep up with the rhythm of speaker switching.

Images