Microphone array sound source positioning method, device and system based on video tracking

A microphone array and sound source localization technology, applied in video conferencing systems, two-way working systems, instruments, etc., can solve problems such as susceptibility to noise, reverberation, and inaccurate positioning, and achieve the effect of improving user experience and accuracy

Inactive Publication Date: 2014-06-04
ZTE CORP
View PDF3 Cites 77 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the technical problem that the existing sound source localization technology is easily affected by factors such as noise and reverberation, resulting

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Microphone array sound source positioning method, device and system based on video tracking

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] The technical scheme of the present invention will be described in further detail below in conjunction with the accompanying drawings and specific examples, so that those skilled in the art can better understand the present invention and implement it, but the examples given are not intended to limit the present invention .

[0047] As shown in Figure 1, a method for localizing a sound source of a microphone array based on video tracking provided by an embodiment of the present invention includes the following specific steps:

[0048] S10, counting multiple microphones in the microphone array to obtain time difference information of the current voice;

[0049] S11. Obtain approximate location information of the current sound source according to the time difference information and location information of multiple microphones;

[0050] S12. Perform the first sound source tracking control on the camera according to the approximate position information, so as to collect vid...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a microphone array sound source positioning method, device and system based on video tracking. The method comprises the steps that the time difference information of a number of microphones which acquire current speech in a microphone array is counted; according to the time difference information and the position information of a number of microphones, the approximate position information of a current sound source is acquired; according to the approximate position information, sound source tracking control of the first time is carried out on a camera, so as to carry out video acquiring and human face detection; and according to a human face detection result, sound source tracking control of the second time is carried out on the camera, so that a human face image of a current spokesman is placed at an intermediate position of a current video image. According to the invention, when a user uses a television conference system, without manual control on the camera, the camera can automatically carry out accurate video positioning and tracking on the spokesman; and due to the fact that human face identification is combined, the accuracy of sound source positioning can be further improved.

Description

technical field [0001] The present invention relates to the technical field of video conferencing, in particular to a video tracking-based microphone array sound source localization method, device and system. Background technique [0002] A current commercial multimedia video conferencing system includes a camera for collecting video images of a meeting place, a microphone array for collecting audio signals of a speaker, and a display device for playing the video images of a current meeting place. During the meeting, in order to better enable the participants to understand the situation of the current speaker in more detail, it is usually necessary to point the camera arranged at the venue at the current speaker, and collect and play the actual speech of the speaker in real time. [0003] At present, the application of sound source localization technology is very extensive. In multimedia video conferencing, the position and direction angle of the sound source can be estimate...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N7/15G06K9/00H04R3/00
Inventor 孙涛
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap