Integrated sensor based on microphone array and stereoscopic vision

A microphone array and integrated sensor technology, applied in the field of integrated sensors, can solve the problems of high processor requirements, reduced real-time tracking of sound sources, large time complexity and large space complexity, etc.

Active Publication Date: 2017-11-07
JILIN UNIV
View PDF7 Cites 37 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The audio processing involved in the above-mentioned patents is used to track the sound source by continuously scanning the space (or calculating the correlation) in continuous time, which has high time and space complexity, high requirements on the processor, and reduces the sound quality. The real-time nature of source tr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Integrated sensor based on microphone array and stereoscopic vision
  • Integrated sensor based on microphone array and stereoscopic vision
  • Integrated sensor based on microphone array and stereoscopic vision

Examples

Experimental program
Comparison scheme
Effect test

Embodiment example

[0143] This patent covers a lot of content, complex logical composition, and diverse functions. It is suitable for various collection scenarios, such as meeting records, remote communication, artificial intelligence and equipment, etc. We can apply some or all of its functions, which is flexible and convenient to use. Since there are many applicable scenarios, it is impossible to cover them one by one. Here, video conferencing is used as an example to illustrate.

[0144] The equipment is easy to install and can be directly hung under the ceiling or supported by a bracket. It should be arranged reasonably according to the actual situation, and the height can be adjusted according to the needs.

[0145] For ease of description, the figure 1 The simplified hardware diagram of the integrated sensor is shown as an example. Construct a coordinate system, the origin is the camera device, and the coordinate axes pass through the four microphones respectively.

[0146] After the dev...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an integrated sensor based on a microphone array and stereoscopic vision. The integrated sensor comprises a hardware system and a control system. The hardware system comprises the microphone array and a stereoscopic vision device. The microphone array is responsible for receiving audio information in an environment and generating multichannel analog audios. The stereoscopic vision device is responsible for collecting environment images. The control system comprises an audio working area, a video working area and a video/audio synthesis working area. The audio working area is responsible for denoising audios, positioning audio sources, and tracking the audio sources (through audio processing). The video working area is responsible for positioning and tracking target audio sources, namely calibrating, positioning and precisely tracking the target audio sources through image processing and image identification. The video/audio synthesis working area is responsible for enhancing audio signals (improving a signal-to-noise ratio of the audio signals) and obtaining and outputting an integrated signal of the video/audio signals.

Description

technical field [0001] The invention mainly relates to an integrated sensor based on a microphone array and stereo vision, in particular to a sound source positioning and tracking technology based on a microphone array and stereo vision, belonging to the field of integrated sensors. Background technique [0002] In today's era, to record events, scenes, etc., audio and video are undoubtedly the most reductive methods; with the rapid development of Internet technology, more and more communication between people is carried out through the Internet, such as video conferencing . However, in the face of the complex sound field environment and the unpredictable position of the sound source, the traditional audio collection and video recording methods are facing major challenges. The sound field contains not only the target sound source, but also other interference sound sources; therefore, the collected sound includes not only the sound of the target sound source, but also enviro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N13/02H04S5/00H04W4/02H04N7/15H04N5/232G10L25/24G10L21/0208G10L21/02
CPCH04N7/15H04N13/204H04S5/005H04W4/02G10L21/02G10L21/0208G10L25/24H04N23/80
Inventor 王建华丁录国赵洁何珺王新群陈宇彬周乃鹏
Owner JILIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap