Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method, system, device and storage medium for microphone array outputting sound source

A microphone array and sound source technology, applied in the direction of microphone signal combination, sensor components, sensors, etc., can solve the problem that audio data cannot be used directly, achieve the effect of improving efficiency and resource utilization, and avoiding post-processing

Active Publication Date: 2022-06-07
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the present invention is to overcome the defect in the prior art that the multiple audio data of multiple sound sources output by the open source project of the microphone array cannot be directly used in the embedded device with limited resources, and provide a method suitable for resource Method, system, device and storage medium for outputting sound source by microphone array of limited embedded device

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, system, device and storage medium for microphone array outputting sound source
  • Method, system, device and storage medium for microphone array outputting sound source
  • Method, system, device and storage medium for microphone array outputting sound source

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0074] like figure 1 As shown, this embodiment provides a method for outputting sound sources from a microphone array, where there are multiple sound sources, and the method includes the following steps:

[0075] Step 101: Obtain the spectrum data of the current frame of each of the sound sources, the current frame includes several frequency points, and the number of intermediate frequency points in this embodiment is 128;

[0076] Step 102, respectively calculating the energy of each frequency point of the current frame of each of the sound sources;

[0077] Step 103: Calculate the energy sum of all frequency points of the current frame of each of the sound sources according to the energy of the respective frequency points;

[0078] Step 104, compare the energy sum of all the sound sources, and determine that the sound source with the maximum energy sum is the sound source to be output;

[0079] Step 105: Output the spectrum data of the current frame of the sound source to ...

Embodiment 2

[0083] like figure 2 As shown, this embodiment provides a method for outputting sound sources from a microphone array, where there are multiple sound sources, and the method includes the following steps:

[0084] Step 200, setting the value of the parameter preset time window;

[0085] Step 201, using ManyEars to obtain the spectral data of each frame of each of the sound sources, and each frame includes M frequency points, where M is a positive integer, and in this embodiment, M is 512;

[0086] Step 202: Calculate the energy of each frequency point of each frame of each of the sound sources, and the calculation formula is:

[0087] power ik =real ik *real ik +imag ik *imag ik ;

[0088] Among them, i represents the ith sound source, k represents the kth frequency point, 0ik Represents the real part of the kth frequency point of the spectral data of the current frame of the ith sound source, imag ik represents the imaginary part of the kth frequency point of the spec...

Embodiment 3

[0103] like image 3 As shown, this embodiment provides a system for outputting sound sources from a microphone array, the sound sources are multiple, and the system includes: an acquisition module 1 , a first calculation module 2 , a first comparison module 3 and an output module 4 .

[0104] The acquisition module 1 is configured to acquire spectrum data of the current frame of each sound source, where the current frame includes several frequency points.

[0105] The first calculation module 2 includes a second calculation module 21 and a third calculation module 22, and the second calculation module 21 is used to calculate the energy of each frequency point of the current frame of each of the sound sources; The third calculation module 22 is configured to calculate the energy sum of all frequency points of the current frame of each of the sound sources according to the energy of the respective frequency points.

[0106] The first comparison module 3 is configured to compa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method, system, device and storage medium for outputting a sound source by a microphone array. There are multiple sound sources. The method includes: acquiring the spectrum data of each of the sound sources; The energy sum of each of the sound sources; comparing the energy sum of all the sound sources, determining that the energy and the largest sound source is the sound source to be output; outputting the spectrum of the sound source to be output data. The method, system, device and storage medium for microphone array output sound source provided by the present invention calculate the energy sum of each sound source spectrum data, and then compare to determine the energy and the largest sound source as the final sound source to be output. , thus providing a single-channel audio input solution for some embedded devices with limited resources, which solves the problem of embedding multiple audio data from multiple sound sources output by the open source project of the microphone array in the prior art with limited resources. Problems that cannot be directly used in standard equipment.

Description

technical field [0001] The present invention relates to the field of microphone array output control, in particular to a method, system, device and storage medium for outputting a sound source from a microphone array. Background technique [0002] Microphone array-related technologies include sound source localization, tracking, separation, and post-filtering. At present, there are open source projects that are relatively mature. Existing open-source projects can track and separate multiple sound sources, and separate each sound source after post-filtering. The output is the corresponding audio file, for example, if there are 4 sound sources, 4 audio files are output. [0003] If you need to use the output of an open source project for applications such as keyword recognition or speech recognition, you need to output one channel of audio, or you need to process corresponding applications such as keyword recognition or speech recognition in multiple threads. In some embedded...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04R3/00
CPCH04R3/005
Inventor 杨楠
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products