463 results about "Sound source location" patented technology

A tinnitus masking system for use by a person having tinnitus The system comprises a sound delivery system having left and right ear-level audio delivery devices and is configured to deliver a masking sound to the person via the audio delivery devices such that the masking sound appears to originate from a virtual sound source location that substantially corresponds to the spatial location in 3D auditory space of the source of the tinnitus as perceived by the person. The masking sound being represented by left and right audio signals that are converted to audible sound by the respective audio delivery devices.

A device for generating a binaural signal based on a multi-channel signal representing a plurality of channels and intended for reproduction by a speaker configuration having a virtual sound source position associated to each channel, is described. It includes a correlation reducer for differently processing, and thereby reducing a correlation between, at least one of a left and a right channel of the plurality of channels, a front and a rear channel of the plurality of channels, and a center and a non-center channel of the plurality of channels, in order to obtain an inter-similarity reduced set of channels; a plurality of directional filters, a first mixer for mixing outputs of the directional filters modeling the acoustic transmission to the first ear canal of the listener, and a second mixer for mixing outputs of the directional filters modeling the acoustic transmission to the second ear canal of the listener. According to another aspect, a center level reduction for forming the downmix for a room processor is performed. According to even another aspect, an inter-similarity decreasing set of head-related transfer functions is formed.

A method and apparatus for enabling an improved experience by better matching of the auditory space to the visual space in video viewing applications such as those that may be used in video teleconferencing systems using window-based displays. In particular, in accordance with certain illustrative embodiments of the present invention, one or more desired sound source locations are determined based on a location of a window in a video teleconference display device (which may, for example, comprise the image of a teleconference participant within the given window), and a plurality of audio signals which accurately locate the sound sources at the desired sound source locations (based on the location of the given window in the display) are advantageously generated.

A method and apparatus for discriminating sound sources from a mixed sound is provided. The method includes separating sound source signals from a mixed sound signal including a plurality of sound source signals that are input through a microphone array, estimating a transfer function of a mixing channel mixing the plurality of sound source signals from relationships between the mixed sound signal and the separated sound source signals, obtaining input signals of the microphone array by multiplying the estimated transfer function by the separated sound source signals, and calculating location information of each sound source using a predetermined sound source location estimation method based on the obtained input signals.

To measure an accurate positional relationship between an ultrasonic tag and a microphone and identify a sound source position, even if an object is present between the ultrasonic tag and the microphone. When a radio transmission unit transmits a radio wave, an ultrasonic wave transmission unit of an ultrasonic tag receives it and transmits an ultrasonic wave. Then, a plurality of microphones in an ultrasonic wave reception array unit receive the ultrasonic wave. A propagation time calculation unit calculates a time from when the radio wave is transmitted by the radio transmission unit till when an ultrasonic wave reaches each of the microphones in the ultrasonic wave reception array unit. A position estimation unit calculates the position (sound source) of the ultrasonic tag according to the arrival time at each of the microphones and the result of object detection while considering reflection of the ultrasonic wave.

The invention discloses a sound source positioning system based on a distributed microphone array, and the system comprises a preprocessing unit which carries out the frame dividing of a signal according to an initial audio signal collected by a microphone subarray, analyzes and calculates the short-time energy of each frame of the audio signal, obtains the noise frame and voice frame in an audio frame sequence, and obtains the signal to noise ratio of the audio frame sequence; a subarray selection unit which analyzes the direct-reverse ratio (DRR) of the signal received by each subarray of the microphone array, and selects the microphone subarray with the DRR being greater than a threshold value; a time delay calculation unit; a sound source positioning unit which carries out the pre-estimation of the position of the sound source according to the time delay of each microphone pair, and obtains a rough positioning module of a sound source space U; a precise positioning module which carries out the searching in the sound source space U, and obtains the maximum point of the improved controllable response power in the sound source space U. The system analyzes the positioning result of the plurality of microphone subarrays, and finally determines the position of the sound source through consistency processing.

The embodiment of the invention discloses a field intelligent video monitoring method with sound acquisition and recognition fused, device and system. Sound data acquired by microphones arranged at different positions in the field are acquired; the sound data are preprocessed and stored; video data acquired by cameras arranged at different positions in the field are acquired; the video data are stored; a sound whose amplitude exceeds a set threshold is subjected to sound source positioning, the sound whose amplitude exceeds the set threshold is subjected to feature extraction, the sound is recognized according to the extracted features, and whether to be an abnormal sound in the field is judged; if yes, according to the sound source position of the abnormal sound, the photographing angle of the camera closest to the sound source position is adjusted; and the video data photographed by the camera with the angle adjusted are acquired, the abnormal sound and the video data at the positioncorresponding to the abnormal sound are fused and are recorded and stored, and an alarm signal is given at the same time.

The vehicle location detection device includes: a sound source location specifying unit which calculates an attenuation amount of a sound pressure of a vehicle sound by subtracting a sound pressure detected by a sound pressure detecting unit from a sound pressure indicated by vehicle sound pressure information stored in a sound pressure information storage unit, and specifies a location where another vehicle emitting a vehicle sound is predicted to be present, by specifying a sound source location of a sound diffracted by an obstacle which is specified by a diffraction location specifying unit and serves as a diffraction point, based on the calculated attenuation amount, a rule indicating an attenuation amount dependent on a propagation distance of the sound, and a relationship indicated by diffraction information stored in a diffraction information storage unit; and a presentation unit which presents the specified location.

A microphone array system (16) for sound acquisition from multiple sound sources in a reception space surrounding a microphone array (18) that is interfaced with a beamformer module (28) is disclosed. The microphone array (18) includes microphone transducers (22) that are arranged relative to each other in N-fold rotationally symmetry, and the beamformer includes beamformer weights that are associated with one of a plurality of spatial reception sectors corresponding to the N-fold rotational symmetry of the microphone array (18). Microphone indexes of the microphone transducers (18) are arithmetically displaceable angularly about the vertical axis during a process cycle, so that a same set of beamformer weights is used selectively for calculating a beamformer output signal associated with any one of the spatial reception sectors. A sound source location module (30) is also disclosed that includes a modified steered power response sound source location method. A post filter module (32) for a microphone array system is also disclosed.

A system and process for tracking an object state over time using particle filter sensor fusion and a plurality of logical sensor modules is presented. This new fusion framework combines both the bottom-up and top-down approaches to sensor fusion to probabilistically fuse multiple sensing modalities. At the lower level, individual vision and audio trackers can be designed to generate effective proposals for the fuser. At the higher level, the fuser performs reliable tracking by verifying hypotheses over multiple likelihood models from multiple cues. Different from the traditional fusion algorithms, the present framework is a closed-loop system where the fuser and trackers coordinate their tracking information. Furthermore, to handle non-stationary situations, the present framework evaluates the performance of the individual trackers and dynamically updates their object states. A real-time speaker tracking system based on the proposed framework is feasible by fusing object contour, color and sound source location.

Sound and image are sampled simultaneously using a sound / image sampling unit incorporating a plurality of microphones and a camera. Sound pressure waveform data and image data are stored in a storage means. Then the sound pressure waveform data are extracted from the storage means, and a graph of a time-series waveform of the sound pressure level is displayed on a display screen. A time point at which to carry out a calculation to estimate sound direction is designated on the graph, and then sound direction is estimated by calculating the phase differences between the sound pressure signals of the sound sampled by the microphones, using the sound pressure waveform data for a calculation time length having the time point at the center thereof. A sound source position estimation image having a graphic indicating an estimated sound direction is created and displayed by combining the estimated sound direction and the image data sampled at the time point.

In order to locate and display the source of a sound such as a noise at a factory or the like accurately even when it is outside, a pair of microphones (M1, M3) and another pair of microphones (M2, M4) are disposed on the X axis and Y axis with a distance L therebetween, respectively, the direction of the sound source is estimated from a difference between sound arrival times to the microphones (M1, M3) and a difference between sound arrival times to the microphones (M2, M4), an image around the estimated location of the sound source is picked up by a camera, and the above estimated location of the sound source is displayed on the above image displayed on the display of a personal computer.

The invention belongs to the fields of measurement and wireless communication, disclosing a sound localization-based wireless measuring method. Firstly, a plurality of wireless acoustic sensors are arranged in a designated area; the coordinates of the sensors are confirmed, and one of the wireless sensors is used as a data aggregation and processing point; a positioning method by means of receiving a signal energy is adopted to localize the sound; a plurality of wireless acoustic sensors are used for measuring a sound signal sent by a target; and a plurality of the most suitable sensors are selected to participate into the sound localization according to a measured sound signal intensity so as to localize the sound by the positioning method by means of receiving the signal energy. In order to overcome the influence of noise and heterogeneity of a medium and to improve positioning accuracy, the problem of an equation set solution is changed into an optimization problem; and a steepest descent method is adopted to search the location of the sound so as to realize the sound localization. A sound localization system established by the invention has the advantages of convenient arrangement and strong adaptability, thereby especially being applied to the positioning of a military vehicle in an outdoor battlefield and an occasion such as an emergency treatment.

The embodiment of the invention discloses a sound-source location method and system e. A basic collection device is positioned on at least two locations in a plane; the basic collection device collects a group of audio signals from the sound source at each location; the plane is the common plane where both the basic collection device and the sound source are arranged; the estimated location of a group of sound source is calculated according to the collected each group of audio signals; the actual location of the sound source is calculated according to the estimated location of the sound source which is convergent to the same point. The audio signals are collected through changing the location of the basic collection device; the actual location of the sound source is calculated according to the collected multiple groups of audio signals; the invention completes the location of the sound source which is realized in the current technology by using at least two basic collection devices; the invention improves the utilization efficiency of the basic collection device.

An electronic device includes processing circuitry configured to produce an audio sound from a virtual sound source position. The circuitry also acquires from a user-input a sound position information of a perceived sound source position, and then controls an enable or disable of a function of the electronic device based on a relationship between the virtual sound source position and the perceived sound source position.

The invention discloses a passive sound source two-dimensional DOA (direction of arrival) estimation method under a complex environment, comprising the steps that (1) voice signals in a room are collected by a uniform circular array; (2) the voice signals received by the uniform microphone array are preprocessed in a spectral subtraction method; (3) an M_AEDA algorithm is adopted to estimate the relative time delay of each microphone; (4) a direction coefficient vector is determined according to a direction coefficient formula; (5) the direction coefficient vector and the voice signals preprocessed in the step (2) are correspondingly multiplied to serve as an input signal for minimum variance undistorted response; (6) an minimum variance undistorted response algorithm is adopted to process the input signal; and (7) the output average power is subjected to spectrum peak search, and the estimation value of the sound source two-dimensional DOA is obtained accordingly. The passive sound source two-dimensional DOA (direction of arrival) estimation method under the complex environment has the advantages that the sound source can be accurately located under a reverberation and low signal-to-noise ratio environment; during sound source location, the location accuracy and accuracy rate are high; and the required equipment is simple, the passive sound source two-dimensional DOA estimation method can be applicable to real life in the aspects of video conference, robots and the like.

The invention relates to a sound source localization method and a sound source localization device. The method comprises the following steps of: converting a sound source signal received by a microphone array into a digital sound signal, wherein a plurality of microphones are included in the microphone array; performing frequency spectrum extraction and whitening treatment on the digital sound signal to obtain whitened frequency spectrum of the digital sound signal of each microphone; calculating a first value of a sound source position according to the whitened frequency spectrum of the digital sound signal of each microphone; giving a weight coefficient for each pair of crossed correlation functions in controllable response power calculation according to the first value of the sound source position; calculating a second value of the sound source position according to the weight coefficient; and comparing the first value of the sound source position with the second value of the sound source position and determining a final sound source position according to a comparison result. According to the method, by giving the weight coefficient for each pair of crossed correlation functions in the controllable response power calculation, the influence of unreliable crossed correlation functions on the final location result can be weakened, so that the robustness of the sound source location is improved.

The invention relates to an intelligent video director method based on microphone array sound guidance, belonging to the field of intelligent technology. The method comprises the following steps of: photographing several positions of a space / region by the user and taking the photos as demonstrations and memorizing the photos in a training set; collecting the sound in the space / region by a microphone array; analyzing the audio data of each microphone by a sound source localization method to locate the positions of the sound source; referring to the training set to calculate the photographing parameters of the camera / high-speed balls corresponding to the positions of the sound source by a K-neighbor method; and guiding the camera to photograph by the given parameters. The method can alternatively capture corresponding target videos automatically, needs not to measure or collate the position of the camera, and has excellent adaptability to the environment; the specified range GCC-PHAT time delay computation method and the least square method position-computation method adopted by the method have a certain immunity to the noise interference so that the method can inhibit the interference of the corresponding noise well.

The embodiment of the invention provides a method and electronic equipment for recognizing orientation and identification, and relates to the field of computers. The method and electronic equipment for recognizing the orientation and the identification can improve the precision of recognition on a speaker, improve the efficiency of the recognition, and achieve real-time feedback. According to the method, a first orientation collection of sound sources is obtained firstly through sound source location, a second orientation collection of the sound sources is then obtained by locating people with lip actions, an identification collection of the people with the lip actions is obtained, then a third orientation collection containing the orientation information of the speakers is obtained according to the first orientation collection and the second orientation collection, and finally the orientation and the identification of the speaker is determined according to the third orientation collection and the identification collection. The method and electronic equipment for recognizing the orientation and the identification are applied to locating of the sound sources and the recognition of the sound source identification.

The invention relates to a hearing aid device and method, in particular to the hearing aid device and method for separating and positioning sound sources in noise environments. The hearing aid device comprises a microphone array, a sound source position displayer, a sound source separating and positioning module, a signal collector, an analog signal amplifier and a sound source selection keyboard. The sound source separating and positioning module adopts a cross-correlation method to process the collected microphone signals to obtain eight initial positions of the sound sources relative to the microphone array, the collected microphone signals are processed through a blind source separation method based on space search to obtain sound sources containing voices of a talker and other persons, a user selects out the sound sources containing voices of the talker through the sound source selection keyboard and computes the accurate position of the talker relative to the microphone array according to the selected sound source, and the position of the sound source is displayed in the sound source position displayer. By means of the hearing aid device and method, voice signals of two persons involving in the conversations in the noise environments can be separated automatically, and a positioning function of a sound signal source is added. Furthermore, the hearing aid device and method for separating and positioning sound sources in noise environments are convenient to use.

Disclosed are an apparatus and a method for tracking locations of a plurality of sound sources. According to the apparatus and the method, a task for searching sound source candidates is repeated at respective predetermined frames of microphone signals to collect sound source candidates, and only the collected sound source candidates are verified through beamforming, thereby more rapidly and accurately tracking the plurality of sound sources in spite of using a small number of microphones.

A sound source location is estimated by particle filtering where a set of particles represents a probability density function for a state variable comprising the sound source location. The method includes determining the weight for a particle in response to a correlation between estimated acoustic transfer functions from the sound source to at least two sound recording positions. A weight update function may specifically be determined deterministically from the correlation and thus the correlation may be used as a pseudo-likelihood function for the measurement function of the particle filtering. The acoustic transfer functions may be determined from an audio beamforming towards the sound source. The audio weight may be combined with a video weight to generate a multi-modal particle filtering approach.

An acoustic source location technique compares the time response of signals from two or more pairs of microphones. For each pair of microphones, a plurality of sample elements are calculated that correspond to a ranking of possible time delay offsets for the two acoustic signals received by the pair of microphones, with each sample element having a delay time and a sample value. Each sample element is mapped to a sub-surface of potential acoustic source locations and assigned the sample value. A weighted value is calculated on each cell of a common boundary surface by combining the values of the plurality of sub-surfaces proximate the cell to form a weighted surface with the weighted value assigned to each cell interpreted as being indicative that a bearing vector to the acoustic source passes through the cell.

The invention relates to an electronic traffic police system which comprises a whistle sound acquisition unit, a whistle sound recognition unit, a whistle sound source location unit, a position measurement unit, a whistle sound source tracking unit, an image acquisition unit and a license plate recognition unit, wherein the whistle sound acquisition unit, the whistle sound recognition unit, the whistle sound source location unit, the position measurement unit, the whistle sound source tracking unit, the image acquisition unit and the license plate recognition unit are based on a microphone array and are successively connected. The whistle sound source tracking unit and the license plate recognition unit are connected with a central control unit. According to the invention, coordinate measuring is carried out on the whistle sound source location information and the license plate location information of a vehicle; the sound source coordinate information acquired by the whistle sound source tracking unit is transmitted to an image acquisition system; license plate capturing is carried out in a designated range, which reduces the hardware storage pressure and improves the processing efficiency of the system; by increasing a weight searched in the designated area, the whistle sound source positioning accuracy can be effectively improved; considering the timing correlation characteristic of a whistle signal, a whistle sound source is tracked in real time; the processing speed is fast; and vehicle violation information is sent to a traffic management department in real time.

The invention discloses a sound source positioning following system and method based on a microphone array, and the system comprises a signal receiving module, an AD sampling circuit, a signal preprocessing module, an algorithm processing module, and an output module. The signal receiving module is the microphone array, and is used for obtaining the voice signal transmitted to each microphone from the sound source. The AD sampling circuit is used for obtaining the voice sampling signals of all microphones. The signal preprocessing module is used for the preprocessing of the voice sampling signals. The algorithm processing module is used for calculating the position of the sound source according to the voice sampling signals. The output module is used for outputting the position information of the sound source. The system builds the wireless communication through a Bluetooth, obtains the sound source signals, determines the position of the sound source signals, and can achieve the real-time positioning and following of a walking device. The system can accurately locate the sound source under the condition that the walking device follows at a short distance, is high in instantaneity, is simple in algorithm, and is easy to implement.

Method and apparatus for locating and quantifying sound sources using an array of acoustic vector probes (200). Signals received at the probes are converted to digital form and fed into a digital signal processor (400) which computes the sound pressure and the sound-intensity vector at each probe. The set of sound-intensity vectors measured by the array provides a set of directions to a sound source (100) whose approximate spatial coordinates are determined using a least-squares triangulation formula. The sound-intensity vectors also determine sound-power flow from the source. In addition sound pressure measured by the probes can be phased to form a sensitivity beam (250) for scanning a source. Sound-intensity measurements made concurrently can be used to determine the spatial coordinates of the part being scanned and the sound power radiated by that part. Results are displayed on a computer screen or other device (500) permitting an operator to interact with and control the apparatus. Additional related features and methods are disclosed.

The invention provides a robustness sound source space positioning method of a distributed microphone array network. The method comprises the steps of: constructing a three-dimensional spatial coordinate system, estimating an arriving time difference and reducing reverberation interference, estimating a sound source position, and finally determining the sound source position. According to the invention, two microphone arrays are used for determining three-dimensional spatial coordinates, and time delay information in the microphone array network is fully utilized for reducing interference caused by indoor reverberation; and a spatial coordinate area is divided, and the spatial position of a sound source is finally determined by means of twice estimation. The robustness sound source space positioning method has the advantages that the performance and the calculation cost are superior to an existing technology, the application is wide, the structure is simple, the cost is low, and the method is applicable to intelligent household and intelligent monitoring scenes utilizing the distributed microphone array network.

The invention provides a method for locating sound and a system thereof, wherein the method comprises the following steps: firstly, a display device receives sound signals, analyzes horizontal position information and vertical position information of a main sound source according to the main sound source location information in the sound signals, secondly, the display device selects one loudspeaker to sound from two or more than two loudspeakers arranged on the upper portion of the display plane of the display device or two or more than two loudspeakers on the lower portion of the display plane according to the horizontal location information of the main sound source, and selects one of the loudspeaker to sound from two or more than two loudspeakers arranged on the left portion of the display plane or two or more than two loudspeakers arranged on the right portion of the display plane of the display device according to the vertical location information of the main sound source.

The invention provides a sound-based method and apparatus for generating an AR content and a storage medium. The method comprises: step 11, acquiring real-time voice data in a current AR environment;S131, determining whether the real-time voice data include a speaker; and if so, converting a speech content of the speaker in the real-time voice data into a text and extracting key semantic information; S132, extracting an artificial non-speaking sound or natural sound in the real-time voice data; S133, locating sound source locations of the speaker and the artificial non-speaking voice or natural sound; S15, carrying out scene matching based on the key semantic information and artificial non-speaking voice or natural sound; and S17, generating an AR content according to the key semantic information, the sound source locations, the scene or a real scene image in the AR environment and displaying the AR content. With the method provided by the invention, the AR content can be dynamicallygenerated based on the input voice and the AR intelligent display of the auditory information can be realized; and thus the convenient and intelligent services and experience can be provided for users.