281 results about "Sound localization" patented technology

A method is provided, including the following method operations: receiving captured images of an interactive environment in which a head-mounted display (HMD) is disposed; receiving inertial data processed from at least one inertial sensor of the HMD; analyzing the captured images and the inertial data to determine a current and predicted future location of the HMD; using the predicted future location of the HMD to adjust a beamforming direction of an RF transceiver towards the predicted future location of the HMD; tracking a gaze of a user of the HMD; generating image data depicting a view of a virtual environment for the HMD, wherein regions of the view are differentially rendered; generating audio data depicting sounds from the virtual environment, the audio data being configured to enable localization of the sounds by the user; transmitting the image data and the audio data via the RF transceiver to the HMD.

A method and apparatus for processing an audio sound source to create four-dimensional spatialized sound. A virtual sound source may be moved along a path in three-dimensional space over a specified time period to achieve four-dimensional sound localization. A binaural filter for a desired spatial point is applied to the audio waveform to yield a spatialized waveform that, when the spatialized waveform is played from a pair of speakers, the sound appears to emanate from the chosen spatial point instead of the speakers. A binaural filter for a spatial point is simulated by interpolating nearest neighbor binaural filters chosen from a plurality of pre-defined binaural filters. The audio waveform may be processed digitally in overlapping blocks of data using a Short-Time Fourier transform. The localized sound may be further processed for Doppler shift and room simulation.

Methods and apparatus are disclosed for processing an audio sound source to create four-dimensional spatialized sound. A virtual sound source may be moved along a path in three-dimensional space over a specified time period to achieve four-dimensional sound localization. The various embodiments described herein provide methods and systems for converting existing mono, 2-channel and / or multi-channel audio signals into spatialized audio signals have two or more audio channels. The incoming audio signals may be down-mixed, up-mixed or otherwise translated into fewer, greater or the same number of audio channels. The various embodiments also describe methods, systems and apparatus for generating low frequency effect and center channel signals from incoming audio signals having one or more channels.

This invention is a method for binaural localization using a cascade of resonators and anti-resonators to implement an HRTF (head-related transfer function). The spectrum of the cascade reproduces the magnitude spectrum of a desired HRTF. The proposed method provides a considerably more computationally efficient implementation of HRTF filters with no detectable deterioration of output quality while saving memory when storing a large quantity of HRTFs due to the parameterization of its resonators and anti-resonators. Finally, the method offers additional flexibility since the resonators and anti-resonators can be manipulated individually during the design process, making it possible to interpolate smoothly between HRTFs, reduce spectral coloring or achieve higher accuracy at perceptually relevant frequency regions. These HRTF are useful in stereo enhancement and multi-channel virtual surround simulation.

The present disclosure relates to a display device for generating sound by directly vibrating a display panel thereof, which includes a display panel connected to a surface of the display panel and configured to display an image; and a sound generating actuator, which is fixed to a support structure of the display panel and attached to the display panel to directly vibrate the display panel. In the display device, the progressing direction of the sound coincides with the image output direction in the display device. Therefore, sound localization or sound output characteristics of the display device or set apparatus can be improved, and a separate speaker is not required, the mechanism of the set apparatus can be easily designed, and a thickness thereof can be easily reduced.

A method for positioning the location of sound source is disclosed that includes steps: the receiving device receives the sound signal generated by the sound source; provisional estimates the time difference of said sound signals reaching the receiving device; provisional estimates the receiving device separately receives the energy ratio of said sound signals; ascertains the location of the sound source by the time difference and the energy ratio. The method of double micro sound localization is compared to people's double ears position mechanism; the position is located by the sound energy and the time-delay information simultaneously, it can reach the aim of reducing the number of matrix element, and doesn't need to send and receive the type-specific reference signal.

A method provides binaural sound to a person through electronic earphones. The binaural sound localizes to a sound localization point (SLP) in empty space that is away from but proximate to the person. When an event occurs, the binaural sound switches or changes to stereo sound, to mono sound, or to altered binaural sound.

A headphone apparatus is presented so that a sound image of game sound outputted from an on-line game machine having a communication function is localized at one or more positions out of the head of the listener wearing a headphone while a sound image of an opponent player's voice outputted from the game machine is localized at a position in the head of the listener.

A method for sound source localization in a digital system having at least two audio capture devices is provided that includes receiving audio signals from the two audio capture devices, computing a signal-to-noise ratio (SNR) for each frequency band of a plurality of frequency bands in a processing frame of the audio signals, determining a frequency band weight for each frequency band of the plurality of frequency bands based on the SNR computed for the frequency band, computing an estimated time delay of arrival (TDOA) of sound for the processing frame using the frequency band weights, and converting the estimated TDOA to an angle representing sound direction.

Provided is a method for canceling background noise of a sound source other than a target direction sound source in order to realize highly accurate speech recognition, and a system using the same. In terms of directional characteristics of a microphone array, due to a capability of approximating a power distribution of each angle of each of possible various sound source directions by use of a sum of coefficient multiples of a base form angle power distribution of a target sound source measured beforehand by base form angle by using a base form sound, and power distribution of a non-directional background sound by base form, only a component of the target sound source direction is extracted at a noise suppression part. In addition, when the target sound source direction is unknown, at a sound source localization part, a distribution for minimizing the approximate residual is selected from base form angle power distributions of various sound source directions to assume a target sound source direction. Further, maximum likelihood estimation is executed by using voice data of the component of the sound source direction passed through these processes, and a voice model obtained by predetermined modeling of the voice data, and speech recognition is carried out based on an obtained assumption value.

The invention relates to a driver sound localization system and method for an automobile. The system comprises a first sound collecting device, a second sound collecting device and a control system, wherein the first sound collecting device and the second sound collecting device are used for collecting a first sound signal and a second sound signal; the control system is used for respectively processing the first sound signal and the second sound signal so as to output driver locating information; and the control system further comprises a noise reduction device, a filtering device, a sound activation detecting device, a long frame framing device, an envelope calculating device and an energy ratio calculating device and used for calculating the envelope energy ratio of the first and second sound signals according to the calculation results of the envelope calculating device and the long frame framing device. The driver sound localization system and method for the automobile have the advantages of relatively low cost and high locating accuracy and real-time performance.

The invention provides a sound localization-based video monitoring system. In the system, two or more microphones which face towards different directions in a plane or space serve as sound acquisition devices for acquiring sound; relative positions of the respective microphones in the acquisition devices are fixed, and are distinguished by labels; the spatial position of a sound source can be solely confirmed according to the time difference of acquiring the sound of different microphones and the difference of sound intensities; and a camera can be controlled to rotate to find a target and to track and photograph the target according to the position information. As the temperature has an influence on the propagation velocity of the sound, a correction can be provided for the system according to an acquired temperature value, so that the accuracy of the system is improved.

The embodiment of the invention discloses a sound-source location method and system e. A basic collection device is positioned on at least two locations in a plane; the basic collection device collects a group of audio signals from the sound source at each location; the plane is the common plane where both the basic collection device and the sound source are arranged; the estimated location of a group of sound source is calculated according to the collected each group of audio signals; the actual location of the sound source is calculated according to the estimated location of the sound source which is convergent to the same point. The audio signals are collected through changing the location of the basic collection device; the actual location of the sound source is calculated according to the collected multiple groups of audio signals; the invention completes the location of the sound source which is realized in the current technology by using at least two basic collection devices; the invention improves the utilization efficiency of the basic collection device.

A headphone apparatus is presented so that a sound image of game sound outputted from an on-line game machine having a communication function is localized at one or more positions out of the head of the listener wearing a headphone while a sound image of an opponent player's voice outputted from the game machine is localized at a position in the head of the listener.

The invention relates to a voice recognition method and method based on sound source localization and an intelligent household appliance. The voice recognition method comprises the following steps of: when the intelligent household appliance enters a voice recognition state, acquiring a voice signal, and controlling a timer to start timing; if the voice signal is acquired when the time recorded by the timer is less than or equal to a preset time, performing location according to the voice signal, and determining position information a sound source corresponding to the voice signal; and determining whether to control the intelligent household appliance to perform recognition of the voice signal or not according to the position information and prestored voice recognition area information, thereby removing interferential voice signals, effectively improving recognition rate of the voice recognition system, and promoting interactive experience of a user.

The invention is suitable for the field of traveling shoot, and provides a shoot control method and a shoot control device. The method comprises the following steps of: receiving sound information and identifying a sound made by a shot object; positioning the shot object according to the sound made by the shot object; and automatically zooming according to the position of the shot object, and shooting the shot object. According to the method, the distance position of the shot object is judged by receiving the sound of the shot object, the need of performing zooming processing is judged according to the distance position of the shot object, and automatic zooming processing is performed under the condition that zooming processing is needed, so that the shot object is positioned at the shooting zooming position of a lens in a shooting process, a user does not need to zoom manually, and complex zooming operation is avoided; and meanwhile, rapid judgment and accurate zooming can be performed by zooming according to sounds.

A sound source localization system and a sound source localization method. The sound source localization system includes sound capturing devices and an arithmetic unit. The sound capturing devices sense a sound source to output time domain signals. The arithmetic unit transforms the time domain signals into frequency domain signals, performs a cross spectrum process according to the frequency domain signals to determine time differences of arrival, and locates the sound source according to the time differences of arrival and locations of the sound capturing devices.

The invention relates to an adaptive microphone array sound positioning rescue robot and a using method thereof. A robot comprises a vehicle body having a running mechanism, a main control unit on the vehicle body and connected with a running driving motor, an obstacle avoiding module and a sound positioning module, wherein the obstacle avoidance module is three sets of supersonic wave detectors, supersonic waves are respectively emitted from the right ahead portion, the front side portion and the front upper portion, an electric cylinder push rod end of the sound positioning module fixed on the vehicle body is equipped with a supporting block and a supporting board, the gear shaft penetrates through the supporting board of which upper and lower surfaces are respectively equipped with a gear and two tooth bar guide rods, and an outer end of each tooth bar guide rod is fixedly equipped with a microphone array element to form a cross array. According to the using method, the three sets of supersonic wave detectors are controlled by a main control unit to detect distances between obstacles and the vehicle body, height and array element separation distances of the microphone arrays are adaptively maintained to be the largest at the maximum degree, moreover, sound received by four array elements is analyzed, positioning on a help-seeking sound source is carried out to correct a navigation angle to approach the help-seeking sound source. Through the using method, a complex disaster site can be rapidly and safely reached, sound source positioning precision is high, and searching efficiency is high.

The invention discloses a sound localization method and device and electronic equipment. The method comprises the steps: obtaining a first image of a sound source at the first position through a camera; determining a first pixel size of an extension direction size scale of a reference portion of the sound source in the first image, wherein the extension direction size scale is a true size scale of the reference portion in the extension direction; obtaining a first camera distance between the first position and the reference position of the camera; determining a location mapping relationship according to the first pixel size and the first camera distance, wherein the location mapping relationship is applied to determining a second camera distance between a second position and the reference position of the camera according to a second pixel size of the extension direction size scale in a second image after the second image of the sound source at the second position is obtained through the camera. Therefore, the sound source can be accurately and completely located.

A method generates a sound localization point (SLP) where binaural sound externally localizes to a person during a telephone call. The method determines coordinates of a location of a handheld portable electronic device (HPED) with respect to the person and saves this location as the SLP. During the telephone call, a voice of another person is convolved so the voice externally localizes to the person as the binaural sound at the SLP.

The invention discloses a robot system based on intelligent sound localization and voice control, and a method. A robot body collects ambient voice information continuously, when a voice command occurs, sound localization is conducted, the robot body is controlled to move to the sound source position, the collected voice information is recognized, when effective sentences are recognized, a corresponding control command is sent to the robot body, and the robot body executes corresponding operation; and meanwhile, the effective sentences are converted into corresponding characters so that Chinese word segmentation can be carried out, an affective dictionary, a degree adverb dictionary, a negative word vocabulary and an associated word vocabulary are loaded, all affective characters in the sentences are identified, and a corresponding facial expression is displayed according to the identification result. Through the robot system based on intelligent sound localization and voice control, and the method, the interactive ability of a service robot with an accompanied person can be improved.

The invention relates to the technical field of special robot systems, in particular to a household security robot system based on wireless communication. The system comprises a robot body and an intelligent control terminal. The robot body is equipped with a mechanical arm and a camera. A base is arranged at the bottom of the robot body. A driving device, a storage battery, a main control unit, a data memory, a sensor unit, a wireless communication unit, a household control unit, an electric quantity detection device, a speech recognition device and an alarm are arranged on the base. A sensor unit comprises an obstacle avoiding sensor and a human body infrared sensor. The speech recognition device comprises a microphone and a sound positioning device. The security robot system has various functions, and is capable of achieving remote control, highly practical and suitable for promotion in the field.

The invention belongs to the electronic technology field and specifically relates to an intelligent environmental lifestyle trash can device. The intelligent trash can device comprises a central processing module, a sound acquiring module, a sound data storing module, a sound identifying module, a motor driving module, an obstacle avoiding device and a human body induction system. Voice commands of an user are acquired in real time by using the sound acquiring module and the sound identifying module, the voice commands are judged whether to exist through judgment and treatment of a central controller, if so, the commands are sent to the motor driving module through a central processing unit, and the motor driving module is moved towards a position where the voice commands are sent to the user. The voice commands of the user can be located and identified by the intelligent trash can device, the trash can automatically move towards the position where the commands are sent to the user when the correct voice commands are sent by the user, a barrier is automatically opened when the trash can encounters the barrier, and the trash can cover is automatically opened when the trash can reach the predetermined place, thus the disable people can conveniently throw garbage by the device.

The invention provides a multi-channel speech enhancement method based on semantic prior selective attention. The method comprises the following steps: picking speech signals from any directions in a reverberant environment by virtue of a multi-microphone array, collecting the multiple paths of speech signals and pre-processing the speech signals; detecting special activation words in the pre-processed speech signals by virtue of an activation word speech recognition model; processing signals which are not cut and include activation word segments, so as to obtain a complete activation word segment; analyzing the activation word segment by virtue of a multi-channel phase difference sound localization method based on reverberation robust, so as to obtain an acoustic wave reaching direction of a target sound source; and enhancing speech in the direction and inhibiting noise from other directions and room reverberation in a remote speak scene, so that enhanced speech in the target direction is obtained. The method provided by the invention is applicable to such occasions as intelligent household electrical appliance, smart home, vehicle-mounted and wearable devices and the like that remote speak type speech input and interaction are required, and the method is especially applicable to complex acoustic noise and interference environment occasions.

The embodiment of the application provides a robot sound localization method and a robot. A two-dimensional microphone array is arranged on the robot, and the method comprises the following steps: calculating a first sound energy value obtained by a first microphone according sound data collected by the first microphone and coming from a target sound source; calculating a second sound energy valueobtained by a second microphone according to sound data collected by the second microphone and coming from the target sound source; and determining the orientation interval of the target sound sourcerelative to the robot according to the energy ratio of the first sound energy value and the second sound energy value and the positional relationship between the first and second microphones. In theembodiment of the application, whether the target sound source is located in front of or at the back of the robot can be judged, and further the true position of the target sound source is accuratelylocalized.

A method and apparatus for processing an audio sound source to create four-dimensional spatialized sound. A virtual sound source may be moved along a path in three-dimensional space over a specified time period to achieve four-dimensional sound localization. A binaural filter for a desired spatial point is applied to the audio waveform to yield a spatialized waveform that, when the spatialized waveform is played from a pair of speakers, the sound appears to emanate from the chosen spatial point instead of the speakers. A binaural filter for a spatial point is simulated by interpolating nearest neighbor binaural filters chosen from a plurality of pre-defined binaural filters. The audio waveform may be processed digitally in overlapping blocks of data using a Short-Time Fourier transform. The localized sound may be further processed for Doppler shift and room simulation.

A sound image control apparatus and sound image control method capable of increasing the accuracy, in particular, in the distance direction while keeping fixed intervals of transmission characteristic filters, without increasing the number of the transmission characteristic filters. Sound image control apparatus 100 is provided with distance gain control section 101 that performs gain control of the sound pressure of an input monaural audio signal of one channel in the distance direction from a head to a sound image before input to virtual sound field 1 sound image localization section 120 and virtual sound field 2 sound image localization section 130, and reflected sound gain control section 102 that performs gain control by distance of a reflected sound of the sound pressure of the input monaural audio signal of one channel before input to virtual reflected sound generating section 150 that controls the sound image to be localized outside the head when the sound is listened to with headphones.