Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

83 results about "Sound localization" patented technology

Sound localization is a listener's ability to identify the location or origin of a detected sound in direction and distance. It may also refer to the methods in acoustical engineering to simulate the placement of an auditory cue in a virtual 3D space (see binaural recording, wave field synthesis).

Autonomous vehicle driving path selection in the presence of emergency vehicle sounds

The described aspects and implementations support sound-based emergency vehicle detection, localization, and tracking for autonomous vehicle and driver-assist systems. The techniques include obtaining, using one or more audio detectors of a vehicle, a sound recording that includes a sound emitted by an emergency vehicle (EV). The techniques further include applying a sound localization (SL) model to the sound recording to obtain a SL output, which includes a first map of possible locations of the EV in a driving environment of the vehicle and can further include a second map of possible velocities of the EV. The techniques further include simulating, using the SL output, trajectories of simulated EV(s) in the driving environment of the vehicle, and causing, responsive to proximity of the simulated trajectories to a driving path of the vehicle, modification of the driving path of the vehicle.
Owner:WAYMO LLC

Gas leakage identification method and system based on sound positioning, medium and equipment

The invention relates to the field of gas leakage identification, and discloses a gas leakage identification method and system based on sound localization, a medium and equipment, and the method comprises the steps: collecting a leakage sound wave signal through a microphone array, and extracting acoustic features in a complex background; simulating a diffusion process of gas in a turbulence environment after gas leakage through an established leakage gas convection-diffusion model, and combining gas concentration distribution in the simulated diffusion process with acoustic characteristics to predict sound source localization at a leakage position; modeling a sound source localization search process as POMDP, and iteratively updating a confidence state of a sound source position through a particle filter; spatial distribution features are extracted from the confidence state through DBSCAN clustering to serve as input of the LSTM-DQN network, spatial and temporal features are fused through the constructed LSTM-DQN network, cross-scene generalization is achieved through transfer learning, and sound source coordinates are dynamically optimized and output through the Q network. According to the invention, the positioning accuracy and real-time performance in a complex environment are improved.
Owner:SUZHOU SHENGTENG ROBOT CO LTD +1

Method and system of sound localization using binaural audio capture

A system, article, device, apparatus, and method of audio processing comprises receiving, by processor circuitry, binaural audio signals at least overlapping at a same time and of a same two or more audio sources. The method also comprises generating localization map data indicating locations of the two or more audio sources relative to microphones providing the binaural audio signals and comprising inputting at least one version of the binaural audio signals into at least one neural network (NN).
Owner:INTEL CORP

Sound positioning and displaying method and system based on 360-degree panoramic video

The invention discloses a sound positioning and displaying method based on a 360-degree panoramic video. The method comprises the following steps: synchronously calibrating a microphone array and a panoramic video lens; a step of cutting, zooming and fusing the panoramic video; collecting audio data and expanding the azimuth angle of the microphone; positioning a sound source and generating a sound histogram; a step of detecting active pixels and texture regions in the video and generating a visual activeness histogram; a step of fusing the sound histogram and the visual activeness histogram and establishing mapping from an azimuth angle to a pixel coordinate; extracting a close-up image according to the azimuth angle of the sound source; the 360-degree panoramic video is comprehensively optimized and innovated from multiple aspects of multi-channel audio pickup, multi-visual feature analysis, audio and video fusion, panoramic close-up splicing and the like, and a set of complete 360-degree panoramic sound source positioning and displaying solution which is low in cost and easy to deploy is formed.
Owner:DRAGONFLY INTELLIGENT VISION TECH (SHENZHEN) CO LTD

Anti-collision driving assistance method based on multi-sensor fusion, electronic equipment and readable storage medium

PendingCN119975345ASound sourcesPoint cloud
The invention provides an anti-collision driving assistance method based on multi-sensor fusion, electronic equipment and a readable storage medium, and relates to the technical field of automatic driving, and the method comprises the steps: obtaining point cloud data obtained by detecting surrounding obstacles through a laser radar of a current vehicle, and three-dimensional image data obtained by detecting the obstacles through a vehicle-mounted camera, the sound source data is acquired by the microphone array; determining image positioning information of an obstacle based on the three-dimensional image data; determining sound positioning information of the dangerous sound source based on the sound source data; performing data fusion on the point cloud data, the image positioning information and the sound positioning information to obtain environment sensing data of the obstacle; and finally, for any obstacle, according to the environment sensing data of the obstacle and the driving data of the current vehicle, judging whether a collision risk exists between the current vehicle and the obstacle or not. And an anti-collision auxiliary driving strategy is generated when the collision risk exists. According to the method, accurate monitoring of obstacles is realized through multi-sensor fusion, so that the accuracy of an anti-collision driving technology is improved.
Owner:SHIJIAZHUANG TIEDAO UNIV

Audio Diarization System that Segments Audio Input

Speech and / or non-speech in an audio input are convolved to localize sounds to different locations for a user. An audio diarization system segments the audio input into speech and non-speech segments. These segments are convolved with one or more head related transfer functions (HRTFs) so the sounds localize to different sound localization points (SLPs) for the user.
Owner:LYREN PHILIP SCOTT +1

Localized projection of audible noises in medical settings

A localized sound projection system can coordinate the sounds of speakers to simulate the placement of an auditory cue in a 3D space. The system can include a plurality of speakers configured to output auditory signals and a sound localization controller configured to control the plurality of speakers to coordinate the auditory signals to simulate an origination location of a patient alarm. The sound localization controller can determine adjusted auditory signals and control a plurality of speakers to output the plurality of adjusted auditory signals. A method for dynamically controlling speaker settings in a medical environment can include determining volume settings corresponding to a speaker, monitoring a level of ambient noise corresponding to a room of a patient, controlling the volume settings of the speaker to reduce or increase a sound level output of a speaker. A patient monitoring system can be configured to physically manipulate medical devices in response to audible commands. The system can receive a plurality of vocal commands from a user and can manipulate various settings after confirmation from a user.
Owner:MASIMO CORP

Method and system for identifying and displaying whistling sound of vehicle and vehicle

PendingCN119007743AReduce traffic hazardsSpeech analysisSound source separationSound source location
The invention relates to the technical field of vehicles, and discloses a method and system for recognizing and displaying vehicle whistling sound, electronic equipment, a storage medium and a vehicle, and the method comprises the steps: receiving and collecting a whistling sound signal in the surrounding environment of the vehicle; processing the whistling sound signal, including extracting horn sound features, filtering interference factors and generating a sound cloud picture, and positioning a sound source based on a sound positioning algorithm to obtain sound source position information; generating and displaying a dynamic image of the direction and intensity of the source of the whistling sound signal based on the sound cloud picture, the sound source position information and the intensity information of the sound source; and detecting the surrounding environment of the vehicle, identifying specific environment characteristics, and realizing echo cancellation, sound source separation and sound source positioning functions through a signal processing algorithm, so that the vehicle identifies and displays the whistling sound signal under various environment conditions. According to the invention, a driver can effectively perceive whistling sound, the source and intensity of the whistling sound are accurately judged, and traffic hidden dangers are reduced.
Owner:CHINA FAW CO LTD +1

Fault identification method based on sound positioning and related device

The invention provides a fault recognition method based on sound localization and a related device, and by implementing the fault recognition method based on sound localization provided by the embodiment of the invention, an abnormal sound automation system can collect sound signals sent by test equipment in a design or test process, determine fault signals in the sound signals, and send out the fault signals to a test device. And finally, the fault type of the test equipment is determined based on the coordinate information feature information corresponding to the fault signal, so that the fault analysis period and cost of the test equipment can be reduced, and the accuracy of fault type identification can be improved.
Owner:HONOR DEVICE CO LTD

Switching binaural sound

A method provides binaural sound to a person through electronic earphones. The binaural sound localizes to a sound localization point (SLP) in empty space that is away from but proximate to the person. When an event occurs, the binaural sound switches or changes to stereo sound, to mono sound, or to altered binaural sound.
Owner:LYREN PHILIP SCOTT +1

Electronic device for providing audio service, and operating method thereof

According to an embodiment, an electronic device (101) comprises: a communication circuit (190); one or more processors (120) including processing circuitry; and a memory (130) including instructions, wherein the instructions, when executed by the one or more processors individually or collectively, may cause the electronic device to: in a first section, receive a signal of a first channel from a first external electronic device (202) and receive a signal of a second channel from a second external electronic device (204) through the communication circuit; identify that a packet loss has occurred in the first channel; identify whether inter-channel similarity of the first channel and the second channel is greater than a first threshold value on the basis of identifying that the packet loss has occurred in the first channel; and on the basis of identifying that the inter-channel similarity is greater than the first threshold value, restore the signal of the first channel received in the first section by applying sound localization between the first channel and the second channel to the signal of the second channel received in the first section. Other embodiments may be possible.
Owner:SAMSUNG ELECTRONICS CO LTD

Wheel type desktop accompanying robot, control system and control method thereof

The invention relates to the technical field of desktop robots, and discloses a wheel type desktop accompanying robot, a control system and a control method of the wheel type desktop accompanying robot. Comprising a robot frame composed of a power supply trunk part, a moving part, limb parts and a head part, a camera module is embedded in the nose protrusion of the head part, a laser radar is installed in the forehead area of the head part, a sound positioning mainboard is installed behind the power supply trunk part, sound collection microphones distributed in an array mode are arranged on the sound positioning mainboard, and the sound collection microphones are connected with the power supply trunk part. The moving part comprises two moving wheels which are distributed triangularly and have collinear axes and a wheat wheel; according to the technical scheme, a multi-mode sensing fusion framework is constructed, visual, auditory and environment sensing data are integrated, real-time interaction and complementary verification are achieved through a communication framework, the problem that single-mode sensing is prone to being interfered by light, noise and shielding is solved, an upper main control board focuses on intelligent algorithm operation and decision logic output, and the real-time interaction and complementary verification are achieved. The lower-layer auxiliary control board is responsible for hardware driving and state feedback, and instruction execution synchronism is improved.
Owner:HANGZHOU XINGMENGDAO TECHNOLOGY CO LTD

Audio system and method

A audio system comprises an analysis unit, configured to receive and analyze a first number of audio signals, an ambient sound unit, configured to determine one or more ambient sounds related to the semantic information of the first number of audio signals obtained by the analysis unit, a sound placement unit, configured to determine a placement of the one or more ambient sounds determined by the ambient sound unit in one or more audio signals of the first number of audio signals, or in one or more processed audio signals of a second number of processed audio signals, and a combiner to combine the one or more ambient sounds with one or more audio signals of the first number of audio signals or with one or more processed audio signals of the second number of processed audio signals, to generate a second number of audio output signals.
Owner:HARMAN BECKER AUTOMOTIVE SYST GMBH

Head posture auxiliary binaural balance adjusting method

The invention relates to the technical field of audio optimization of TWS Bluetooth earphones, in particular to a head posture assisted binaural balance adjustment method, which comprises the following steps: step 1, a head posture assisted TWS Bluetooth earphone calculates relative movement between a left ear and a right ear according to the head posture of a wearer; 2, establishing a binaural balance model considering a head posture factor, analyzing the influence of different head postures on binaural hearing, and quantifying the influence into corresponding hearing features; 3, the head posture auxiliary TWS Bluetooth headset evaluates the current double-ear listening effect, and main ears and auxiliary ears are determined according to the current environment and task requirements; 4, dynamically adjusting the main ear and the auxiliary ear to adapt to the current auditory demand; and 5, performing model verification based on the step 4, and adjusting and optimizing model parameters according to a model verification result, so that the method not only can improve the accuracy of sound positioning, but also can remarkably improve the auditory experience of the user in different environments.
Owner:COSONIC INTELLIGENT TECH CO LTD

An Adaptive Sound Pickup Method and System Based on Multi-Source Sound Localization

The present application discloses an adaptive sound pickup method and system based on multi-source localization. The method includes: extracting features from the collected multi-source sound generation data to obtain a comprehensive feature vector set; inputting the comprehensive feature vector set into a preset sound source localization model for processing to obtain target sound source features; according to the target sound source features, obtaining the optimal sound pickup device parameters in the current environment through a preset sound pickup strategy prediction model; and setting the adjustable parameters of the sound pickup device according to the optimal sound pickup device parameters to perform sound pickup. The present application accurately locates the target sound source when multiple sound sources are generating sound simultaneously, and sets the relevant parameters of the sound pickup device according to the information of the target sound source, so as to achieve more accurate and rapid sound pickup.
Owner:GUANGZHOU BAOLUN ELECTRONICS CO LTD

Automatic speaker registration method and system

An automatic speaker registration method and system, in which an image is captured by a camera, image data is generated, a face position of a person is identified from the image data, a microphone array is used for sound reception, voice data is generated, a sound source direction is estimated by using a sound localization technique, and then a target speaker is matched according to the face position of the person and the sound source direction. Especially, whether a target speaker is within an effective geometric range is confirmed, so that voice generated by the target speaker in the direction of the target speaker can be recorded, voice enhancement is performed, and speaker characteristics of the target speaker registered in a specific system are formed.
Owner:REALTEK SEMICON CORP

Portable sound box with sound positioning function

The utility model discloses a portable sound box with a sound positioning function, which relates to the technical field of audio frequency, and comprises a support, a basin stand is fixedly arranged on the bottom surface of the support, a sound basin is fixedly arranged on the bottom surface of the support, a core fixing support chip is fixedly arranged on the bottom surface in the basin stand, a circular groove is fixedly arranged on the top surface of the support, and a sound box is fixedly arranged in the circular groove. The positioning assembly is arranged, so that the direction and the distance of a sound source are accurately recognized, the sound positioning function brings unprecedented sound experience to a user, and the sound positioning function is particularly suitable for occasions such as movie watching, music meeting listening or conference participating and the like. The sound box can simulate the real source of sound, so that a user seems to be in a real scene, and the immersive sound experience not only enhances the sense of participation and immersion of the user, but also enables the transmission of sound information to be clearer and more intuitive, and improves the receiving efficiency of information.
Owner:SHENZHEN BELON TECH CO LTD

Autonomous vehicle driving path selection in presence of emergency vehicle sounds

To support sound-based emergency vehicle detection, localization, and tracking for an autonomous vehicle and a driver-assist system.SOLUTION: Techniques of the present invention include obtaining, using one or more audio detectors of a vehicle, a sound recording that includes a sound emitted by an emergency vehicle (EV). The techniques further include applying a sound localization (SL) model to the sound recording to obtain an SL output, which includes a first map of possible locations of the EV in a driving environment of the vehicle and can further include a second map of possible velocities of the EV. The techniques further include simulating, using the SL output, trajectories of simulated EV(s) in the driving environment of the vehicle, and causing, responsive to proximity of the simulated trajectories to a driving path of the vehicle, modification of the driving path of the vehicle.SELECTED DRAWING: Figure 4
Owner:WAYMO LLC

Sound localization method, apparatus and device

A conference speech presentation system, a sound localization method and apparatus, a conference system and a pickup device. The method includes the following steps: collecting (S101) a multi-channel voice signal through a directional microphone array; determining (S103) a steering vector including phase information and amplitude information according to array shape information and microphone pointing direction information; determining (S105) sound direction information according to the steering vector and the voice signal. By adopting this processing mode, both the phase information and the amplitude information are considered when determining the steering vector, which can effectively improve the accuracy of sound localization.
Owner:ZHEJIANG ALIBABA ROBOT CO LTD

In-Vehicle Spatial Audio Alerts

A vehicle system uses OEM sensors and OEM speakers to spatially convey, inside the cabin, the location and distance of real-world entities relative to a driver. A processor determines a directional bearing and, when available, a distance from proximity sensors, integrated cameras, or a directional microphone. An audio generation module produces a warning that is routed only to the speakers on the side that corresponds with the bearing, with audio gain set as a function of distance so closer entities sound louder. For emergency vehicles, the system synthesizes a siren or isolates and re-broadcasts the original siren, then plays the siren only through the speakers that correspond with the detected bearing. An interior microphone gates synthesis when the original siren is already audible. The approach enables drivers to localize pedestrians and other hazards by sound.
Owner:UNIVERSITY OF CENTRAL FLORIDA RESEARCH FOUNDATION INC

Sound transducer and MEMS microphone

The present disclosure discloses a sound transducer including a substrate; a back plate mounted on the substrate; a back plate electrode mounted on a side of back plate facing the substrate, including a plurality of first electrode plates arranged at intervals; a diaphragm electrode opposite to the back plate along a first direction, including: a plurality of second electrode plates arranged at intervals; and a center pillar arranged between the back plate and the diaphragm electrode, extending along the first direction; the plurality of first electrode plates surrounds the center pillar; the plurality of second electrode plates surrounds the center pillar; each second electrode plate is flexibly connected to the center pillar. The sound transducer in the present disclosure has sound localization function.
Owner:AAC MICROTECH (CHANGZHOU) CO LTD

Audio system and method of augmenting spatial audio rendition

An audio system and method of using the audio system to augment spatial audio rendition is described. The audio system can include a device to receive user inputs designating positions on an augmented reality view of a listening environment. Sound source icons can be presented in the augmented reality view at the designated positions. The sound source icons can visually represent sound sources at locations in the listening environment that correspond to, but are different than, the positions. One or more processors of the audio system can apply head-related transfer functions, which correspond to the locations in the listening environment, to audio input signals to generate binaural audio signals. The audio system can include a headset that uses the binaural audio signals to render spatialized audio localizing sounds to the locations in the listening environment. Other aspects are also described and claimed.
Owner:APPLE INC

Image and sound localization method and system thereof

The application provides a sound image matching method and a system thereof. The method comprises: collecting participant audio of each seat by each microphone; setting the number of routers of each row according to the number of microphones of each row, the number of interfaces of each router is not less than the number of collection areas, and different interfaces of each router are connected to the microphones of different collection areas in the row where the router is located to route the participant audio collected by the microphones of different collection areas to an audio processor; selecting at least one collection area with participant audio output as a sound area according to a preset rule; processing all participant audio in each sound area by the audio processor to make each sound area correspond to one piece of processed audio, and obtaining multiple pieces of audio; and sending the multiple pieces of video and the multiple pieces of audio to a remote end. The application effectively realizes accurate matching of sound and image and provides an immersive audio and video experience for users.
Owner:上海赛连信息科技有限公司

Directional sound recording and playback

Systems and methods for providing improved localization of recorded and played back sound are provided by improved microphone arrays for recording sound and by improved systems for playback of sound. Microphone arrays include four microphones with sound transducers located and aimed to mimic capture of sound by human ears. Sound captured by two side-viewing microphones is attenuated, at the time of sound capture and / or recording, at a later processing stage, or at the time of sound playback, by low-pass filtering. The recording maintains four separate channels of sound. Playback occurs through four speakers arranged to reproduce sound in the way human ears hear sound, with appropriate attenuation for side speakers. Playback can also occur through four-channel headphones. Improved playback of two-channel stereo sound can also occur through low-pass filtering of each track and playing the filtered sound through side / rear speakers on the opposite sides.
Owner:ALEXANDER ERIC JAY

Sound image localization processing method and sound image localization processing device

A sound image localization processing method includes inputting a sound source signal of a same sound source and localization information of the sound source to a first signal processing unit and a second signal processing unit; generating the first sound signal by subjecting the sound source signal to first localization processing based on the localization information and position information of the first speaker group to localize a sound of the sound source at a position indicated by the localization information; and generating the second signal by subjecting the sound source signal to second localization processing based on the localization information and position information of the second speaker group to localize the sound of the sound source at the position indicated by the localization information.
Owner:YAMAHA CORP

Multichannel noise simulation system based on XAudio 2

The invention provides a multichannel noise simulation system based on XAudio 2, and the system comprises an XAudio 2 engine initialization module which is used for initializing a COM assembly and creating an XAudio 2 engine instance; the main audio frequency sound mixer creating module is used for calling a CreateMasteringVoice method to create a main audio frequency sound mixer; the audio data loading module is used for reading an audio stream from an audio file and filling the audio stream into the XAUDIO2BUFFER structure; the source voice creating and playing module is used for calling a CreateSourceVoice method to create source voice, submitting the source voice to XAUDIO2BUFFER and starting playing; and the volume control module is used for independently adjusting the volume of each sound channel through a SetChannelVolumes function and muting other sound channels when the target sound channel is played. According to the invention, the accuracy of sound positioning and the user experience can be improved, and the system cost is reduced.
Owner:AVIC HUADONG OPTOELECTRONICS (SHANGHAI) CO LTD

Video image processing method and device, electronic equipment and storage medium

The invention relates to the technical field of data processing, and particularly provides a video image processing method and device, electronic equipment and a storage medium. The video image processing method comprises the following steps: positioning a speaker based on a surrounding sound signal collected for a video call, and obtaining sound positioning information of a target object; based on the sound positioning information, adjusting an image acquisition device to enable a video call image acquired by the image acquisition device to contain the target object; and displaying the video call image acquired by the image acquisition device. Therefore, when a video call is carried out, a speaker can be accurately tracked and shot.
Owner:BEIJING XIAOMI MOBILE SOFTWARE CO LTD

Sound image localization processing method and sound image localization processing device

A sound image localization processing method includes inputting a sound source signal of a same sound source and localization information of the sound source to a first signal processing unit and a second signal processing unit; generating the first sound signal by subjecting the sound source signal to first localization processing based on the localization information and position information of the first speaker group to localize a sound of the sound source at a position indicated by the localization information; and generating the second signal by subjecting the sound source signal to second localization processing based on the localization information and position information of the second speaker group to localize the sound of the sound source at the position indicated by the localization information.
Owner:YAMAHA CORP

Switching binaural sound from head movements

A method or apparatus switches between binaural sound and stereo sound in response to head movements of a listener. An electronic device provides the listener with binaural sound at a sound localization point (SLP) in a field-of-view of the listener. Binaural sound at the SLP switches to one of mono or stereo sound when head movements of the listener cause the SLP to move outside the field-of-view.
Owner:IP3 2025 SERIES 925 OF ALLIED SECURITY TRUST I

Three-dimensional sound event positioning and detection method based on audio-guided visual attention

The invention discloses a three-dimensional sound event positioning and detection method based on audio guidance visual attention, and belongs to the field of audio-visual fusion positioning detection, and the method comprises the steps: extracting audio features of audio data through an audio encoder, and outputting the audio features to an audio guidance visual attention module; extracting visual features of the video data through a visual encoder and outputting the visual features to an audio-guided visual attention module; an audio-guided visual attention module guides visual features through audio features to obtain attention visual features, and an output branch serves as a visual sound positioning result to be output; the audio features and the attention visual features are fused through the fusion module, and the obtained multi-modal features are input into the context network to obtain a sound event detection result and a sound source coordinate estimation result which are output through the two output branches. The method effectively improves the positioning and detection performance of sound events in a three-dimensional space through an audio-guided visual attention mechanism and audio-visual fusion in combination with a sound source coordinate estimation branch.
Owner:UNIV OF SCI & TECH OF CHINA