39 results about "Sound localization" patented technology

The invention relates to the field of gas leakage identification, and discloses a gas leakage identification method and system based on sound localization, a medium and equipment, and the method comprises the steps: collecting a leakage sound wave signal through a microphone array, and extracting acoustic features in a complex background; simulating a diffusion process of gas in a turbulence environment after gas leakage through an established leakage gas convection-diffusion model, and combining gas concentration distribution in the simulated diffusion process with acoustic characteristics to predict sound source localization at a leakage position; modeling a sound source localization search process as POMDP, and iteratively updating a confidence state of a sound source position through a particle filter; spatial distribution features are extracted from the confidence state through DBSCAN clustering to serve as input of the LSTM-DQN network, spatial and temporal features are fused through the constructed LSTM-DQN network, cross-scene generalization is achieved through transfer learning, and sound source coordinates are dynamically optimized and output through the Q network. According to the invention, the positioning accuracy and real-time performance in a complex environment are improved.

The invention relates to the technical field of desktop robots, and discloses a wheel type desktop accompanying robot, a control system and a control method of the wheel type desktop accompanying robot. Comprising a robot frame composed of a power supply trunk part, a moving part, limb parts and a head part, a camera module is embedded in the nose protrusion of the head part, a laser radar is installed in the forehead area of the head part, a sound positioning mainboard is installed behind the power supply trunk part, sound collection microphones distributed in an array mode are arranged on the sound positioning mainboard, and the sound collection microphones are connected with the power supply trunk part. The moving part comprises two moving wheels which are distributed triangularly and have collinear axes and a wheat wheel; according to the technical scheme, a multi-mode sensing fusion framework is constructed, visual, auditory and environment sensing data are integrated, real-time interaction and complementary verification are achieved through a communication framework, the problem that single-mode sensing is prone to being interfered by light, noise and shielding is solved, an upper main control board focuses on intelligent algorithm operation and decision logic output, and the real-time interaction and complementary verification are achieved. The lower-layer auxiliary control board is responsible for hardware driving and state feedback, and instruction execution synchronism is improved.

A audio system comprises an analysis unit, configured to receive and analyze a first number of audio signals, an ambient sound unit, configured to determine one or more ambient sounds related to the semantic information of the first number of audio signals obtained by the analysis unit, a sound placement unit, configured to determine a placement of the one or more ambient sounds determined by the ambient sound unit in one or more audio signals of the first number of audio signals, or in one or more processed audio signals of a second number of processed audio signals, and a combiner to combine the one or more ambient sounds with one or more audio signals of the first number of audio signals or with one or more processed audio signals of the second number of processed audio signals, to generate a second number of audio output signals.

The invention relates to the technical field of audio optimization of TWS Bluetooth earphones, in particular to a head posture assisted binaural balance adjustment method, which comprises the following steps: step 1, a head posture assisted TWS Bluetooth earphone calculates relative movement between a left ear and a right ear according to the head posture of a wearer; 2, establishing a binaural balance model considering a head posture factor, analyzing the influence of different head postures on binaural hearing, and quantifying the influence into corresponding hearing features; 3, the head posture auxiliary TWS Bluetooth headset evaluates the current double-ear listening effect, and main ears and auxiliary ears are determined according to the current environment and task requirements; 4, dynamically adjusting the main ear and the auxiliary ear to adapt to the current auditory demand; and 5, performing model verification based on the step 4, and adjusting and optimizing model parameters according to a model verification result, so that the method not only can improve the accuracy of sound positioning, but also can remarkably improve the auditory experience of the user in different environments.

An automatic speaker registration method and system, in which an image is captured by a camera, image data is generated, a face position of a person is identified from the image data, a microphone array is used for sound reception, voice data is generated, a sound source direction is estimated by using a sound localization technique, and then a target speaker is matched according to the face position of the person and the sound source direction. Especially, whether a target speaker is within an effective geometric range is confirmed, so that voice generated by the target speaker in the direction of the target speaker can be recorded, voice enhancement is performed, and speaker characteristics of the target speaker registered in a specific system are formed.

A conference speech presentation system, a sound localization method and apparatus, a conference system and a pickup device. The method includes the following steps: collecting (S101) a multi-channel voice signal through a directional microphone array; determining (S103) a steering vector including phase information and amplitude information according to array shape information and microphone pointing direction information; determining (S105) sound direction information according to the steering vector and the voice signal. By adopting this processing mode, both the phase information and the amplitude information are considered when determining the steering vector, which can effectively improve the accuracy of sound localization.

A vehicle system uses OEM sensors and OEM speakers to spatially convey, inside the cabin, the location and distance of real-world entities relative to a driver. A processor determines a directional bearing and, when available, a distance from proximity sensors, integrated cameras, or a directional microphone. An audio generation module produces a warning that is routed only to the speakers on the side that corresponds with the bearing, with audio gain set as a function of distance so closer entities sound louder. For emergency vehicles, the system synthesizes a siren or isolates and re-broadcasts the original siren, then plays the siren only through the speakers that correspond with the detected bearing. An interior microphone gates synthesis when the original siren is already audible. The approach enables drivers to localize pedestrians and other hazards by sound.

The present disclosure discloses a sound transducer including a substrate; a back plate mounted on the substrate; a back plate electrode mounted on a side of back plate facing the substrate, including a plurality of first electrode plates arranged at intervals; a diaphragm electrode opposite to the back plate along a first direction, including: a plurality of second electrode plates arranged at intervals; and a center pillar arranged between the back plate and the diaphragm electrode, extending along the first direction; the plurality of first electrode plates surrounds the center pillar; the plurality of second electrode plates surrounds the center pillar; each second electrode plate is flexibly connected to the center pillar. The sound transducer in the present disclosure has sound localization function.

The application provides a sound image matching method and a system thereof. The method comprises: collecting participant audio of each seat by each microphone; setting the number of routers of each row according to the number of microphones of each row, the number of interfaces of each router is not less than the number of collection areas, and different interfaces of each router are connected to the microphones of different collection areas in the row where the router is located to route the participant audio collected by the microphones of different collection areas to an audio processor; selecting at least one collection area with participant audio output as a sound area according to a preset rule; processing all participant audio in each sound area by the audio processor to make each sound area correspond to one piece of processed audio, and obtaining multiple pieces of audio; and sending the multiple pieces of video and the multiple pieces of audio to a remote end. The application effectively realizes accurate matching of sound and image and provides an immersive audio and video experience for users.

Systems and methods for providing improved localization of recorded and played back sound are provided by improved microphone arrays for recording sound and by improved systems for playback of sound. Microphone arrays include four microphones with sound transducers located and aimed to mimic capture of sound by human ears. Sound captured by two side-viewing microphones is attenuated, at the time of sound capture and / or recording, at a later processing stage, or at the time of sound playback, by low-pass filtering. The recording maintains four separate channels of sound. Playback occurs through four speakers arranged to reproduce sound in the way human ears hear sound, with appropriate attenuation for side speakers. Playback can also occur through four-channel headphones. Improved playback of two-channel stereo sound can also occur through low-pass filtering of each track and playing the filtered sound through side / rear speakers on the opposite sides.

A sound image localization processing method includes inputting a sound source signal of a same sound source and localization information of the sound source to a first signal processing unit and a second signal processing unit; generating the first sound signal by subjecting the sound source signal to first localization processing based on the localization information and position information of the first speaker group to localize a sound of the sound source at a position indicated by the localization information; and generating the second signal by subjecting the sound source signal to second localization processing based on the localization information and position information of the second speaker group to localize the sound of the sound source at the position indicated by the localization information.

A sound image localization processing method includes inputting a sound source signal of a same sound source and localization information of the sound source to a first signal processing unit and a second signal processing unit; generating the first sound signal by subjecting the sound source signal to first localization processing based on the localization information and position information of the first speaker group to localize a sound of the sound source at a position indicated by the localization information; and generating the second signal by subjecting the sound source signal to second localization processing based on the localization information and position information of the second speaker group to localize the sound of the sound source at the position indicated by the localization information.

The invention discloses a three-dimensional sound event positioning and detection method based on audio guidance visual attention, and belongs to the field of audio-visual fusion positioning detection, and the method comprises the steps: extracting audio features of audio data through an audio encoder, and outputting the audio features to an audio guidance visual attention module; extracting visual features of the video data through a visual encoder and outputting the visual features to an audio-guided visual attention module; an audio-guided visual attention module guides visual features through audio features to obtain attention visual features, and an output branch serves as a visual sound positioning result to be output; the audio features and the attention visual features are fused through the fusion module, and the obtained multi-modal features are input into the context network to obtain a sound event detection result and a sound source coordinate estimation result which are output through the two output branches. The method effectively improves the positioning and detection performance of sound events in a three-dimensional space through an audio-guided visual attention mechanism and audio-visual fusion in combination with a sound source coordinate estimation branch.

A method and a system for automated speaker enrollment are provided. In the method, a camera is used to capture image data so that a facial position of a person can be recognized, a microphone array is used to generate speech data, and a sound localization technology is used to estimate a sound source direction. A target speaker can be determined by matching the facial position and the direction toward the sound source, and more particularly whether the target speaker is within a valid geometric range. After that, the speech produced by the target speaker along a target speaker direction is recorded, and the speech can be enhanced for generating speaker features with respect to the target speaker for enrolling to a specific system.

The present application relates to the technical field of LED display. Provided is a passive 3D LED display module with a sound-transmitting effect, comprising a support structure, an area matrix driving board, a mask layer, a polarizing layer and sound-transmitting channels, wherein the area matrix driving board is fixed to the support structure, and light-emitting diodes arranged in an array are provided on the side of the area matrix driving board away from the support structure; the mask layer is fixed on the side of the area matrix driving board away from the support structure; the polarizing layer is attached to the side of the mask layer away from the area matrix driving board; and the sound-transmitting channels sequentially pass through the support structure, the area matrix driving board, the mask layer and the polarizing layer. According to the technical solution provided in the embodiments of the present application, by means of the provision of the sound-transmitting channels that pass through the support structure, the area matrix driving board, the mask layer and the polarizing layer, a sound source perceived by a viewer comes from a display image. In this way, from the audiovisual perspective of the viewer, image and sound are in the same position, that is, the integration of image and sound positioning is achieved by means of the sound-transmitting channels, thereby improving the synchronization between sound and image, and thus improving the audiovisual effect of a playback device.

The utility model relates to the technical field of sound positioning, and discloses a sound positioning device based on a microphone array, which comprises a fixed shell, a power supply interface is fixedly arranged on the front side surface of the fixed shell, the power supply interface is electrically connected with a signal processing device, and the signal processing device is fixedly arranged on the inner surface of the fixed shell. And an array microphone is mounted at the upper end of the signal processing device. According to the sound positioning device based on the microphone array, the position of the adjusting plate is adjusted, so that the sound positioning device can be clamped and fixed on robots with different sizes without being fixed by screws, and the situation that the sound positioning device cannot be mounted and fixed due to the position deviation of holes formed in different robots can be effectively avoided; the sound positioning device is simple in structure and convenient to use, rapid and lossless disassembly and assembly can be achieved in a clamping and fixing mode, more convenience and rapidness are achieved, the sound positioning device can be clamped on robots with different shapes through rotation of the rotating plate, and the use range of the sound positioning device is widened.

The described aspects and implementations support sound-based emergency vehicle detection, localization, and tracking for autonomous vehicle and driver-assist systems. The techniques include obtaining, using one or more audio detectors of a vehicle, a sound recording that includes a sound emitted by an emergency vehicle (EV). The techniques further include applying a sound localization (SL) model to the sound recording to obtain a SL output, which includes a first map of possible locations of the EV in a driving environment of the vehicle and can further include a second map of possible velocities of the EV. The techniques further include simulating, using the SL output, trajectories of simulated EV(s) in the driving environment of the vehicle, and causing, responsive to proximity of the simulated trajectories to a driving path of the vehicle, modification of the driving path of the vehicle.

A signal-processing method has the steps of: obtaining a plurality of signal components from an input signal, the plurality of signal components including a plurality of perceptual feature components, and further including a first-directional signal component, a second-directional signal component, a non-directional signal component, or a combination thereof; using at least a pair of filters to filter each of the plurality of signal components into a filtered first-directional signal and a filtered second-directional signal, thereby forming a group of filtered first-directional signals and a group of filtered second-directional signals; and obtaining a first output signal and a second output signal for outputting and / or analysis, the first output signal including a combination of the group of filtered first-directional signals, and the second output signal including a combination of the group of filtered second-directional signals.

A sound-processing apparatus for processing a sound-bearing signal. The apparatus has a signal decomposition module for separating the sound-bearing signal into a plurality of signal components comprising a plurality of perceptual feature components, a spectrum modification module and a phase adjustment module for modifying the spectrum and time delay of each of the plurality of signal components, a psychoacoustical signal processing module having a plurality of psychoacoustic filters for filtering the plurality of signal components into a group of left (L) signals and a group of right (L) signals which are combined for outputting a L output signal and a R output signal for sound generation.

This invention provides a method and robot for recognizing cattle mooing based on deep hearing, belonging to the field of sound localization technology. The recognition method includes: acquiring the sound signal of the cattle moo to be recognized; extracting low-level descriptors from each frame of the sound signal and calculating their statistics to obtain a statistical feature vector; preprocessing and extracting features from the sound signal to obtain Fbank features; inputting the Fbank features into an improved CRNN model to obtain a deep feature vector; fusing the statistical feature vector and the deep feature vector to obtain a mooing classification result; calculating the mooing location information based on a sound source localization method; and combining the classification result and location information to obtain the cattle mooing recognition result. This invention achieves accurate classification and real-time dynamic location localization of cattle mooing in complex noise environments in pastures, while also considering the requirements of lightweight model design and embedded robot integration, providing technical support for precise cattle management in smart pastures.

The application relates to the technical field of underground pipe network monitoring, in particular to an urban underground pipe network intelligent monitoring device and a monitoring method, which comprises a sound positioning mechanism arranged in a pipe gallery and a control center, the sound positioning mechanism is electrically connected with the control center, a mobile monitoring mechanism is arranged in the pipe gallery, the mobile monitoring mechanism comprises a 3D camera and a moving assembly, the 3D camera slides in the pipe gallery through the moving assembly and is used for monitoring a section of pipe network; the 3D camera is electrically connected with the control center, the moving assembly is electrically connected with the control center, after receiving a water leakage sound signal, the control center controls the moving assembly to drive the 3D camera to move to a sound source position to collect images and confirm whether water leaks, and the control center collects monitoring signals and reminds monitoring personnel. The application has the effect of improving the positioning accuracy of water leakage points.

The invention according to the present disclosure relates to an in-wheel drive electric vehicle capable of directed sound emission and a method of operation thereof comprising at least two sound emitting direct drive mechanisms and a sound localisation unit capable of calculating and applying phase delays, amplitude modulation, frequency modulation and other relevant dependencies between at least two sounds emitted from the at least two direct drive mechanisms in a manner in which the maximum or minimum sound level is achieved towards a desired direction using the sum of both sounds emitted from the at least two direct drive mechanisms.

The embodiment of the utility model provides a remote control key. The remote control key comprises a shell, a controller and a sounder. The controller is arranged in the shell and used for sending a lock body control signal, the sounder is electrically connected with the controller, and the controller can control the sounder to make a sound. According to the remote control key, the sounder is arranged, so that when the remote control key is lost, a user can control the sounder to make a sound by sending the control instruction to the controller, the remote control key is positioned according to the sound, and the retrieval probability of the remote control key is improved.

The invention discloses a microphone arraying method and device for sound source localization and a microphone array structure. Comprising the following steps: determining the total number of microphones in a microphone array and unit array element spacing, and determining two groups of co-prime integers according to the total number of the microphones; the first group of co-prime integers comprises a first coefficient and a second coefficient, and the second group of co-prime integers comprises a third coefficient and a fourth coefficient; constructing four uniform rectangular sub-arrays; the number of array elements of the first sub-array and the fourth sub-array is determined according to a first coefficient and a fourth coefficient, and the number of array elements of the second sub-array and the third sub-array is determined according to a second coefficient and a third coefficient; the first sub-array and the fourth sub-array are symmetrically distributed at equal intervals relative to a horizontal coordinate, and the second sub-array and the third sub-array are symmetrically distributed at equal intervals relative to a vertical coordinate; and determining the position of each array element in each sub-array according to the two groups of co-prime integers and the unit array element spacing to obtain a microphone array arrangement result. According to the invention, by optimizing the layout design of the microphone array, the sound positioning accuracy is improved.

This invention provides an audio signal processing method that can achieve appropriate sound localization processing regardless of the distribution platform. [Solution] The sound signal processing method is used in a sound signal processing system composed of multiple terminals that output sound signals. Each of the multiple terminals outputs a video signal containing unique identification information for each terminal, acquires localization control information that is generated based on the identification information and determines the sound image localization position of the terminal in the sound signal processing system, applies localization processing to the sound signal of the terminal based on the acquired localization control information, and outputs the sound signal after the localization processing has been applied.

This invention relates to a smart microphone stand system that detects the direction of a sound source through sound localization and automatically orients toward the sound source using a pan-tilt mechanism controlled by a microcontroller circuit (12). Compared to stationary microphone stands, the system offers improved ease of use and operational efficiency, thanks to its ability to dynamically track sound sources. The invention eliminates the need for manual directional adjustment required in conventional systems. It provides enhanced sensitivity in speaker tracking and effective noise reduction, thereby offering a comprehensive solution in various fields, including the audio industry, education, conferences, broadcasting, voice command systems, and security implementations.

The invention discloses a report hall sound reinforcement system based on an SIS system principle, and relates to the technical field of control systems, and the system comprises a multichannel input interface, a main sound reinforcement array, an auxiliary loudspeaker array, an ultra-low frequency loudspeaker, a matrix processor, and a self-adaptive controller. The directional radiation design of the main sound amplification array is combined with the distributed auxiliary loudspeaker topology, so that the whole-field sound pressure uniformity is improved, and the problem of non-uniform sound field distribution of a traditional system is solved; a middle sound channel independent regulation and control technology optimizes music signal restoration quality while guaranteeing language definition through a dynamic frequency division point switching mechanism, solves a long-term pain point of compatibility of music and human voice in the industry, effectively inhibits crosstalk between sound channels through a phase correction algorithm of a matrix type audio processing module, improves sound positioning precision, and improves sound positioning accuracy. A sound positioning fuzzy phenomenon is eliminated; the ground coupling design of the ultralow-frequency module reduces low-frequency harmonic distortion, realizes high-efficiency transmission of low-frequency energy and avoids interference on medium-high-frequency sound image positioning.

The present application relates to the security monitoring technical field, specifically to a kind of automatic sound positioning security monitoring method, equipment and storage medium.It includes the following steps:S1, the sound signal in monitoring area is collected;S2, current time information is obtained, and current time slot is determined according to preset time slot division rule;S3, the white list sound category subset corresponding to current time slot is loaded;S4, the sound feature vector is input into sound recognition model;S5, the identification result is matched with current effective white list, preset blacklist and preset red signal category;S6, the statistical data of sound event in each time slot is recorded.Through the introduction of time slot mechanism, static white list is upgraded to dynamic white list matrix of time dimension, so that the system can automatically adapt to the background sound change in different time periods, effectively reduce the false alarm rate in night and other special periods.

A localized sound projection system can coordinate the sounds of speakers to simulate the placement of an auditory cue in a 3D space. The system can include a plurality of speakers configured to output auditory signals and a sound localization controller configured to control the plurality of speakers to coordinate the auditory signals to simulate an origination location of a patient alarm. The sound localization controller can determine adjusted auditory signals and control a plurality of speakers to output the plurality of adjusted auditory signals. A method for dynamically controlling speaker settings in a medical environment can include determining volume settings corresponding to a speaker, monitoring a level of ambient noise corresponding to a room of a patient, controlling the volume settings of the speaker to reduce or increase a sound level output of a speaker.

The utility model relates to the technical field of LED display, and provides a passive 3D LED display module with a sound transmission effect, which comprises a supporting structure, an area array driving plate, a mask layer, a polarization layer and a sound transmission channel. The area array driving plate is fixed on the supporting structure, one side, far away from the supporting structure, of the area array driving plate is provided with light-emitting tubes which are arranged in an array mode, the shade layer is fixed on one side, far away from the supporting structure, of the area array driving plate, and the polarization layer is attached to one side, far away from the area array driving plate, of the shade layer. The sound transmission channel sequentially penetrates through the supporting structure, the area array driving plate, the mask layer and the polarization layer. According to the technical scheme provided by the embodiment of the invention, the penetrating supporting structure, the area array driving plate, the shielding layer and the polarization layer are arranged, so that a sound source heard by a viewer comes from a display picture, the picture and the sound are located at the same position at the viewing angle of the viewer, that is, the picture and the sound are positioned and fused through the sound transmission channel, and the sound transmission effect is improved. And the synchronism of sound and pictures is improved, so that the audio-visual effect of the playing equipment is improved.