857 results about "Environmental sounds" patented technology

Introduced here is a wearable audio system including modular ear-cup and ear-bud that can be attached and detached to the user together, or independently of each other. Further, the modular ear-cup and ear-bud can operate together, or independently of each other. The wearable audio system can perform active noise cancellation by measuring noise inside the ear-cup and / or the ear-bud, computing the noise canceling sound, and forwarding the noise canceling sound to a speaker inside the ear-cup and / or the ear-bud. The wearable audio system can be wirelessly charged while operating, thus allowing the user to continuously listen to music more than previously possible. The wearable audio system can optimize power consumption by redistributing power intensive tasks to power sources with the highest amount of power. Further, the ambient sound outside the ear-cup can be measured and played by the speakers in the earbud allowing the user to hear the surrounding environment.

The invention relates to the technical field of environmental sound event detection, in particular to an environmental sound event detection method based on multi-modal data fusion, which utilizes a microphone array, a camera and a sensor to synchronously acquire audio, video and environmental data to form a multi-modal data source. And the collected multi-modal data is preprocessed, so that the data quality and the accuracy of subsequent analysis are improved. And key features are extracted from the processed data, and the features are fused to form multi-modal features. And a deep learning model is constructed, and multi-modal features are used for training, so that a model capable of identifying an environmental sound event can be obtained. And performing optimization such as pruning, quantification and knowledge distillation on the trained model, and deploying the model on edge equipment to realize real-time preliminary feature extraction and event detection. The problems that an environment sound event detection method in the prior art is poor in robustness, low in real-time performance and limited in generalization ability are solved.

The invention discloses a long video multi-modal understanding and question-answering method and system based on large model and retrieval enhancement generation. The method comprises the following steps: 1) a multi-modal feature extraction module; 2) a multi-modal synchronization and alignment mechanism; 3) constructing a structured memory pool; 4) querying a drive generation mechanism; 5) incremental updating and memory compression strategy; and 6) unifying the multi-modal representation space. The invention provides a long video multi-mode understanding method fusing a large language model and retrieval enhancement generation, and aims to break through the limitation of a traditional method in the aspects of single-mode processing and semantic fragmentation. According to the method, video image features are extracted through a visual model (such as YOLO and ViT), voice transcription and environment voice description are obtained in combination with an audio model (such as Whisper and Qwen-Audio), and unified coding of vision, voice and audio in a long video is achieved. Then, a structured memory pool is constructed through semantic consistency segmentation and timestamp alignment technologies to store time slice data of different modalities.

The invention discloses a voiceprint recognition method and system for authority verification and a model construction method and system, and relates to the technical field of user identification, and the method comprises the steps: sending a random verification instruction; acquiring response voice of the person, extracting entrance identity acoustic features, comparing the entrance identity acoustic features with the identity reference model to obtain a comparison result, and determining whether the person is authorized to enter a predetermined operation scene or not based on the comparison result; recording an entry state during authorization; in the predetermined operation scene, continuously capturing environment sound, and extracting a target voice segment; extracting real-time identity acoustic features and real-time state acoustic features from the target voice segment; comparing the real-time identity acoustic features with an identity reference model; acquiring real-time context information; determining a corresponding predefined behavior rule according to the role and the real-time context information; and based on a predefined behavior rule, executing dynamic verification to obtain a dynamic verification result, and generating output information. According to the invention, the accuracy of voiceprint recognition can be effectively improved.

The invention relates to the technical field of audio noise reduction, in particular to a multi-scene adaptive noise reduction method and system for audio terminal equipment. The method comprises the following steps: identifying a real-time environmental sound signal; environment noise source identification is carried out on the real-time environment sound signal, noise distribution perception modeling is carried out, and an environment noise distribution field is constructed; performing current scene noise change analysis on the environment noise distribution field, performing dynamic noise distribution rendering, and constructing a dynamic noise scene model; performing hedging suppression parameter calculation based on the dynamic noise scene model, performing adaptive noise suppression processing, and constructing an adaptive noise suppression strategy; acquiring an audio input signal of a user; and performing local audio gain processing on an audio input signal of a user, and performing multi-band decomposition to generate an audio frequency parameter of each band. The stability and the accuracy of the noise reduction effect are improved, so that the practicability and the adaptability of the audio terminal equipment are enhanced.

The invention discloses an automobile environment sound enhancement method and device, electronic equipment and a storage medium, which are used for solving the technical problems of low automobile external environment sound recognition precision and poor environment adaptability in related technologies. The method comprises the following steps: acquiring audio data outside a vehicle and video data outside the vehicle; scene recognition is carried out according to the vehicle exterior audio data and the vehicle exterior video data, and the current environment sound type and the current driving environment are obtained; extracting visual information from the video data outside the vehicle, and extracting audio information from the audio data outside the vehicle; carrying out multi-modal data fusion based on comprehensive confidence in combination with the visual information and the audio information to obtain an effective scene judgment result; and based on the current driving environment, the current environment sound type and the effective scene judgment result, the external environment sound is enhanced through a sound unvarnished transmission enhancement strategy. Therefore, environmental sound recognition accuracy can be improved based on multi-modal data fusion, environmental sound enhancement is realized in combination with a sound unvarnished transmission enhancement strategy, and environmental adaptability is improved.

The invention relates to the technical field of voiceprint recognition, in particular to a photovoltaic equipment fault detection method and system based on voiceprint recognition, and the method comprises the following steps: collecting the sound of the surrounding environment of a current photovoltaic power station, and building scene associated equipment spectrum peak features; according to the method, classification of environment sound is introduced in the sound acquisition stage, and scene association is performed on the operation sound of the photovoltaic equipment and the surrounding background sound in combination with Mel-frequency cepstrum coefficient extraction and acoustic scene recognition, so that a more targeted reference framework is provided for subsequent analysis. Modeling of multi-source sound features is achieved by synchronously collecting operation sound of an inverter and a cooling fan in equipment and extracting spectrum peak frequency points and amplitudes. In the signal processing process, multiple sub-bands are divided on the basis of scene correlation spectrum peak frequency points, so that each sub-band is aligned with the acoustic characteristics of equipment, the structural precision of short-time energy envelope extraction is improved, and it is ensured that the cross-correlation analysis result is more reliable.

The invention relates to the technical field of indoor old people safety monitoring, and discloses an indoor old people tumble detection system based on a hybrid mode, which comprises a video acquisition module, an audio acquisition module, an identity recognition module, a tumble detection module, an emotion recognition module and an alarm module. According to the method of the indoor old people tumble detection system based on the mixed mode, video and audio data are creatively fused, multi-dimensional monitoring of the state of the old people, capturing of action postures of the old people by the video acquisition module and obtaining of voice and environment sound information by the audio acquisition module are achieved, and the two complements each other; abnormal sound in the audio, such as collision sound of falling and shouting sound, can assist in judgment, the multi-dimensional data acquisition and analysis mode greatly reduces misjudgment and missed judgment caused by single data, the accuracy and reliability of detection are remarkably improved, and the safety of old people is comprehensively guaranteed.

The embodiment of the invention discloses a range hood control method and device, electronic equipment and a storage medium, and the range hood control method comprises the steps that environment sound signals are collected; performing feature extraction on the environment sound signal to obtain a sound frequency feature of the environment sound signal; if the sound frequency characteristics meet the preset cooker starting sound characteristics, determining a target working mode; and starting based on the target working mode so as to execute corresponding smoke exhaust operation. Visibly, by automatically sensing starting of the cooker, the smoke exhaust function is responded and started in time, the situation that the range hood is not started in time due to human negligence, oil smoke diffusion and potential health risks are caused can be prevented, and the intelligent degree is improved.

The invention relates to the technical field of wing-mounted flight simulation, in particular to an immersive active control wing-mounted flight simulation system. The system comprises a physical simulation platform used for bearing an experiencer and providing immersive sensory feedback; the motion capture subsystem is used for collecting motion data of an experiencer in real time; the wing-mounted flight aerodynamic modeling subsystem is used for calculating aerodynamic characteristics in the wing-mounted flight process; the dynamic wind feeling simulation subsystem is used for dynamically adjusting the intensity and direction of a wind field and simulating wind pressure distribution in different flight states; the dynamic stress control subsystem is used for applying dynamic force feedback to the experiencer and simulating stress change in the flight process; the three-dimensional visual subsystem is used for simulating a visual picture in real time; and the sound subsystem is used for comprehensively simulating the environment sound effect in the flight process. According to the invention, the immersion and reality of wing-mounted flight simulation are greatly improved, and the safety and reliability are ensured.

The invention relates to the field of hearing equipment, in particular to an earphone system, an earphone and a control method of a camera module of the earphone. The earphone system comprises a sound acquisition module and a camera shooting module which are arranged on an earphone, and a processing module, the sound acquisition module is used for acquiring environment sound data of a space where the earphone wearer is located; the camera module is used for shooting under the control of the processing module; and the processing module is used for determining a current scene where the earphone wearer is located according to the environment sound data, and awakening the camera module to shoot under the condition that the current scene is a preset target scene.

The invention relates to the technical field of sound box regulation and control, in particular to a sound box self-adaptive regulation and control method and system based on environmental noise characteristics. The method comprises the following steps: acquiring and analyzing a plurality of pieces of real-time environment sound information, and determining a plurality of pieces of sound signal information; analyzing the plurality of pieces of sound signal information, determining a plurality of pieces of noise information, and determining a plurality of frequency band noise features in combination with preset frequency band information; audience distribution information and sound distribution information are obtained and analyzed, and a preliminary adjustment strategy is determined; based on the preliminary adjustment strategy, determining an adaptive dynamic adjustment strategy according to the plurality of frequency band noise characteristics; and according to the adaptive dynamic adjustment strategy, adaptive dynamic adjustment is carried out on the sound equipment. The determination of the preliminary adjustment strategy can provide good preliminary hearing experience for the audience. Through adaptive adjustment, the sound system can be quickly and effectively adjusted in a complex and variable noise environment, interference of noise on sound effects is reduced, and the best hearing experience is brought to audiences.

The invention relates to the technical field of voice processing, can be applied to business scenes of financial science and technology, medical treatment and health and the like, and discloses an authenticity analysis method, device and equipment based on environmental sound characteristics and a medium. Performing voice separation processing on the original voice data to generate environment voice data and pure voice data, analyzing the environment voice data and retrieving knowledge information associated with the environment voice data, and identifying the content of the pure voice data to generate dialogue text data, and inputting the environment sound features, the knowledge information, the dialogue text data and the user declaration information into an analysis model, and outputting a authenticity analysis result. According to the method, the environment sound data and the voice content are separated, the available features of the environment sound data and the voice content are extracted respectively, and the background knowledge and the user declaration information are combined to perform fusion reasoning in the unified analysis model, so that the accuracy of authenticity judgment and the adaptability to complex scenes can be improved.

The invention provides a campus safety monitoring method and system based on multi-modal perception, and relates to the technical field of campus safety, and the method comprises the steps: collecting multi-modal data in real time through a front-end perception unit, the multi-modal data comprising human body motion data, environmental sound data and personnel physiological data; independently analyzing the multi-modal data, and respectively generating a first early warning signal, a second early warning signal and a third early warning signal; the three early warning signals are uploaded to a cloud analysis platform for fusion analysis, so that the cloud analysis platform determines a comprehensive alarm level based on the signal intensity, the superposition weight and the time-space dynamic threshold of the three early warning signals; the space-time dynamic threshold value is dynamically adjusted based on the incident time and the incident place; early warning information is directionally distributed to a preset terminal according to the comprehensive alarm level and the incident site, and emergency response operation is triggered. According to the method provided by the invention, the campus spoofing event can be detected under the condition that the privacy of students is not influenced, and the detection result is more accurate.

A method and a system for triggering a smart dialogue with audio-video reality are provided, in which a reality image interface is opened in a user device, in which a camera is activated to obtain an environment image, and a microphone is activated to obtain an environment audio. Afterwards, the server may receive the location information and the reality image request from the user device, and may include identifying the environment image to obtain the environment object, and identifying the environment audio to obtain the environment sound. Then, after an intelligent dialogue link point displayed on the reality image interface is triggered, an intelligent dialogue program is started, an intelligent dialogue interface can be started in the intelligent dialogue program, and after the chat robot is imported, dialogue content can be generated by running a natural language model according to the position information, the environment object and / or the environment sound.

The invention provides an up-mixing processing method, system and device for a stereo audio video, and a storage medium, and relates to the technical field of audio and video processing, and the method comprises the steps: obtaining a to-be-processed stereo audio video, carrying out the multi-stream separation of the to-be-processed stereo audio video, obtaining a plurality of independent sound source components, the to-be-processed stereo audio video comprises a to-be-processed stereo audio or a to-be-processed stereo video; performing dry and wet sound processing on the to-be-processed stereo sound video to obtain an environment sound component; performing frequency band extension on the environment sound component to obtain a target environment sound component; and carrying out space rendering on each independent sound source component and the target environment sound component by adopting a vector-based amplitude translation method, and carrying out multichannel output fusion to obtain a multichannel audio / video. According to the method, the sound source is accurately positioned and efficiently separated, the dynamic sense and the space sense of the sound source object are enhanced, and the audio and video upmix processing quality and the user experience are improved.

The invention provides a compensation method and system for a high-precision space sound scene of an earphone, and is applied to the field of data processing. The preset microphone array is used for capturing the environment sound data in real time, dynamic EQ compensation is carried out according to the environment type, the intelligent earphone is helped to adapt to sound scenes in different environments, the tone quality stability and the environment adaptability are improved, meanwhile, the unique space sound scene of a user is constructed according to the music type and the frequency response, and the user experience is improved. In combination with dynamic EQ compensation, sound effect setting can be adjusted in real time according to the level and type of environmental noise, a user can obtain consistent music experience in different environments, immersion is enhanced, dynamic sound source positioning and sound field reconstruction are carried out based on a head related transmission function, and simulation volume is transmitted into ear canals, so that the user experience is improved. The head movement of the user is tracked in real time, audio rendering is adjusted, the omnibearing surround sound effect can be achieved, and more real and immersive music experience is provided for the user.

The invention relates to the technical field of medical monitoring, and particularly discloses a remote monitoring nursing method, device and equipment for old people and a storage medium, and the method comprises the steps: obtaining wrist acceleration information and environment sound information; acquiring a wrist acceleration frequency spectrum and an environment sound frequency spectrum; calculating the ratio of the noise intensity of the environment sound information at each frequency to the environment noise reference intensity to obtain a noise intensity proportion; acquiring a weighted wrist acceleration frequency spectrum; splicing to form a fusion feature vector; and adopting a preset health risk identification model to carry out risk level evaluation so as to judge the current health state of the old people, and generating alarm information when the risk level exceeds a preset threshold value. According to the method, monitoring and abnormal early warning of the health state of the old people are realized, the motion information and the environment sound information are comprehensively utilized, the interference of sound noise of household appliances on the acceleration information can be effectively inhibited, and the accuracy of health risk identification is improved.

The present description relates to methods and systems for a medical dictation. In one example, a stethoscope includes a first microphone positioned to capture physiological sounds of a patient, a second microphone positioned to capture ambient sounds, one or more processors, and memory storing instructions executable by the one or more processors to: during a stethoscope mode, obtain a first signal from the first microphone and a second signal from the second microphone, process the first signal to capture a physiological sound signal, including performing noise cancellation on the first signal based on the second signal, and transmit the physiological sound signal to an external computing device and / or a speaker of the stethoscope; and during a dictation mode, obtain the second signal from the second microphone, process the second signal to capture a voice signal, and transmit the voice signal to the external computing device.

The invention relates to the technical field of artificial intelligence, and particularly provides a multi-modal information fusion emotion detection method based on visible light and voiceprint. The method comprises the following steps: respectively acquiring video images and environment sounds of old people in a monitoring environment through a visible light image module and an audio voiceprint acquisition module; a facial expression detection module is used for recognizing a human face in the video image, and a visual anomaly signal is output; recognizing an audio voiceprint signal in the environmental sound according to a voiceprint detection module, and outputting an audio abnormal signal; according to the method, the detection accuracy is effectively improved, the missing report is reduced, the method is suitable for home and old-age care institution environments, and the method is of great significance to guarantee the safety of old people and alleviate serious consequences caused by falling down.

At least one exemplary embodiment is directed to a method and device for voice operated control with learning. The method can include measuring a first sound received from a first microphone, measuring a second sound received from a second microphone, detecting a spoken voice based on an analysis of measurements taken at the first and second microphone, learning from the analysis when the user is speaking and a speaking level in noisy environments, training a decision unit from the learning to be robust to a detection of the spoken voice in the noisy environments, mixing the first sound and the second sound to produce a mixed signal, and controlling the production of the mixed signal based on the learning of one or more aspects of the spoken voice and ambient sounds in the noisy environments.

The invention discloses an intelligent interaction system for recognizing voiceprint information through environmental sound, and relates to the field of man-machine interaction. Comprising an environment sound pickup module which picks up environment sound in a vehicle by using a microphone array and carries out filtering and denoising processing on the sound; the voiceprint feature extraction module is used for converting the sound signal into a spectrogram by using short-time Fourier transform, distinguishing different passengers through different waveform features, and then extracting MDCC features in the sound signal as sound feature vectors; according to the invention, through picking up the environment sound, then extracting the voice data of the passenger, carrying out feature extraction on the voice data again, obtaining the voice content of the passenger, carrying out emotion and intention analysis on the voice content of the passenger, and then carrying out recommendation and related control, the active degree and the automation degree of man-machine interaction are increased, and the experience of the passenger is improved.

The present disclosure provides a gas sensor, including a substrate, a first housing fixed on the substrate and enclosed with the substrate to form a first chamber, and a first infrared transmitter and a first acoustic sensor connected to the substrate. The first acoustic sensor and the first infrared transmitter are housed in the first chamber, and the first housing is provided with a first venthole. The gas sensor also includes an environmental detection assembly connected to the substrate and located outside the first housing, and a differential processor connected to the substrate. The differential processor of the present disclosure can eliminate the ambient sound signal and the vibration signal in the first detection signal according to the second detection signal. Eliminate the strong interference of noise and vibration in the external environment, and improve the accuracy of the gas concentration detection of the gas sensor.

The invention relates to a sound output control method based on multiple game levels, and relates to the field of sound output control of cloud games, which comprises the following steps: establishing an entry library, selecting specific entries from the entry library, randomly generating levels by the game according to the selected entries, and extracting a basic music library corresponding to the specific entries; randomly selecting a fixed number of basic music from the extracted basic music library, combining the basic music into background music, environment sound effect, atmosphere sound effect and customs clearance music by using a random algorithm, and generating a music playing strategy according to the selected vocabulary entry; a large batch of random music is intelligently generated through machine learning to meet the requirements of multiple game levels, and the workload of game music making is greatly reduced; music used in the game is split into basic music capable of being freely combined according to types and use occasions, and the requirement of the game for the music is met on the premise that resources and cost are saved.

The invention relates to the field of mobile truck identification, and particularly discloses a mobile truck identification system and method of a mobile robot. The method comprises the following steps: firstly, acquiring multi-region images of the surrounding environment of the mobile robot acquired by a camera, ultrasonic distance data between the mobile robot and the surrounding environment acquired by an ultrasonic sensor, and environment sound data at a plurality of preset time points acquired by a sound sensor; according to the method, feature extraction and correlation analysis are carried out on the three parts, and finally whether the mobile robot needs to carry out avoidance operation is judged through a classifier, so that the understanding ability of the mobile robot to the surrounding environment is improved in the complex and dynamic industrial environment, and efficient and safe operation on the mobile truck in the industrial environment is ensured.

The invention discloses a head-mounted earmuff device comprising: two earmuff bodies and a headband body. Each earmuff body has an earpad portion and a housing portion. The earpad portion has an accommodating hole. The housing portion is pivotably connected to the earpad portion. The housing portion covers the outer side surface of the earpad portion to isolate environmental sounds. The housing portion is pivoted to leave away from the outer side surface of the earpad portion to allow reception of the environmental sounds. The headband body has a mounting member and two assembling portions, and a pivoting end of the assembling portion is pivotably connected to the earpad portion. A sliding end of the assembling portion is slidably connected to a mounting section of the mounting member, and a dimension of a head-mounted space is adjustable by sliding and fixing the two assembling portions with respect to the mounting member.

The invention belongs to the technical field of earphone noise reduction, and provides a noise reduction regulation and control method for an earphone and a noise reduction earphone. The method comprises the following steps: acquiring a first environment sound signal of an environment area, and extracting human voice features from the first environment sound signal to construct a human voice feature template library; in response to a noise reduction regulation and control instruction, collecting a second environment sound signal of the environment area, converting the time domain signal into a frequency domain signal through Fourier transform, and extracting a frequency spectrum feature from the frequency domain signal; performing matching calculation on the spectrum features and a human voice feature template library to determine environment voice signals, human voice signals and noise signals; an active noise reduction algorithm is adopted to generate offset sound waves opposite to the noise signals in phase, the human voice signals are amplified, and the offset sound waves and the amplified human voice signals are output through a loudspeaker of the earphone. According to the invention, effective noise filtering and clear transparent transmission of specific human voice are realized, smooth communication can be realized without taking off the earphone, and the use experience is improved.

The invention belongs to the field of industrial noise control, and relates to an echo cancellation and noise reduction method and system for environmental sound of a steel mill workshop. The method comprises the following steps: (1) acquiring a sound signal of an on-site monitoring point in a steel mill workshop environment in a working process in real time; the field monitoring point comprises each noise source and each target source; (2) aligning the original sound signal and the workshop echo signal from the same on-site monitoring point in time to obtain an aligned signal; (3) filtering the aligned signal obtained in the step (2) so as to suppress noise and echo signals superposed in a channel; and (4) training a neural network mask, processing the sound signal by using a mask frequency domain to suppress a residual noise signal, and outputting a clean sound signal. According to the method provided by the invention, the application limitation of a traditional sound noise reduction technology in a complex industrial environment is effectively solved.

The invention discloses a vehicle door control method and device, electronic equipment and a vehicle, and belongs to the technical field of vehicles. The method comprises the steps that when the vehicle senses an external knocking action, the environment sound intensity is detected; the response feasibility of the knocking signal is determined according to the environment sound intensity to control the vehicle door to be opened. According to the method, a user can unlock and open the vehicle door only through simple knocking without traditional key or key operation, the method is particularly suitable for the situation that a heavy object is held by hand or the key cannot be easily taken out, whether the knocking signal is responded or not is determined according to the environment sound intensity, false triggering can be reduced, high accuracy of knocking to open the door in the complex environment is achieved, and the user experience is improved. And the trouble that the user can take effect and is invalid when knocking to open the vehicle door is reduced.

A system and method to generate a video is provided. The method may include generating, based on a user input including a description of a desired video, a structured script including one or more of scene descriptions, dialogue, or explicit shot-level information. The method also includes generating, based on the structured script, a sequence of video frames representing one or more scenes. The method further includes generating, based on the structured script and the sequence of video frames, an audio track including one or more of ambient sounds, sound effects, or music. The generated audio track being temporally synchronized with the sequence of video frames. The method also includes combining the sequence of video frames with the audio track to generate a synchronized video output representing the desired video.