502 results about "Environmental sounds" patented technology

The invention discloses a long video multi-modal understanding and question-answering method and system based on large model and retrieval enhancement generation. The method comprises the following steps: 1) a multi-modal feature extraction module; 2) a multi-modal synchronization and alignment mechanism; 3) constructing a structured memory pool; 4) querying a drive generation mechanism; 5) incremental updating and memory compression strategy; and 6) unifying the multi-modal representation space. The invention provides a long video multi-mode understanding method fusing a large language model and retrieval enhancement generation, and aims to break through the limitation of a traditional method in the aspects of single-mode processing and semantic fragmentation. According to the method, video image features are extracted through a visual model (such as YOLO and ViT), voice transcription and environment voice description are obtained in combination with an audio model (such as Whisper and Qwen-Audio), and unified coding of vision, voice and audio in a long video is achieved. Then, a structured memory pool is constructed through semantic consistency segmentation and timestamp alignment technologies to store time slice data of different modalities.

The invention relates to the technical field of voice processing, can be applied to business scenes of financial science and technology, medical treatment and health and the like, and discloses an authenticity analysis method, device and equipment based on environmental sound characteristics and a medium. Performing voice separation processing on the original voice data to generate environment voice data and pure voice data, analyzing the environment voice data and retrieving knowledge information associated with the environment voice data, and identifying the content of the pure voice data to generate dialogue text data, and inputting the environment sound features, the knowledge information, the dialogue text data and the user declaration information into an analysis model, and outputting a authenticity analysis result. According to the method, the environment sound data and the voice content are separated, the available features of the environment sound data and the voice content are extracted respectively, and the background knowledge and the user declaration information are combined to perform fusion reasoning in the unified analysis model, so that the accuracy of authenticity judgment and the adaptability to complex scenes can be improved.

The invention provides an up-mixing processing method, system and device for a stereo audio video, and a storage medium, and relates to the technical field of audio and video processing, and the method comprises the steps: obtaining a to-be-processed stereo audio video, carrying out the multi-stream separation of the to-be-processed stereo audio video, obtaining a plurality of independent sound source components, the to-be-processed stereo audio video comprises a to-be-processed stereo audio or a to-be-processed stereo video; performing dry and wet sound processing on the to-be-processed stereo sound video to obtain an environment sound component; performing frequency band extension on the environment sound component to obtain a target environment sound component; and carrying out space rendering on each independent sound source component and the target environment sound component by adopting a vector-based amplitude translation method, and carrying out multichannel output fusion to obtain a multichannel audio / video. According to the method, the sound source is accurately positioned and efficiently separated, the dynamic sense and the space sense of the sound source object are enhanced, and the audio and video upmix processing quality and the user experience are improved.

The invention relates to the technical field of artificial intelligence, and particularly provides a multi-modal information fusion emotion detection method based on visible light and voiceprint. The method comprises the following steps: respectively acquiring video images and environment sounds of old people in a monitoring environment through a visible light image module and an audio voiceprint acquisition module; a facial expression detection module is used for recognizing a human face in the video image, and a visual anomaly signal is output; recognizing an audio voiceprint signal in the environmental sound according to a voiceprint detection module, and outputting an audio abnormal signal; according to the method, the detection accuracy is effectively improved, the missing report is reduced, the method is suitable for home and old-age care institution environments, and the method is of great significance to guarantee the safety of old people and alleviate serious consequences caused by falling down.

The invention belongs to the technical field of earphone noise reduction, and provides a noise reduction regulation and control method for an earphone and a noise reduction earphone. The method comprises the following steps: acquiring a first environment sound signal of an environment area, and extracting human voice features from the first environment sound signal to construct a human voice feature template library; in response to a noise reduction regulation and control instruction, collecting a second environment sound signal of the environment area, converting the time domain signal into a frequency domain signal through Fourier transform, and extracting a frequency spectrum feature from the frequency domain signal; performing matching calculation on the spectrum features and a human voice feature template library to determine environment voice signals, human voice signals and noise signals; an active noise reduction algorithm is adopted to generate offset sound waves opposite to the noise signals in phase, the human voice signals are amplified, and the offset sound waves and the amplified human voice signals are output through a loudspeaker of the earphone. According to the invention, effective noise filtering and clear transparent transmission of specific human voice are realized, smooth communication can be realized without taking off the earphone, and the use experience is improved.

A system and method to generate a video is provided. The method may include generating, based on a user input including a description of a desired video, a structured script including one or more of scene descriptions, dialogue, or explicit shot-level information. The method also includes generating, based on the structured script, a sequence of video frames representing one or more scenes. The method further includes generating, based on the structured script and the sequence of video frames, an audio track including one or more of ambient sounds, sound effects, or music. The generated audio track being temporally synchronized with the sequence of video frames. The method also includes combining the sequence of video frames with the audio track to generate a synchronized video output representing the desired video.

Various implementations include approaches for device control and / or sound source selection in audio devices. In some implementations, an audio device includes: an electro-acoustic transducer for providing an audio output; a set of microphones for detecting ambient sounds; and a processor coupled with the electro-acoustic transducer and the set of microphones, the processor configured to: evaluate microphone signals from the set of microphones to identify classes of sound sources in the ambient sounds; and adjust output of at least one class of the ambient sounds relative to another class of ambient sounds based on a user input.

The invention relates to a debris flow early warning system and method based on Transform fusion sound and image, the system comprises a front end acquisition module, an edge calculation module and a remote alarm module, the system can synchronously acquire visible light image and environment sound information of a monitoring area, and uploads the acquired data to a cloud server in real time through a communication module; the cloud model is based on a Transform structure, carries out deep fusion analysis on sound and image features, and combines synthetic data and a data enhancement strategy, thereby effectively improving the recognition precision of the model for weak symptoms before debris flow occurrence and the overall generalization ability of the system. The system can be widely applied to debris flow high-incidence areas, meets the actual requirements of high-frequency monitoring, intelligent identification and rapid early warning of geological disasters in a complex environment, solves the problems of single mode, low identification precision, difficult arrangement and the like of an existing system, and improves the intelligent level and response efficiency of the geological disaster monitoring system.

The invention discloses a sound environment analysis and monitoring method based on artificial intelligence, and belongs to the field of artificial intelligence. Sound feature extraction and parameter analysis; converting sound into text; converting the sound event into a text description form by using a multi-mode big language model with a sound event analysis function and outputting text information; timestamps are added to the output text information, and the text information is classified, sorted, recorded and stored for a user to trace back; determining a key sound event by identifying a dialogue scene; after the key sound event is triggered, the device reminds the user according to a specific form. Any equipment does not need to be implanted, and postoperative risks and maintenance cost do not exist; a user can perceive environment sound and understand dialogue content without listening by himself or herself, and a hearing aid is not needed; sign language actions do not need to be captured through a camera, and the problem of dialect sign language recognition errors does not exist; the user does not need to stare at the character display device in real time during use, and the user is reminded in a specific mode after the key sound event is triggered.

A method for adaptive additive sound includes receiving ambient sound data corresponding to ambient sound in a first zone acquired by a microphone in the first zone, analyzing the ambient sound data from the first zone, generating audio signal data for the second zone based at least in part on the ambient sound data from the first zone, and transmitting the audio signal data for the second zone to a speaker in the second zone. The first zone is separate from the second zone within a space.

The present disclosure provides for the division of environmental sounds from speech sounds to extract and analyze the behaviors and activities occurring in the environment; thus expanding and improving the functionality of AI assistant devices. These environmental sounds can be securely uploaded to an electronic chart, and may be used to aid in the treatment of existing conditions or the prophylaxis / mitigation of conditions not yet experienced by a patient under observation. Accordingly, the present disclosure provides for improved functionality in assistant devices and devices linked to the AI assistant devices.

The invention discloses an intelligent health monitoring alarm system, and the system comprises an environment behavior monitoring module which is used for collecting environment and behavior data related to daily activities of a user, and the environment and behavior data comprises water data, power data, gas data, image data, environment sound data and refrigerator door state change data; wherein the environment sound data particularly refers to a playing sound source signal which is acquired by an indoor microphone and is generated by a television or audio playing equipment; the data processing center is used for receiving and storing the environment and behavior data; and the user habit learning module is used for establishing and dynamically updating a personalized daily behavior baseline model of the user through a machine learning algorithm based on historical data. According to the invention, through multi-dimensional non-contact monitoring, the influence of contact equipment on the self-respect of the elderly can be avoided, and more comprehensive and intelligent health monitoring alarm of the elderly can be monitored at the same time.

A method and apparatus to assist people with hearing loss. An augmented reality device with microphones and a display captures speech of a person talking to the wearer of the device and displays real-time captions in the wearer's field of view, while optionally not captioning the wearer's own speech. The microphone system in this apparatus inverts the use of microphones in augmented reality devices by analyzing and processing environmental sounds while ignoring the wearer's own voice.

The invention relates to the technical field of acoustic signal processing, and discloses a motion state detection method and device based on a multi-sensor fusion signal and application, and the method comprises the steps: collecting an environment sound signal and a user motion vibration signal through at least two sound sensors disposed at different positions; carrying out signal preprocessing on the environment sound signal and the motion vibration signal respectively and then carrying out feature extraction; and performing motion mode classification based on a feature extraction result and outputting a motion state detection result. According to the invention, through a dual-microphone signal fusion technology, various motion states can be accurately identified, and motion speed estimation and environment safety early warning functions are realized. The technical problems that a traditional single sensor scheme is single in function and prone to noise interference are solved.

A system and method to generate a video is provided. The method may include generating, based on a user input including a description of a desired video, a structured script including one or more of scene descriptions, dialogue, or explicit shot-level information. The method also includes generating, based on the structured script, a sequence of video frames representing one or more scenes. The method further includes generating, based on the structured script and the sequence of video frames, an audio track including one or more of ambient sounds, sound effects, or music. The generated audio track being temporally synchronized with the sequence of video frames. The method also includes combining the sequence of video frames with the audio track to generate a synchronized video output representing the desired video.

The utility model discloses an off-ear type loudspeaking assembly and a helmet, the off-ear type loudspeaking assembly comprises a housing, a loudspeaker and an exhaust channel, the housing is internally provided with an accommodating cavity, and the housing is provided with a sound guide port and an exhaust port; the loudspeaker is installed in the containing cavity and provided with a first side and a second side which are oppositely arranged, the first side and one end of the containing cavity are spaced to form a sound guide interval, and the sound guide interval is communicated with the sound guide opening; the second side and the other end of the containing cavity are spaced to form an exhaust interval, and the exhaust interval communicates with the exhaust port. The exhaust channel is arranged outside the exhaust port, and the exhaust port is communicated with the exhaust channel and the exhaust interval, so that the second side is communicated with the outside of the shell. The off-ear loudspeaking assembly can reduce the bass offset phenomenon between the rear side and the front side of the loudspeaker, and provides a high-quality sound effect for a user. According to the helmet, sound can be guided to human ears through the off-ear loudspeaking assembly, the helmet does not cover the human ears, a user can hear environmental sound while enjoying music, and the helmet is safer to use.

The invention provides a multi-mode perception gas station environment safety early warning method and system, which are applied to the technical field of safety early warning, and are used for obtaining video and audio data, extracting vehicle and environment sound information, carrying out preliminary judgment, and carrying out event confirmation, priority ranking and linkage instruction generation through a rule inference engine. Therefore, deep fusion and comprehensive analysis of the multi-modal information are achieved, the accuracy and robustness of event judgment are improved, concurrent events can be effectively processed, refined linkage control is achieved, the accuracy and robustness of event judgment are improved through multi-modal information fusion, priority ranking and linkage can be carried out according to the events, and the efficiency of event judgment is improved. The method has the advantages that the problems that single-modal information is limited, simple fusion is insufficient, and concurrent event processing is not fine are solved.

The invention discloses a control method of a cleaning robot, a storage medium and equipment, and relates to the technical field of smart home / smart home, the control method of the cleaning robot comprises the following steps: determining working parameters of the cleaning robot according to a cleaning instruction, and controlling the cleaning robot to operate according to the working parameters; in the operation process of the cleaning robot, the environment sound of the environment where the cleaning robot is located and / or the emotion information of a user in the environment are / is obtained, and the working parameters of the cleaning robot are adjusted according to the environment sound and / or the emotion information. According to the method, the cleaning strategy is dynamically adjusted based on the environment change, so that the cleaning robot can better adapt to different family environments and user emotions, individual requirements of different users are met, interference to daily activities of the users is reduced, and the use experience of the users is improved.

The invention discloses an intelligent exoskeleton bone auxiliary conduction hearing aid system capable of being remotely controlled and having an electroencephalogram control function, and relates to the technical field of intelligent rehabilitation robots and hearing aid devices. The wearable mechanical part comprises a flexible actuator, an elastic fabric base material, an inertial measurement unit IMU, a plantar pressure sensor array, a surface myoelectricity EMG sensor and an electroencephalogram EEG sensor. And the information processing communication part comprises a central controller, a bone conduction hearing aid module, a multi-mode sensor, an embedded SoC, a DSP / AI accelerator, a 4G / 5G / Wi-Fi module and a power management unit. The flexible exoskeleton walking aid system and the bone conduction hearing aid module are integrated, the electroencephalogram EEG sensor is additionally arranged to achieve the electroencephalogram control function, and cooperation of the three functions of movement assistance, auditory perception and neural intention recognition is achieved. A user can directly control the exoskeleton action mode through electroencephalogram signals, meanwhile, intelligent assistance of lower limb joints is obtained in the walking process, and environment sounds and voice prompts are clearly received in a bone conduction mode. According to the system, the perception ability, the control flexibility and the social participation degree of old people or rehabilitation patients who are inconvenient to move and accompanied with hearing impairment in a complex environment are remarkably improved, and more natural and convenient man-machine interaction experience is provided for users.

The invention discloses an infant cry detection and translation system based on voice feature recognition in the technical field of voice recognition. The infant cry detection and translation system comprises a cloud database, an intelligent system and acquisition equipment, the intelligent system comprises an acquisition module, a preprocessing module, an analysis module, a translation module, a feedback module, an input module and an adjustment module. The acquisition module is used for acquiring environment sound and various indexes of a baby; the preprocessing module is used for preprocessing voiceprint information; the analysis module is used for calling the cloud database, analyzing and judging the infant crying reason and analyzing the environment sound condition; the translation module is used for translating the baby cry and sending suggestions to the guardian terminal; the feedback module is used for receiving feedback information; the input module is used for recording feedback information and various indexes of the baby; and the adjusting module is used for adjusting the system sensitivity. According to the system, sound information of the environment where a baby is located is collected through the collection module and is analyzed by the analysis module, and finally the sensitivity of the system is adjusted through the adjustment module.

The invention provides a speech synthesis method and device, electronic equipment and a storage medium, and relates to the technical field of speech synthesis, and the method introduces a target attribute text in a speech synthesis process, can support speech synthesis with an audio attribute corresponding to the target attribute text, and improves the speech synthesis efficiency. Therefore, the expressive force and rhythm of the target synthetic speech can be controlled according to the user demand, so that the target synthetic speech better meets the user demand, and the user experience is improved. A speech synthesis model is obtained through training of a text sample with an attribute tag, so that the speech synthesis model has an audio attribute control capability during speech synthesis, and audio attributes such as tone, speech style, emotional expression, human settings, mood, rhythm and the like of target synthesis speech can be controlled at the same time; and audio attributes such as language switching, environment sound effect, dialect generation and the like can be supported, and controllability is improved while the generation quality of the speech synthesis model is ensured.

The invention relates to the field of speech analysis, and discloses a natural sound interference stripping algorithm and an application thereof in noise monitoring, which are used for efficiently and accurately stripping interference components in a target speech signal in a complex natural sound environment. Comprising the following steps: synchronously acquiring an environmental sound signal by using a spatially distributed microphone array, generating an original mixed voice signal with spatial coherence, performing real-time fractional order differential processing, strengthening resonance characteristics, realizing spatial separation of a voice guided wave mode and an interference radiation mode through real-time phase analysis, and extracting an interference radiation mode component. And reconstructing a time domain interference waveform, and outputting a pure target voice signal according to the original mixed voice signal and the reconstructed interference waveform. The system has the functions of residual interference sound energy recovery, equipment vibration suppression, environment sudden change monitoring, system resetting, bimodal output and the like, the stability, reliability and practicability of the system are effectively improved, and pure voice can be accurately extracted in a complex environment.

The invention belongs to the technical field of intelligent breeding, and discloses an animal respiratory tract health detection method and system, and the method comprises the steps: carrying out the noise reduction preprocessing and marking of a sound segment of a target animal, and obtaining a respiratory tract abnormal sound segment and a respiratory tract health sound segment of the target animal; constructing a training set; an audio encoder large model based on a large-scale general audio data set and pre-trained through self-supervised learning is adopted, an output layer of audio classification is added, and an audio classification model used for recognizing the abnormal respiratory tract sound is constructed; when it is detected that the volume root mean square value of the collected continuous environment sound exceeds a preset threshold value, triggering and extracting a sound fragment with the time point as the center, marking the sound fragment as a target sound fragment, and inputting the target sound fragment into the trained audio classification model to obtain a classification result. According to the method, the dependence on the labeled data is remarkably reduced, the recognition accuracy and the model robustness are improved, and intelligent and automatic continuous monitoring and early warning are realized.

The present invention is an emergency vehicle alert system designed to enhance road safety by notifying drivers of approaching emergency vehicles such as ambulances, police cruisers, and fire trucks. The system includes a software application integrated into a vehicle's dashboard and is equipped with a database of emergency siren sound profiles and a signal processing module to analyze ambient sound and identify emergency vehicle sirens. The system captures ambient sound using built-in microphones or sensors, filters irrelevant noise, and generates alerts such as visual notifications on the dashboard, audible alerts, and / or text-based messages. Additionally, the system mutes the vehicle's audio system during alerts. The invention also includes an aftermarket cigarette lighter plug-in variant with embedded detection and alert capabilities.

A method for noise suppression in a hearing instrument includes using an acousto-electric input transducer of the hearing instrument to generate an input signal from ambient sound. A frequency-band-wise noise suppression is applied to a processing signal derived from the input signal. Stationary noise is detected in the respective frequency band, and depending on the detected stationary noise, an amplification factor of the processing signal is set for the relevant frequency band. An analysis adapted to detect stationary and non-stationary noise is applied to the processing signal. The analysis has a lower frequency resolution than the frequency-band-wise noise suppression and, upon detected presence of stationary and / or non-stationary noise in the analysis of the processing signal, the stationary noise in the frequency-band-wise noise suppression is presumed to be detected in each frequency band, and the corresponding amplification factors are set.

The present application provides a collision prompting method, which is suitable for a mobile device. The mobile device comprises an acceleration sensor, a sound sensor and a display screen. First, according to the acceleration data, it is determined whether the mobile device is in a falling state. After confirming that the mobile device is in the falling state, the ambient sound data is collected. Then, according to the acceleration data, it is determined whether the mobile device has a collision. After confirming that the mobile device has a collision, a preset time is calculated, and after the preset time, the collection of the ambient sound data is stopped. Next, according to the acceleration data and the collected ambient sound data, the severity of the collision of the mobile device is determined. Then, according to the severity of the collision, a prompt signal is generated. The present application also provides a collision prompting device.

The application provides a lighting device control circuit, a control method and a lighting device, which are applied to the technical field of intelligent traffic, the circuit is provided with a first light collection device and a sound collection device, light brightness is collected through the first light collection device, and environmental sound is collected through the sound collection device, in the case that the light brightness meets a first preset condition and the environmental sound meets a second preset condition, a second switch is controlled to be closed, so that a driving circuit of the lighting device is powered on and drives a light source in the lighting device to work, through the lighting device control circuit, the environmental light brightness and the environmental sound can be comprehensively considered, compared with the control mode of controlling the lighting device to work according to fixed time in the prior art, the application can more flexibly adapt to environmental changes, realizes the control of the lighting device according to the environmental changes, and further improves the lighting effect.

The present invention discloses an intelligent stop-barking method, device, and computer-readable storage medium. The method runs on an embedded terminal worn by a pet. The embedded terminal is built in with a preset pet barking model. The method includes: sound collection: obtaining a decibel value of ambient sound of the pet's surrounding environment; model comparison: if the decibel value of the sound is greater than a preset decibel value, then the sound collected is compared with the pet barking model and a comparison result is output; and output punishment: if the comparison result is greater than a preset punishment value, then the punishment module is triggered to stop the pet from barking. The technical solution, through machine learning models and signal processing techniques, enables high-accuracy dog barking sound recognition. It reduces reliance on powerful computing resources, and achieves stand-alone operation of data model, thereby improving feasibility and popularization.

1. The name of the designed product: hearing aid (LS528). 2. The use of the designed product: for amplifying environmental sound, helping the hearing impaired to hear normal conversation and other important sound. 3. The design points of the designed product: in shape. 4. The picture or photo that best indicates the design points: perspective view 1.

This disclosure relates to a hearing aid for placement on head of a user comprising a first second part. The first part may comprise an acoustic input transducer adapted to convert ambient sound picked up at the ear of the user to an electric signal, a signal processor adapted to process the electric signal according to specifications of user into a processed electric signal, and an output transducer adapted to covert the processed electric signal into a transmission signal, The second part may comprise an anchor adapted to fixate said second part under the skin to skull bone of the user, and a receiver adapted to receive the transmission signal and convert the transmission signal to an output signal perceivable as sound by the user. The first part may comprise an inner recess adapted to receive an insert element, where the insert element may comprise a first magnet adapted to in cooperation with the second part to cause the first part to attach to the head of the user.