Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

95 results about "Soundscape" patented technology

A soundscape is the acoustic environment as perceived by humans, in context. The term was originally coined by Michael Southworth, and popularised by R. Murray Schafer. There is a varied history of the use of soundscape depending on discipline, ranging from urban design to wildlife ecology to computer science. An important distinction is to separate soundscape from the broader acoustic environment. The acoustic environment is the combination of all the acoustic resources, natural and artificial, within a given area as modified by the environment. The International Organization for Standardization (ISO) standardized these definitions in 2014.(ISO 12913-1:2014)

Methods of presenting dynamic soundscapes for virtual environments

Some examples are directed to systems and methods for presenting spatial audio at a plurality of locations based upon movement of a user viewpoint. Some examples are directed to systems and methods for presenting spatial audio with a level of detail based upon a distance between a location corresponding to spatial audio and a user viewpoint. Some examples are directed to systems and methods for changing a level of audio of an audio component associated with a virtual environment in response to a request to change a level of immersion of the virtual environment.
Owner:APPLE INC

Compensation method and system for high-precision space sound scene of earphone

The invention provides a compensation method and system for a high-precision space sound scene of an earphone, and is applied to the field of data processing. The preset microphone array is used for capturing the environment sound data in real time, dynamic EQ compensation is carried out according to the environment type, the intelligent earphone is helped to adapt to sound scenes in different environments, the tone quality stability and the environment adaptability are improved, meanwhile, the unique space sound scene of a user is constructed according to the music type and the frequency response, and the user experience is improved. In combination with dynamic EQ compensation, sound effect setting can be adjusted in real time according to the level and type of environmental noise, a user can obtain consistent music experience in different environments, immersion is enhanced, dynamic sound source positioning and sound field reconstruction are carried out based on a head related transmission function, and simulation volume is transmitted into ear canals, so that the user experience is improved. The head movement of the user is tracked in real time, audio rendering is adjusted, the omnibearing surround sound effect can be achieved, and more real and immersive music experience is provided for the user.
Owner:SHENZHEN GUANGSU SHIDAI TECHNOLOGY CO LTD

Acousto-optic coupled intelligent sleep aiding method and system

PendingCN121513326AElectrocardiographyMedical devicesAV junctional rhythmSleep state
The invention relates to an acousto-optic coupled intelligent sleep aiding method and system. The method comprises the following steps: constructing an initial sound scene environment and controlling sound and light output to smoothly transit to a reference value; collecting a user respiration signal to obtain a respiration rhythm; adjusting the sound and light output rhythm to be synchronous with the respiratory rhythm; coupling the acousto-optic output with the respiratory rhythm on the basis of keeping synchronization; executing acousto-optic guidance according to the selected sleep aiding mode and the acousto-optic coupling mode, and guiding the respiratory rhythm to a target frequency by adjusting an acousto-optic output change frequency; and when the user is in the sleep state, controlling the sound-light output to smoothly transit to a closed state. By adopting the method, dynamic synchronization and self-adaptive guidance of acousto-optic output and the breathing rhythm of the user can be realized, the problem of rhythm mismatch caused by fixed output rhythm of traditional sleep-aiding equipment is effectively solved, and the sleep-aiding effect is improved.
Owner:KEESON TECH CORP LTD

Sound scene regulation and control method and system for virtual reality scene

The invention provides a sound scene regulation and control method and system for a virtual reality scene, and relates to the virtual reality technology, and the method comprises the steps: segmenting a VR audio / video into slices at equal time intervals; packaging the heart rate variability characteristic data and the VR audio and video into attribute data of slices according to a time sequence of the slices; randomly adjusting the audio attribute of the slice, and collecting heart rate data of different experiencers when experiencing the slice with the adjusted audio attribute; extracting heart rate variability characteristic data, inputting the data into an emotion recognition classifier, and recognizing an emotion state of the experiencer as training data; according to the target emotional state and the counted emotional response, calculating Juyden indexes of different audio attributes to determine an optimal threshold interval of the audio attributes; and according to the association degree between the audio attribute of the optimal threshold interval and the emotional state of the experiencer, whether the audio attribute needs to be adjusted is judged, so that sound scene self-adaptive regulation and control are realized, the problem that sound field creation is not matched with visual experience is solved, and the user experience is improved.
Owner:NANKAI UNIV

Rehabilitation training system for hearing disorder patient based on virtual reality

The invention discloses an auditory disorder patient rehabilitation training system based on virtual reality. The system comprises a perception fusion module, a basic perception reconstruction module, a language content integration module, a rehabilitation training module and a virtual reality auxiliary module. The invention belongs to the technical field of auditory rehabilitation training, and particularly relates to an auditory disorder patient rehabilitation training system based on virtual reality, which adopts a multi-stage cross-modal attention-enhanced voice audiovisual characterization method, converts sound signals into visual light waves and tactile vibration data through a deep learning model, and displays the visual light waves and tactile vibration data on the basis of the visual light waves and tactile vibration data. High-precision and real-time multi-modal data fusion is realized; basic auditory reconstruction is carried out by adopting an audio frequency generation dynamic adjustment method combined with voiceprint dynamic mapping, personalized sound scene mapping is effectively and dynamically generated, and a patient is helped to reconstruct basic perception ability for sound; a cross-modal contrast learning method is adopted to assist lip language synchronous training, and voice context background prompts are provided in the rehabilitation training process.
Owner:川北医学院附属医院

Method for outputting an adaptive soundscape in a vehicle interior and vehicle

The invention relates to a method for outputting an adaptive soundscape (3) in a vehicle interior depending on the driving situation, wherein an in-vehicle processing unit imparts a driving-dependent effect to the sound tracks (4) of a song (5) broken down into sound tracks (4) and controls a sound system of the vehicle to output the correspondingly manipulated sound tracks (4) via in-vehicle loudspeakers. The inventive method is characterized in that - the computing unit extracts a sound track characteristic sound track section from each sound track (4), wherein the computing unit generates a base sound track section (7.1) with a first sampling rate and a first time duration and at least one layer sound track section (7.2) with a second sampling rate and a second time duration using granular synthesis, wherein the first sampling rate is smaller than the second sampling rate and the first time duration is larger than the second time duration; and - the computing unit causes the output of the basic sound track section (7-1) when the vehicle is started and, depending on the driving situation, causes the output of a layered sound track section (7.2) for each driving event (1) when driving events (1) occur.
Owner:MERCEDES BENZ GROUP AG

Air conditioner sound scene optimization method based on large model, air conditioner and storage medium

The invention provides an air conditioner sound scene optimization method based on a large model, an air conditioner and a storage medium. The method comprises the steps of obtaining audio data in a current environment; analyzing the audio data by using a preset artificial intelligence large model, and identifying all noise data in the audio data; extracting feature data of all the noise data, and matching corresponding music data according to the feature data; performing audio fusion on the music data and the noise data to obtain an output audio; and playing the output audio. By means of the air conditioner sound scene optimization method based on the large model, noise can be converted into music in real time, the irritability of a user is reduced, meanwhile, natural perception of environment sound can be reserved, and auditory vacuum of traditional noise reduction is avoided.
Owner:GREE ELECTRIC APPLIANCE INC OF ZHUHAI

Immersive Contextual Audio Effects In E-Books With Generative Artificial Intelligence (AI) Systems

Various embodiments include systems and methods of using an LXM to augment and enhance the reading experience of an eBook with contextual sound and music. A computing device may be configured to use large generative artificial intelligence model (LXM) to analyze eBooks to identify key narrative elements such as settings, mood, themes, character details, location, time period, and sound-effect descriptors (e.g., dialogue intensity, transition points, etc.). The computing device may use the analysis results (or LXM query results) to select a soundscape or sounds and / or music that align with the mood, setting, character traits, and narrative cues identified in the eBook content (e.g., gentle, nature-related sounds for a serene forest setting, intense music for suspenseful scenes, etc.).
Owner:QUALCOMM INC

Spatial audio rendering of vehicle sounds in a vehicle interior

In various embodiments, a computer-implemented method for reproducing a simulated soundscape within a first vehicle, comprises receiving selection of the simulated soundscape within a vehicle cabin associated with the first vehicle, receiving a sensor input associated with the first vehicle, identifying a soundscape element based on the selected simulated soundscape, determining a sound corresponding to the soundscape element based on the sensor input, determining a location within the cabin of the plurality of sounds based on the selected simulated soundscape, and causing playback of the sound within the vehicle cabin based on the location.
Owner:HARMAN BECKER AUTOMOTIVE SYST GMBH

Devices, methods, and graphical user interfaces for three-dimensional user experience sessions in augmented reality environments

Devices, methods, and graphical user interfaces are provided for a three-dimensional user experience session in an augmented reality environment. The present disclosure relates to techniques for providing computer-generated user experience sessions in an augmented reality environment. In some embodiments, a computer system provides particles that move based on breathing characteristics of a user to a computer-generated user experience session. In some embodiments, a computer system provides a computer-generated user experience session with options selected based on characteristics of an XR environment. In some embodiments, a computer system provides a computer-generated user experience session with a sound scene having planned sound components that are randomly selected.
Owner:APPLE INC

Bionic covert communication method based on multi-sea-area dolphin voiceprint feature library matching

The invention relates to the technical field of covert communication, in particular to a bionic covert communication method based on multi-sea-area dolphin voiceprint feature library matching, which comprises the following steps of: constructing a dynamic voiceprint feature library associated with sea area coordinates, dolphin species and voiceprints, and adjusting acoustic parameters in combination with real-time environment monitoring; communication information is encoded in a natural variation range of acoustic characteristics of the dolphin, bionic signals highly conforming to the sound scene of a target sea area are synthesized and emitted, low-recognizable and low-monitorable hidden data transmission between underwater equipment is achieved, meanwhile, false alarm of a marine mammal protection system is avoided, and the safety communication requirement of equipment such as an unmanned underwater vehicle is met.
Owner:HARBIN ENGINEERING UNIVERSITY SANYA NANHAI INNOVATION & DEVELOPMENT BASE

Urban sound scene perception extraction method and system based on text big data

The invention discloses an urban sound scene perception extraction method and system based on text big data, and the method comprises the steps: obtaining historical text data with a geographic position mark and a timestamp, and carrying out the preprocessing of the historical text data, and obtaining a sound related data set; sampling and labeling the sound related data set to obtain sound scene multi-dimensional data, and constructing a sound scene perception model according to the sound scene multi-dimensional data; and obtaining current text data, inputting the current text data into the sound scene perception model, and outputting an urban sound scene perception prediction result. According to the method, large-scale historical text data from social media can be efficiently processed by utilizing natural language processing and machine learning technologies, and text information related to sound scenes is automatically screened, so that the urban sound environment data processing efficiency is greatly improved, the high cost of a traditional monitoring means is reduced, and the urban sound environment data processing efficiency is improved. And the accuracy of acquiring the urban sound environment monitoring result is effectively improved.
Owner:HARBIN INSTITUTE OF TECHNOLOGY (SHENZHEN) (INSTITUTE OF SCIENCE AND TECHNOLOGY INNOVATION HARBIN INSTITUTE OF TECHNOLOGY SHENZHEN)

System and method for enhancing in-vehicle acoustic experience

A system and method for enhancing an in-vehicle acoustic experience is provided, including obtaining and transmitting sensor data by a sensor module, a sound scene generation module receiving the sensor data and referring to the sensor data to generate a sound scene audio signal. Then, a mixed audio signal formed by mixing the generated sound scene audio signal and an audio source signal provided by a vehicle-mounted entertainment module is played in the space in the vehicle through at least one loudspeaker, so that the acoustic experience in the vehicle can be enhanced under the condition that the driving of the vehicle is not influenced, a driver and passengers are helped to relax, the concentration degree is improved, and the safety of the vehicle is improved. And the immersive acoustic experience is enjoyed while the noise is further masked.
Owner:HARMAN INT IND INC

Service for targeted crowd sourced audio for virtual interaction

An audio generation system is provided to enable coordinated control of multiple IoT devices for audio collection and distribution of one or more audio sources according to location and user preference. The audio generation system enables a location sensitive acoustic control of sound, both as a shaped envelope for a particular source, and as an individualized experience. The audio generation system also facilitates an interactive visual system for visualization and manipulation of the audio environment including via the use of augmented reality and / or virtual reality to depict soundscapes. The audio generation system can also facilitate a system for improving and achieving an audio environment (sound influence zone) and an intuitive way to understand where sounds will be heard.
Owner:AT&T INTELLECTUAL PROPERTY I L P

A sound-driven VR serious game interaction control method for semi-blind people

PendingCN122633019ASound sourcesVirtual space
The application belongs to the technical field of virtual reality, and particularly relates to a sound-driven VR serious game interaction control method for semi-blind people. The method comprises the following steps: constructing a 3D sound scene space and a motion guide field, and converting a motion path into a sound change rule; collecting and fusing user pose and physiological feedback signals in real time; dynamically adjusting sound source parameters and tactile feedback according to pose deviation to realize non-visual orientation guidance; performing boundary verification and area determination through ray projection to ensure interaction safety; synchronously processing collision by using a bounding box model and quaternion interpolation; and establishing a mapping model of emotional parameters and sound characteristics to synthesize exciting sound effects. Through multi-modal collaborative interaction, the application significantly improves the perception accuracy and safety of semi-blind users in a virtual space, realizes the cooperation of psychological intervention and motion rehabilitation, and has excellent real-time response capability.
Owner:陈鸣蕾

Gramophone type projector

The utility model relates to the technical field of projectors, and discloses a gramophone type projector, which comprises a shell, a volume gear knob arranged on one side of the shell, a sound scene selection button arranged adjacent to the volume gear knob, and a light adjusting knob arranged adjacent to the sound scene selection button. A PCB is fixedly arranged on the inner side wall, provided with the volume gear knob, the sound scene selection button and the light adjusting knob, of the shell, and a control processing unit is arranged on the PCB. The control processing unit is connected with a music chip unit, the music chip unit is connected with a volume adjusting unit, and the volume gear knob is specifically connected with the volume adjusting unit; the sound scene selection button and the light adjusting knob are connected with the control processing unit; a bottom cover plate is arranged at the bottom end of the shell, a sound transmission hole is formed in the bottom cover plate, and a loudspeaker is fixedly arranged on the sound transmission hole. According to the utility model, the indoor atmosphere with atmosphere sense can be molded, the functions are rich, the operation is simple, and the practicability is strong.
Owner:宁波全成锐璟电子有限公司

Multi-sound-source relaxing and sleep-aiding method based on staged sound scene guidance

PendingCN121987917ARespiratory organ evaluationSensorsSound therapySound sources
The invention relates to the technical field of sound therapy relaxation and sleep aiding, in particular to a staged sound scene guided multi-sound-source relaxation and sleep aiding method. A multi-sound-source sound scene output model is constructed by taking a sound bowl as a core sound source, and a parameterized control structure of a sound source set and sound mixing gain is established. A time sequence model of four stages of entering, transition, maintaining and quitting resetting is constructed according to the respiration and pulse frequency of a user, and stable stage switching is achieved by combining continuous meeting of time criteria. Structured breathing guidance is introduced in the entering stage, a sound bowl is used as a sensing anchor point in the transition and maintenance stage, paragraph arrangement is adopted, binaural rhythms are selectively superposed, and sound sources are decreased progressively according to the priority and reset prompts are added in the exiting stage. And a personalized scheme is generated by recording user data self-adaptive adjustment parameters. According to the invention, stage switching is realized to fit the physiological state, individual differences are adapted, the relaxed state is ensured to be continuous and stable, the reset quit is stable and smooth, the application scene is diversified and wide, and the relaxed sleep-aiding effect and the overall use experience are remarkably improved.
Owner:SHANGHAI RUYI HEALTH MANAGEMENT CONSULTING CO LTD

Customization of sound production for on-road vehicles

A system for customization of on-road sound production for a vehicle includes one or more noise generators supported relative to the vehicle and configured to produce a soundscape in an environment of the vehicle. The system further includes memory storing instructions that, when executed by one or more processors, cause the processor(s) to generate the soundscape from a sound file based on an indication of a user-preferred sound file of multiple files, an environmental context surrounding the vehicle, or both. The instructions cause the processor(s) to determine whether an operational status of the vehicle is suitable for on-road operation. The instructions cause the processor(s) to further produce, in response to a determination that the operational status of the vehicle is suitable for on-road operation, the soundscape utilizing the noise generator(s) while the operational status of the vehicle is suitable for on-road operation.
Owner:VOLVO CAR CORP

Vehicle external sound intelligent screening and sound scene feedback system

The invention discloses a vehicle external sound intelligent screening and sound scene feedback system, and relates to the technical field of vehicles. The system comprises a data sensing module used for collecting external sound data and scene state data of a vehicle and transmitting the data to a data processing module; the data processing module is used for carrying out classification judgment on the external sound data of the vehicle to obtain a classification result, processing the external sound data of the vehicle according to a sound processing strategy corresponding to the classification result and the scene state data of the vehicle to obtain first sound data, and sending the first sound data to the server; the classification result and the first sound data are transmitted to an interaction output module; and the interactive output module is used for carrying out safety prompt according to the classification result and outputting the first sound data. According to the invention, the driving safety and the environment perception capability of people in the vehicle can be improved.
Owner:CHINA FAW CO LTD

Bird sound noise reduction method and system for adaptive sub-band and acoustic index consistency loss facing bird sound production

The invention belongs to the field of bird sound noise reduction, and discloses a bird sound noise reduction method and system for adaptive sub-band and acoustic index consistency loss of bird sound production, and the method comprises the steps: S1, carrying out the superposition synthesis of a clean bird sound sample and a noise sample, and generating a training sample; s2, processing the training sample to obtain a frequency band feature tensor; s3, performing time dimension and frequency dimension feature fusion processing on the frequency band feature tensor to obtain a fusion feature; and S4, performing calculation based on the fusion features, and reconstructing a de-noised bird sound audio signal. The high signal-to-noise ratio improvement, the distortion rate reduction and the target bird chirp audibility improvement are realized in the complex field sound scene, the accuracy of subsequent automatic identification and acoustic index calculation can be remarkably improved, and the method has important application value for ecological monitoring, bird protection and habitat evaluation.
Owner:GUANGZHOU UNIVERSITY

Sound scene enhancement device based on environmental perception

The utility model discloses a sound scene enhancing device based on environmental perception, and relates to the technical field of acoustics. The system comprises a microphone array, a signal conditioning circuit, an analog-to-digital converter, a DSP processor, a sound scene database memory, a master control MCU, an FPGA beam controller, an audio synthesis chip, a power amplifier, a loudspeaker array and a noise classification coprocessor, the microphone array is electrically connected with the signal conditioning circuit, and the signal conditioning circuit is electrically connected with the analog-to-digital converter. The analog-to-digital converter is electrically connected with the DSP processor, the analog-to-digital converter is electrically connected with the master control MCU, the DSP processor is electrically connected with the sound scene database memory, the DSP processor is electrically connected with the noise classification coprocessor, the noise classification coprocessor is electrically connected with the master control MCU, the master control MCU is electrically connected with the sound scene database memory, and the master control MCU is electrically connected with the FPGA beam controller. The sound scene can be automatically adjusted according to environment changes.
Owner:JIANGSU ACOUSTIC IND TECH INNOVATION CENT

Spatial sound generation for mixed reality applications

As disclosed herein, a computer-implemented method for audio generation in mixed reality environments is provided. The method may include determining, based on a description of a soundscape of a mixed reality environment, a first prompt for a continuous audio signal associated with the soundscape and a second prompt for an intermittent audio signal associated with the soundscape. The method may include providing the first and second prompts to a model configured to determine at least one audio signal based on a prompt describing the audio signal. The method may include generating, by the model, a continuous audio signal and an intermittent audio signal. The method may include combining the continuous audio signal and the intermittent audio signal to generate a composite audio signal. The method may include rendering the composite audio signal in the mixed reality environment. A system and a non-transitory computer-readable storage medium are also disclosed.
Owner:META PLATFORMS TECHNOLOGIES LLC

Immersive contextual audio effects in e-books with generative artificial intelligence (AI) systems

Various embodiments include systems and methods of using an LXM to augment and enhance the reading experience of an eBook with contextual sound and music. A computing device may be configured to use large generative artificial intelligence model (LXM) to analyze eBooks to identify key narrative elements such as settings, mood, themes, character details, location, time period, and sound-effect descriptors (e.g., dialogue intensity, transition points, etc.). The computing device may use the analysis results (or LXM query results) to select a soundscape or sounds and / or music that align with the mood, setting, character traits, and narrative cues identified in the eBook content (e.g., gentle, nature-related sounds for a serene forest setting, intense music for suspenseful scenes, etc.).
Owner:QUALCOMM INC

A method and system for optimizing spatial layout of multi-dimensional sound scene ecological elements

The application provides a kind of multi-dimensional sound scene ecological element space layout optimization method and system, belongs to mechanical vibration measurement technical field field, this method includes integration three-dimensional point cloud and environmental parameter construction digital basement, establishes the native plant model containing growth and acoustic characteristics, generates the space sound effect contribution degree pressure field representing the noise reduction potential by reverse sound wave ray tracing, constructs the plant growth agent driven by the pressure field, runs the symbiotic simulation engine to generate the morphological dynamic evolution sequence, calculates the acoustic performance, ecological stability and landscape robustness index, and uses it as the fitness evaluation basis of evolution algorithm, iteratively optimizes the initial planting layout, the application realizes the coupling of acoustic physical simulation and plant growth competition logic, is used to guide the long-term planning and species configuration of ecological garden, improves the sound environment quality and succession stability of landscape.
Owner:XUCHANG LINQIYU ECOLOGICAL GARDEN CO LTD

Urban public space sound scene and illumination intelligent cooperation device and method

The invention belongs to the technical field of smart cities and environment regulation, solves the problem of how to enable sound and light to be associated and to be more fused with the surrounding environment, and relates to an urban public space sound scene and illumination intelligent collaboration device, which comprises a collection device configured to collect environmental parameters; the database is used for storing a natural sound source for sound masking; a speaker configured to play a natural sound; the lighting equipment is used for lighting; and the controller is configured to select a natural sound source from the database according to the environmental parameters, generate playing parameters, perform fast Fourier transform on the natural sound source, convert a time domain signal into a frequency domain signal, extract energy intensity of each frequency band and generate control parameters of the lighting equipment in combination with the environmental parameters. The invention also provides an urban public space sound scene and illumination intelligent cooperation method.
Owner:CHONGQING UNIV

Sound scene ecological red line quantitative delimitation method and system based on multi-model coupling

PendingCN122656377AAlgorithmSegmented regression
The present application provides a kind of based on multi-model coupling sound scene ecological red line quantitative demarcation method and system.The present application constructs the cascade detection mechanism of generalized additive model and segmented regression combination, can accurately identify the ecosystem cliff type degradation node;Supporting scale response curve and random forest-variance inflation factor joint dimensionality reduction strategy, on the basis of eliminating multicollinearity interference, lock core driving factor, avoid the blindness of artificial specified spatial scale;And introduce non-parametric conditional inference tree to build multi-model cross-validation system, by calculating the deviation rate intelligent discrimination environmental heterogeneity, adaptive output rigid control boundary point or elastic early warning buffer zone, with multi-level dynamic backtracking mechanism realizes different habitat and data characteristics under multi-scene coverage, fully safeguards the algorithm coherence, result robustness and dynamic fault tolerance ability, for sound scene ecological red line scientific demarcation, accurate control and dynamic supervision provides stable and reliable technical support.
Owner:RES INST OF FOREST RESOURCE INFORMATION TECHN CHINESE ACADEMY OF FORESTRY

Method for underwater covert communication based on message latent variable injection

PendingCN122293217ATelecommunicationsUnderwater acoustic propagation
This invention discloses a generative acoustic scene underwater covert communication method based on message latent variable injection, comprising: acquiring a message to be sent and acoustic scene condition information of a target local sea area; inputting the message to be sent into a trained message encoding module for encoding processing to obtain message latent variables; injecting the message latent variables into a trained condition generation module so that the condition generation module generates an acoustic scene underwater acoustic payload waveform carrying the message to be sent under the constraints of the acoustic scene condition information; processing the acoustic scene underwater acoustic payload waveform to obtain a covert communication frame suitable for transmission, and transmitting the covert communication frame; thereby, by simultaneously realizing acoustic scene camouflage and message carrying during the generation of the acoustic scene underwater acoustic signal, underwater covert communication that balances the acoustic scene adaptability of the target local sea area, the low distinguishability of the generated signal, and the reliability of legitimate reception recovery after underwater acoustic propagation is achieved.
Owner:XIAMEN UNIV

System for recognizing soundscapes

A system for recognizing soundscapes includes audio extractors, audio sampling and modulation circuits, an audio recognition device, environment detectors, a data integration circuit, a wireless communication module, a wireless base station, and a cloud server. The audio extractors extract soundscape signals so that the audio sampling and modulation circuits generate audio modulation signals. The audio recognition device recognizes the audio modulation signals to generate audio features. Based on biological audio models respectively corresponding to different species, the audio recognition device determines the number of the species corresponding to the audio features, thereby adjusting the sampling rate, the working period, or both of the soundscape signal extracted by each audio extractor. The environment detectors detect different environment-related data. The data integration circuit synchronizes the environment-related data, the audio features, the species corresponding thereto and uploads them to the server through the base station and the communication module.
Owner:FAR EASTONE TELECOMMUNICATIONS CO LTD

Audio-visual linkage system based on AI sound scene regulation and control

The invention relates to the technical field of man-machine interaction, and discloses an audio-visual linkage system based on AI sound scene regulation and control, and the system comprises a composite sensing assembly which collects environmental acoustics and audience biological characteristics; the emotional state evaluation engine is used for updating the emotional belief state of the audience based on the collected features, and actively calibrating the state by releasing an emotional probe and monitoring biological feature changes when the belief state is high in uncertainty; the hierarchical strategy engine is used for generating a director intention and a collaborative rendering action according to the belief state; and an audiovisual rendering component for executing a rendering action to regulate and control the audiovisual scene in a linkage manner. The method comprises the steps of collecting multi-modal data, evaluating and updating an emotional belief state, judging uncertainty and executing active calibration, performing hierarchical decision to generate a rendering instruction, and finally executing the instruction to realize audio-visual linkage and form closed-loop control. According to the invention, deep, real-time and adaptive coupling of the audio-visual content and the inherent emotion of the audience can be realized.
Owner:SHENZHEN WEIKING TECH CO LTD