Audio Signal Analysis Using Neural Activity Pattern Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current audio signal analysis methods fail to accurately represent the neural activity patterns in the human auditory system, leading to inefficiencies in audio signal processing and recognition, particularly in mimicking the human hearing process.

Innovation Solution

A device and method that convert audio signals into representations of neurotransmitter vesicle occurrence between nerve fibers and inner auditory cells, calculating neural activity patterns over time to mimic the human auditory system's neural activity, incorporating models of the basilar membrane, stereocilia, and neurotransmitter release to achieve a realistic simulation of auditory processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional audio signal analysis methods are used, then the analysis process is simple and fast, but the accuracy of representing neural activity patterns in the human auditory system is poor

Engineering Contradiction:
Improveaccuracy of neural activity pattern representationVSAvoidcomplexity of audio signal analysis system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates a computational model that copies the neural activity patterns of the human auditory system by simulating the cochlea, auditory nerve, and brainstem processing. This model generates spike trains that replicate human neural responses to audio signals, enabling accurate representation of auditory perception without requiring direct measurement of human neurons.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces direct mechanical/physiological measurement of human auditory neural activity with a computational simulation system. Instead of measuring actual neural spikes in humans, the system uses mathematical models to simulate the mechanical and electrical processes of the cochlea and auditory nerve, producing virtual neural activity patterns that accurately represent human perception.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If conventional audio analysis methods are used, then the processing is efficient, but relevant acoustic events are missed or imperceptible events are incorrectly identified

Engineering Contradiction:
Improveaccuracy of acoustic event detectionVSAvoidefficiency of audio signal processing
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent changes the fundamental parameters of audio analysis from traditional acoustic features (amplitude, frequency, duration) to neural response parameters (spike timing, firing rate, neural correlates). By transforming the analysis domain to match human neural processing parameters, the system achieves superior accuracy in detecting relevant acoustic events while filtering out imperceptible ones.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent incorporates feedback mechanisms where the simulated neural activity patterns are continuously refined based on comparisons with actual human auditory perception data. This feedback loop allows the model to adjust and improve its accuracy in predicting human auditory responses, enabling reliable detection of acoustically relevant events.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If detailed neural activity simulation is performed, then the representation of auditory processing becomes realistic, but the computational time and resources increase significantly

Engineering Contradiction:
Improverealism of auditory processing simulationVSAvoidcomputational time for signal analysis
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the complex auditory processing system into distinct functional modules: cochlear processing, auditory nerve modeling, and brainstem analysis. Each module handles specific aspects of neural processing independently, allowing the system to achieve realistic neural activity simulation while managing computational complexity through modular architecture that can be applied at different levels of detail as needed.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS8761893B2Device, method and computer program for analyzing an audio signal
Publication Date: 2014.06.24 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US8761893B2 patent drawing
  • US8761893B2 patent drawing
  • US8761893B2 patent drawing

AI summary

A device for analyzing an audio signal to obtain an analysis representation of the audio signal includes a converter for converting the audio signal into a representation representing a neurotransmitter vesicle occurrence in clefts between a plurality of nerve fibers and inner auditory cells of an ear model, and a calculator for calculating a neural activity pattern over time on the plurality of nerve fibers, which results based on the neurotransmitter vesicle occurrence, wherein the neural activity pattern is an analysis representation of the audio signal. The inventive device thus generates an especially suitable analysis representation of an audio signal in which masking effects occurring in the generation of action potentials on nerve fibers are considered. The inventive analysis representation is also suitable for an examination of the audio content and also for controlling cochlea implants.