Marine Mammal Detection via Spectrogram Machine Learning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current marine mammal detection methods, particularly those relying on human operators and existing PAM techniques, face challenges such as inconsistency, inaccuracy, and high resource requirements due to the wide frequency range of marine mammal vocalizations and the complexity of underwater noise environments, which can lead to ineffective mitigation of sound-induced impacts on marine mammals.
Innovation Solution
A computerized system and method using machine learning models, including neural networks and rule-based classifiers, to process underwater acoustic data, differentiate between marine mammal vocalizations and noise, and provide real-time detection and alerts, utilizing hydrophone arrays and preprocessing techniques to handle noisy environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If human operators monitor audio feed for marine mammal detection, then detection coverage can be provided, but subjectivity and inconsistency are introduced leading to reduced accuracy
Solution Approach 1:
The patent replaces the mechanical system of human auditory monitoring with an electronic signal processing system that converts audio data into visual spectrogram representations. This substitution eliminates human subjectivity while maintaining detection capability, as the visual representation can be objectively analyzed by both human operators and automated systems.
Solution Approach 2:
The patent introduces spectrograms as an intermediary representation between the raw audio signal and the final detection decision. This intermediary transforms the audio data into a visual format that highlights relevant features while filtering out irrelevant information, providing a consistent and objective basis for detection that removes human subjectivity.
2Reliability
If human operators monitor audio feed for marine mammal detection, then detection can be performed, but high human resource requirements and costs are incurred
Solution Approach 1:
The patent creates a visual copy (spectrogram) of the audio signal that contains all the essential information for detection. This copy can be analyzed without requiring continuous human listening, allowing operators to review visual representations instead of monitoring audio continuously, thereby reducing human resource requirements while maintaining detection reliability.
3Measurement precision
If acoustic methods are used for marine mammal detection, then greater range and weather independence are achieved, but complexity in differentiating mammal vocalizations from noise increases
Solution Approach 1:
The patent applies local quality by transforming the audio signal into a spectrogram representation that emphasizes specific local features (frequency components over time) while suppressing others. This transformation makes mammal vocalizations distinguishable from background noise by highlighting their characteristic frequency-time patterns, thereby managing the complexity of differentiation.
Solution Approach 2:
The patent transitions from analyzing audio signals in the time domain to representing them in the time-frequency domain through spectrograms. This dimensional change adds the frequency dimension to the analysis, enabling better differentiation between mammal vocalizations and noise by examining their spectral characteristics alongside temporal patterns.
4Device complexity
If visual observation methods are used for marine mammal detection, then simple equipment requirements are maintained, but detection is limited by weather and light conditions
Solution Approach 1:
The patent replaces visual observation (optical method) with acoustic monitoring followed by spectrogram analysis. This substitution uses sound waves instead of light waves, eliminating dependence on weather and light conditions while maintaining relatively simple equipment requirements consisting of hydrophones and processing software.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A computer (15,45) implemented method of detecting marine mammals (30) comprises receiving (610) acoustic data from hydrophones (25) and sampling and transforming )620) the acoustic data to time-frequency image data. The image data is transformed (630) to be suitable for input to a model trained to detect the presence or absence of marine mammal vocalizations in the acoustic data, wherein the model automatically outputs (640) a prediction of whether or not a mammal is present. The user is provided with output indicating the prediction.