Ultrasonic Signal Detection Using Gyroscope and Microphone Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

User devices, such as smartphones and earphones, face challenges in detecting and mitigating ultrasonic signals that can cause unwanted events or outputs, as these signals are down-shifted to the audio range due to non-linear components and are not effectively distinguished from legitimate audio signals.

Innovation Solution

An apparatus and method that utilize data from microphones and gyroscopes to detect ultrasonic signals by analyzing amplitude envelope correlation and spectral analysis of waveforms, with machine-learned models trained on ultrasonic signal parameters, to identify and mitigate such signals by controlling the user device's output or functions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If non-linear components are used to process audio signals, then signal processing functionality is improved, but ultrasonic signals are down-shifted to audio range causing unwanted events

Engineering Contradiction:
Improvesignal processing functionalityVSAvoidultrasonic signal interference
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent uses the gyroscope as an intermediary sensor to detect ultrasonic signals through mechanical vibrations, providing an additional detection pathway that complements the microphone-based audio processing system without interfering with its normal functionality

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the traditional acoustic detection method (microphone) with a mechanical detection method (gyroscope) for ultrasonic signal detection, exploiting the gyroscope's ability to detect high-frequency mechanical vibrations that correspond to ultrasonic frequencies

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If traditional microphone-based detection is used, then audio signal detection is simple, but ultrasonic signals cannot be distinguished from audio signals

Engineering Contradiction:
Improvedetection system simplicityVSAvoidsignal distinction accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments the detection task into two parts: the microphone handles audio frequency detection while the gyroscope handles ultrasonic frequency detection, allowing each sensor to specialize in its optimal frequency range and improving overall detection precision

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a new detection dimension by incorporating gyroscope data alongside microphone data, transforming the detection problem from a single-channel audio analysis to a multi-modal sensing approach that can distinguish ultrasonic signals through their unique mechanical vibration characteristics

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If gyroscope data is added to detect ultrasonic signals, then detection accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveultrasonic signal detection accuracyVSAvoiddetection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent leverages the gyroscope's existing mechanical vibration sensing capability, which was already present in the device for other purposes, and repurposes it for ultrasonic detection, avoiding the need to add entirely new specialized hardware

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the processing of microphone and gyroscope data within the existing audio processing pipeline, utilizing the device's existing computational resources and processing architecture to handle the combined data stream without requiring separate dedicated processing systems

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Effectively prevents unwanted events associated with ultrasonic signals by accurately distinguishing them from audio signals, thereby protecting user devices from potential malicious inputs or distractions.

Implementation Method 1

detecting, based at least in part on the first data and the second data, that the signal received by the microphone comprises an ultrasonic signal

Methodology Applied
Scientific EffectAcoustic radiation pressure: Acoustic Radiation Pressure

Data Source

PatentEP4414873A1Detection of ultrasonic signals
Publication Date: 2024.08.14 NOKIA TECHNOLOGIES OY
  • EP4414873A1 patent drawingFigure 1~3
  • EP4414873A1 patent drawingFigure 4~5
  • EP4414873A1 patent drawingFigure 6

AI summary

Example embodiments relate to detection of ultrasonic signals. Example embodiments may comprise an apparatus, method and/or computer program. For example, the method may comprise: providing first data derived from a signal received by a microphone of a user device; providing second data representing mechanical oscillations within a gyroscope of the user device; detecting, based at least in part on the first data and the second data, that the signal received by the microphone comprises an ultrasonic signal; and responsive to the detection, controlling the user device for mitigating one or more events associated with receipt of the ultrasonic signal by the microphone.