Event-Based Vision Sensor Vibration Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in detecting minute vibrations from sound waves with high accuracy while managing resource consumption effectively.

Innovation Solution

A computer system utilizing an event-based vision sensor to analyze vibrations and reconstruct sound data, incorporating a processor for analyzing event signals and applying Fourier transforms to enhance detection accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a high frame rate moving image is used to detect vibrations, then detection accuracy is improved, but data amount and resource consumption increase

Engineering Contradiction:
Improvevibration detection accuracyVSAvoiddata amount
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The invention extracts only the essential information needed for vibration detection from the moving image data. Instead of processing complete high-frame-rate video sequences, the system extracts feature quantities representing vibration characteristics, thereby reducing data amount while maintaining detection accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The invention changes the parameter representation from raw pixel data to extracted feature quantities. By transforming the data representation and focusing on relevant vibration features, the system achieves accurate vibration detection with reduced data processing requirements.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If a high frame rate moving image is used to detect vibrations, then detection accuracy is improved, but resource consumption increases

Engineering Contradiction:
Improvevibration detection accuracyVSAvoidresource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The invention extracts only the essential information needed for vibration detection from the moving image data. Instead of processing complete high-frame-rate video sequences, the system extracts feature quantities representing vibration characteristics, thereby reducing data amount while maintaining detection accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The invention changes the parameter representation from raw pixel data to extracted feature quantities. By transforming the data representation and focusing on relevant vibration features, the system achieves accurate vibration detection with reduced data processing requirements.

Inventive Principle:
Principle #35Parameter changes

3Use of energy by moving object

If conventional vision sensors are used for vibration detection, then resource consumption is reduced, but detection accuracy deteriorates

Engineering Contradiction:
Improveresource consumptionVSAvoidvibration detection accuracy
Core Design Contradiction:
Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The invention introduces an intermediary processing stage that extracts feature quantities from moving image data. This intermediary step acts as a bridge between conventional vision sensors and vibration detection requirements, enabling accurate vibration detection without the full resource consumption of high-frame-rate processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Improves detection accuracy of sound wave-induced vibrations with reduced resource usage by leveraging the high time resolution of event-based vision sensors.

Implementation Method 1

an event signal generated by an event-based vision sensor

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

incorporating a processor for analyzing event signals and applying Fourier transforms to enhance detection accuracy

Methodology Applied
Scientific EffectFourier Transform:

Data Source

PatentUS20250211934A1Computer system, method, and program
Publication Date: 2025.06.26 SONY INTERACTIVE ENTERTAINMENT LLC
  • US20250211934A1 patent drawing
  • US20250211934A1 patent drawing
  • US20250211934A1 patent drawing

AI summary

Provided is a computer system for detecting vibrations generated by sound waves in a space, the computer system including a memory for storing a program code and a processor for performing an operation in accordance with the program code, the operation including analyzing the vibrations of an object in the space in reference to an event signal generated by an event-based vision sensor, and reconstructing sound data from a result of the analysis of the vibrations.