Sensor Data Synchronization via Motion Characteristic Filtering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mobile devices face challenges in synchronizing image sensor data and motion sensor data for video stabilization, as raw data from these sensors are often not perfectly synchronized, and dedicated hardware solutions are not always available.

Innovation Solution

A method and system for synchronizing image sensor data and motion sensor data by processing and filtering the data to extract motion characteristics, applying corrections such as time delays or interpolation, and using pattern matching to align timestamp data, allowing for synchronization without dedicated hardware.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If dedicated hardware synchronization lines are used, then synchronization precision is improved, but device complexity increases

Engineering Contradiction:
Improvesynchronization precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical hardware synchronization system with a software-based signal processing system. Specifically, it uses high-pass filtering to extract motion characteristics from both image sensor data and motion sensor data, then employs pattern matching algorithms to identify corresponding motion patterns and calculate time offsets. This substitution eliminates the need for dedicated hardware synchronization lines while achieving accurate temporal alignment between the two data streams.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If software-based synchronization is used, then device complexity is reduced, but synchronization precision deteriorates

Engineering Contradiction:
Improvedevice complexityVSAvoidsynchronization precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces motion characteristics as an intermediary element that mediates between the image sensor data and motion sensor data. By extracting motion characteristics from both data streams through high-pass filtering and then matching these characteristics through pattern recognition, the system creates a common reference framework that enables precise synchronization without direct hardware coupling. This intermediary approach maintains high precision while keeping the system architecturally simple.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of manufacture

If hardware synchronization lines are not available, then ease of manufacture is improved, but reliability of synchronization deteriorates

Engineering Contradiction:
Improveease of manufactureVSAvoidsynchronization reliability
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent implements a self-service synchronization mechanism where the system uses its own operational data (image sensor data and motion sensor data) to automatically determine and correct timing offsets. The high-pass filtering extracts motion characteristics inherent in the captured data, and pattern matching algorithms automatically identify corresponding patterns to calculate synchronization offsets. This self-service approach eliminates the need for external hardware synchronization infrastructure while ensuring reliable temporal alignment through data-driven correction.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10506163B2Systems and methods for synchronizing sensor data
Publication Date: 2019.12.10 MOVEA
  • US10506163B2 patent drawing
  • US10506163B2 patent drawing

AI summary

A method for synchronizing data provided by an image sensor and a motion sensor rigidly linked together, comprising the steps of:obtaining image sensor data and motion sensor data;processing at least one of the image sensor data and the motion sensor data;extracting motion characteristics from filtering said processed data, wherein said filtering comprises at least applying a high pass filter; andsynchronizing the image sensor data and the motion sensor data provided by the rigidly linked sensors using synchronization data derived from identification of substantially similar motion characteristics in the filtered image sensor data and the filtered motion sensor data.