Sensor Data Synchronization Module for Real-Time Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Real-time processing of data from multiple sources is challenging due to the difficulty in integrating and analyzing data streams from heterogeneous sources, such as camera, GPS, and inertial sensors, which is critical for time-sensitive applications like monitoring driver distraction levels, as existing technologies incur significant software overhead and struggle to provide a unified, timely view.

Innovation Solution

A synchronization module that temporally couples data streams from cameras, GPS receivers, and inertial sensors by generating synchronization signals, computing phase differences, and appending metadata to motion measurements, allowing for real-time processing with minimal software overhead, enabling the processor to associate images with motion and speed values effectively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If real-time processing is employed to process data as it is streamed from multiple sources, then time-sensitive scenarios can be addressed quickly, but the staggering amounts of data that must be processed become increasingly difficult to manage

Engineering Contradiction:
Improveprocessing speedVSAvoiddata integration complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The system segments data processing by creating separate data streams for different sensor types (camera, GPS, inertial sensors) and processing them independently through dedicated circuits before final integration. This allows parallel processing of multiple data sources simultaneously, reducing the complexity of handling staggered data amounts while maintaining real-time processing speed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A synchronization module acts as an intermediary between multiple sensor sources and the processor. It receives synchronization signals from each sensor, computes phase differences, and temporally couples the data streams before presenting them to the processor. This mediator approach simplifies the overall system complexity by providing a unified interface for handling multiple heterogeneous data sources in real-time.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If batch processing is employed to process large amounts of data efficiently, then processing efficiency is improved, but time-sensitive scenarios cannot be addressed appropriately

Engineering Contradiction:
Improvedata processing efficiencyVSAvoidresponse time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system employs periodic synchronization signals from each sensor source (camera frame rates, GPS update rates, inertial sensor sampling rates) to structure data acquisition and processing. This periodic approach allows the system to process data in regular intervals while maintaining real-time responsiveness, combining the efficiency of structured processing with the timeliness needed for dynamic scenarios.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The synchronization module performs preliminary actions by pre-computing phase differences between synchronization signals and pre-temporally coupling data streams before they reach the main processor. This preliminary processing reduces the computational burden on the main processor during real-time operation, enabling both efficient processing and rapid response to time-sensitive events.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If data streams from multiple heterogeneous sources are integrated and analyzed in real-time, then a unified timely view is achieved, but significant software overhead is incurred

Engineering Contradiction:
Improvedata integration reliabilityVSAvoidsoftware overhead
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system replaces software-based data integration with hardware-based synchronization and temporal coupling mechanisms. The synchronization module uses hardware circuits to compute phase differences and temporally align data streams from multiple sensors, eliminating the need for complex software overhead while ensuring reliable data integration. This hardware substitution reduces computational burden and energy consumption.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10992844B2Video imaging and inertial sensor data coupling
Publication Date: 2021.04.27 NAUTO INC
  • US10992844B2 patent drawing
  • US10992844B2 patent drawing
  • US10992844B2 patent drawing

AI summary

Introduced here are synchronization modules designed to integrate streams of data acquired from multiple sources in a precise, repeatable manner. To improve the usability of data acquired from multiple sources, a synchronization module can tightly couple streams of data received from these sources so that the data is temporally aligned. For example, a synchronization module may tightly couple motion data generated by a motion sensor with location data generated by a location sensor and image data generated by an image sensor in a manner that lessens the incurrence of software overhead.