Multi-Device Eye Data Alignment Using Blink Pattern Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge of aligning multiple data streams recorded by different devices is significant, especially in attention tracking and gaze analysis, due to unpredictable and inconsistent temporal offsets caused by factors like timestamping delays and device synchronization issues, leading to errors in data interpretation.
Innovation Solution
A method and system that utilize blink detection and sequence comparison to determine a temporal offset between data streams, aligning them by detecting a common blink pattern across both streams and using it to synchronize the data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If timestamping is used to synchronize data streams from multiple recording devices, then data alignment is attempted, but clock drift and synchronization delays cause temporal offset mismatches leading to incorrect data interpretation
Solution Approach 1:
The patent uses blink events as an intermediary reference signal to align multiple data streams. Instead of relying on device timestamps which drift, the system detects blink events in each stream and uses these consistent physiological events as a mediator to calculate and correct temporal offsets, thereby resolving the synchronization mismatch problem
Solution Approach 2:
The system implements feedback by continuously monitoring blink patterns across data streams, calculating temporal offsets based on detected blink events, and applying correction factors to realign the streams. This closed-loop approach continuously compensates for clock drift and synchronization delays
2Loss of information
If multiple recording devices are used to capture comprehensive user data, then data completeness is improved, but temporal misalignment between devices causes errors in event correlation
Solution Approach 1:
Blink events serve as a universal intermediary marker present across all recording devices. By detecting these common events in each device's data stream, the system establishes a shared temporal reference framework that allows comprehensive multi-device data collection while maintaining precise event timing correlation through the calculated offsets
3Ease of operation
If data streams are aligned using fixed timestamp offsets, then initial synchronization is achieved, but clock drift over time causes progressive misalignment
Solution Approach 1:
The system transitions from static fixed offset alignment to dynamic continuous realignment. Instead of applying a constant timestamp correction, the system continuously detects blink events, recalculates temporal offsets in real-time, and dynamically adjusts alignment parameters to compensate for clock drift, maintaining stable synchronization throughout the recording period
Solution Approach 2:
The system performs preliminary blink pattern analysis to establish initial temporal offset corrections, then uses these pre-calculated offsets to align data streams. This preliminary alignment provides a stable foundation that can be further refined through continuous monitoring and adjustment
Data Source
Figure 1~2B
Figure 3
AI summary
The invention is related to a method of determining a temporal offset of data from two recording devices. The method comprises: receiving a first data stream from a first recording device and a second data stream from a second recording device, wherein each of the first data stream and second data stream include data relating to an eye of the user, and wherein the first data stream and second data stream overlap temporally; processing the first data stream to determine a first blink sequence of the user; processing the second data stream to determine a second blink sequence of the user; comparing the first blink sequence and the second blink sequence to detect a blink pattern present in both the first blink sequence and the second blink sequence; and determining a temporal offset of the first data stream and the second data stream by comparing respective positions of the blink pattern in the first data stream and the second data stream.