Sensor Frame Rate Synchronization via Supplementary Signal Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In the field of Internet technologies, particularly in data processing for mobile devices equipped with sensors like accelerometers and image sensors, the disparity in frame rates between different sensors leads to inaccurate location estimation due to the lack of synchronization, resulting in deviated true location information.

Innovation Solution

A data processing method and apparatus that generates supplementary signal frames for sensors with lower frame rates, synchronizing them with higher frame rate sensors through intelligent terminal processing, ensuring accurate signal fusion and improved measurement accuracy by aligning output times.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a sensor outputs signals at a high frame rate, then the output frame rate is improved, but the measurement precision deteriorates due to lack of correction signals from low frame rate sensors

Engineering Contradiction:
Improveoutput frame rateVSAvoidlocation estimation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by generating supplementary signal frames from low frame rate sensor data before they are needed for fusion. The system pre-processes low frame rate sensor signals and creates intermediate representation data that can be quickly interpolated to match high frame rate timestamps, ensuring correction signals are ready when needed for accurate location estimation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses an intermediary approach by introducing an intermediate representation of sensor signal frames that acts as a mediator between low frame rate and high frame rate sensors. This intermediate form allows the system to bridge the frame rate gap by creating synthetic correction signals at high frame rate timestamps based on low frame rate measurements, enabling accurate sensor fusion without requiring both sensors to operate at the same high frame rate.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple sensors with different frame rates are used for signal fusion, then the adaptability is improved, but the device complexity increases due to synchronization requirements

Engineering Contradiction:
Improvesensor integration capabilityVSAvoidsignal synchronization complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by transforming the frame rate parameter from a fixed constraint to a flexible variable. The system changes how sensor data is represented and processed by creating intermediate frames at different timestamps, allowing low frame rate sensors to effectively contribute to high frame rate fusion outputs through parameter transformation rather than requiring all sensors to operate at identical frame rates.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent uses copying by creating supplementary signal frames that replicate and adapt low frame rate sensor data to match high frame rate timestamps. Instead of requiring the low frame rate sensor to physically output data at high frame rates, the system copies the essential measurement information and interpolates it to generate correction signals at the needed timestamps, simplifying the synchronization process.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP3614256B1Data processing method, computer device, and storage medium
Publication Date: 2023.02.01 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • EP3614256B1 patent drawingFigure 1
  • EP3614256B1 patent drawingFigure 1a
  • EP3614256B1 patent drawingFigure 2

AI summary

A data processing method, a computer device, and a storage medium are provided. The method includes: generating a supplementary signal frame according to a first original signal frame of a first data collector when a first frame rate of the first data collector in a terminal is less than a second frame rate of a second data collector, and determining an input time stamp of the supplementary signal frame according to the second frame rate; inputting the supplementary signal frame into a first input queue of the first data collector when a current time reaches the input time stamp of the supplementary signal frame, obtaining a second original signal frame that is currently input into a second input queue and that is of the second data collector; and performing signal fusion on the supplementary signal frame in the first input queue and a second original signal frame in the second input queue.