Vehicle Sensor Synchronization Using Image and IMU Shift Timing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing synchronization devices struggle to accurately synchronize detection data from multiple sensors in a vehicle due to difficulties in identifying the detection timing of image sensors, leading to inaccurate synchronization.

Innovation Solution

A synchronization device that calculates shift time based on detection data from an image sensor and another sensor, such as an IMU, to synchronize detection data accurately by adjusting the time of the IMU data to match the detection timing of the image sensor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If time data of each sensor are corrected based on time information received from a NTP server, then the synchronization can be performed using standard time protocols, but it is difficult to identify the detection timing of the image sensor and achieve accurate synchronization

Engineering Contradiction:

Improveability to use standard time protocolsVSAvoidsynchronization accuracy

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary approach by using detection data from sensors (particularly image sensors and IMUs) as a mediator to establish synchronization. Instead of directly relying on NTP time information, the system uses the correlation between detection data and time information to identify detection timing and calculate shift time, thereby achieving accurate synchronization while maintaining adaptability to standard protocols.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the traditional time-based synchronization mechanism (NTP protocol) with a data-based synchronization mechanism. By substituting the mechanical/time-based system with a system that uses detection data correlation and shift time calculation, the patent achieves higher precision while maintaining the ability to use standard protocols when needed.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If detection data from multiple sensors are synchronized using NTP time information, then the system can operate with standard time protocols, but the synchronization accuracy deteriorates due to inability to identify image sensor detection timing

Engineering Contradiction:

Improveability to operate with standard protocolsVSAvoidsynchronization reliability

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The patent introduces dynamic adjustment by calculating shift time based on the correlation between detection data and time information. Instead of using a static time synchronization approach, the system dynamically determines the detection timing of image sensors by analyzing the relationship between detection data and NTP time information, thereby improving reliability while maintaining ease of operation with standard protocols.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent implements a feedback mechanism by using detection data to verify and adjust synchronization accuracy. The system continuously monitors the correlation between detection data and time information, calculates shift time based on this correlation, and uses this feedback to refine synchronization, thereby improving reliability while maintaining compatibility with standard protocols.

Inventive Principle:

Principle #23Feedback

3Measurement precision

If shift time is calculated to match first time-series data with second time-series data, then synchronization accuracy is improved, but the system complexity increases due to additional calculation requirements

Engineering Contradiction:

Improvesynchronization precisionVSAvoidcalculation processing complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies partial action by focusing the shift time calculation on specific sensors (particularly image sensors and IMUs) and specific detection data (angular velocity data). Instead of calculating shift time for all sensors and all data types, the system selectively applies the calculation to the most critical sensor combinations, thereby achieving high synchronization precision while limiting the increase in system complexity to only where necessary.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS12361720B2Synchronization device, synchronization method, and non-transitory tangible computer readable storage medium

Publication Date: 2025.07.15 DENSO CORP

AI summary

A synchronization device is for a vehicle equipped with a plurality of sensors including an image sensor. The synchronization device acquires, as data related to a motion state of the vehicle, first time-series data based on detection data detected by the image sensor and second time-series data based on detection data detected by a sensor other than the image sensor. The synchronization device calculates shift time required for matching the first time-series data with the second time-series data.