3D Image Processing Synchronization via Change Pattern Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing three-dimensional image processing systems face challenges in accurately synchronizing moving image recording data from cameras with time-series measurement data from motion sensors, particularly at high-speed motions like a golf swing, due to differing time resolutions and resulting position misalignment.

Innovation Solution

A three-dimensional image processing system that includes a sensor for detecting motion, imaging units for generating moving image data, and a control unit to synchronize measurement data and moving image data by comparing change patterns, allowing for accurate association and synchronization even with different data sampling cycles and without relying on characteristic changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a camera records moving image data at its native frame rate, then the camera operation is simple and the frame rate is maintained, but the time resolution is significantly lower than that of the motion sensor, causing inaccurate synchronization

Engineering Contradiction:
Improvetime resolutionVSAvoidsynchronization complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary synchronization process that compares change patterns between moving image data and measurement data to establish correspondence relationships. This intermediary mechanism bridges the gap between the camera's lower frame rate and the motion sensor's higher time resolution, enabling accurate synchronization without requiring the camera to operate at its native frame rate or complex hardware modifications.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameter of time resolution by performing comparison processing at multiple time resolutions. It compares change patterns at both the camera's frame rate and the motion sensor's higher sampling rate, then establishes correspondence relationships that enable accurate temporal alignment. This parameter transformation allows the system to achieve high time resolution synchronization while maintaining simple camera operation.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the camera operates at its native frame rate, then the camera operation remains simple, but position misalignment occurs between the moving image data and measurement data during high-speed motion

Engineering Contradiction:
Improveposition alignment accuracyVSAvoidoperation simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent introduces an intermediary synchronization process that compares change patterns between moving image data and measurement data to establish correspondence relationships. This intermediary mechanism bridges the gap between the camera's lower frame rate and the motion sensor's higher time resolution, enabling accurate synchronization without requiring the camera to operate at its native frame rate or complex hardware modifications.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical approach of synchronizing at the camera's frame rate with an information-processing approach. By comparing change patterns and establishing correspondence relationships through pattern recognition, the system achieves accurate position alignment without relying on mechanical synchronization mechanisms or complex hardware modifications.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If characteristic changes (such as light source blinking) are used for synchronization, then synchronization can be achieved at known reference points, but synchronization fails when no characteristic changes appear in the data

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidapplicability to various motions
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent creates a universal synchronization method that works for all types of motion by comparing change patterns rather than relying on specific characteristic changes. The comparison-based approach can identify correspondence relationships in any motion scenario, whether or not characteristic changes like light source blinking are present, making the synchronization method universally applicable to diverse motion types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Instead of using characteristic changes to trigger synchronization, the patent inverts the approach by continuously comparing change patterns to detect correspondence relationships. This inversion allows the system to synchronize based on pattern matching rather than waiting for specific events, enabling synchronization to work even when no characteristic changes occur in the data.

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS9967550B2Three-dimensional image processing system, three-dimensional image processing apparatus, and three-dimensional image processing method
Publication Date: 2018.05.08 SEIKO EPSON CORP
  • US9967550B2 patent drawing
  • US9967550B2 patent drawing
  • US9967550B2 patent drawing

AI summary

Provided is a three-dimensional image processing system that includes a sensor portion that is attached to a measurement target and detects a three-dimensional motion thereof as measurement data; a moving image data generation portion that generates moving image data in which the sensor potion is imaged together with the measurement target; and a control portion that causes the moving image data and the measurement data to be synchronized with each other on a time axis by comparing a change pattern relating to the motion of the sensor portion and being based on the moving image data with a change pattern relating to the motion of the sensor portion and being based on the measurement data.