Motion Image Trajectory Mapping via Time Stamp Correlation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face difficulties in correlating position information with time series data, such as motion images, especially when using coding techniques like MPEG, which can rearrange image frames, making it hard to maintain the correct sequence and thus hinder the display of accurate trajectories on maps.

Innovation Solution

An information generating apparatus that captures motion images, acquires position information, codes the data, and multiplexes the position information with the coded motion image data, using system time to ensure correlation and correct sequencing, allowing for the display of trajectories on a map during decoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If motion image data is coded using MPEG scheme with bidirectional predictive coding, then data compression efficiency is improved, but the sequence of image frames is rearranged making it difficult to correlate with position information

Engineering Contradiction:
Improvedata compression efficiencyVSAvoidcorrelation between frame sequence and position information
Core Design Contradiction:
Loss of energyVSLoss of information

Solution Approach 1:

The patent applies preliminary action by adding presentation time stamps (PTS) and decoding time stamps (DTS) to each image frame during the coding process. These time stamps are inserted in advance to preserve the original temporal sequence information, enabling correct reordering of frames after compression without losing the correlation between frames and their corresponding position information.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses presentation time stamps (PTS) and decoding time stamps (DTS) as intermediary elements that mediate between the compressed frame sequence and the original temporal sequence. These time stamps act as markers that enable the playback system to reconstruct the correct chronological order of frames, thereby maintaining the correlation with position information even after rearrangement for compression.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If image frames are rearranged for bidirectional predictive coding, then coding efficiency is improved, but trajectory display accuracy on map deteriorates

Engineering Contradiction:
Improvecoding efficiencyVSAvoidtrajectory display accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by embedding presentation time stamps (PTS) that record the original temporal sequence of image frames before rearrangement. This allows the playback system to restore the correct chronological order of frames for accurate trajectory display on maps, while still benefiting from the compressed storage.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses decoding time stamps (DTS) and presentation time stamps (PTS) as intermediary markers that enable the separation between the compressed storage sequence and the original temporal sequence. These time stamps mediate the reconstruction process, ensuring that trajectory display accuracy is maintained despite frame rearrangement for coding efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If position information is correlated with each unitary image in coded motion image data, then trajectory display capability is improved, but system complexity increases

Engineering Contradiction:
Improvetrajectory display capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses presentation time stamps (PTS) and decoding time stamps (DTS) as intermediary elements that automatically manage the correlation between position information and image frames. Instead of requiring complex manual correlation systems, the time stamps provide a structured mechanism that simplifies the association process while enabling trajectory display capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies parameter changes by encoding temporal sequence information directly into the time stamp parameters (PTS and DTS) of each frame. This transforms the complex problem of maintaining frame-position correlation into a simpler parameter-based system where the temporal sequence is explicitly represented, reducing system complexity while improving trajectory display capability.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS7609901B2Recording/reproducing system
Publication Date: 2009.10.27 SONY GROUP CORP
  • US7609901B2 patent drawing
  • US7609901B2 patent drawing
  • US7609901B2 patent drawing

AI summary

Time varying images 712 before coded are rearranged in a coding stage into unitary images 722 having the sequence of time stamps DTS 725. A GPS or the like provides position information indicative of the position whereat the respective unitary image of a motion image has been captured. The unitary image and the position information are correlated to one another by setting common time stamps PTS (724 and 723) thereon. When decoding each of blocks of coded and multiplexed data 731 to 735, the position information corresponding to the unitary image is specified. Thereby, the unitary image of the coded motion image and the corresponding position information are correlated to one another, whereby a trajectory of the motion image can be displayed on a map in accordance with the position information.