Dynamic Frame Rate Synchronization for Time Lapse Stabilization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Action cameras capture unstable video or image sequences due to high amplitude motion during activities like running, biking, or flying, resulting in undesirable vertical motion and unstabilized recordings.

Innovation Solution

A method that synchronizes the frame rate of a time lapse image sequence by converting motion data from the time domain to the frequency domain, determining a dominant frequency, and sampling frames at a frequency related to this dominant frequency to create a new image sequence, thereby stabilizing the image capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the camera captures video or image sequences at a fixed frame rate during high amplitude motion activities, then the recording captures the full range of motion, but the output exhibits undesirable vertical motion and appears unstabilized

Engineering Contradiction:
Improveimage stabilityVSAvoidcapture simplicity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent applies dynamics by making the frame rate adjustable and adaptive rather than fixed. The system dynamically modifies the frame interval based on detected motion characteristics, allowing the capture rate to change in response to varying motion conditions. This resolves the contradiction by enabling image stabilization through dynamic frame rate adjustment while maintaining operational simplicity through automated detection and adjustment.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the temporal parameter (frame interval) based on detected motion frequency. By analyzing motion data and adjusting the time between captured frames, the system stabilizes images during high amplitude motion. This parameter change allows the camera to capture stable footage during activities like running or flying without requiring manual intervention, resolving both image stability and operational simplicity requirements.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the camera captures frames at a higher frame rate to reduce motion blur, then motion detail is improved, but the amount of data to process and store increases

Engineering Contradiction:
Improvemotion capture accuracyVSAvoiddata volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent optimizes the frame rate parameter based on detected motion characteristics rather than using a uniformly high frame rate. By adjusting the frame interval dynamically, the system captures sufficient motion detail during high-speed activities while reducing unnecessary frame captures during lower motion periods, thereby maintaining measurement precision while managing data volume.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies partial action by capturing frames selectively based on motion detection rather than continuously at maximum rate. The system uses motion data to determine when high-speed capture is necessary and reduces capture rate when motion is minimal, achieving adequate motion capture accuracy without generating excessive data.

Inventive Principle:
Principle #16Partial or excessive action

3Ease of operation

If the camera uses a fixed frame interval during time lapse capture, then the capture process is simple, but the output exhibits rhythmic oscillations that match the cadence of the user's motion

Engineering Contradiction:
Improvecapture simplicityVSAvoidimage sequence stability
Core Design Contradiction:
Ease of operationVSStability of the object's composition

Solution Approach 1:

The patent resolves this contradiction by making the frame interval dynamic rather than fixed. The system continuously monitors motion characteristics and adjusts the time between frames accordingly, breaking the synchronization with the user's motion cadence. This dynamic adjustment maintains capture simplicity through automated control while eliminating rhythmic oscillations in the output image sequence.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent uses feedback from motion sensors to automatically adjust the frame interval during time lapse capture. The system detects motion cadence and modifies capture timing in response, preventing synchronization with rhythmic motion patterns. This feedback mechanism maintains operational simplicity while achieving image sequence stability without requiring manual frame interval adjustment.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12003856B2Dynamic synchronization of frame rate to a detected cadence in a time lapse image sequence
Publication Date: 2024.06.04 GOPRO INC
  • US12003856B2 patent drawing
  • US12003856B2 patent drawing
  • US12003856B2 patent drawing

AI summary

Synchronization of a frame rate to a detected cadence includes receiving a sequence of image frames. Motion data recorded contemporaneously with a capture of the sequence of image frames are also received. At least some of the motion data are converted from time domain data to frequency domain data. A dominant frequency in the frequency domain data is determined. Frames from the sequence of image frames are sampled at a sampling frequency related to the dominant frequency. A new image sequence is created using the sampled frames.