Video Frame Spatial Arrangement Using Motion Anchor Points

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for creating photo book layouts from video frames fail to effectively represent motion, often requiring numerous frames to depict complex motion and struggle with dynamic layout paths and image characteristics.

Innovation Solution

A method for spatially arranging video frames based on determined motion paths, where anchor points are used to position frames relative to a layout path, allowing for dynamic and motion-based frame placement and characteristics adjustment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional photo book methods are used to represent motion, then the layout can be created with pre-defined paths, but the motion representation becomes inaccurate and requires many frames

Engineering Contradiction:
Improvemotion representation accuracyVSAvoidnumber of frames required
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent applies dynamics by making the layout path adaptive rather than static. The system dynamically generates layout paths that follow the actual motion trajectories of objects in the video, allowing the path to adjust automatically based on detected motion characteristics. This resolves the contradiction by accurately representing motion through dynamic path adaptation without requiring excessive frames.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes parameters by transitioning from fixed, pre-defined layout paths to adaptive paths generated through object tracking. The system modifies path parameters (position, orientation, shape) based on real-time motion analysis, enabling accurate motion representation with fewer frames by aligning the layout structure with actual motion dynamics.

Inventive Principle:
Principle #35Parameter changes

2Ease of manufacture

If pre-defined layouts are used for photo books, then the layout creation process is simplified, but the layout cannot adapt to complex or varying motion characteristics

Engineering Contradiction:
Improvelayout creation simplicityVSAvoidmotion adaptability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent implements self-service by enabling the system to automatically generate and adapt layout paths without manual intervention. The object tracking and motion analysis components autonomously create customized layout paths that fit the specific motion characteristics of each video, maintaining ease of use while achieving high adaptability to various motion patterns.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system transitions from static pre-defined layouts to dynamic adaptive layouts that automatically adjust to motion characteristics. The layout path is generated and modified in real-time based on tracked object motion, providing both simplicity through automation and versatility through adaptive motion-based customization.

Inventive Principle:
Principle #15Dynamics

3Device complexity

If linear panoramic images are created from video frames, then the images can be arranged in a single path, but complex motion cannot be effectively expressed

Engineering Contradiction:
Improvelayout structure simplicityVSAvoidcomplex motion expression
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent moves beyond linear one-dimensional panoramic arrangements by creating two-dimensional adaptive layout paths that can curve, branch, and adjust in multiple directions. This dimensional expansion allows the layout to follow complex motion trajectories while maintaining a cohesive visual structure, effectively expressing complex motion without excessive complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Extent of automation

If template-based frame placement is used, then the layout process is automated, but the placement does not dynamically reflect actual motion characteristics

Engineering Contradiction:
Improvelayout automation levelVSAvoiddynamic motion reflection
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

The patent enhances automation by implementing dynamic, motion-driven layout path generation. Instead of using fixed templates, the system automatically creates and adjusts layout paths based on real-time object tracking and motion analysis, providing both high automation and dynamic adaptation to motion characteristics.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback mechanisms where motion tracking information continuously informs layout path adjustments. The automated process uses real-time feedback from motion analysis to dynamically modify layout parameters, ensuring that frame placement accurately reflects actual motion characteristics while maintaining full automation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10440313B2Method, system and apparatus for spatially arranging a plurality of video frames for display
Publication Date: 2019.10.08 CANON KK
  • US10440313B2 patent drawing
  • US10440313B2 patent drawing
  • US10440313B2 patent drawing

AI summary

A method and system for spatially arranging a plurality of video frames for display on a layout region is provided. The plurality of video frames are selected from a video sequence based on a determination of motion of an object within the video sequence. An image layout path is determined for the selected video frames. An anchor point is determined for each selected video frame based on a determination of motion of the object depicted in the video frame, each said anchor point locating a selected video frame with respect to the layout path. The selected plurality of video frames are spatially arranged on the layout region relative to the determined image layout path and in accordance with the determined anchor points.