Variable Frame Rate Slow Motion Video Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing slow motion video techniques record all objects in a scene at a uniform frame rate, leading to a less visually pleasing experience as fast-moving objects are slowed more than slow-moving objects, hindering cinematic quality.

Innovation Solution

An electronic device segments objects in a video, determines their interactions, and applies variable frame rate interpolation to different sections based on significance scores, generating multiple sectional slow motion effects to enhance the visual experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If uniform frame rate is applied to all objects in slow motion video, then the processing is simple and consistent, but fast-moving objects are slowed excessively while slow-moving objects become too stagnant, reducing visual appeal

Engineering Contradiction:
Improveprocessing simplicityVSAvoidvisual appeal for different motion speeds
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The video is segmented into multiple sections based on object clusters with different motion characteristics. Each section is identified through object detection and motion analysis, allowing different frame rates to be applied to different segments of the video corresponding to different objects or regions with similar motion patterns.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different frame rates are applied to different sections of the video based on the local motion characteristics of objects in those sections. Fast-moving objects are assigned higher frame rates to prevent excessive slowing, while slow-moving objects are assigned lower frame rates to maintain natural appearance, creating locally optimized quality throughout the video.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If variable frame rate interpolation is applied to different sections of video, then visual experience is improved by maintaining appropriate motion appearance, but processing complexity and computational requirements increase

Engineering Contradiction:
Improvevisual experience qualityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system dynamically determines frame rates for different video sections based on real-time analysis of object motion characteristics. The frame rate assignment is not static but adapts to the motion patterns detected in each section, allowing the processing parameters to change dynamically according to content requirements.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The frame rate parameter is changed across different sections of the video based on object motion analysis. By identifying sections with different motion characteristics and assigning appropriate frame rates to each, the system optimizes visual quality while managing computational complexity through targeted parameter adjustment rather than uniform processing.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12033666B2Method and electronic device for a slow motion video
Publication Date: 2024.07.09 SAMSUNG ELECTRONICS CO LTD
  • US12033666B2 patent drawing
  • US12033666B2 patent drawing
  • US12033666B2 patent drawing

AI summary

A method for generating a slow motion video. The method includes segmenting, by an electronic device, objects in the video. Further, the method includes determining, by the electronic device, an interaction between the segmented objects. Further, the method includes clustering, by the electronic device, the segmented objects in the video to generate object clusters based on the interaction. Further, the method includes determining, by the electronic device, a degree of slow motion effect to be applied to each of the object clusters in the video based on a significance score of each of the object clusters. Further, the method includes generating, by the electronic device, the slow motion video by applying the degree of slow motion effect to that has been determined to corresponding the object clusters.