Variable Playback Rate Control for Motion-Active Image Sequences

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for capturing images fail to effectively model playback around a particular frame in digital videos, neglecting user experience in viewing motion information and high-resolution images, and lack a mechanism for unique visual representation of motion activity.

Innovation Solution

An electronic device with an image capturing unit, motion detecting unit, and controller that determines playback rates based on detected motion data to display images, allowing for variable playback rates and enhanced user experience by discarding irrelevant motion segments and incorporating motion information into image representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional variable-rate playback is used to browse digital videos, then playback speed can be adjusted, but it fails to model playback around a particular frame and lacks unique visual representation of motion activity

Engineering Contradiction:
Improveplayback modeling capabilityVSAvoidplayback control mechanism
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The video is segmented into multiple playback regions, each associated with a specific frame. The controller divides the video content into distinct segments that can be played back at different rates independently, enabling localized playback control around key frames without affecting the entire video stream.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different playback rates are applied to different regions or segments of the video based on local motion characteristics. The controller analyzes motion data for specific regions and assigns appropriate playback rates to each region, creating a locally optimized playback experience that highlights motion activity in specific areas while maintaining normal playback elsewhere.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If high resolution images are captured, then image quality is improved, but motion information viewing experience is neglected

Engineering Contradiction:
Improveimage resolutionVSAvoidmotion information
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The system adds a temporal dimension to the high-resolution images by capturing multiple frames over time and playing them back at variable rates. This transforms static high-resolution images into dynamic sequences that preserve both the high spatial quality of individual frames and the motion information across the temporal dimension.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The controller acts as an intermediary that processes both the high-resolution image data and motion detection data. It synthesizes this information to create a playback sequence that maintains the high resolution of the original images while incorporating motion information through variable playback rates, effectively mediating between image quality and motion representation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If multiple takes are captured to ensure the desired moment, then capture reliability is improved, but the process becomes cumbersome and user experience deteriorates

Engineering Contradiction:
Improvemoment capture accuracyVSAvoidcapture process simplicity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system performs preliminary capture of multiple frames continuously in the background before, during, and after the desired moment. Instead of requiring the user to manually retake shots, the system has already captured the surrounding frames in advance, which are then selectively played back to ensure the desired moment is captured with high reliability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The controller automatically selects and plays back the appropriate frames from the captured sequence without requiring user intervention. The system serves itself by autonomously identifying key moments based on motion detection and automatically configuring the variable playback rates, eliminating the need for cumbersome manual retaking and simplifying the user experience.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10991393B2Electronic device and method of managing a playback rate of a plurality of images
Publication Date: 2021.04.27 SAMSUNG ELECTRONICS CO LTD
  • US10991393B2 patent drawing
  • US10991393B2 patent drawing
  • US10991393B2 patent drawing

AI summary

Disclosed herein are an electronic device and a method of managing a playback rate of a plurality of images using an electronic device. The electronic device may include a display, an image capturing unit configured to obtain a plurality of images, a motion detecting unit configured to detect motion data of at least one region of interest (ROI) in the plurality of images, and a controller configured to determine at least one playback rate for the plurality of images based on the detected motion data and control the display to display the plurality of images based on the at least one playback rate.