Video Frame Cropping for Interactive Presentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video communication on mobile devices faces challenges such as the appearance of black bars when viewing landscape video on vertically oriented screens, especially on smaller devices, and lacks interactive presentation methods.

Innovation Solution

A system and method for processing and formatting video by determining device orientation and cropping frames based on a region of interest, allowing for interactive presentation by selecting and combining video sources, and providing user-controlled video selection through device orientation and input interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If landscape video is displayed on a vertically oriented mobile device screen, then the video can be viewed on the device, but large black bars appear on the top and bottom of the screen reducing the viewing area

Engineering Contradiction:
Improveviewing areaVSAvoidvideo formatting complexity
Core Design Contradiction:
Area of stationary objectVSEase of manufacture

Solution Approach 1:

The patent extracts and removes the black bars from the video display by cropping the video frames to the region of interest. The system identifies the active video area within each frame and extracts only that portion for display, eliminating the wasted space occupied by black bars and maximizing the viewing area on vertically oriented screens.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements dynamic video formatting that automatically adjusts the cropping region based on device orientation and screen dimensions. The system dynamically determines the appropriate region of interest for each frame and applies real-time cropping to optimize the viewing area regardless of whether the device is held vertically or horizontally, making the viewing area adaptable to different device orientations.

Inventive Principle:
Principle #15Dynamics

2Area of stationary object

If video is cropped to eliminate black bars, then the viewing area is maximized, but the region of interest may be lost or distorted

Engineering Contradiction:
Improveviewing areaVSAvoidregion of interest accuracy
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent employs feedback mechanisms where the system continuously monitors the video content and device orientation, then adjusts the cropping parameters accordingly. By analyzing each frame to identify the region of interest and using this information to guide the cropping process, the system ensures that the most important content is preserved while maximizing the viewing area, creating a closed-loop system that adapts to maintain precision.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If traditional video playback is used, then the video plays smoothly, but interactive presentation options are lacking

Engineering Contradiction:
Improveinteractive controlVSAvoidvideo presentation system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent transforms static video playback into a dynamic interactive experience by allowing users to control video orientation and selection based on device orientation. The system dynamically switches between different video sources and orientations in response to user actions and device orientation changes, enabling interactive presentation while maintaining smooth playback through real-time adaptation.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11159743B2Processing and formatting video for interactive presentation
Publication Date: 2021.10.26 SNAP INC
  • US11159743B2 patent drawing
  • US11159743B2 patent drawing
  • US11159743B2 patent drawing

AI summary

Systems and methods are described for determining that the user interaction with a display of a computing device during display of a video comprising a sequence of frames indicates a region of interest in a current frame of the sequence of frames of the displayed video. For each frame of the sequence of frames after the current frame, the frame is cropped to generate a cropped frame comprising a portion of the frame including the region of interest in the frame, the cropped frame is enlarged based on a display size corresponding to an angle or orientation of the computing device during display of the video, and the enlarged cropped frame replaces the frame such that the enlarged cropped frame is displayed in the sequence of frames of the video on the display of the computing device instead of the frame.