Orientation-Aware Video Cropping for Mobile Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Videos and media recorded in wide aspect ratios cannot be directly displayed full-screen on mobile devices in portrait orientation, often resulting in cropping or the addition of black bars, which reduces the display size and loses detail.
Innovation Solution
A method and system that utilize metadata to intelligently crop or pad video frames, identifying important features and regions to maintain full-screen display while adapting to orientation changes, using techniques like face tracking, object detection, and deep learning algorithms to determine optimal cropping paths.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If wide aspect ratio video is displayed on mobile device in portrait orientation, then full-screen display is achieved, but video content is cropped or surrounded with black bars reducing display size
Solution Approach 1:
The system dynamically adjusts the cropping region based on detected object positions and orientations. The cropping rectangle adapts its location, size, and aspect ratio according to the detected content, allowing the same wide aspect ratio video to be displayed optimally in different portrait orientations without fixed cropping patterns.
Solution Approach 2:
The system changes multiple parameters including cropping region coordinates, cropping rectangle aspect ratio, and display orientation based on detected object characteristics. By adjusting these parameters dynamically, the system maintains full-screen display while preserving important video content details.
2Adaptability or versatility
If video is cropped to center to fit portrait orientation, then display compatibility is improved, but detail at left and right edges is lost
Solution Approach 1:
The system automatically detects objects, their positions, and orientations within the video frame, then autonomously determines the optimal cropping region without manual intervention. The self-service approach allows the system to adapt cropping decisions based on actual content distribution rather than following fixed cropping rules.
Solution Approach 2:
The system replaces traditional mechanical cropping methods (fixed center cropping or letterboxing) with an intelligent detection-based approach using computer vision algorithms. This substitution allows for adaptive cropping that preserves content details while maintaining orientation compatibility.
3Stability of the object's composition
If black bars are added to surround video, then aspect ratio is maintained, but display size is reduced
Solution Approach 1:
Instead of using fixed black bars, the system dynamically adjusts the cropping region boundaries based on detected object positions. The cropping rectangle adapts its dimensions and position to maintain the desired aspect ratio while maximizing the display area, eliminating the need for static black bars.
Solution Approach 2:
The system transitions from two-dimensional fixed cropping approaches to a multi-dimensional adaptive cropping strategy that considers object position, orientation, and aspect ratio requirements simultaneously. This allows for optimal use of display space while maintaining compositional integrity.
Data Source
AI summary
Systems and methods for cropping media for a particular orientation using a computing device are described. In some implementations, a method may first comprise receiving by a video preprocessor of the device, a first frame of media in a first orientation. A first region comprising a first feature within the first frame may be identified, by an image analyzer. A cropping calculator of the device may generate a score for the first region based on a characteristic of the first feature and determine that the score for the first region exceeds a threshold. An image processor of the device may then crop the first frame of the video, responsive to the determination that the score for the first region exceeds the threshold, to include the first region within a predetermined display area comprising a subset of the first frame in a second orientation.