Dynamic Image Cropping for Variable Aspect Ratios
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for displaying digital content with different aspect ratios on smaller devices, such as smartphones and tablets, often result in a compromised viewing experience due to scaling down or cropping, which can lead to the most visually interesting or significant subject matter being obscured.
Innovation Solution
A technique for dynamically cropping digital content by computing visual interest scores for different regions within an image or video and transmitting metadata to endpoint devices to ensure the most visually interesting or significant subject matter is displayed, even when the display aspect ratio differs from the content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the image or video is scaled down to fit entirely within the display device, then the content fits the display aspect ratio, but the presentation size becomes too small to be viewable on smaller display screens
Solution Approach 1:
The image is divided into multiple aspect ratio segments or regions, each optimized for different display aspect ratios. The system identifies and segments the most visually interesting portions of the image that can be adapted to various aspect ratios without losing key subject matter.
Solution Approach 2:
Different regions of the image are treated differently based on their visual importance. The system applies local quality assessment to identify areas containing significant subject matter and ensures these regions maintain adequate size and visibility across different display aspect ratios.
2Adaptability or versatility
If the original content is cropped to fit the display aspect ratio of a particular display device, then the display aspect ratio compatibility is achieved, but the most visually interesting or significant subject matter may not be displayed
Solution Approach 1:
The system performs preliminary analysis of the image to identify and mark the most visually interesting or significant subject matter before cropping. This pre-identification ensures that when the image is cropped to fit different aspect ratios, the key subject matter is preserved and not lost.
Solution Approach 2:
The system uses visual interest scoring and analysis to provide feedback on which regions contain significant subject matter. This feedback mechanism guides the cropping process to ensure that important elements are retained while adapting to different display aspect ratios.
3Loss of information
If visual interest scores are computed and metadata is transmitted to dynamically crop content, then the most visually interesting subject matter remains viewable, but the system complexity increases
Solution Approach 1:
The system introduces an intermediary metadata layer that carries visual interest score information between the content source and the display device. This metadata acts as a mediator, guiding the cropping process without requiring complex real-time processing at the display device, thus managing system complexity while preserving subject matter.
Data Source
AI summary
One embodiment of the present invention sets forth a technique for dynamically cropping image data transmitted to an endpoint device. The technique includes computing a first visual interest score for a first visual interest region within a digital image based on content included in the first visual interest region, computing a second visual interest score for a second visual interest region within the digital image based on content included in the second visual interest region, and determining that the first visual interest region is preferred over the second visual interest region based on the first visual interest score and the second visual interest score. The technique further includes setting a location within the first visual interest region as a point of visual interest and transmitting the digital image and the location of the point of visual interest to a computing device for displaying a portion of the digital image that includes the point of visual interest.