Image Layout Clustering and Cost Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image layout technologies fail to efficiently determine optimal arrangements of image elements with varying sizes and aspect ratios while preserving their original order and aspect ratio, leading to suboptimal visual presentation in constrained spaces.

Innovation Solution

The method involves grouping image elements into clusters by inserting line breaks and evaluating each potential cluster using a cost function to minimize total layout cost, where image elements are mapped to a graph, and the preferred layout corresponds to a path that minimizes total cost, ensuring the aspect ratio and format of each image element are preserved.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If image elements are arranged in constrained spaces using existing layout technologies, then the layout can be generated, but the visual presentation becomes suboptimal and space utilization is inefficient

Engineering Contradiction:
Improvespace utilizationVSAvoidvisual presentation quality
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent segments the sequence of image elements into multiple clusters by inserting line breaks at optimized positions. Each cluster represents a group of image elements that will be displayed together in a row. This segmentation allows the system to independently optimize the arrangement within each cluster while maintaining the overall order of elements, thereby improving space utilization without sacrificing visual presentation quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs a dynamic programming approach to determine the optimal insertion positions of line breaks. The cost function dynamically evaluates different clustering scenarios based on image element dimensions, aspect ratios, and sequence order. This dynamic optimization enables the system to adaptively find the best layout configuration that maximizes space utilization while preserving visual appeal.

Inventive Principle:
Principle #15Dynamics

2Area of stationary object

If image elements are resized to fit constrained spaces, then space utilization improves, but the aspect ratio and format of individual elements may be distorted

Engineering Contradiction:
Improvespace utilizationVSAvoidaspect ratio preservation
Core Design Contradiction:
Area of stationary objectVSShape

Solution Approach 1:

By segmenting image elements into clusters that are displayed in rows, the patent ensures that each image element maintains its original aspect ratio within its cluster. The segmentation approach allows elements to be grouped without forcing individual elements to stretch or distort, as each element retains its natural dimensions within the constrained row space.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality optimization by evaluating the cost function at each potential line break position based on the specific characteristics of image elements in that local region. The cost function considers the dimensions and aspect ratios of individual elements when determining cluster boundaries, ensuring that each element's shape characteristics are respected in its local context while contributing to overall space utilization.

Inventive Principle:
Principle #3Local quality

3Area of stationary object

If line breaks are inserted to group image elements into clusters, then space utilization improves, but determining the optimal layout becomes computationally complex

Engineering Contradiction:
Improvespace utilizationVSAvoidcomputational complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent applies dynamic programming to efficiently solve the optimization problem of determining optimal line break positions. The dynamic programming approach breaks down the complex problem into smaller subproblems, where the cost of each potential layout configuration is calculated based on previously computed costs. This reduces the computational complexity from exponential to polynomial time, making the optimization feasible for practical implementation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent performs preliminary actions by pre-calculating the costs associated with inserting line breaks at each possible position in the sequence of image elements. These preliminary cost calculations are stored and used to quickly determine the optimal layout without re-evaluating all possibilities from scratch. This preliminary computation significantly reduces the overall computational complexity while still achieving optimal space utilization.

Inventive Principle:
Principle #10Preliminary action

4Stability of the object's composition

If the original order of image elements is preserved, then the semantic sequence is maintained, but flexible arrangement options are limited

Engineering Contradiction:
Improvesequence order preservationVSAvoidlayout flexibility
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The patent segments the fixed sequence of image elements into flexible clusters while maintaining the original order of elements within each cluster. The segmentation approach allows different clustering configurations that respect the sequential order, providing multiple valid layout options. This maintains the semantic sequence stability while introducing flexibility in how elements are grouped and arranged in the visual layout.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The dynamic programming approach evaluates multiple possible clustering configurations that all preserve the original element order. The cost function dynamically selects among these configurations based on space utilization metrics, providing adaptability in the layout arrangement while maintaining sequence stability. This allows the system to adapt to different space constraints while respecting the inherent order of image elements.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9406093B2Determining an image layout
Publication Date: 2016.08.02 META PLATFORMS INC
  • US9406093B2 patent drawing
  • US9406093B2 patent drawing
  • US9406093B2 patent drawing

AI summary

In one embodiment, a method includes accessing multiple image elements that have an ordered sequence. From the ordered sequence of image elements, multiple clusters of image elements are determined, where each cluster has one or more image elements arranged in a line. The image elements within each cluster are scaled to have substantially the same first dimension while maintaining their original aspect ratios and being arranged to maintain the ordered sequence. Each of the clusters has substantially the same second dimension. A cost for each cluster, based on a cost function, is determined. A graph based on the clusters that maintains the ordered sequence is accessed. The graph includes multiple paths that each represent a layout of the image elements and have a total cost based on the costs of the clusters along the path. The path with a lowest total cost is identified to determine a preferred layout.