Triangulation Raster Image Interpolation Edge Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image smoothing methods, such as data-dependent triangulation, face challenges like incorrect triangle orientation due to color intensity only considerations, failure on thin lines, generation of unnatural parallel lines, poor curve representation, and high computational complexity, leading to visible pixels and staircase effects at high magnification.

Innovation Solution

The method involves triangulating images, using a cost function that includes a LAB weighted color intensity factor to align triangle edges with contour lines, performing initial edge swaps for squares, limiting triangle length, and adjusting the cost function to consider color differences and gradient orientations, thereby optimizing edge swapping to reduce computational load and improve image smoothness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If data-dependent triangulation is used for image smoothing, then image smoothness is improved, but computational complexity increases significantly

Engineering Contradiction:
Improveimage smoothnessVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The image processing is divided into two distinct phases: a fast initial pass that processes only square configurations, and a subsequent optimization pass that handles general quadrilateral cases. This segmentation allows the majority of computations to be performed using the simpler square-based algorithm, reducing overall computational complexity while maintaining image smoothness improvements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The method performs an initial edge swapping pass using the computationally efficient square-based algorithm before applying the more complex general quadrilateral optimization. This preliminary action establishes a good initial triangulation state, reducing the workload and computational requirements of the subsequent optimization pass.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If triangulation edge swapping is performed to align with color intensity contours, then staircase effects are reduced, but processing time increases

Engineering Contradiction:
Improvestaircase effect reductionVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The edge swapping operation is segmented into two passes: a fast initial pass that quickly processes square configurations to achieve immediate staircase effect reduction, and a slower optimization pass that refines the triangulation. This allows the system to achieve significant improvement early while providing an option to stop before the full computationally intensive optimization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The method allows for partial execution of the optimization process. Users can choose to perform only the initial fast pass if processing time is critical, or continue with the full optimization if maximum quality is required. This partial action approach provides flexibility in trading off processing time against image quality.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If simple bilinear interpolation is used, then processing speed is maintained, but image smoothness and detail preservation deteriorate

Engineering Contradiction:
Improveprocessing speedVSAvoidimage smoothness
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent replaces the traditional pixel-based interpolation mechanism (bilinear or bicubic) with a geometry-based triangulation mechanism. Instead of calculating interpolated colors based on pixel positions and weights, the system uses triangular facets to represent image surfaces, substituting the mathematical interpolation mechanism with a geometric modeling approach that inherently preserves edges and contours.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The method changes the fundamental parameter representation from pixel colors to triangular facet orientations and colors. By representing the image as a mesh of triangles with vertices at pixel centers, the system transforms the interpolation problem into a surface rendering problem, where triangle edges naturally align with image contours when optimized, providing both smoothness and edge preservation.

Inventive Principle:
Principle #35Parameter changes

4Manufacturing precision

If bicubic interpolation is used to improve image clarity, then pixel visibility is reduced, but computational complexity and processing time increase

Engineering Contradiction:
Improveimage clarityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent substitutes the complex bicubic interpolation mathematical operations with a geometric triangulation approach. Instead of performing repeated bicubic calculations on overlapping pixel neighborhoods, the system creates a triangular mesh and uses simple linear interpolation within each triangle, achieving similar or better clarity with reduced computational complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The triangulation method applies different triangle configurations locally based on image features. By optimizing triangle edges to align with local contours and using adaptive triangle sizing, the method provides high image clarity in regions requiring it while using simpler configurations in uniform areas, reducing overall computational complexity compared to uniform bicubic interpolation.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS7683914B1Triangulation based raster image interpolation
Publication Date: 2010.03.23 BENTLEY SYSTEMS INC
  • US7683914B1 patent drawing
  • US7683914B1 patent drawing
  • US7683914B1 patent drawing

AI summary

A method of smoothing a triangulated raster image includes the steps of: triangulating the image to create triangles having vertices, each of which is centered on a pixel of the image; comparing the costs of a first and a second orientation of an edge of each pair of adjacent triangles that forms a quadrilateral; swapping the edge of the pair of triangles to the lower cost orientation; and iterating the comparing and swapping until a stopping point is reached. The cost function used may include a cost factor that causes a triangle edge orientation that aligns with a both a color and an intensity of a color intensity contour line of the image to have a lower cost than a triangle edge orientation that does not so align.