Image Generation Device Reducing Jaggies via Gradient-Based Pixel Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image generation devices for construction machines suffer from jaggies in output images due to insufficient interpolation methods, and bilinear or bi-cubic interpolation increases computational load and manufacturing costs.

Innovation Solution

An image generation device that associates input pixel values with output pixel values using two integer coordinate points from four nearby points on the input image plane, employing a weight-based interpolation method to reduce jaggies while maintaining low operational load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If bilinear or bi-cubic interpolation is used to reduce jaggies, then image quality is improved, but computational load and manufacturing costs increase

Engineering Contradiction:
Improveimage qualityVSAvoidcomputational load
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent changes the interpolation parameter from using all four surrounding pixels (bilinear/bi-cubic) to using only two selected pixels (horizontal or vertical pair). This parameter change reduces computational complexity while maintaining acceptable image quality by selecting the most relevant pixel pairs based on the gradient direction of the image content.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent segments the interpolation process into two distinct cases: horizontal pixel pair interpolation and vertical pixel pair interpolation. By dividing the problem into these two segments and selecting the appropriate segment based on gradient analysis, the system achieves efficient computation without sacrificing image quality.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If simple nearest neighbor interpolation is used, then computational load is reduced, but jaggies increase on the output image

Engineering Contradiction:
Improvecomputational loadVSAvoidimage quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent improves upon nearest neighbor interpolation by changing the selection parameter from simply picking the closest pixel to selecting one of two pixels based on gradient direction. This parameter change maintains low computational load while significantly reducing jaggies by choosing the pixel that best aligns with the image content's orientation.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies local quality by analyzing the gradient direction at each pixel location and selecting the interpolation method (horizontal or vertical pixel pair) that best matches the local image structure. This local adaptation reduces jaggies in regions with strong directional features while maintaining efficiency.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10134119B2Image generation device and operation support system
Publication Date: 2018.11.20 SUMITOMO HEAVY IND LTD
  • US10134119B2 patent drawing
  • US10134119B2 patent drawing
  • US10134119B2 patent drawing

AI summary

An image generation device generates an output image based on an input image captured by a camera attached to a shovel. Further, the image generation device includes an output image generation unit that associates a value of an input pixel in the input image with a value of an output pixel in the output image to generate the output image. A value of an output pixel specified by an integer coordinate point on an output image plane is determined based on values of two input pixels specified by two integer coordinate points selected from four integer coordinate points in the vicinity of a real number coordinate point on an input image plane corresponding to the integer coordinate point on the output image plane.