Image Quantization Using Machine Learning Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image quantization methods lack consistency across multiple images, requiring separate optimization for each image and not effectively preserving image similarity for computer vision tasks, such as object recognition and semantic segmentation in autonomous driving.

Innovation Solution

A computer-implemented method using a deep neural network system that trains an image-to-image machine-learning model and a mixer model to consistently assign a fixed set of colors across a set of images, ensuring visual similarity while reducing the number of colors, thereby optimizing image quantization for computer vision tasks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If traditional image quantization methods are used to reduce the number of colors, then file size is reduced, but consistency across multiple images is lost and visual similarity for computer vision tasks deteriorates

Engineering Contradiction:
Improvenumber of colorsVSAvoidconsistency across images
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent applies universality by training a single machine learning model to handle multiple images simultaneously, learning a consistent color mapping that works across the entire dataset. The model learns universal color relationships rather than image-specific quantization, enabling consistent color palettes across all input images while maintaining visual similarity for downstream computer vision tasks.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent employs preliminary action by pre-training the machine learning model on a large dataset before applying quantization. The model learns optimal color mappings in advance through training on reference images and target images, so that when actual quantization is performed, the consistent color relationships are already established, ensuring both reduction in color quantity and maintenance of consistency across images.

Inventive Principle:
Principle #10Preliminary action

2Quantity of substance

If traditional image quantization methods are used to reduce the number of colors, then file size is reduced, but visual similarity for computer vision tasks deteriorates

Engineering Contradiction:
Improvenumber of colorsVSAvoidvisual similarity
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

The patent implements feedback by using a loss function that measures the difference between original images and quantized images, then backpropagating this error to update the model parameters. This continuous feedback loop ensures that the quantization process maintains visual similarity by adjusting the color mappings to minimize information loss while still reducing the number of distinct colors.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces traditional mechanical quantization methods (such as k-means clustering or palette quantization) with a machine learning-based approach. Instead of using fixed algorithms that blindly reduce colors, the neural network learns optimal color mappings that preserve visual information, substituting the mechanical reduction process with an intelligent system that understands image content and maintains visual similarity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If separate optimization is performed for each image, then individual image quality is maintained, but processing time and complexity increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing speed
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent merges the processing of multiple images into a single unified model training process. Instead of optimizing each image separately, the model learns from batches of images simultaneously, combining the quantization task across the entire dataset. This merging approach maintains image quality through learned color mappings while dramatically improving processing efficiency by handling multiple images in parallel during training and inference.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent performs preliminary training on a large dataset to establish consistent color mappings that work across all images. This pre-learning phase captures general color relationships and patterns, so that when actual quantization is applied to individual images or new datasets, the model can quickly produce high-quality results without requiring separate optimization for each image, thus maintaining both quality and speed.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11893709B2Image quantization using machine learning
Publication Date: 2024.02.06 ROBERT BOSCH GMBH
  • US11893709B2 patent drawing
  • US11893709B2 patent drawing
  • US11893709B2 patent drawing

AI summary

Methods and systems are disclosed for quantizing images using machine-learning. A plurality of input images are received from a sensor (e.g., a camera), wherein each input image includes a plurality of pixels. Utilizing an image-to-image machine-learning model, each pixel is assigned a new pixel color. Utilizing a mixer machine-learning model, each new pixel color is converted to one of a fixed number of colors to produce a plurality of quantized images, with each quantized image corresponding to one of the input images. A loss function is determined based on an alignment of each input image with its corresponding quantized image via a pre-trained reference machine-learning model. One or more parameters of the image-to-image machine-learning model and the mixer model are updated based on the loss function. The process repeats, with each iteration updating the parameters of the image-to-image machine-learning model and the mixer model, until convergence, resulting in trained models.