Time-Series Image Inpainting for Stable Nonlinear Forecasting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing time series forecasting methods, particularly those using machine learning and deep learning, struggle with stability and flexibility when dealing with complex, nonlinear data, often requiring tailored approaches and failing to provide robust probabilistic predictions.

Innovation Solution

Convert time series data into images using a Pixelate Transform, employing inpainting techniques to fill in future data blanks, generating probabilistic visual forecasts through machine learning algorithms, and using metrics like SMAPE, MASE, and EMD to assess accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If machine learning and deep learning approaches are used for time series forecasting, then the ability to handle complex nonlinear data is improved, but stability and robustness deteriorate

Engineering Contradiction:
Improveability to handle complex nonlinear dataVSAvoidstability and robustness
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent segments the time series forecasting problem into two distinct phases: (1) converting time series data into image representations using pixelate transform, and (2) applying inpainting algorithms to fill missing future values. This segmentation allows each phase to be optimized independently, with the image conversion providing stability and the inpainting providing adaptability to nonlinear patterns.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary representation layer by transforming time series data into image format before processing. This intermediary image representation acts as a bridge that enables the use of stable inpainting algorithms while still capturing complex nonlinear temporal patterns through visual features.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If traditional forecasting methods like linear regression and ARIMA are used, then stability is improved, but the ability to handle highly nonlinear and inseparable data deteriorates

Engineering Contradiction:
ImprovestabilityVSAvoidability to handle highly nonlinear and inseparable data
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent replaces traditional mechanical forecasting approaches (linear regression, ARIMA) with a visual processing system. By substituting the mechanical time series modeling with image-based inpainting, the system achieves both the stability of traditional methods and the adaptability to handle nonlinear patterns through visual feature recognition.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transitions from one-dimensional time series data to two-dimensional image representations. This dimensional change enables the application of spatial processing techniques and inpainting algorithms that can capture complex nonlinear relationships while maintaining computational stability.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If image inpainting techniques are applied to forecast time series, then flexibility and adaptability are improved, but computational complexity increases

Engineering Contradiction:
Improveflexibility in handling various data typesVSAvoidcomputational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent changes the parameter representation from numerical time series values to visual image features. This parameter transformation enables the use of efficient inpainting algorithms that operate on visual patterns rather than complex numerical sequences, reducing computational complexity while maintaining flexibility.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12541828B2Method and system for forecasting time series by image inpainting
Publication Date: 2026.02.03 JPMORGAN CHASE BANK NA
  • US12541828B2 patent drawing
  • US12541828B2 patent drawing
  • US12541828B2 patent drawing

AI summary

Methods and systems for using images that represent time-series data to forecast corresponding images depicting future values of the time-series data are provided. The method includes: receiving a set of time-series data; converting the set of time-series data into a partial first image that includes a blank region to which future data to be included in the first set of time-series data corresponds; and performing an inpainting operation with respect to the partial first image by generating pixels for filling in the blank region in order to produce an augmented version of the first image. A machine learning algorithm that is trained by using historical time-series data may be used to perform the inpainting operation.