Spectral Band Translation via Machine Learning Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current spectral imaging systems face challenges in obtaining multispectral imagery due to high costs and bandwidth limitations when collecting and transmitting data across various spectral bands, particularly in non-visual portions of the electromagnetic spectrum.

Innovation Solution

An image spectral band translation system that uses machine learning models to translate image data from one spectral band to another, including those not initially captured, allowing for synthesis of desired spectral bands without the need for physical sensors or excessive bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multispectral sensors are deployed to collect electro-optical imagery from multiple spectral bands, then the quality and completeness of spectral imaging data is improved, but the cost and device complexity increase significantly

Engineering Contradiction:
Improvespectral imaging data qualityVSAvoidmultispectral sensor system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates a virtual copy of multispectral data by training a machine learning model on paired RGB and multispectral images. The model learns to generate synthetic multispectral images from RGB inputs, effectively copying the information content without requiring physical multispectral sensors. This resolves the contradiction by providing high-quality spectral imaging data through computational synthesis rather than expensive hardware deployment.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical/optical system of multispectral sensors with a computational system based on machine learning. Instead of using physical sensors to capture multiple spectral bands, the system uses a trained model to computationally generate synthetic spectral bands from standard RGB images. This substitution eliminates the need for complex sensor hardware while maintaining data quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If electro-optical imagery is collected and transmitted from remote sensors, then comprehensive spectral data is obtained, but the network bandwidth consumption and transmission time increase

Engineering Contradiction:
Improvespectral data completenessVSAvoidnetwork bandwidth
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent extracts only the essential spectral information needed for the application and synthesizes it computationally, rather than transmitting complete multispectral image data. By generating synthetic spectral bands locally from compact RGB images, the system extracts and reconstructs only the necessary spectral characteristics, significantly reducing bandwidth consumption while maintaining data completeness for analysis purposes.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system creates virtual copies of spectral data through machine learning synthesis, allowing comprehensive spectral analysis to be performed on locally generated synthetic images rather than transmitting large volumes of raw multispectral data. This copying approach maintains analytical completeness while minimizing network energy consumption.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If multispectral sensors are deployed to capture non-visual spectral bands, then the versatility of imaging applications is improved, but the cost of purchasing and deploying sensors increases

Engineering Contradiction:
Improveimaging application capabilityVSAvoidsensor deployment cost
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent creates a universal solution where a single machine learning model can generate multiple different spectral bands (near-infrared, short-wave infrared, etc.) from standard RGB images. This multi-functional approach allows various imaging applications to be supported without deploying specialized sensors for each band, significantly reducing deployment costs while maintaining application versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses computational copying to synthesize multiple spectral band types from a single RGB input, eliminating the need to purchase and deploy separate sensor systems for each spectral band. This approach provides cost-effective access to diverse imaging capabilities across agriculture, manufacturing, healthcare, and public safety applications.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12061117B2Image spectral band translation in multispectral image applications
Publication Date: 2024.08.13 MICROSOFT TECHNOLOGY LICENSING LLC
  • US12061117B2 patent drawing
  • US12061117B2 patent drawing
  • US12061117B2 patent drawing

AI summary

First image data including a plurality of values representing the image in one or more first spectral bands of an electromagnetic spectrum is received. Second image data including a plurality of values representing the image in one or more second spectral bands of the electromagnetic spectrum is determined based on the first image data. The one or more second spectral bands of the electromagnetic spectrum include at least one spectral band not included in the one or more first spectral bands of the electromagnetic spectrum. The second image data is stored in a memory and/or provided to a user device for displaying the image in one or more second bands of the electromagnetic spectrum to a user of the user device.