Machine Learning Conversion of Color Images to Hyperspectral Food Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Travelers face challenges in finding food that meets their dietary requirements, health considerations, and cultural preferences while traveling, as existing systems fail to provide accurate and personalized recommendations that account for nutritional content, taste, and cultural compatibility.

Innovation Solution

A method and system that utilizes machine learning to convert color images of food into hyperspectral images, generating features such as taste, nutrient content, and chemical composition, and creates a database to recommend suitable food based on user preferences, dietary needs, and geographical location, using a cognitive dietary assistant.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If machine learning is used to convert color images to hyperspectral images for detailed food analysis, then measurement precision of food composition is improved, but device complexity increases

Engineering Contradiction:
Improvefood composition analysisVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex physical hyperspectral imaging hardware with a machine learning-based software system that converts standard color images into hyperspectral representations. This substitution eliminates the need for specialized optical equipment while achieving comparable or superior analysis accuracy through algorithms that infer compositional data from color information.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates virtual hyperspectral images as digital copies from standard color images using machine learning models. These synthesized hyperspectral images contain inferred compositional information without requiring actual hyperspectral sensors, enabling detailed food analysis through computational rather than physical means.

Inventive Principle:
Principle #26Copying

2Loss of information

If a comprehensive database is created to analyze multiple food features (taste, nutrients, chemical composition), then information completeness is improved, but loss of time in data processing increases

Engineering Contradiction:
Improvefood information completenessVSAvoiddata processing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system pre-processes and structures food data during database creation, organizing taste, nutrient, and chemical composition information in advance. This preliminary organization enables rapid retrieval and comparison when users query the system, reducing real-time processing delays while maintaining comprehensive food information analysis.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent divides food analysis into separate feature categories (taste, nutrients, chemical composition) that can be independently processed and stored. This segmentation allows the system to retrieve only relevant features for each query rather than processing all data, significantly reducing processing time while preserving complete information availability.

Inventive Principle:
Principle #1Segmentation

3Ease of operation

If existing menu recommendation systems are used, then ease of operation is improved, but reliability of dietary recommendations deteriorates

Engineering Contradiction:
Improvesystem usabilityVSAvoiddietary recommendation accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system incorporates user feedback mechanisms where dietary outcomes and preferences are continuously monitored and used to refine recommendations. This feedback loop enables the system to learn from user responses and improve recommendation accuracy over time while maintaining the simple interface that users find easy to operate.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent implements self-adjusting recommendation algorithms that automatically refine their outputs based on analyzed food data and user patterns without requiring manual intervention. The system serves itself by continuously learning from the comprehensive food database and user interactions, improving reliability while keeping the user interface simple and easy to use.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10832094B2Generating hyperspectral image database by machine learning and mapping of color images to hyperspectral domain
Publication Date: 2020.11.10 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10832094B2 patent drawing
  • US10832094B2 patent drawing
  • US10832094B2 patent drawing

AI summary

Color images of food a user consumes, text information associated with the food and audio information associated with the food may be received. Color images are converted into hyperspectral images. A machine learning model classifies the hyperspectral images into features comprising at least taste, nutrient content and chemical composition. A database of food consumption pattern associated with the user is created based on classification features associated with the hyperspectral images, the text information and the audio information. A color image of local food may be received and converted into a hyperspectral image. The machine learning model is run with the hyperspectral image as input, and outputs classification features associated with the local food. Based on whether the classification features associated with the local food satisfies the food consumption pattern associated with the user, the local food may be recommended.