Reflectance Spectra Estimation from Digital Camera RGB Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for estimating reflectance spectra from images are either complex and expensive, such as spectrophotometers, or impractical for in-situ use, like methods relying on precise illumination spectra, and often produce inaccurate results due to differences in camera sensitivity and illumination.

Innovation Solution

A method and apparatus that generate a transform for adjusting image colors by acquiring an input compensation transform, estimating simulated intensity levels for reference reflectance spectra, and using these to derive a transform for accurate reflectance spectrum estimation or color space conversion, independent of the image input device and illumination.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If spectrophotometers are used to measure reflectance spectra, then measurement precision is improved, but device complexity and cost increase

Engineering Contradiction:
Improvereflectance spectra measurement accuracyVSAvoidspectrophotometer complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates a mathematical model (copy) of the spectrophotometer's measurement function that can be executed by standard digital cameras. Instead of requiring the complex physical device, the invention captures the essential measurement capability through computational algorithms that process camera RGB data to estimate reflectance spectra, thereby achieving spectrophotometer-level precision with consumer-grade equipment.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical/optical measurement system (spectrophotometer with moving parts, gratings, and detectors) with a computational system. The physical measurement apparatus is substituted by mathematical transformations and algorithms that process digital camera data, eliminating the need for complex mechanical components while maintaining measurement accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If hyper-spectral imaging systems are used to measure spectral characteristics of multiple pixels, then productivity is improved, but device complexity and cost increase

Engineering Contradiction:
Improvespectral measurement speedVSAvoidhyper-spectral imaging system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent makes standard digital cameras multi-functional by enabling them to perform both conventional photography and spectral estimation tasks. The same camera hardware that captures ordinary images is also used to estimate reflectance spectra across multiple pixels simultaneously, eliminating the need for specialized hyper-spectral imaging equipment while maintaining high productivity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent creates a computational model that copies the spectral measurement capability of hyper-spectral systems into standard camera software. The algorithm processes RGB values from all pixels in an image to generate spectral estimates, effectively replicating the functionality of expensive hyper-spectral imagers using ubiquitous consumer camera technology.

Inventive Principle:
Principle #26Copying

3Measurement precision

If methods relying on precise illumination spectra are used, then measurement precision is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvereflectance spectra accuracyVSAvoidin-situ measurement capability
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent enables the system to self-calibrate by using the camera's own RGB sensitivity characteristics and the known properties of the scene to automatically determine the illumination spectrum. Instead of requiring external illumination measurement equipment or controlled lighting conditions, the algorithm extracts illumination information from the captured image data itself, allowing accurate spectral estimation in uncontrolled environments.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent introduces the camera's RGB sensor response as an intermediary that links the unknown illumination spectrum to the measurable pixel values. By using the camera's known spectral sensitivity functions as a mediator, the system can solve for both the illumination spectrum and the object reflectance simultaneously, eliminating the need for separate illumination measurements.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Device complexity

If conventional cameras with multiple filters are used, then device complexity is reduced, but measurement precision deteriorates

Engineering Contradiction:
Improvemulti-spectral imaging system simplicityVSAvoidspectral information accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent transforms the limited three-channel RGB data into a full spectral dimension by applying mathematical transformations. Instead of trying to capture spectral information directly in the spatial domain with multiple filters, the invention uses the RGB values as a starting point and reconstructs the spectral dimension through computational algorithms, effectively adding a spectral dimension to the data without requiring spectral sensors.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the parameter representation from discrete RGB values to continuous spectral functions. By transforming the data from three broad wavelength bands (RGB) to a continuous spectrum across the visible range, the system achieves higher spectral precision while maintaining the simplicity of conventional camera hardware. The transformation involves changing the mathematical representation rather than the physical measurement approach.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8044969B2Reflectance spectra estimation and colour space conversion using reference reflectance spectra
Publication Date: 2011.10.25 CHROMETRICS
  • US8044969B2 patent drawing
  • US8044969B2 patent drawing
  • US8044969B2 patent drawing

AI summary

A Personal Computer (PC) adjusts a color of an image received from a digital camera to produce an estimated reflectance spectrum and/or to convert the color to a new color space. First, an input compensation transform is generated, e.g. based on a Macbeth color chart in the image, to compensate for the sensitivity of the camera used to generate the image to different wavelengths of light and the illumination spectrum incident on an object of interest to which the image relates. In order to estimate the reflectance spectrum, a reflectance spectrum estimation transform is then generated by the PC. In order to convert the color of the image to the new color space, a color space conversion transform is generated by the PC. Both the reflectance spectrum estimation transform and the color space conversion transform are based on the input compensation transform and reference reflectance spectra stored in a reference reflectance spectra database.