Spectral Imaging Cavity with Structured Light for Plant Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multispectral imaging of plant tissue is hindered by non-Lambertian reflectance and the need for sample fixation, which is time-consuming and limits the usefulness of the technology.

Innovation Solution

An apparatus that uses structured illumination and photometric stereo imaging to determine spectral and depth information of plant surfaces, correcting for orientation and depth to improve spectral data accuracy, employing a combination of imaging light sources, including photometric stereo, structured light, and fluorescence sources, within a hemisphere-shaped cavity with a diffuse reflecting material.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If plant tissue samples are fixed in place to address orientation issues, then measurement reliability is improved, but loss of time increases

Engineering Contradiction:
Improvemeasurement reliabilityVSAvoidtime for sample fixation
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary 3D mapping and orientation determination of the plant tissue sample before spectral measurement. By capturing depth information and surface orientation data in advance using structured light and photometric stereo imaging, the system pre-compensates for non-Lambertian reflectance effects, eliminating the need for time-consuming physical fixation while ensuring measurement reliability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The invention replaces the mechanical fixation system with an optical-computational system. Instead of physically fixing the sample to control its orientation, the system uses structured light projection, photometric stereo imaging, and computational algorithms to determine and correct for sample orientation and depth variations, achieving the same measurement reliability without mechanical constraints

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If plant tissue samples are fixed in place to address orientation issues, then spectral information accuracy is improved, but productivity decreases

Engineering Contradiction:
Improvespectral information accuracyVSAvoidusefulness of multispectral imaging
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary 3D mapping and orientation determination of the plant tissue sample before spectral measurement. By capturing depth information and surface orientation data in advance using structured light and photometric stereo imaging, the system pre-compensates for non-Lambertian reflectance effects, eliminating the need for time-consuming physical fixation while ensuring measurement reliability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The invention replaces the mechanical fixation system with an optical-computational system. Instead of physically fixing the sample to control its orientation, the system uses structured light projection, photometric stereo imaging, and computational algorithms to determine and correct for sample orientation and depth variations, achieving the same measurement reliability without mechanical constraints

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If structured illumination and photometric stereo imaging are used to correct for orientation and depth, then spectral information accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvespectral information accuracyVSAvoidcomplexity of imaging system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The invention merges multiple imaging functions into a single integrated apparatus. The structured light source, photometric stereo light sources, and imaging device are combined in a unified system with a common optical path, allowing simultaneous acquisition of depth, orientation, and spectral information. This integration reduces the complexity that would arise from separate independent systems while maintaining high measurement precision

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging device serves multiple functions within a single system: it captures structured light patterns for 3D mapping, records photometric stereo images for surface normal determination, and acquires multispectral data. This multi-functionality reduces the number of separate components needed while achieving accurate spectral measurements through computational correction of orientation and depth effects

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables rapid and accurate determination of spectral and depth information of plant surfaces, reducing the need for sample fixation and improving the quality of multispectral image data by correcting for orientation and depth, thus enhancing the efficiency and effectiveness of multispectral imaging.

Implementation Method 1

The cavity (110) comprises a hemisphere (110) which is located having a major opening for facing the plant (200)... An internal surface of the cavity (110), or hemisphere (110), may be coated with a diffuse reflecting material

Methodology Applied
Scientific EffectDiffuse reflection: Reflection

Implementation Method 2

A first plurality of object information (OI) light sources (130) are provided for selectively illuminating the plant (200) with illumination from different angles around the cavity (110)

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 3

A second plurality of OI light sources (130) are provided for projecting structured illumination onto the plant (200)

Methodology Applied
Scientific EffectStructured light:

Implementation Method 4

A third plurality of OI light sources (130) are provided for illuminating the plant (200) with fluorescence

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Data Source

PatentEP3729023B1Apparatus for determining spectral information
Publication Date: 2024.08.28 UNIV OF MANCHESTER
  • EP3729023B1 patent drawingFigure 1
  • EP3729023B1 patent drawingFigure 2a
  • EP3729023B1 patent drawingFigure 2b

AI summary

Embodiments of the present invention provide an apparatus for determining spectral information of a three-dimensional object, comprising a cavity (110) for location in relation to the object, an imaging light source (120) located in relation to the cavity, wherein the imaging source is controllable to selectively emit light in a plurality of wavelength ranges, structured light source (130) for emitting structured illumination toward the object, wherein the structured light source comprises a plurality of illumination devices arranged around the cavity, one or more imaging devices (140) for generating image data relating to at least a portion of the object, a control unit, wherein the control unit (1100) is arranged to control the structured light source to emit the structured illumination and to control the imaging light source to emit light in a selected one or more of the plurality of wavelength ranges, a data storage unit (1120) arranged to store image data corresponding to the structured illumination and each of the selected one or more of the plurality of wavelength ranges, and processing means (1110) arranged to determine depth information relating to at least a portion of the object in dependence on the image data corresponding to the structured illumination stored in the data storage means.