Mushroom Ripeness Detection Using Computer Vision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mushroom harvesting methods rely heavily on human expertise for assessing ripeness, which is time-consuming, costly to train for, and can lead to compromised quality due to contact-based assessment, inconsistency, and the lack of an objective, contactless assessment method, hindering the development of automated harvesting solutions.

Innovation Solution

A method and system using computer vision to obtain a sequence of images of mushrooms over time, measuring temporal changes in features like cap diameter, height, and hyperspectral reflectance, comparing these measurements to pre-determined ripeness functions to determine the optimal harvesting time, enabling automated and consistent contactless ripeness assessment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If contact-based ripeness assessment by human harvesters is used, then ripeness can be assessed through firmness and other tactile features, but mushroom quality is compromised due to bruises and discoloration from frequent touching

Engineering Contradiction:
Improveripeness assessment accuracyVSAvoidmushroom quality deterioration
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent replaces manual tactile assessment with an automated vision-based system using cameras and image processing algorithms. The system captures images of mushrooms and uses computer vision to measure cap diameter, height, color, and other features to determine ripeness without physical contact, thereby eliminating bruises and discoloration while maintaining assessment accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary computational model that translates visual features into ripeness predictions. The system uses trained machine learning models to interpret image data and predict optimal harvest timing, serving as an intermediary between visual observation and ripeness determination without requiring direct contact with the mushrooms

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If human harvesters are trained to assess mushroom ripeness accurately, then harvesting quality improves, but significant training time and cost are required

Engineering Contradiction:
Improveripeness assessment accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs self-training through automated machine learning model training using historical image data and ground truth ripeness information. Once trained, the model can independently assess ripeness without requiring human experts, eliminating the need for ongoing training time and costs while maintaining consistent assessment accuracy

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent performs preliminary training of the ripeness prediction model offline using historical data before deployment. This preliminary action creates a pre-trained system that can immediately begin accurate assessments without requiring real-time training or human expert intervention, saving significant time during actual harvesting operations

Inventive Principle:
Principle #10Preliminary action

3Productivity

If multiple harvesting rounds are conducted daily to maximize yield, then productivity increases, but consistency in ripeness assessment deteriorates due to labor fatigue and time constraints

Engineering Contradiction:
Improveharvesting throughputVSAvoidassessment consistency
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The automated vision system operates continuously without interruption across multiple harvesting rounds, maintaining consistent assessment criteria throughout the day. The system can process mushrooms at high speed through multiple rounds without fatigue, ensuring reliable and consistent ripeness determination while maximizing productivity

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The system provides real-time feedback on ripeness predictions, enabling consistent decision-making across all harvesting rounds. The automated feedback mechanism eliminates variability introduced by human fatigue and maintains uniform assessment standards throughout extended harvesting periods

Inventive Principle:
Principle #23Feedback

4Productivity

If automated harvesting is implemented, then productivity increases and labor costs decrease, but the lack of objective contactless ripeness assessment methods limits development

Engineering Contradiction:
Improveharvesting efficiencyVSAvoidautomated system development difficulty
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical harvesting systems with a vision-based automated system. By using computer vision and machine learning to assess ripeness and guide harvesting decisions, the system achieves automation with reduced mechanical complexity while improving productivity and consistency

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system transforms the ripeness assessment problem from tactile parameter measurement to visual parameter analysis. By changing the measurement parameters from physical contact-based features to visual features like cap diameter, height, and color from images, the system enables automated assessment without requiring complex contactless tactile sensors

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11657488B2Methods and systems related to mushroom ripeness determination
Publication Date: 2023.05.23 VINELAND RES & INNOVATIONS CENT
  • US11657488B2 patent drawing
  • US11657488B2 patent drawing
  • US11657488B2 patent drawing

AI summary

A method of determining ripeness of a growing mushroom involves obtaining a sequence of images of a growing mushroom over a period of time and, from the sequence of images, measuring one or more features of the growing mushroom to obtain temporal measurements for the one or more features. The temporal measurements indicate rates at which the one or more features are changing. The temporal measurements are compared to pre-determined ripeness functions to determine the ripeness of the mushroom. The mushroom is picked if the comparison indicates that the mushroom is ready to be harvested.