Mobile Robot Weed Identification for Safe Toxicodendron Removal

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

It is challenging to visually distinguish and effectively manage Toxicodendron plants, such as poison ivy, poison oak, and poison sumac, from other plant species due to their similar appearances and the allergenic resin urushiol, which poses risks to human health.

Innovation Solution

A mobile robot equipped with a computer vision system and machine learning agent acquires phytomorphological data to predict the likelihood of a plant being Toxicodendron and conducts non-phytomorphological assessments to determine appropriate actions, such as marking or removing the plants, based on predefined thresholds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If visual inspection methods are used to identify Toxicodendron plants, then the操作简单性 is maintained, but the measurement precision of plant identification deteriorates due to similar appearances with other plant species

Engineering Contradiction:
Improve操作简便性VSAvoid植物识别精度
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent replaces manual visual inspection with an automated machine learning system that uses image processing and computer vision algorithms to identify Toxicodendron plants. The system captures images via camera, processes them through trained neural networks, and automatically determines plant species, eliminating the need for manual visual identification while significantly improving accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary machine learning model that acts as a bridge between raw visual data and identification results. The model processes images through multiple layers of feature extraction and classification, serving as an intelligent intermediary that transforms visual information into accurate plant identification without requiring direct human interpretation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If manual identification and management methods are used, then the device complexity is low, but the productivity of weed control deteriorates due to time-consuming visual differentiation

Engineering Contradiction:
Improve系统复杂度VSAvoid除草效率
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent implements a self-service system where the mobile robot autonomously performs the complete workflow of plant identification, assessment, and management decision-making. The system independently captures images, processes them through machine learning models, evaluates plant characteristics, and determines appropriate actions without requiring continuous human intervention, thereby significantly improving productivity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent applies preliminary action by pre-training machine learning models with extensive plant image data before deployment. The system performs preliminary assessment of plant characteristics using multiple features (leaf shape, stem patterns, growth habits) before making final identification decisions, enabling rapid and accurate processing during actual field operations.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If aggressive removal actions are taken without accurate identification, then the productivity is improved, but the object-affected harmful factors increase due to potential damage to non-Toxicodendron plants

Engineering Contradiction:
Improve除草速度VSAvoid误伤其他植物的危害
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent implements a feedback mechanism where the machine learning system continuously refines its identification accuracy by analyzing multiple plant features and comparing them against trained data. The system provides feedback loops for model improvement and includes verification steps that cross-check identification results before triggering removal actions, ensuring high confidence in plant classification.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes the parameters of identification by using multiple plant characteristics (leaf morphology, stem features, growth patterns, flower structures) rather than relying on a single parameter. The system adjusts identification thresholds and confidence levels dynamically, requiring multiple matching features to be confirmed before classifying a plant as Toxicodendron, thereby reducing false positives.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11783207B2Robotic Toxicodendron weeding
Publication Date: 2023.10.10 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11783207B2 patent drawing
  • US11783207B2 patent drawing
  • US11783207B2 patent drawing

AI summary

A system includes a memory having instructions therein and at least one processor in communication with the memory. The at least one processor is configured to execute the instructions to acquire phytomorphological field data via a sensor component of a mobile robot, generate, based on the phytomorphological field data and via a machine learning agent, a predicted likelihood of whether a hypothetical action by the mobile robot against a found plant would be directed against a true Toxicodendron plant, conduct a non-phytomorphological assessment of the found plant via the mobile robot and based on the predicted likelihood being below a first threshold and above a second threshold, and, via the mobile robot and based on the non-phytomorphological assessment, attack the found plant, mark a site of the found plant, and/or document a context of the site.