Laser Vision System for Teat Detection and Robotic Arm Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing dairy milking systems face challenges in accurately positioning and maneuvering robotic arms due to the unpredictable movement of dairy livestock, such as cows, and the variability in teat positions, which leads to inefficiencies and potential collisions with legs and tails.

Innovation Solution

A vision system incorporating a robotic arm, laser, and processor that uses 3D images and profile signals to detect and adapt to the movement of legs, teats, and tails, allowing for real-time adjustments and precise teat cup attachment without hard coding specific movements or positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If hard coded movements and positions are used for robotic arm operations, then the system structure is simple, but the system cannot adapt to unpredictable livestock movement and variable teat positions

Engineering Contradiction:
Improveadaptability to livestock movementVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The robotic arm transitions from static hard-coded positions to dynamic real-time positioning. The system continuously adjusts the robotic arm's movement based on live detection of livestock position and teat location, enabling adaptation to unpredictable movements while maintaining operational precision

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The vision system provides continuous feedback on livestock and teat positions to the robotic arm control system. This feedback loop enables the robotic arm to adjust its movements in real-time based on detected positions, resolving the contradiction between adaptability and system complexity

Inventive Principle:
Principle #23Feedback

2Productivity

If the robotic arm operates at high speed, then productivity increases, but the risk of collision with livestock legs and tails increases

Engineering Contradiction:
Improvemilking operation speedVSAvoidcollision risk
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The vision system performs preliminary detection of livestock legs, tails, and teat positions before the robotic arm executes its movement. This advance detection allows the system to plan collision-free trajectories at high speed, maintaining productivity while eliminating collision risks

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The vision system acts as an intermediary between the robotic arm and the livestock environment. It provides real-time spatial information about legs and tails, enabling the robotic arm to operate at high speed without direct collision risks by navigating around detected obstacles

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If the robotic arm uses fixed positioning methods, then the device complexity is low, but the measurement precision of teat position is insufficient

Engineering Contradiction:
Improveteat position detection accuracyVSAvoidpositioning system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system replaces simple mechanical positioning with an optical vision-based detection system. The vision system uses cameras and image processing to precisely locate teats, providing high measurement precision while the robotic arm executes the positioning based on these visual measurements

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The vision system adds visual measurement dimensions to the positioning system. By capturing images and analyzing teat positions in 2D/3D space, the system achieves high precision location detection that complements the robotic arm's mechanical positioning capabilities

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Reliability

If the system scans and detects teats in real-time, then the reliability of teat cup attachment improves, but the time required for each milking operation increases

Engineering Contradiction:
Improveteat cup attachment success rateVSAvoiddetection time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The vision system performs preliminary scanning and identification of teats before the robotic arm approaches for attachment. This advance detection ensures reliable identification of the correct teat position, improving attachment success rate while minimizing the time required during the actual attachment phase

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The vision system operates continuously throughout the milking operation, maintaining constant detection of teat positions rather than performing discrete scanning. This continuous monitoring ensures reliable attachment while optimizing the timing and coordination of robotic arm movements to minimize overall operation time

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The vision system enhances the accuracy and speed of robotic arm operations by enabling real-time detection and compensation for leg and teat movement, avoiding collisions and ensuring successful teat cup attachment, even for close, hidden, or offset teats.

Implementation Method 1

The laser is coupled to the robotic arm and is configured to generate a plurality of profile signals, each profile signal comprising information associated with a relative distance between the laser and at least a portion of the dairy livestock

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS10477827B2Vision system for teat detection
Publication Date: 2019.11.19 TECHNOLOGIES HOLDINGS CORP
  • US10477827B2 patent drawing
  • US10477827B2 patent drawing
  • US10477827B2 patent drawing

AI summary

A system includes a robotic arm, a laser, and a processor. The processor is configured to determine that a teat cup is to be attached to a front teat of a dairy livestock, and in response, determine an amount of separation between the front teat and a rear teat. The processor is further configured to calculate, if the amount of separation between the front and rear teats is greater than or equal to a predetermined distance, an updated front teat position based on the amount of separation between the front and rear teats and command the robotic arm to move to the updated front teat position. The processor is further configure to determine whether the front teat is found in a scan of the dairy livestock by the laser, and if so, command the robotic arm to attach the teat cup to the front teat.