Laser Vision System for Teat Detection and Robotic Arm Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing dairy milking systems face challenges in accurately positioning and maneuvering robotic arms due to the unpredictable movement of dairy livestock, such as cows, and the variability in teat positions, which leads to inefficiencies and potential collisions with legs and tails.
Innovation Solution
A vision system incorporating a robotic arm, laser, and processor that uses 3D images and profile signals to detect and adapt to the movement of legs, teats, and tails, allowing for real-time adjustments and precise teat cup attachment without hard coding specific movements or positions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If hard coded movements and positions are used for robotic arm operations, then the system structure is simple, but the system cannot adapt to unpredictable livestock movement and variable teat positions
Solution Approach 1:
The robotic arm transitions from static hard-coded positions to dynamic real-time positioning. The system continuously adjusts the robotic arm's movement based on live detection of livestock position and teat location, enabling adaptation to unpredictable movements while maintaining operational precision
Solution Approach 2:
The vision system provides continuous feedback on livestock and teat positions to the robotic arm control system. This feedback loop enables the robotic arm to adjust its movements in real-time based on detected positions, resolving the contradiction between adaptability and system complexity
2Productivity
If the robotic arm operates at high speed, then productivity increases, but the risk of collision with livestock legs and tails increases
Solution Approach 1:
The vision system performs preliminary detection of livestock legs, tails, and teat positions before the robotic arm executes its movement. This advance detection allows the system to plan collision-free trajectories at high speed, maintaining productivity while eliminating collision risks
Solution Approach 2:
The vision system acts as an intermediary between the robotic arm and the livestock environment. It provides real-time spatial information about legs and tails, enabling the robotic arm to operate at high speed without direct collision risks by navigating around detected obstacles
3Measurement precision
If the robotic arm uses fixed positioning methods, then the device complexity is low, but the measurement precision of teat position is insufficient
Solution Approach 1:
The system replaces simple mechanical positioning with an optical vision-based detection system. The vision system uses cameras and image processing to precisely locate teats, providing high measurement precision while the robotic arm executes the positioning based on these visual measurements
Solution Approach 2:
The vision system adds visual measurement dimensions to the positioning system. By capturing images and analyzing teat positions in 2D/3D space, the system achieves high precision location detection that complements the robotic arm's mechanical positioning capabilities
4Reliability
If the system scans and detects teats in real-time, then the reliability of teat cup attachment improves, but the time required for each milking operation increases
Solution Approach 1:
The vision system performs preliminary scanning and identification of teats before the robotic arm approaches for attachment. This advance detection ensures reliable identification of the correct teat position, improving attachment success rate while minimizing the time required during the actual attachment phase
Solution Approach 2:
The vision system operates continuously throughout the milking operation, maintaining constant detection of teat positions rather than performing discrete scanning. This continuous monitoring ensures reliable attachment while optimizing the timing and coordination of robotic arm movements to minimize overall operation time
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The vision system enhances the accuracy and speed of robotic arm operations by enabling real-time detection and compensation for leg and teat movement, avoiding collisions and ensuring successful teat cup attachment, even for close, hidden, or offset teats.
Implementation Method 1
The laser is coupled to the robotic arm and is configured to generate a plurality of profile signals, each profile signal comprising information associated with a relative distance between the laser and at least a portion of the dairy livestock
Data Source
AI summary
A system includes a robotic arm, a laser, and a processor. The processor is configured to determine that a teat cup is to be attached to a front teat of a dairy livestock, and in response, determine an amount of separation between the front teat and a rear teat. The processor is further configured to calculate, if the amount of separation between the front and rear teats is greater than or equal to a predetermined distance, an updated front teat position based on the amount of separation between the front and rear teats and command the robotic arm to move to the updated front teat position. The processor is further configure to determine whether the front teat is found in a scan of the dairy livestock by the laser, and if so, command the robotic arm to attach the teat cup to the front teat.


