The invention provides a cattle and sheep feed trough residual feed monitoring method based on vision, and relates to the technical field of intelligent
livestock breeding, and the method comprises the following six steps: intelligent triggering and multi-
modal image acquisition, image preprocessing and fusion,
time sequence image segmentation and
feature extraction, density adaptive volume calculation,
online learning and residual feed
estimation, and decision analysis and early warning. According to the method, RGB and near-
infrared images are synchronously collected through
infrared triggering, after perspective correction and illumination adaptive fusion, an LSTM-U-Net
time sequence segmentation model is adopted to solve the dynamic shielding problem, a residual feed area is accurately extracted, the
feed type is recognized, density adaptive
volume measurement is achieved in combination with
monocular depth
estimation and
texture feature analysis, and the method is suitable for large-scale industrial production.
Weight estimation is carried out through a
support vector regression model,
model parameters are optimized on line based on manual correction data, intelligent early warning of the residual material amount is finally achieved through a cloud platform, and the limitation of a traditional method in the aspects of shielding
processing, density
adaptation and environment anti-interference is effectively overcome.