Natural environment bird monitoring method based on multi-modal fusion deep learning and computer device

Through multimodal fusion deep learning technology, combining visual and sound data, a cross-attention Transformer network model is constructed, which solves the problem of inefficiency of traditional bird monitoring methods and realizes efficient and accurate real-time monitoring and analysis of bird activities. , enhances environmental adaptability.

CN119027775AInactive Publication Date: 2024-11-26SICHUAN AGRI UNIV
3 Cites 43 Cited by

Patent Information

Application Number
CN202411517428.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-29
Publication Date
2024-11-26
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Traditional bird monitoring methods are inefficient, have limited data collection, are difficult to adapt to complex environments, and lack real-time monitoring and data processing capabilities, so they cannot effectively capture bird activities and behaviors in the natural environment.

Method used

Using a multimodal fusion deep learning method, the multimodal cross-attention Transformer network model is constructed, combining visual and sound data, data preprocessing and feature extraction, using graph neural network for context modeling, and combining YOLOv8 and The DeepSORT algorithm performs real-time analysis to achieve efficient monitoring of birds.

Benefits of technology

It improves the accuracy and environmental adaptability of bird monitoring, realizes real-time tracking and behavioral analysis of bird activities, provides rich data sets and efficient data processing capabilities, and enhances the monitoring capabilities of the ecological environment.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention relates to the field of bird monitoring, in particular to a natural environment bird monitoring method based on multi-modal fusion deep learning and a computer device. The scheme comprises the following steps: establishing a multi-modal bird data set; labeling the multi-modal bird data set; carrying out preprocessing on the marked data; the method comprises the following steps of: constructing a multi-modal trans-attention Transform network model; the method comprises the following steps of: training and optimizing a multi-modal trans-attention Transform network model; sound and image data in the multi-mode bird data set are subjected to conjoint analysis, a YOLOv8 target detection model is used, marked image data are trained, and rapid detection of a bird target is achieved; in combination with a DeepSORT tracking algorithm, the detected target is tracked, and the motion trail of the birds is obtained; and performing space-time synchronization on the sound source positioning information and the visual tracking result, and verifying the identity and the position of the bird. The bird monitoring device is suitable for monitoring birds in the natural environment.
Need to check novelty before this filing date? Find Prior Art