A wild animal behavior recognition method based on multi-task learning

By employing a multi-task learning method involving progressive training and gradient coordination, a dual-channel spatiotemporal feature extraction network and a main-auxiliary dual-branch output network were constructed. This solved the real-time and stability issues in wildlife behavior recognition, enabling efficient monitoring of fine-grained behavior recognition.

CN122135404APending Publication Date: 2026-06-02INST OF SEMICONDUCTORS - CHINESE ACAD OF SCI

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
INST OF SEMICONDUCTORS - CHINESE ACAD OF SCI
Filing Date
2026-03-12
Publication Date
2026-06-02

AI Technical Summary

Technical Problem

Existing technologies struggle to achieve real-time, stable, fine-grained behavioral understanding and cross-scene generalization in wildlife behavior recognition. This is especially true in bird monitoring, where targets are small-scale, frequently occluded, subject to large changes in lighting, and have strong background interference, leading to frequent missed and false detections in the model. Furthermore, gradient conflicts in multi-task learning cause training instability.

Method used

A progressively trained multi-task spatiotemporal action recognition model is adopted, which constructs a dual-channel spatiotemporal feature extraction network and a main-auxiliary dual-branch output network. The weights of the auxiliary task are adjusted by gradient cosine similarity detection to achieve joint learning of behavior category recognition and motion attribute prediction, thereby alleviating gradient conflict and improving recognition robustness.

Benefits of technology

It improves the accuracy and robustness of wildlife behavior identification, reduces processing time, is suitable for large-scale, long-term bird behavior monitoring, and significantly improves identification efficiency and stability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122135404A_ABST
    Figure CN122135404A_ABST
Patent Text Reader

Abstract

This invention provides a method for wildlife behavior recognition based on multi-task learning, relating to the fields of video intelligent analysis and animal behavior recognition technology. The method includes: acquiring continuous frame videos containing target wildlife individuals, and segmenting the continuous frame videos according to a preset target window to obtain multiple target video segments; preprocessing each target video segment to obtain an input tensor for each target video segment; inputting the input tensor of each target video segment into a target model to identify and obtain the behavior recognition result of the target wildlife individual in each target video segment; and merging the behavior recognition results of the target wildlife individuals in multiple target video segments to obtain the target behavior result of the target wildlife individual; wherein the target model is a multi-task spatiotemporal action recognition model obtained through progressive training.
Need to check novelty before this filing date? Find Prior Art