基于光流引导及双流网络的动作识别方法、系统及装置

By constructing a pet dog action video dataset and improving the dual-stream network, introducing optical flow-guided features, and optimizing feature extraction and fusion, the problems of high computational cost and low accuracy in pet dog action recognition were solved, achieving a more efficient action recognition effect.

CN115631535BActive Publication Date: 2026-07-17HANGZHOU YUNXIANG NETWORK TECH

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
HANGZHOU YUNXIANG NETWORK TECH
Filing Date
2022-10-31
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing technologies struggle to effectively handle pet dog motion recognition tasks, especially in open environments with multi-scale, multi-target, and perspective-shifting issues. They also require significant computation and lack pet dog motion video datasets, resulting in poor performance of existing algorithms for pet dog motion recognition.

Method used

A dataset of pet dog action videos was constructed, the dual-stream network was improved, optical flow guided features were introduced, and temporal feature extraction was optimized. Feature extraction and fusion were performed through feature generation subnetwork, OFF subnetwork, spatiotemporal information fusion network and LK optical flow neural network, and the network architecture was optimized to improve recognition accuracy.

Benefits of technology

By improving the dual-stream network and optical flow-guided features, the accuracy of pet dog motion recognition was improved, the extraction of temporal features and the fusion of spatiotemporal features were optimized, and the recognition performance was enhanced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115631535B_ABST
    Figure CN115631535B_ABST
Patent Text Reader

Abstract

本发明提供了一种基于光流引导特征和双流网络的宠物犬动作识别方法,包括如下步骤:采集含有宠物犬动作的视频数据,对视频进行处理后划分为训练集和测试集;搭建特征生成子网络,用于提取视频图像序列的空间外观信息;基于光流引导特征搭建OFF子网络,用于提取视频图像序列的时间运动信息;搭建时空信息融合网络模型,融合所述空间特征图和时间特征图,输出视频级的特征矢量;基于光流场搭建LK光流神经网络;设置模型训练超参数,利用训练集训练模型,保存训练得到的权重文件;利用权重文件对测试集中视频进行动作预测,得到预测的结果。本发明通过引入光流引导特征和改进双流网络,强化了对于时空特征的提取,提高了动作识别的准确率。
Need to check novelty before this filing date? Find Prior Art