Domain adaptive behavior recognition system and method based on data enhancement and pseudo tag

A domain adaptation and recognition system technology, applied in the field of intelligent perception technology and artificial intelligence, can solve problems such as low performance, achieve the effect of enhancing accuracy and robustness, improving recognition performance, and reducing costs

Pending Publication Date: 2022-06-17
NANJING UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the deficiencies of the above-mentioned prior art, the purpose of the present invention is to provide a domain adaptive behavior recognition system and method based on data enhancement and pseudo-labels to solve the problem of existing behavior recognition models in new data domains without labeled data ( That is, the problem of low performance when performing behavior recognition tasks on the target domain); the invention can make the model use the unlabeled data on the target domain to adjust and optimize, reduce the dependence on the labeled samples in the target domain, and improve the efficiency while reducing the marking cost. Accuracy and Robustness of Action Recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Domain adaptive behavior recognition system and method based on data enhancement and pseudo tag
  • Domain adaptive behavior recognition system and method based on data enhancement and pseudo tag
  • Domain adaptive behavior recognition system and method based on data enhancement and pseudo tag

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0097] In order to facilitate the understanding of those skilled in the art, the present invention will be further described below with reference to the embodiments and the accompanying drawings, and the contents mentioned in the embodiments are not intended to limit the present invention.

[0098] refer to figure 1 As shown, a domain adaptive behavior recognition system based on data enhancement and pseudo-labels of the present invention includes: a data acquisition module, a data preprocessing module and a behavior recognition module; wherein,

[0099] a data acquisition module, used to collect sensor data of the mobile device or wearable device when the user is exercising; the sensor data includes: accelerometer data, magnetometer data, and gyroscope data;

[0100] The data preprocessing module is used to process and obtain the source domain sample data and the target domain sample data, including: a data normalization module and a data segmentation module;

[0101] The da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a domain adaptive behavior recognition system and method based on data enhancement and a pseudo tag, and the system comprises a data collection module which collects the original data of a sensor when a user moves; the data preprocessing module is used for carrying out normalization and data segmentation on the source domain sensor data in the public data set and the collected target domain sensor data to obtain source domain and target domain sample data; the behavior recognition module is used for selecting source domain sample data for training to obtain a domain generalization basic model, performing data enhancement on target domain sample data to obtain enhanced target domain sample data, and optimizing the domain generalization basic model by using an iterative calculation pseudo-label algorithm and the enhanced target domain sample data to obtain the behavior recognition result. The classification result of the target domain sample data when iteration is terminated is the behavior recognition result. According to the method, the classification model is optimized by using the unmarked target domain sample data, the dependence on the marked sample of the target domain is reduced, and the accuracy and robustness of behavior recognition are improved while the marking cost is reduced.

Description

technical field [0001] The invention belongs to the fields of intelligent perception technology and artificial intelligence technology, and in particular relates to a domain adaptive behavior recognition system and method based on data enhancement and pseudo-labels. Background technique [0002] At present, mobile smart devices and wearable smart devices have become an important part of people's daily life, and people use these devices to detect and record their behavioral states. Sensors compatible with mobile devices and wearable devices save and record data generated by user activities, which are widely used in behavior recognition tasks, such as motion detection, human-computer interaction, and other applications. [0003] For behavior recognition tasks based on wearable devices, the traditional solution is to train the behavior recognition model in a supervised manner, that is, to train the classification model through a large number of labeled sample data, and then use...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06V10/77G06V10/774G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/213G06F18/214
Inventor 殷亚凤尤明辉谢磊陆桑璐
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products