Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Cross-domain pedestrian re-identification method and system based on multi-feature mixed learning

A technology of pedestrian re-identification and mixed learning, applied in neural learning methods, character and pattern recognition, instruments, etc., can solve the problem of less multi-feature mixed learning, improve self-adaptive ability, reduce inter-domain differences, and improve performance effect

Pending Publication Date: 2021-08-06
青岛根尖智能科技有限公司
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, pedestrian re-identification based on deep learning is very mature in single feature learning, and there are relatively few studies on multi-feature mixed learning methods.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-domain pedestrian re-identification method and system based on multi-feature mixed learning
  • Cross-domain pedestrian re-identification method and system based on multi-feature mixed learning
  • Cross-domain pedestrian re-identification method and system based on multi-feature mixed learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] Embodiment 1 of the present invention provides a cross-domain pedestrian re-identification system based on multi-feature hybrid learning, which includes:

[0043] The extraction module is used to extract the pedestrian image to be recognized and the pedestrian global feature, pedestrian attribute feature and pedestrian attribute feature of the pedestrian image in the image base library gallery that are similar to the pedestrian identity in the pedestrian image to be recognized by using the re-identification model that has been jointly trained. Pedestrian local features; where the re-identification model is trained using the source domain with identity labels and attribute pseudo-labels and the target domain with identity pseudo-labels;

[0044] The identification module is used to fuse the pedestrian global features, pedestrian attribute features and pedestrian local features to be identified, and perform similarity matching and sorting with the features after the fusion o...

Embodiment 2

[0065] Embodiment 2 provides a cross-domain pedestrian re-identification method based on multi-feature hybrid learning, the method comprising:

[0066] Step S0, data collection. Cross-domain and cross-camera data collection, record the source domain data set as S, S domain has identity ID labels and attribute pseudo-labels, record the target domain data set as T, T domain only has attribute pseudo-labels, and divide each data set into a training set and the test set;

[0067] Step S1, preprocessing. Perform image preprocessing on consecutive screenshots of the video in the collected data set, such as scaling, cropping, averaging, normalization, etc., try to have multiple full-body photos of the same person;

[0068] Step S2, blended learning. Through the source domain learning of global and local features and the joint learning of attribute features, that is, joint training is performed on the source domain data set S and the target domain data set T at the same time.

[0...

Embodiment 3

[0083]Embodiment 3 of the present invention provides a cross-domain pedestrian re-identification method based on multi-feature hybrid learning. Taking a certain pedestrian recognition data set S as an example, it contains 6 different viewing angle camera data, and the training set contains 12936 images, a total of 751 People, with an average of 17.2 training data per person, the test set contains 19,732 images, a total of 750 people; taking a pedestrian recognition data set T as an example, it contains 8 camera data from different perspectives, and the training set contains 16,522 images, a total of 702 People, with an average of 23.5 training data per person, and the test set contains 17661 images.

[0084] The pedestrian re-identification method described in Embodiment 3 specifically includes the following steps:

[0085] Step S0, data collection. The above-mentioned pedestrian recognition data set S is recorded as the source domain data set S, and the S domain has identity...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a cross-domain pedestrian re-identification method and system based on multi-feature mixed learning, and belongs to the technical field of computer vision. The method comprises: by means of a re-identification model subjected to combined training, extracting pedestrian global features, pedestrian attribute features and pedestrian local features of the pedestrian image to be recognized and a bottom library image, which is similar to the pedestrian identity in the pedestrian image to be recognized, in the image bottom library gallley; and fusing the extracted to-be-identified features, and carrying out similarity matching sorting on the fused features of the features of the bottom library image to obtain a pedestrian re-identification result. According to the method, inter-domain joint training and multi-feature mixed learning are utilized to reduce inter-domain differences, so that the system is more stable and higher in robustness, source domain training of global and local features and joint training of attribute features are performed on images of different scenes, pedestrian attributes are combined, the adaptive capacity of a cross-domain pedestrian re-identification model is improved, and pedestrian re-identification is carried out on a cross-domain data set, so that the cross-domain pedestrian re-identification performance is improved.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a cross-domain pedestrian re-identification method and system based on multi-feature hybrid learning. Background technique [0002] Pedestrian re-identification is the process of matching the same target person from different camera perspectives, which plays an important role in traffic, public security and video surveillance. The task of person re-identification mainly includes two steps: feature extraction and similarity measurement. In the traditional pedestrian re-identification method, the idea of ​​feature extraction is mainly to manually extract some low-level image features, and the accuracy of re-identification is low. In recent years, with the rapid development of convolutional neural networks and deep learning, more and more deep learning models have been applied to the problem of person re-identification. This also makes the performance of pedestrian re-iden...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/103G06V10/44G06N3/047G06N3/045G06F18/241G06F18/2415Y02T10/40
Inventor 王海滨纪文峰姜丽莉
Owner 青岛根尖智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products