Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Cross-modal pedestrian re-identification method based on multi-modal image style conversion

A pedestrian re-identification, multi-modal image technology, applied in the field of image processing, can solve the problem of pedestrian re-identification method difficult to identify pedestrians, etc.

Active Publication Date: 2020-08-14
CHINA UNIV OF MINING & TECH
View PDF5 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] The present invention researches a method based on deep learning, uses generative confrontation network to realize the exchange of style attribute information of pedestrian images in the infrared domain and visible light domain, and solves the problem that the pedestrian re-identification method is affected by different illuminations in practice, which makes it difficult to identify pedestrians, and the design A neural network-based similarity metric learning method improves the robustness of cross-modal person re-identification methods based on multi-modal image style transfer

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-modal pedestrian re-identification method based on multi-modal image style conversion
  • Cross-modal pedestrian re-identification method based on multi-modal image style conversion
  • Cross-modal pedestrian re-identification method based on multi-modal image style conversion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0088] The technical scheme of the present invention will be described in further detail below in conjunction with the accompanying drawings.

[0089] figure 1 Shown is a cross-modal pedestrian re-identification method based on multi-modal image style conversion, including the following process steps:

[0090] Step S01: Collect and preprocess the training pedestrian images, collect several pedestrian images in the visible light pedestrian image data set as visible light domain training images; collect several pedestrian images in the infrared pedestrian image data set as infrared domain training images, for two The size of the training image in the domain is normalized to obtain the training sample;

[0091] Step S02: Build an automatic encoding network model for decoupling image features, which encodes pedestrian images in two input domains after normalization processing, and decouples pedestrian image features in the two domains into style features and content features . ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a cross-modal pedestrian re-identification method based on multi-modal image style conversion, and the method comprises: carrying out the collection and preprocessing of training images according to a pedestrian image data set, and obtaining a training sample; constructing an automatic coding network model for decoupling image features, performing feature decoupling on thepedestrian image input after processing by the model, and dividing the pedestrian image into domain-independent content features and domain-related style features; and constructing a generation network and discrimination network model based on modal transformation, the model realizing style attribute information exchange of pedestrian images in different domains, and realizing style-transformed sample generation. Aiming at the problem that a pedestrian re-identification algorithm is easily influenced by different illumination, the similarity matrix of different images is learned by extractingthe characteristics of the pedestrian images through the neural network, the metric matrix learned by the method has flexibility compared with a manually selected matrix, and the similarity between the image characteristics can be better obtained.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a cross-modal pedestrian re-identification method based on multi-modal image style conversion. Background technique [0002] With the rapid development of artificial intelligence technology and the improvement of people's requirements for social security, more and more cameras are put into use and appear in every corner of life, and people pay more and more attention to the analysis and research of camera videos. Multi-camera monitoring has a wide field of view, which overcomes the problem of limited monitoring range of a single camera, but also brings a large amount of video and image information. Reasonable use of camera monitoring information combined with good video tracking technology can filter out useful information from massive amounts of data. Video tracking technology involves many research directions, including image processing, computer vision, patte...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/103G06N3/045G06F18/22Y02T10/40
Inventor 赵佳琦陈莹夏士雄周勇牛强姚睿陈朋朋杜文亮朱东郡
Owner CHINA UNIV OF MINING & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products