Unlock instant, AI-driven research and patent intelligence for your innovation.

Cross-modal image matching method based on coupled convolution sparse coding

A convolutional sparse coding and matching method technology, applied in neural learning methods, character and pattern recognition, biological neural network models, etc., can solve problems such as low sparsity and inaccurate image features

Active Publication Date: 2020-07-24
DONGGUAN UNIV OF TECH +1
View PDF2 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a cross-modal image matching method based on coupled convolution sparse coding to overcome the technical defects of low sparsity and inaccurate extracted image features in existing cross-modal image matching methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-modal image matching method based on coupled convolution sparse coding
  • Cross-modal image matching method based on coupled convolution sparse coding
  • Cross-modal image matching method based on coupled convolution sparse coding

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0085] Such as figure 1 , figure 2 , image 3 As shown, the present invention provides a cross-modal image matching method based on coupled convolutional sparse coding, comprising the following steps:

[0086] S1: Construct a cross-modal image matching algorithm model based on coupled convolutional sparse coding;

[0087] S2: Set the dimension and number of filters; set the number of samples of the two modal training sets and preprocess to obtain training set X and training set Y;

[0088] S3: Initialize the projection matrix T according to the dimension and number X , T Y ; Initialize the local dictionary D according to the training set X and training set Y XL ,D YL , combined with training set X, training set Y and local dictionary D XL ,D YL Initialize local sparse vector and Complete the parameter setting;

[0089] S4: Optimizing and updating the parameter D through continuous cross-iteration XL ,D YL , T X , T Y , when updating a pair of parameters, se...

Embodiment 2

[0155] More specifically, on the basis of Example 1, the process and function of the matching algorithm are illustrated by using the face sketch and face photo matching simulation to assist the police in tracking suspects, but the function of the algorithm is not limited to this. Specific embodiment flow chart sees Figure 4 .

[0156] The data set used in this embodiment adopts the public data set CUHK such as Figure 5 As shown, the data set has a total of 188 pairs of face pictures, including 188 face photos and 188 face portraits, of which 88 face photos and 88 face portraits are used as training sets, and the remaining 100 face photos And 100 face portraits as a test set. The face sketch map and face photo matching algorithm are listed as follows:

[0157]

[0158] In the specific implementation process, parameter setting and initial modeling are carried out. Among them, X is a training set of 88 face photos, Y is a training set of 88 face portraits, and each 88 pi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a cross-modal image matching method based on coupling convolution sparse coding. The cross-modal image matching method comprises the following steps: constructing and training across-modal image matching algorithm model based on coupling convolution sparse coding; and according to the algorithm model, calculating model quality in combination with a KNN algorithm, and completing cross-modal image matching. According to the cross-modal image matching method based on coupling convolution sparse coding, the thought of convolution sparse coding is used for replacing the thought of traditional sparse coding, the method can globally run on the whole image, the relevance between image pixels is improved to a great extent, and therefore a more accurate model feature map is extracted; moreover, the method inherits the basic theory of a common feature space and is combined with a coupled convolution sparse vector canonical correlation analysis method to further improve theperformance in cross-modal image matching, the precision is high, the understanding and programming are easy, and a feasible matching model is provided for different modal image matching in actual engineering.

Description

technical field [0001] The present invention relates to the technical field of image processing, and more specifically, to a cross-modal image matching method based on coupled convolutional sparse coding. Background technique [0002] Modality refers to the different ways in which humans receive the same type of information, and cross-modal image matching is a growing field in computer vision and pattern recognition technology, with diverse applications. Cross-modal image matching has always been a very valuable research direction in the field of image processing. With the rapid development of science and technology, the types of imaging sensors are changing with each passing day, including different near-infrared image sensors, optical sensors, radar sensors, etc. The images obtained by these sensors are different from each other. In real life, there are many channels for images expressing the same information, such as optical photos and sketch photos of the same object or...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/172G06N3/045G06F18/22G06F18/214Y02T10/40
Inventor 陈高王翠瑜周清峰
Owner DONGGUAN UNIV OF TECH