The invention discloses a deep learning pattern recognition method of a vector kernel convolutional neural network, the method comprising: (1) designing the structure of the vector kernel convolutional neural network, including an input layer, a convolutional layer, and at least one fully connected layer , and the output layer of the soft-max classifier; where the input is an image of size m×n, the kernels of layer l are vectors of size pl×1 or vectors of size 1×ql, and Nl represents the size of layer l The number of convolution kernels; select the values of pl (or ql) and Nl based on experience, the convolution operation step size of the l layer is sl (sl≥1), and the activation function is selected as a corrected linear unit; (2) set The number of iterations of the convolutional neural network, select the cost function, and use the training samples {(x1,y1),...,(xD,yD)} to learn the parameters of the vector kernel convolutional neural network according to the backpropagation algorithm;( 3) Judging whether the number of iterations is completed, if not, continue training; if the number of iterations is completed, input the test sample into the trained network model for testing, and obtain the test result.