The invention discloses a palm image recognition method and
system based on fusion of a
convolutional neural network and an image neural network, and belongs to the technical field of crossing of biological
feature recognition and
artificial intelligence. The problems that in the prior art, local texture features and a global topological relation are separated, dynamic scene adaptability is poor, and multi-
modal features are not fully fused are solved. The method comprises the following steps: 1) designing a dual-path
hybrid network architecture (DPHGCN), extracting multi-scale local texture features through a lightweight CNN, constructing an adaptive graph structure by using a dynamic
graph generator (DGG), and modeling a topological relation between key points in combination with a graph
attention network; 2) developing a cross-
modal feature alignment module (GIPL), and realizing dimension mapping and
semantic alignment of CNN feature graph and
graph node embedding; and 3) providing a layered attention
fusion mechanism, and combining space attention, topological attention and cross-
modal attention to dynamically weight and fuse heterogeneous features. According to the method, 98.7% of recognition accuracy is achieved on a public
data set, the reasoning speed reaches 32 ms / frame, 76.2% of robustness is still kept in a 50% shielding scene, and the method can be widely applied to the fields of financial
payment identity
authentication, medical palmprint
pathological analysis, real-time security
verification and the like.