The invention discloses a palm detecting and key point location method based on deep learning. The palm detecting and key point location method based on deep learning particularly includes the following steps of 1, collecting training samples; 2, building network models, wherein a CNN feature extraction network, an RPN candidate area extraction network and a judgment network are built; 3, trainingthe network models, wherein the CNN feature extraction network, the RPN candidate area extraction network and the judgment network are initialized; 4, building a detection model, wherein the CNN feature extraction network, the RPN candidate area extraction network and the judgment network form a Faster R-CNN detection network; 5, detecting the palm and location key points. According to the palm detecting and key point location method based on deep learning, the Faster R-CNN detection framework which has optimal performance and accuracy at present is adopted, compared with a Fast R-CNN, a RPNis adopted to replace a Selective Search method to extract candidate areas, the RPN is completely built in the whole target detection framework, therefore, the speed of extracting the candidate areasis increased, and at the same time, the detection accuracy is improved.