The invention relates to the technical field, in particular to an offline handwritten
mathematical formula recognition method based on
deep learning, which comprises the steps of
data acquisition and
processing, formula detection and symbol segmentation, symbol
feature extraction and recognition,
structural analysis and reconstruction and evaluation and optimization. According to the offline handwritten
mathematical formula recognition method based on
deep learning, the robustness of a model to partial shielding is improved through
decomposition and recombination, real handwritten deformation is simulated through local
distortion, the generalization ability is enhanced through global
distortion, a low-contrast image is improved according to CLAHE
equalization, the illumination influence is reduced, and formula data enhancement diversification
processing is ensured; a formula area is positioned through YOLOv5, adhesion symbols are accurately segmented and processed according to U-Net, global features are extracted by adopting Transform, a Tesseract OCR is called, a symbol
library is self-defined, the OCR and a
rule engine are combined, the special symbol recognition rate can be increased, a
syntax tree is generated through
syntax tree and PCFG analysis and recursive descent, an optimal structure is selected, and a two-dimensional
layout is accurately analyzed.