Method for analyzing and recognizing structure of handwritten mathematical formula in natural scene image

A technology of natural scene images and mathematical formulas, applied in the field of structural analysis and recognition of handwritten mathematical formulas

Active Publication Date: 2015-12-23
BEIJING YUNJIANG TECH CO LTD
View PDF5 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The method for structural analysis and recognition of handwritten mathematical formulas in natural scene images provided by the present invention can effectively solve the problem of representation of elementary mathematical formulas in OCR recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for analyzing and recognizing structure of handwritten mathematical formula in natural scene image
  • Method for analyzing and recognizing structure of handwritten mathematical formula in natural scene image
  • Method for analyzing and recognizing structure of handwritten mathematical formula in natural scene image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The method for analyzing and recognizing the structure of handwritten mathematical formulas in natural scenes provided by the embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0056] Such as figure 1As shown, the handwritten mathematical formula structure analysis and recognition method in the natural scene provided by the embodiment of the present invention includes the following steps:

[0057] Step S1, converting the grayscale matrix of the natural scene image into a local contrast matrix, and using the otsu method to perform binary division on the obtained local contrast matrix to obtain a binary matrix;

[0058] In this embodiment, the formula for calculating the local contrast Con(i,j) of a point whose coordinates are (i,j) in the local contrast matrix is:

[0059] Con(i,j)=αC(i,j)+(1-α)(I max (i,j)-I min (i,j))

[0060] in,

[0061] I max (i, j) and I min (i, j) are the maximum gray value ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for analyzing and recognizing the structure of a handwritten mathematical formula in a natural scene image. The method comprises the steps of S1, converting the gray matrix of a natural scene image into a local contrast matrix, and conducting the binary classification on the local contrast matrix based on the otsu method to obtain a binary matrix; S2, analyzing the connected domains of the binary matrix obtained in the step S1, and removing non-character type connected domains to obtain character type connected domains; S3, detecting formula structural elements and other special structural elements in the character type connected domains based on the correlation coefficient method, and separately marking out all detected special structural elements; S4, dividing the binary matrix obtained in the step S1 based on the horizontal projection method; S5, recognizing each character type connected domain via a convolutional neural network; S6, defining an output sequence and outputting recognized results according to the corresponding sequence in the latex layout format. According to the technical scheme of the invention, by means of the method, the expression problem of elementary mathematical formulas during the OCR recognition process can be effectively solved.

Description

technical field [0001] The invention relates to image processing and pattern recognition technology, in particular to a method for analyzing and recognizing the structure of handwritten mathematical formulas in natural scene images. Background technique [0002] OCR (Optical Character Recognition, Optical Character Recognition) technology has a wide range of applications, and the OCR recognition technology for Chinese and English is relatively mature, but at present, the current OCR technology does not have good support for mathematical formulas with complex structures. The present invention focuses on solving this problem with strong application requirements. Contents of the invention [0003] The method for analyzing and recognizing the structure of handwritten mathematical formulas in natural scene images can effectively solve the problem of expressing elementary mathematical formulas in OCR recognition. [0004] The method for analyzing and recognizing the structure o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/32G06K9/62G06N3/02
CPCG06N3/02G06V20/63G06V10/751G06V30/10
Inventor 陈李江刘宁刘辉
Owner BEIJING YUNJIANG TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap