Computer vision based image and chart recognition system and method

Abstract

The application relates to the technical field of computer vision, and discloses an image and chart recognition system and method based on computer vision, which comprises the following steps: acquiring a to-be-processed file image set of a to-be-processed file, performing resolution standardization processing to obtain a standard image sequence; determining a visual saliency map according to the standard image sequence, and generating a chart detection frame set; constructing a chart region association graph based on the spatial topological relation and visual feature similarity of the chart detection frame set, and determining a chart type identifier; extracting a coordinate axis structure element, a legend semantic element and a data visualization element, and generating a structured data record; and fusing and encoding the structured data record, the chart type identifier and the corresponding legend semantic element of each chart region to generate a chart knowledge vector, and establishing a chart mapping relation of the to-be-processed file, so that accurate classification and structured data extraction of multiple types of charts are realized, and cross-file semantic association and batch processing performance are optimized.

Images