The application relates to the technical field of
computer vision, and discloses an image and chart
recognition system and method based on
computer vision, which comprises the following steps: acquiring a to-be-processed file image set of a to-be-processed file, performing resolution
standardization processing to obtain a standard
image sequence; determining a
visual saliency map according to the standard
image sequence, and generating a chart detection frame set; constructing a chart region association
graph based on the spatial topological relation and visual feature similarity of the chart detection frame set, and determining a chart type identifier; extracting a coordinate axis structure element, a legend semantic element and a
data visualization element, and generating a structured data
record; and fusing and encoding the structured data
record, the chart type identifier and the corresponding legend semantic element of each chart region to generate a chart knowledge vector, and establishing a chart mapping relation of the to-be-processed file, so that accurate classification and structured
data extraction of multiple types of charts are realized, and cross-file
semantic association and
batch processing performance are optimized.