A method,
system, device and medium for simultaneous recognition and segmentation of hand-drawn sketches, the method comprising: obtaining a hand-drawn sketch in a
scalable vector graphics format from hand-drawn sketch acquisition
software, and converting the result into an RGB format image and graph format data; constructing a dual-
stream network for simultaneous recognition and segmentation based on a
convolutional neural network and a graph convolutional network; inputting the RGB format hand-drawn sketch image into the
convolutional neural network stream to obtain global features and
category recognition results that characterize the hand-drawn sketch category; inputting the graph format hand-drawn sketch data into the graph convolutional network
stream to obtain
stroke-level features and point-level features, and splicing the global features,
stroke-level features and point-level features to achieve point-level segmentation; utilizing the KL
divergence method to achieve supervision of the segmentation results; the
system, device and medium are used for simultaneous recognition and segmentation of hand-drawn sketches; the present invention can simultaneously perform hand-drawn
sketch recognition and segmentation tasks, is more efficient than performing only segmentation or only recognition tasks, and improves the accuracy of hand-drawn
sketch recognition and segmentation.