The embodiment of the invention relates to a multi-round medical image
annotation method and device introducing a
cross validation mechanism, and the method comprises the steps: transmitting a first image to a plurality of expert
annotation interfaces, and merging the feedback
annotation sets of all interfaces to obtain a first annotation set; setting
cross validation items of every two annotation boxes in the first annotation set and constructing a corresponding
cross validation matrix; on the basis of a cross validation matrix, dispute-free annotation box extraction, dispute-free annotation box aggregation and consistency
score estimation are carried out; if the
score is lower than a threshold value, a round of multi-person labeling is initiated again, otherwise, when the dispute labeling
box set is empty, the non-dispute labeling
box set serves as a
final labeling result, when the dispute labeling
box set is not empty, reexamination is conducted on the dispute labeling box set, and a set of the reexamination result and the non-dispute labeling box set serves as the
final labeling result. According to the method, the labeling error of each image can be reduced, the overall labeling quality of all the images is improved, and the stability of the overall labeling quality is guaranteed.