This invention relates to an
automatic localization method,
computer device, and
system for ulcer fragments in intestinal
capsule endoscopy videos. It establishes an automatic ulcer fragment localization network based on initial temporal boundary specifications, combined with policy gradients and evaluation. The network is trained using query image-reference video pairs. The network is input into the trained network and outputs ulcer fragments in the reference video associated with the query image. A
computer device is implemented based on this method. The
system uses an input unit to input query image-reference video pairs, a localization unit to execute the method and locate the ulcer fragments, and an output unit to output the results. This invention uses an image of an ulcer
lesion of interest from an intestinal
capsule endoscopy as the query image and a long intestinal
capsule endoscopy video as the reference video. It analyzes the video using
reinforcement learning, refines the temporal boundary through sequential decisions using start and end markers, and accurately locates fragments related to the query image, thus completing the video relocalization task.