Wireless capsule endoscope lesion automatic detection method and device and storage medium

Abstract

The invention provides a wireless capsule endoscope lesion automatic detection method and device and a storage medium. The method mainly comprises the steps that a video file is converted into an image sequence with a timestamp, and a data set with labels is obtained through key frame expert labeling and target tracking of a similar interval sequence; a focus detection model is trained through a convolutional neural network, the trained model is loaded to predict a focus detection result of the to-be-detected video, and the focus detection result comprises timestamps, focus positions, focus categories and confidence coefficients of all images with focuses; obtaining a manual correction result of an expert for a'difficult example 'sample in the detection result, and obtaining an error detection area; and transforming the error detection area, re-synthesizing the error detection area and the background into a new data set, and finely adjusting the original model to gradually optimize the model effect. According to the method, the high-performance focus detection model is obtained under the condition that expert annotation data is as few as possible, so that experts are assisted to complete focus automatic detection, and the film reading efficiency and the detection performance are improved.

Description

technical field [0001] The present invention relates to the technical field of image processing and intelligent disease diagnosis, in particular, to a wireless capsule endoscope automatic lesion detection method, device and storage medium. Background technique [0002] Wireless Capsule Endoscopy (WCE) is an instrument used to spy on abnormalities in the stomach and esophagus of the human body. Enter the human body through the microcapsules, run along the digestive direction with the movement of the gastrointestinal muscles, and take pictures, and then transmit the images to the imaging workstation, and the doctor will diagnose the digestive tract diseases of the subject. [0003] At present, the clinical diagnosis of wireless capsule endoscope mainly relies on the manual reading method of doctors. However, a subject can collect video for 8-12 hours and collect about 120,000 pictures. Expert manual screening is highly subjective and Time-consuming and labor-intensive, and pr...

AI Technical Summary

Problems solved by technology

[0006] Third, the image diversity is strong and the background is complex, and the accuracy of lesion detection is low

The photos taken by the wireless capsule endoscope are easily affected by residues, air bubbles, etc., which may cause false detection and reduce the accuracy of lesion detection

Images