A method and system for automatically identifying biopsy sites and biopsy quantities under endoscopy
A technology of automatic recognition and action recognition, applied in biometric recognition, character and pattern recognition, computer components, etc., can solve the problems of increasing the burden on endoscopists and easily confusing parts of materials, and achieve the effect of positive and efficient promotion
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0032] Such as figure 1 As shown, this embodiment discloses a detection method for automatically identifying biopsy sites and biopsy quantities under an endoscope, including a training stage and an inference stage.
[0033] (1) Training stage
[0034] Step 1: Obtain endoscopic biopsy forceps to collect video clips, and perform image sampling and labeling processing.
[0035] Step 101: based on the development interface of the video capture card, manually collect biopsy video clips and endoscopic images with biopsy forceps in real time, and simultaneously collect an equal number of video clips without biopsy;
[0036] Step 102: Evenly sample n frames (16 frames) of the collected video clips through video frame division
[0037] , use LabelImg and other tools to annotate the biopsy image, and generate an annotation file with the .xml suffix;
[0038] Step 103: No data enhancement or processing is performed on the endoscopic biopsy image, only the image is scaled to 300X300, a...
Embodiment 2
[0073] The purpose of this embodiment is to provide a system for automatically identifying the biopsy site and the number of biopsies under the endoscope.
[0074] A system for automatically identifying the biopsy site and the number of biopsies under an endoscope, comprising:
[0075] The image acquisition module acquires video frames collected in real time during the endoscopic examination;
[0076] The biopsy forceps detection module, based on the pre-trained biopsy forceps detection model, detects whether there is a biopsy forceps frame by frame;
[0077] The biopsy site identification module is used to determine the current endoscopic site for biopsy based on the pre-trained endoscopic site identification model when there is a biopsy forceps;
[0078] The biopsy action recognition module is used to track the biopsy forceps when there is a biopsy forceps to obtain continuous video clips containing the biopsy forceps, and determine whether to perform biopsy according to th...
Embodiment 3
[0082] The purpose of this embodiment is to provide an electronic device.
[0083] An electronic device, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, when the processor executes the program, the following steps are implemented, including:
[0084] Obtain video frames collected in real time during the endoscopic examination;
[0085] Based on the pre-trained biopsy forceps detection model, detect the presence of biopsy forceps frame by frame;
[0086] If there is biopsy forceps, based on the pre-trained endoscopic site recognition model, determine the current endoscopic site for biopsy; at the same time, start tracking the biopsy forceps to obtain continuous video clips containing the biopsy forceps Action recognition model to determine whether to take a biopsy.
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com