Method and system for automatically identifying biopsy parts and biopsy quantity under endoscope

An automatic recognition and motion recognition technology, applied in biometric recognition, character and pattern recognition, computer parts, etc., can solve the problems of increasing the burden on endoscopists, confusing the parts of materials, and achieve the effect of positive and efficient promotion.

Active Publication Date: 2020-05-12
SHANDONG UNIV QILU HOSPITAL +1
View PDF14 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] According to the standardized writing requirements for biopsy applications, endoscopists should accurately provide pathologists with the location, quantity, and endoscopic findings of the specimens submitted for examination. Currently, the biopsy locations and the number of blocks are manually counted and recorded, and not only are there easy to confuse the sampling locations, etc. risk, and increases the burden on endoscopists

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for automatically identifying biopsy parts and biopsy quantity under endoscope
  • Method and system for automatically identifying biopsy parts and biopsy quantity under endoscope
  • Method and system for automatically identifying biopsy parts and biopsy quantity under endoscope

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] Such as figure 1 As shown, this embodiment discloses a detection method for automatically identifying the biopsy site and the number of biopsies under an endoscope, including a training stage and an inference stage.

[0033] (1) Training stage

[0034] Step 1: Obtain endoscopic biopsy forceps to collect video clips, and perform image sampling and labeling processing.

[0035] Step 101: based on the development interface of the video capture card, manually collect biopsy video clips and endoscopic images with biopsy forceps in real time, and simultaneously collect an equal number of video clips without biopsy collection;

[0036] Step 102: Evenly sample n frames (16 frames) of the collected video clips through video frame division

[0037] Step 103: Do not do any data enhancement or processing for the endoscopic biopsy image, only zoom the image to 300X300, and its annotation style is as follows figure 2 As shown, for the endoscopic biopsy video clips after sub-frame...

Embodiment 2

[0072] The purpose of this embodiment is to provide a system for automatically identifying the biopsy site and the number of biopsies under the endoscope.

[0073] A system for automatically identifying the biopsy site and the number of biopsies under an endoscope, comprising:

[0074] The image acquisition module acquires video frames collected in real time during the endoscopic examination;

[0075] The biopsy forceps detection module, based on the pre-trained biopsy forceps detection model, detects whether there is a biopsy forceps frame by frame;

[0076] The biopsy site identification module is used to determine the current endoscopic site for biopsy based on the pre-trained endoscopic site identification model when there is biopsy forceps;

[0077] Get the biopsy action identification module, be used for when biopsy forceps exists, track biopsy forceps, obtain the continuous video segment that comprises described biopsy forceps, according to the pre-trained biopsy actio...

Embodiment 3

[0081] The purpose of this embodiment is to provide an electronic device.

[0082] An electronic device, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, when the processor executes the program, the following steps are implemented, including:

[0083] Obtain video frames collected in real time during the endoscopic examination;

[0084] Based on the pre-trained biopsy forceps detection model, detect the presence of biopsy forceps frame by frame;

[0085] If there is biopsy forceps, based on the pre-trained endoscopic site recognition model, determine the current endoscopic site for biopsy; at the same time, start tracking the biopsy forceps to obtain continuous video clips containing the biopsy forceps Action recognition model to determine whether to take a biopsy.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for automatically identifying biopsy parts and biopsy quantity under an endoscope. The method comprises the following steps: acquiring video frames acquired in real time in an endoscope examination process; detecting whether biopsy forceps exist frame by frame based on a pre-trained biopsy forceps detection model; if the biopsy forceps exist, based ona pre-trained endoscope part recognition model, determining an endoscope part for biopsy at present; and meanwhile, starting to track the biopsy forceps to obtain continuous video clips containing thebiopsy forceps, and determining whether biopsy is carried out or not according to a pre-trained biopsy taking action recognition model. The biopsy forceps can be accurately detected and tracked, thebiopsy taking part is determined, the biopsy taking scene is accurately inferred, the biopsy taking frequency is counted, and a guarantee is provided for a standard pathological report.

Description

technical field [0001] The invention belongs to the technical field of artificial intelligence, in particular to a method and system for automatically identifying biopsy sites and biopsy quantities under an endoscope. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art. [0003] Endoscopic biopsy is currently an indispensable means for the early diagnosis and treatment of digestive system diseases. When suspicious lesions are found during endoscopic examination, in order to clarify the nature, distribution and extent of the lesions, it is often necessary to perform multiple biopsies in multiple parts of the gastrointestinal mucosa , which not only provides clues for disease diagnosis, but also understands the development trend of the disease and judges the prognosis. [0004] According to the standardized writing requirements for biopsy applications,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62A61B10/04A61B10/06G06N3/04
CPCA61B10/04A61B10/06G06V40/10G06V40/14G06N3/045G06F18/214
Inventor 李真冯建左秀丽阿迪莱李延青杨晓云赖永航邵学军
Owner SHANDONG UNIV QILU HOSPITAL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap