Machine learning-based endoscopic auxiliary biopsy system and method

A machine learning and biopsy technology, applied in the system field of endoscopic assisted biopsy, can solve problems such as inability to meet accurate biopsy, inconsistent differentiation types, and lesions

Active Publication Date: 2021-04-06
SHANDONG UNIV QILU HOSPITAL +1
View PDF17 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In clinical practice, there are often inconsistencies between preoperative biopsy and postoperative pathology. The reason may be that the differentiation types of different parts of the same lesion are inconsistent, and a certain part of the lesion is too deeply infiltrated. How to choose the best biopsy site and reduce surgical time? Pre-misjudgment is an urgent problem to be solved
[0003] Although the current convolutional neural network technology can solve the problem of image recognition very well, it is mostly based on the judgment of the overall lesion and cannot meet the needs of accurate biopsy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Machine learning-based endoscopic auxiliary biopsy system and method
  • Machine learning-based endoscopic auxiliary biopsy system and method
  • Machine learning-based endoscopic auxiliary biopsy system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] Such as figure 1 As shown, Embodiment 1 of the present invention provides a system for endoscopic assisted biopsy based on machine learning. The system includes: an image acquisition module, which is used to acquire video frames of parts to be detected that are collected in real time during endoscopic examination; lesion infiltration The depth identification module is used to identify the lesion area of ​​the video frame of the part to be detected by using the lesion infiltration depth identification model, and score the infiltration depth of different differentiation types of the lesion area to obtain a mask image of a scoring matrix with different infiltration depths; wherein, The lesion infiltration depth recognition model model is obtained by training multiple sets of data, and each set of data includes an endoscopic image containing a lesion area and labeling information for labeling different differentiation types of the lesion area in the endoscopic image.

[004...

Embodiment 2

[0068] Embodiment 2 of the present invention provides a method for endoscopic assisted biopsy based on machine learning. This method can display the endoscopic lesion scoring matrix according to the lesion differentiation type and infiltration depth, thereby assisting the endoscopist to select the best biopsy site.

[0069] In this embodiment 2, the method of endoscopic assisted biopsy based on machine learning includes the following steps:

[0070] Step 1: Collect sample images with lesions, and automatically mark the training data according to the infiltration depth and differentiation type determined by the case slice results:

[0071] Usually, before training the neural network model, it is necessary to label the training data to determine the category to which each pixel of the image is marked, the depth of infiltration and the type of differentiation. , the depth of infiltration in each part of the lesion is different, and sometimes the differentiation type is also diff...

Embodiment 3

[0101] Embodiment 3 of the present invention provides a computer device, including a memory and a processor, the processor and the memory communicate with each other, the memory stores program instructions executable by the processor, and the processor calls the The above program instruction executes the method of endoscopic assisted biopsy based on machine learning, the method includes the following process steps:

[0102] Obtain video frames of the parts to be detected that are collected in real time during the endoscopic examination;

[0103] Using the lesion infiltration depth identification model to identify the lesion area of ​​the video frame of the part to be detected, and scoring the infiltration depth of different differentiation types of the lesion area, and obtaining a mask image of a scoring matrix with different infiltration depths; wherein, the lesion infiltration depth identification The model is obtained by training multiple sets of data, and each set of data ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a machine learning-based endoscopic auxiliary biopsy system and method, and belongs to the technical field of endoscopes, and the system comprises an image collection module which is used for obtaining a to-be-detected part video frame collected in real time in an endoscopic examination process; a lesion infiltration depth recognition module used for recognizing a lesion area of the video frame of the to-be-detected part by utilizing the lesion infiltration depth recognition model and carrying out infiltration depth scoring on different differentiation types of the lesion area to obtain mask images with scoring matrixes with different infiltration depths; wherein the lesion infiltration depth recognition model is obtained by training a plurality of groups of data, and each group of data comprises an endoscopic image containing a focus area and labeling information used for labeling different differentiation types of the lesion in the endoscopic image. An endoscopic lesion scoring matrix can be displayed in real time according to the lesion differentiation type and the infiltration depth, so that an endoscopic doctor is assisted in selecting the optimal biopsy part, and the optimal diagnosis and treatment decision is obtained clinically.

Description

technical field [0001] The invention relates to the technical field of endoscopic biopsy, in particular to a system and method for endoscopic assisted biopsy based on machine learning. Background technique [0002] Endoscopic biopsy is currently an indispensable method for the early diagnosis and treatment of digestive system diseases. When suspicious lesions are found during endoscopic examination, biopsy is often required to clarify the nature, differentiation type, and infiltration depth of the lesion, which are related to subsequent treatment decisions. In clinical practice, there are often inconsistencies between preoperative biopsy and postoperative pathology. The reason may be that the differentiation types of different parts of the same lesion are inconsistent, and a certain part of the lesion is too deeply infiltrated. How to choose the best biopsy site and reduce surgical time? Front misjudgment is an urgent problem that needs to be resolved. [0003] Although the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/00G06K9/46G06N20/00G06N3/08G06N3/04
CPCG06T7/0012G06N20/00G06N3/08G06T2207/10068G06T2207/10016G06T2207/20081G06V10/462G06N3/045
Inventor 马铭骏左秀丽李延青李真邵学军杨晓云赖永航冯健
Owner SHANDONG UNIV QILU HOSPITAL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products