Stomach image processing method and system introducing picture translation information

An image processing and stomach technology, applied in informatics, medical images, medical informatics and other directions, can solve the problems of feature extraction interference, stomach image processing is not suitable for multi-image input, and high sample dependence, so as to improve understanding Ability, the effect of strong image classification ability

Pending Publication Date: 2022-08-09
紫东信息科技(苏州)有限公司
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] For this reason, the technical problem to be solved by the present invention is to overcome the technical defects in the prior a...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Stomach image processing method and system introducing picture translation information
  • Stomach image processing method and system introducing picture translation information
  • Stomach image processing method and system introducing picture translation information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] The present invention will be further described below with reference to the accompanying drawings and specific embodiments, so that those skilled in the art can better understand the present invention and implement it, but the embodiments are not intended to limit the present invention.

[0066] In the present invention, Transformer refers to a transformation network, Decoder refers to a decoder, Encoder refers to an encoder, and ResNet refers to a residual network.

[0067] refer to Figure 1-Figure 4 As shown, the present invention discloses a stomach image processing method for introducing image translation information, comprising the following steps:

[0068] Step 1: Obtain a set of stomach disease sample images, where the stomach disease sample image set includes multiple stomach disease cases, and each stomach disease case corresponds to multiple stomach pictures.

[0069] Step 2: Constructing a disease report generator based on the Transformer, using the stomach...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a stomach image processing method and system introducing picture translation information. The method comprises the following steps: acquiring a stomach disease sample image set; constructing a disease report generator based on Transform, and training the disease report generator by using the stomach disease sample image set to obtain an optimized disease report generator; constructing a stomach disease classifier based on a BERT bimodal classification model, and training the stomach disease classifier by using the stomach disease sample image set to obtain an optimized stomach disease classifier; and inputting a to-be-detected stomach image into the optimized disease report generator and the stomach disease classifier to obtain a classification result of the stomach image. According to the method, the condition of multi-picture input can be processed, and a natural language processing technology is introduced, so that the model can have stronger picture classification capability under the condition that the scale of a data set is not expanded.

Description

technical field [0001] The present invention relates to the technical field of image processing, and in particular, to a stomach image processing method and system for introducing image translation information. Background technique [0002] Stomach disease is a common internal medical disease, with a high incidence and complex classification in human daily life. Common stomach diseases include gastritis, gastric polyps, gastric ulcers, gastric cancer, bile reflux, and gastric bleeding. The clinical reactions of patients after the onset are often characterized by stomach pain, acid reflux and belching, and nausea, vomiting, and loss of appetite. Generally, patients do not pay attention to stomach diseases, which will not only affect their physical health, but also affect their daily activities. Stomach disorders can even be life-threatening if not detected and treated promptly. Therefore, timely detection of gastric diseases is particularly important for people's healthy g...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G16H30/40G16H50/20G16H15/00G06V10/82G06V10/764G06N3/04G06N3/08
CPCG16H30/40G06V10/764G06N3/08G06V10/82G16H50/20G16H15/00G06N3/045Y02A90/10
Inventor 鹿伟民张希钢赖春晓李峰何顺辉王镇煜邱霖戴捷
Owner 紫东信息科技(苏州)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products