Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Esophageal endoscope video frame sequence quality classification algorithm using space-time information of adjacent frames

A quality classification, video frame technology, applied in the field of medical image processing, can solve the problem of pictures interfering with doctor's observation and diagnosis

Pending Publication Date: 2022-04-15
FUDAN UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the application scenario of endoscopic image analysis, when doctors perform endoscopic examination, they are often prone to encounter situations with low endoscopic image quality, such as the lens is pushed and pulled too fast, too close to the wall of the digestive tract, and blocked by blood foam. Low-quality pictures interfere with doctors' observation and diagnosis

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Esophageal endoscope video frame sequence quality classification algorithm using space-time information of adjacent frames
  • Esophageal endoscope video frame sequence quality classification algorithm using space-time information of adjacent frames
  • Esophageal endoscope video frame sequence quality classification algorithm using space-time information of adjacent frames

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Algorithm for quality classification of esophageal endoscopy video frame sequences using the temporal and spatial information of adjacent frames, the model structure is as follows figure 1 As shown, the specific steps are as follows:

[0036] The first step, model construction:

[0037] First, construct a content feature extraction sub-network whose topology is:

[0038] contentFeat=ResNetRear(ConvGRU(ResNetFront(F t-1 ), ResNetFront(F t ), ResNetFront(F t+1 ))),(1).

[0039] Among them, F t ResNetFront is the first half of ResNet-50 used to extract features, and ResNetRear is the second half of ResNet-50 used for spatial compression features. ConvGRU is a convolutional recurrent gate unit.

[0040] Secondly, construct the motion feature extraction sub-network, whose topology is:

[0041] motionFeat=AlexNetFront(Concat(Edge(F t-1 ), Edge (F t ), Edge (F t+1 ), Flow(F t-1 ,F t ), Flow(F t ,F t+1 ),Diff(F t-1 ,F t ),Diff(F t ,F t+1 ))), (2)

[0042] Amon...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of medical image processing, and particularly relates to an esophageal endoscope video frame sequence quality classification algorithm using adjacent frame space-time information. The algorithm comprises the following steps: constructing a convolutional neural network model for a video frame sequence prediction algorithm, including a content feature extraction sub-network and a motion feature extraction sub-network, referring to information of two features, and finally giving a video quality score of an intermediate frame through a full-connection sub-network; data collection and model training are carried out, and when a trained objective function is reduced to a certain acceptable threshold value, it can be considered that the network is converged; and finally, inputting three continuous frames of images into the trained network model to obtain quality classification of a middle frame. Experimental results show that the accuracy of quality classification of the algorithm exceeds 85%, and the algorithm has very high application value for diagnosis and quality control of clinical esophageal endoscopes.

Description

technical field [0001] The invention belongs to the technical field of medical image processing, and in particular relates to an esophageal endoscope video frame sequence quality classification algorithm. Background technique [0002] With the development of computer science, intelligent medical care has become a major technological innovation to improve the level of modern medical care. As the combination of artificial intelligence and new medical care, its advantages in various aspects are getting more and more recognition and attention. [0003] In the application scenario of endoscopic image analysis, when doctors perform endoscopic examination, they are often prone to encounter situations with low endoscopic image quality, such as the lens is pushed and pulled too fast, too close to the wall of the digestive tract, and blocked by blood foam. Low-quality pictures interfere with doctors' observation and diagnosis. Therefore, prompting the doctor to classify the quality ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V10/764G06V10/82G06K9/62G06N3/04G06N3/08
Inventor 钟芸诗颜波蔡世伦谭伟敏李吉春林青
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products