Model training method, video fuzzy frame conversion method, equipment and storage medium

A model training and video frame technology, applied in image data processing, instruments, calculations, etc., can solve the problems of poor conversion effect and inability to guarantee the quality of medical video, and achieve the goal of maintaining timing consistency, improving conversion effect, and improving quality Effect

Active Publication Date: 2019-12-20
TENCENT TECH (SHENZHEN) CO LTD
View PDF10 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present application provides a model training method, video blur frame conversion method, equipment, and storage medium, which can solve the problem of using the image generation model in the related art to convert blur video frames into clear video frames. The problem of ensuring the quality of converted medical videos

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model training method, video fuzzy frame conversion method, equipment and storage medium
  • Model training method, video fuzzy frame conversion method, equipment and storage medium
  • Model training method, video fuzzy frame conversion method, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045]In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0046] Cycle-GAN is a network model for style conversion of images. In related technologies, in order to convert blurred video frames in video into clear video frames, thereby improving video quality, Cycle-GAN is usually used for blurred video frames. Perform style conversion, generate corresponding clear video frames, and replace blurred video frames with the generated clear video frames to improve video quality.

[0047] However, Cycle-GAN is not specially designed for video data. In the process of training Cycle-GAN, only the image style is used as a constraint. When using Cycle-GAN to perform style conversion on blurred video frames, Cycle-GAN only focuses on image style changes. . For the video obtained by medical imaging, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a model training method, a video fuzzy frame conversion method, equipment and a storage medium, and relates to the field of artificial intelligence. The method comprises the steps of obtaining a sample video; extracting a training data pair from the sample video, wherein the training data pair comprises a sample clear frame and a sample fuzzy frame, and the sample clear frame and the sample fuzzy frame belong to the same video frame interval; inputting the training data pair into a generator of an image generation model to obtain a sample generation frame and sample optical flow information output by the generator; inputting the sample generation frame into a discriminator of the image generation model to obtain a discrimination result output by the discriminator; and training an image generation model according to the training data pair, the sample generation frame, the sample optical flow information and the discrimination result. When the image generation model obtained by training in the embodiment of the invention is used for converting the blurred video frames in the video, the time sequence consistency between the video frames can be kept, the conversion effect of converting the blurred video frames into the clear video frames is improved, and the quality of the converted video is further improved.

Description

technical field [0001] The embodiments of the present application relate to the field of artificial intelligence, and in particular to a model training method, a video blurred frame conversion method, a device, and a storage medium. Background technique [0002] Medical imaging is a technique for imaging the human body or specified parts of the human body in a non-invasive manner. Common medical imaging methods include ultrasound (Ultrasound) imaging, computerized tomography (CT) imaging, nuclear magnetic resonance (Nuclear Magnetic Resonance, NMR) imaging, etc. [0003] Affected by many factors, there may be a large number of artifacts in medical images obtained by medical imaging methods, resulting in poor quality of medical imaging; moreover, the contrast of medical images is low, and the edges of lesions are blurred, which is difficult for subsequent lesion segmentation and diagnosis. cause adverse effects. In related technologies, a pre-trained image generation model ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T7/00G06T7/269
CPCG06T5/003G06T7/0012G06T7/269G06T2207/20081G06T2207/20084G06T2207/30168G06T2207/10016G06T2207/10132G06T2207/30068
Inventor 陈思宏郑冶枫
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products