Image generation method based on self-attention model

An attention model and image generation technology, which is applied in the field of image processing and can solve the problems of high computational cost and low image resolution.

Inactive Publication Date: 2018-09-04
SHENZHEN WEITESHI TECH
View PDF2 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing image generation technology still has the proble

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image generation method based on self-attention model
  • Image generation method based on self-attention model
  • Image generation method based on self-attention model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present invention will be further described in detail below in conjunction with the drawings and specific embodiments.

[0029] figure 1 It is a system framework diagram of an image generation method based on a self-attention model in the present invention. It mainly includes image representation, self-attention model, and local self-attention.

[0030] Image representation, treating RGB intensities of both input pixels and predicted pixels as categorical variables; the three color channels of each input pixel are encoded using a channel-specific set of 256-dimensional embedding vectors with channel intensity values ​​0-255; for output intensities , sharing a single 256-dimensional cross-channel embedding; for an image of width w and height h, the width and channel dimensions are combined into a 3D tens...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an image generation method based on a self-attention model. The method comprises the main content of image representation, the self-attention model and local self-attention. According to the process, three color channel intensities of input pixels and prediction pixels are regarded as classification variables, and coding is performed; width and channel dimensions are combined into a three-dimensional tensor; current representation of a position and representation of other positions are compared, so that attention distribution of other positions is obtained; self-attention is subjected to parallel calculation for all query blocks, and meanwhile a feedforward network and normalization of layers are subjected to parallel calculation for all the positions; and one-dimensional local attention and two-dimensional local attention are used to select query blocks and relevant storage block neighborhoods. The method is based on the self-attention model, the size of an image capable of being processed through the model in practice is remarkably increased, two-dimensional characteristics of the image can be effectively utilized, and the quality of the generated image isgreatly improved.

Description

technical field [0001] The invention relates to the field of image processing, in particular to an image generation method based on a self-attention model. Background technique [0002] Image processing and image generation is an important topic in the field of computer vision. Nowadays, with the popularity of the Internet and the development of various shooting equipment, the number of various images has grown exponentially. However, due to the influence of network transmission and shooting equipment, the pictures obtained by people may be incomplete or blurred, making it impossible for people to obtain effective information from the images. Therefore, through various image inpainting and image generation techniques, images can be quickly identified and restored, which has wide applications in many fields. For example, in the field of medical engineering, because the patient's diseased tissue is dark and the visibility is low, it is difficult for doctors to distinguish th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00
CPCG06T5/001
Inventor 夏春秋
Owner SHENZHEN WEITESHI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap