Unlock instant, AI-driven research and patent intelligence for your innovation.

Image processing method and device based on random matrix

An image processing and random matrix technology, applied in the field of image processing, can solve the problem of low image processing efficiency

Active Publication Date: 2021-09-10
SHANGHAI BIREN TECH CO LTD
View PDF11 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides an image processing method and device based on a random matrix to solve the defect of low image processing efficiency in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image processing method and device based on random matrix
  • Image processing method and device based on random matrix
  • Image processing method and device based on random matrix

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In order to make the objects, technical solutions, and advantages of the present invention, the technical solutions in the present invention will be described in connection with the drawings of the present invention, and it will be described, and , Not all of the embodiments. Based on the embodiments of the present invention, those of ordinary skill in the art will belong to the scope of the present invention without all other embodiments obtained without creative labor.

[0039] The self-focus depth model for image processing includes multi-stage self-payment layers, each layer can include a query matrix (W Q ), Key value matrix (W K ) And value matrix (W V ). For the pixel matrix X to be processed, the corresponding self-payment value can be calculated by the following formula:

[0040] Y = Softmax (x × W Q × (x × W k ) T ) × (x × W v );

[0041] However, query matrix (W Q ), Key value matrix (W K ) And value matrix (W V ) The typical matrix (e.g., 1024 × 128-dimensional ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an image processing method and device based on a random matrix, and the method comprises the steps: inputting a to-be-processed image into an image processing model, and obtaining an image processing result outputted by the image processing model, wherein the image processing model is a self-attention depth model of a hierarchical structure, an initial calculation matrix of each hierarchy in the image processing model is replaced by a low-dimensional equivalent matrix, the low-dimensional equivalent matrix is determined based on a random matrix corresponding to the initial calculation matrix of each hierarchy, the column number of the random matrix is smaller than that of the initial calculation matrix, and the effective rank is larger than that of the initial calculation matrix. According to the method, the low-dimensional equivalent matrix is determined based on the random matrix corresponding to the initial calculation matrix of each level, and the corresponding intermediate variable is calculated by replacing the initial calculation matrix with the low-dimensional equivalent matrix, so that the scale of the self-attention model is reduced, the matrix operand of the model is reduced, and the image processing efficiency is improved.

Description

Technical field [0001] The present invention relates to the field of image processing, and more particularly to an image processing method and apparatus based on a random matrix. Background technique [0002] The self-focus depth model such as Transformer has been widely used in the task of image processing. Among them, the self-focus depth model includes multi-stage self-payment layers, each layer has its own calculation matrix, and the calculation matrix based on each layer can obtain the self-focus value of each layer. [0003] However, the calculation matrix of each layer has a higher dimension, thereby increasing the calculation amount of the model, thereby reducing image processing efficiency. Inventive content [0004] The present invention provides an image processing method and apparatus based on a random matrix to solve the defects with lower image processing efficiency in the prior art. [0005] The present invention provides an image processing method based on a rand...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/50G06F17/16
CPCG06T5/50G06F17/16G06T2207/20081
Inventor 不公告发明人
Owner SHANGHAI BIREN TECH CO LTD