Unlock instant, AI-driven research and patent intelligence for your innovation.

Image processing method and device, electronic equipment and storage medium

A technology of image processing and electronic equipment, applied in the information field, can solve problems such as strange images, large image distortion, and unsatisfactory image quality, and achieve the effect of improving image quality

Active Publication Date: 2019-06-25
BEIJING SENSETIME TECH DEV CO LTD
View PDF17 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the prior art, it is realized by means of face manipulation, but the prior art can only make small changes to the face. If the magnitude of the change is relatively large, the generated image will be very strange. The difference in real face imaging is very large; this leads to problems with large image distortion and unsatisfactory image quality

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image processing method and device, electronic equipment and storage medium
  • Image processing method and device, electronic equipment and storage medium
  • Image processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0187] The technical solution for this example consists of three parts:

[0188] 1. A convolutional neural network model for edge detection. For the input face picture, the model is responsible for obtaining an accurate face edge line detection result (such as outer eyelids, outer face contour lines, etc.).

[0189] 2. A conditional encoding and decoding network, from the contour information obtained in the first step, the structural representation is extracted through the network, as clear structural feature information to help the encoder decompose the appearance texture features and structural features of the input face image.

[0190] 3. A weight normalization and decoder design based on perceptual quality, which further helps to improve the generation quality.

[0191] The neural network provided in this example, by decomposing the spatial structure information of the picture, clearly decomposing the texture features and structural features of the encoder appearance, main...

example 2

[0193] This example provides an image processing method that includes:

[0194] Given an image x; then need to get x and The mapping relationship between G. The G may include: φ app and u str . The mapping relationship can be passed through the texture feature z=φ app (x,c) and y=u str (c).

[0195] The aforementioned deep learning model can be constructed using a conditional variance autoencoder (CVAE) network.

[0196] The aforementioned probability distributions and / or probabilities are solved using the following functional relationship.

[0197] logp(x / y)≥E q [logp(x / z,y)]-D KL [q(z / x,y),p(z / y)]; Based on this functional relationship, by solving the maximum value of p(x / y), q(z / x,y) and p(z / y) can be obtained ). Among them, q(z / x,y) can be approximated as p(z / y) 2 .

[0198] The network provided in this example can be trained with a function of the following stochastic objective:

[0199]

[0200] q φ (z / x,y) satisfies the distribution constraint N(0,I)....

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses an image processing method and device, electronic equipment and a storage medium. The image processing method comprises the steps of detecting a first image,and obtaining texture features of a first object in the first image; Obtaining structural characteristics; And generating a second image comprising a second object in combination with the texture feature and the structure feature.

Description

technical field [0001] The present invention relates to the field of information technology, in particular to an image processing method and device, electronic equipment and a storage medium. Background technique [0002] In some image processing scenarios, users want to generate another image based on one image. For example, image A is an image of user A with a serious expression, and the user wants to generate an image of user A with a smiling expression based on image A. [0003] In the prior art, it is realized by means of face manipulation, but the prior art can only make small changes to the face. If the magnitude of the change is relatively large, the generated image will be very strange. The difference in real face imaging is very large; this leads to problems with large image distortion and unsatisfactory image quality. Contents of the invention [0004] In view of this, the embodiments of the present invention expect to provide an image processing method and de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06T11/00
CPCG06T11/001
Inventor 钱晨林君仪吴文岩王权钱湦钜
Owner BEIJING SENSETIME TECH DEV CO LTD