Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Universal portrait photo cartoon stylizing method

A stylized and cartooning technology, applied in the field of image processing, can solve problems such as large gaps in original images, uncontrollable results, and single form of cartoon processing methods, achieving high versatility, avoiding uncontrollable and inconsistency in features

Active Publication Date: 2020-07-24
HANGZHOU QUWEI SCI & TECH
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, various comic-style special effects are often involved in mobile apps or PC image processing software, such as Japanese comics, American comics, Chinese comics, etc. The existing comic processing methods are single, and most of them are special processing for a certain type of comic scenes , does not have universality; at the same time, the caricature effect of the caricature method based on traditional image algorithms (template matching, lineization, etc.) is too poor, and the caricature effect based on the GAN network is too far from the original image of the user (the facial features are not the same), and the output resolution Too small, the result is uncontrollable, and cannot meet the needs of the current market and users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Universal portrait photo cartoon stylizing method
  • Universal portrait photo cartoon stylizing method
  • Universal portrait photo cartoon stylizing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0050] Such as figure 1 In the described embodiment, a kind of general portrait photo caricature stylization method specifically comprises the following steps:

[0051] (1) Input image S; bgra32 format or other formats.

[0052] (2) Segment the comic area of ​​the input image S: use a semantic segmentation algorithm based on deep learning, such as Unet, PSPNet, BiseNet, etc., to divide the input image S into a portrait feature area A, a portrait non-feature area B, and a background area C. Take Unet as an example (actually not limited to this algorithm, it can be any kind of semantic segmentation network) The steps for semantic segmentation are as follows:

[0053] (21) Set the Unet semantic segmentation network input image to a size of 256×256, 3-channel RGB data, and output a color three-channel image of 256×256×3 (such as figure 2shown),...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a universal portrait photo cartoon stylizing method. The method specifically comprises the following steps: inputting an image S; carrying out cartoon region segmentation on the input image S; dividing the input image S into a portrait feature region A, a portrait non-feature region B and a background region C by using a semantic segmentation algorithm based on deep learning; performing five-sense-organ cartoon special effect algorithm processing on the portrait feature area A to obtain a graph E; carrying out selectable filter algorithm processing on the portrait non-feature area B to obtain a graph F; carrying out selectable filter algorithm processing on the background area C to obtain a graph G; and image fusion: combining the portrait feature area A in the image E, the portrait non-feature area B in the image F and the background area C in the image G to obtain a final effect image D. The beneficial effects of the method are that the method solves a problemthat the output resolution of a pure GAN network is too small; the method is high in universality, and effectively avoids the uncontrollability of the effect and the inconsistency of features.

Description

technical field [0001] The present invention relates to the related technical field of image processing, in particular to a method for stylizing general portrait photos and caricatures. Background technique [0002] At present, various comic-style special effects are often involved in mobile apps or PC image processing software, such as Japanese comics, American comics, Chinese comics, etc. The existing comic processing methods are single, and most of them are special processing for a certain type of comic scenes , does not have universality; at the same time, the caricature effect of the caricature method based on traditional image algorithms (template matching, lineization, etc.) is too poor, and the caricature effect based on the GAN network is too far from the original image of the user (the facial features are not the same), and the output resolution Too small, the result is uncontrollable, and cannot meet the needs of the current market and users. Contents of the inv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/00G06T5/00G06T5/50G06T7/11G06T7/90G06K9/00G06K9/34
CPCG06T7/11G06T5/50G06T7/90G06T2207/20221G06V40/161G06V10/267G06T3/02G06T5/94
Inventor 胡耀武李云夕熊永春
Owner HANGZHOU QUWEI SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products