Generating colorized images based on interactive color edges using colorized neural networks

A color edge and neural network technology, applied in the field of digital images, can solve the problems of failure to provide smooth options for digital images and coloring areas, inflexible image colorization systems, and low efficiency

Pending Publication Date: 2021-09-10
ADOBE SYST INC
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Consequently, conventional image colorization systems are often inflexible and fail to provide fluid options for modifying the colorized digital image and shaded regions
[0005] Furthermore, conventional image colorization systems are often inefficient
In particular, conventional systems must often devote additional computing resources to correct for bleeding or other inaccuracies

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Generating colorized images based on interactive color edges using colorized neural networks
  • Generating colorized images based on interactive color edges using colorized neural networks
  • Generating colorized images based on interactive color edges using colorized neural networks

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] One or more embodiments of the present disclosure include an edge-guided colorization system that utilizes a deep colorization neural network to efficiently and accurately generate colorized images using user-guided color edges. For example, edge-guided colorization systems can utilize a two-stage approach to generate colorized digital images. In the first stage, an edge-guided colorization system can utilize an edge prediction neural network to analyze grayscale images and generate an interactive edge map that includes a set of color edges. In particular, the edge-guided colorization system may present the interactive edge map via a graphical user interface that includes various dynamic elements for modifying color edges (such as a global slider element that modifies the number of color edges, or A suggestion element for additional color edges is recommended. In the second stage, the edge-guided colorization system can utilize an edge-guided colorization neural networ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the present disclosure relate to generating colorized images based on interactive color edges using colorized neural networks. Methods, systems, and non-transitory computer-readable storage media are disclosed for converting a grayscale digital image into a colorized digital image using an edge prediction neural network and an edge guided colorization neural network. In one or more embodiments, the disclosed system applies a color edge prediction neural network to a grayscale image to generate a color edge map indicative of predicted chroma edges. The disclosed system may present a color edge map to a user via a colorized graphical user interface, and receive user color point and color edge modifications. The disclosed system may apply a second neural network, an edge-guided colorization neural network to the color edge map or modified edge map, user color point, and grayscale image to generate an edge-constrained colorized digital image.

Description

technical field [0001] Embodiments of the present disclosure relate to the field of digital images, and more particularly to generating digital images that reflect selected colors. Background technique [0002] Significant improvements have been made in recent years in the hardware and software platforms used to edit and generate digital images. For example, developers have created techniques for modifying or improving digital images, including photographs and illustrations. To illustrate, conventional image colorizing systems can automatically add color to complex black-and-white or grayscale images based on user selection of a particular fill color. For example, a client device can select a color that corresponds to a particular area of ​​a grayscale image, and the image colorization system can generate a digital image that reflects the selected color. [0003] Although conventional image colorization systems can add color to digital images, they suffer from several tech...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/13G06T7/90G06T5/00G06N3/04G06N3/08
CPCG06T7/13G06T7/90G06N3/08G06T2207/10024G06T2207/20024G06T2207/20081G06T2207/20084G06N3/045G06T5/90G06T2200/24G06T11/00G06T11/001G06T2207/20096
Inventor 柳承珠R·张M·费希尔吕婧琬
Owner ADOBE SYST INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products