Screen shot image moire removing method based on convolutional neural network AMNet

A convolutional neural network and moiré technology, applied in the field of computer vision, can solve the problems of dark screen images, learn brightness information, restore image brightness, etc., and achieve the effect of retaining details, good details, and avoiding plaque and false color.

Pending Publication Date: 2020-08-25
TIANJIN UNIV
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the existing research, there are few data sets dedicated to the moiré removal task, and in these data sets, there is no brightness difference between the moiré image and the corresponding clean image, and it is difficult for the network to pass

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Screen shot image moire removing method based on convolutional neural network AMNet
  • Screen shot image moire removing method based on convolutional neural network AMNet
  • Screen shot image moire removing method based on convolutional neural network AMNet

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0046] The present invention adopts following technical scheme:

[0047] 1) Analyze the moiré features and establish the moiré model in the screen shot image:

[0048] I m =I c +I mc (1)

[0049] Simply put, moiré in screen shot images can be regarded as a complex additive noise, which is related to the angle of shooting and the parameters of the camera lens. In equation (1), I m The image with moiré pattern obtained by screen capture, I c is the original image being captured, I mc It is a moiré layer.

[0050] 2) Create a dataset

[0051] The data set is composed of screen shot images with moiré patterns and image pairs that are directly downloaded or screenshots obtained after processing. It is called the moiré removal and brightness improvement (MRBI) data set. The data set is divided into training set and test set.

[0052] Use mobile phones of different brands and models to shoot text, web pages, photos of people, landscape photos, etc. displayed on display dev...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of computer vision, and aims to remove moire and output a corresponding clean picture. The invention discloses a screen shot image moire removing method based on a convolutional neural network AMNet, and the method comprises the following steps: analyzing moire features, and building a moire model in a screen shot image; building a data set; designing a network framework; designing a network structure; setting the learning rate of the network and the weight of the loss function of each part, training the convolutional neural network by using a deep learning framework Tensorflow until the loss converges, and generating a training model; and inputting the test picture with the moire pattern into a network to obtain a corresponding clean picture without themoire pattern. The method is mainly applied to occasions for removing the screen moire patterns.

Description

technical field [0001] The invention belongs to the field of computer vision, and relates to a method for removing moiré in screen shot images. Specifically, through a learning-based approach, pairs of moiré-patterned images and clean images directly downloaded or screenshots are used as input. Through training, the network learns the mapping relationship from moiré images to clean images. Finally, the process of inputting a picture with moiré pattern, removing the moiré pattern by the network, and outputting a corresponding clean picture is realized. Background technique [0002] Moiré refers to the irregular fringes produced when two arrays of different frequencies are aliased together. When a digital camera is used to shoot a digital display device, aliasing occurs between the photosensitive element of the camera and the display device, and it is easy to appear moiré, which seriously affects the quality of the captured image. Due to its irregular shape, various colors,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00G06N3/04
CPCG06T5/005G06T2207/20081G06N3/045
Inventor 岳焕景毛岩梁丽璞杨敬钰
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap