A multi-attribute image aesthetics evaluation system based on attention mechanism

An image aesthetics and evaluation system technology, applied in the fields of image analysis and computer vision, can solve problems such as lack of pertinence, inability to realize multi-attribute evaluation, difficulty in meeting scale requirements, etc., and achieve the effect of avoiding complexity and generating objective and comprehensive evaluation

Active Publication Date: 2019-03-29
中共中央办公厅电子科技学院
View PDF4 Cites 40 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, its method has the following disadvantages and deficiencies: the amount of data is too small (4307 images), it is difficult to meet the scale requirements of large-scale deep neural networks for training samples; only one type of evaluation informa

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A multi-attribute image aesthetics evaluation system based on attention mechanism
  • A multi-attribute image aesthetics evaluation system based on attention mechanism
  • A multi-attribute image aesthetics evaluation system based on attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0043] This system is developed using Intel Xeon E5 v4 processor, and the training and testing process is carried out through NVIDIA TITANXp graphics card.

[0044] Such as figure 1 Shown, the present invention is concretely realized as follows:

[0045] The implementation process of the data set acquisition module:

[0046] The image aesthetic quality evaluation of this method is obtained from the website www.dpchallenge.com to obtain 330,000 photos with the first number, each of which has a score result, ranging from 1 to 10 points, each attribute is randomly selected 2,000 photos are used as the verification set, 2,000 photos are used as the test set, and the remaining images are used as the training set, with a total of 154,384 images, and images can be reused for each attribute.

[0047] Image preprocessing module implementati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-attribute image aesthetics evaluation system based on attention mechanism. Using machine learning methods, A composite neural network model is trained by using large-scale photograph dataset and corresponding comment information, this model can extract the multi-attribute aesthetic features of image effectively by convolution operation, the image features are extracted from the multi-attribute feature extraction network of the model, Features are further processed in the channel and spatial attention network, and finally the final comments are generated in the language generation network through the long-short memory network unit. The model can automatically output comments of different attributes according to the image characteristics. When an image is inputted, the generated model considers the characteristics of the image from different attributes and evaluates the aesthetic quality of the image in natural language. The method is easily realized by software, and the invention can be widely applied to computer vision, image evaluation and the like.

Description

technical field [0001] The invention belongs to the fields of image analysis and computer vision, in particular to image aesthetic quality evaluation, in particular to a multi-attribute image aesthetic evaluation system based on attention mechanism. Background technique [0002] With the popularity of multimedia data such as image data and video data in the era of big data and the increasingly frequent processing and transmission, how to process multimedia data has become a hot spot and focus of academic and applied research. The quality evaluation of image aesthetics is a field formed by the intersection of computer vision, image processing, image aesthetics and other disciplines. [0003] Image Aesthetic Quality Assessment (Image Aesthetic Quality Assessment) aims to use computers to simulate human perception and understanding of beauty, and automatically evaluate the "beauty" of images, that is, the objective evaluation of image aesthetic quality. The aesthetic stimulati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00G06N3/04G06N3/08
CPCG06N3/049G06N3/08G06T7/0002G06T2207/30168G06N3/045Y02P90/30
Inventor 金鑫吴乐章乐赵耿李晓东周兴晖孙红波
Owner 中共中央办公厅电子科技学院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap