Composition scoring method based on attention mechanism

An attention and composition technology, applied in neural learning methods, semantic analysis, special data processing applications, etc., can solve problems such as insufficient basis for composition scoring, insufficient model analysis, and difficulty in capturing long-distance information.

Active Publication Date: 2017-09-05
RENMIN UNIVERSITY OF CHINA +2
View PDF4 Cites 59 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Compared with natural language processing tasks such as sentiment analysis and text classification, the automatic grading of articles has a stronger priori. Traditional automatic grading systems for composition generally use manual extraction of features and statistical methods of multi-regression regression for analysis and evaluation. The number of words in a composition usually exceeds 500 words. Recurrent neural network models such as LSTM are difficult to capture long-distance information. Language modeling that relies solely on recurrent neural networks is not enough to capture complex language structures, and the existing automatic scoring technology is capable of analyzing the model. Not enough, the basis for grading the composition is not sufficient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Composition scoring method based on attention mechanism
  • Composition scoring method based on attention mechanism
  • Composition scoring method based on attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0029] The flow process of the system realized by the present invention is as figure 1 As shown, including feature generation of text data and training of the model. The extracted text features apply the features automatically generated by the deep neural network model and the shallow text semantic features extracted manually. Composition scoring is usually accompanied by artificially defined ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a composition scoring method based on an attention mechanism; the method comprises: using a neural network attention frame of word-sentence-document trilayer structure in a composition scoring system, using artificially extracted features to perform fusing in sentence and document levels of the frame, and setting attention weights of the sentence and document levels. The influences of factors, such as local features and global features of a language, completeness of sentences, accuracy of word usage, diversity of expressions, coherency of sentences and digressing or zero digressing from the subject, upon a scoring task are comprehensively considered herein, and composition scoring effect is maximally improved.

Description

technical field [0001] The invention relates to a composition scoring method, in particular to a composition scoring method based on an attention mechanism with a multi-hop structure. Background technique [0002] Compared with the manual scoring system, AES (Automated Essay Scoring) has the advantages of being more objective, efficient and low-cost. The composition scoring system constructed by AES has been successfully applied to GMAT, TOEFL, GRE and other examination systems in the United States. With the advancement of technology, the machine scoring system has gradually become a trend. Traditional automatic scoring systems rely on machine learning techniques such as natural language processing to model and analyze text through shallow text semantic features. However, text features need to be manually designed by experts in related fields, which is too expensive and wastes a lot of manpower. With the development of deep learning in recent years, technology based on dee...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/27G06N3/08
CPCG06F40/211G06F40/30G06N3/084
Inventor 赵鑫
Owner RENMIN UNIVERSITY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap