Sentence semantic coding method based on reinforcement learning

A technology of semantic coding and reinforcement learning, which is applied in the field of semantic coding of sentences based on reinforcement learning, can solve the problems of slow coding and poor effect of sequential models, and achieve the effect of good text understanding ability

Active Publication Date: 2019-02-19
SUN YAT SEN UNIV
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In general, unordered models are faster to encode but less effective; seq...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sentence semantic coding method based on reinforcement learning
  • Sentence semantic coding method based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] The accompanying drawings are for illustrative purposes only, and should not be construed as limitations on this patent; in order to better illustrate this embodiment, certain components in the accompanying drawings will be omitted, enlarged or reduced, and do not represent the size of the actual product; for those skilled in the art It is understandable that some well-known structures and descriptions thereof may be omitted in the drawings. The positional relationship described in the drawings is for illustrative purposes only, and should not be construed as a limitation on this patent.

[0014] A sentence semantic coding method based on reinforcement learning, which includes the following steps. The invention uses reinforcement learning to realize a reading method similar to human behavior. The function of reinforcement learning in the invention is to locate the text to be read next. The following are some introductions to Agent:

[0015] (1) State: Indicates the sta...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to the technical field of artificial intelligence, natural language processing, and more particularly, to a sentence semantic coding method based on reinforcement learning. The sentence semantic encoding method based on reinforcement learning comprises the following steps: the invention realizes the reading mode similar to human behavior by reinforcement learning; andthe reinforcement learning function of the invention is to locate the text to be read in the next step. The invention is innovative in that a reinforcement learning network is introduced to learn a reading strategy similar to human reading behavior. As that human intensively reads an article, reading and processing of the text is not in disorder or fixed order, but skipping, rereading and other reading behaviors are added, so these behaviors are given to LSTM through the reinforcement learning network, so that LSTM can encode text in a more similar way to human reading behavior, which will enable the model to have better text understanding ability.

Description

technical field [0001] The present invention relates to the technical fields of artificial intelligence and natural language processing, and more specifically, relates to a sentence semantic coding method based on reinforcement learning. Background technique [0002] Semantic Representation is the basic task in NLP, so Sentence Embedding is also a very important research direction in NLP. The current modeling of Sentence Embedding can be roughly divided into two types, disordered model and sequential model. The unordered model does not use the sequence information of the symbols in the input text. For example, Joulin et al. use the bag-of-words model to classify texts. Kim.Y proposed a classic CNN-based text classification architecture. The pooling layer at the highest layer of CNN The extracted features are out of order, so it is considered that the modeling method of CNN is also out of order. In the ordered model, the classic approach is to use the RNN network such as th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/35G06F17/27
CPCG06F40/30
Inventor 许文深潘嵘
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap