Compound word representation learning method and device
A learning method and a technology of compound words, which are applied in the fields of instruments, calculations, electrical digital data processing, etc., can solve the problems of poor downstream tasks and other problems
Active Publication Date: 2019-11-15
TSINGHUA UNIV
View PDF5 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] In order to overcome the problem that the existing compound word representation learning methods only use vector representations of compound word components, resulting in poor downstream task effects or at least partially solve the above problems, embodiments of the present invention provide a compound word representation learning method and device
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
[0023] In one embodiment of the present invention, a compound word representation learning method is provided, figure 1 It is a schematic diagram of the overall flow of the compound word representation learning method provided by the embodiment of the present invention, the method includes: S101, learning the basic vector representation of each component in the compound word and the vector representation of each sememe of each component;
[0024] Among them, a compound word refers to a word formed by compo...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a compound word representation learning method and device. The compound word representation learning method comprises the steps: learning basic vector representation of each component in a compound word and vector representation of each meaning of each component; for any one of the components, obtaining a synonym enhancement vector representation of the component based on amutual attention mechanism according to the vector representation of each synonym of the component and the basic vector representation of other components except the component in the compound word; and obtaining a final vector representation of the compound word according to the basic vector representations of all the components in the compound word and the synonym enhancement vector representations of all the components. According to the compound word representation learning method, the representation of the compound words contains semantic features of finer granularity of all components of the compound words, and the effect of downstream application of the compound words is improved, and the compound word representation learning method has good practicability.
Description
technical field [0001] The invention belongs to the technical field of natural language processing, and in particular relates to a compound word representation learning method and device. Background technique [0002] In linguistics, semantic composition refers to the phenomenon that the semantics of a compound language unit is composed of the semantics of its constituents, which is considered by many linguists to be a fundamental fact of semantics. Semantic composition has important applications in many natural language processing tasks, such as language models and sentiment analysis. [0003] Representation learning for compound words is a major research problem in semantic composition, especially for bimorphic compound words. Existing compound word representation learning methods focus on using more complex combination functions for modeling. In fact, external linguistic knowledge, such as sememe knowledge, can also be introduced into the semantic composition model to im...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/27
Inventor 孙茂松岂凡超刘知远
Owner TSINGHUA UNIV