Text semantic analysis and feature value extraction method

A semantic analysis and extraction method technology, applied in the field of automatic text information processing, can solve the problems of low efficiency and inability to continue to improve the text similarity judgment, and achieve the effect of improving classification accuracy, improving performance and optimizing performance

Active Publication Date: 2021-01-15
中国人民解放军军事科学院军事科学信息研究中心
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the current research on text automatic information processing, researchers often only improve the later processing algorithms, and usually use simple word frequency probability statistics methods to extract feature values ​​in text, resulting in low efficiency in text similarity judgment. Can't continue to improve

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text semantic analysis and feature value extraction method
  • Text semantic analysis and feature value extraction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] The invention provides a method for text semantic analysis and feature value extraction, which specifically includes the following steps:

[0042] Step 10: Text extraction, using a text extraction tool to extract text from the target document;

[0043] Step 20: preprocessing, after obtaining the initial text in step 10, judge and process typos and typos, and obtain a preprocessing text with correct content;

[0044] Step 30: Construct a text corpus, construct a text corpus with words as the smallest unit, extract attributes, perform semantic weight calculations, and obtain word meaning weights, and based on this, perform association weight calculations to obtain association weights of associated words;

[0045] Step 40: Synonym analysis, map the original feature words as the basic unit of text feature extraction to synonymous concepts as the unit of feature extraction, and use the weight of each synonymous concept class obtained from the text corpus to find the correspo...

Embodiment 2

[0061] The invention provides a method for text semantic analysis and feature value extraction, which specifically includes the following steps:

[0062] Step 10: Text extraction, using a text extraction tool to extract text from the target document;

[0063] Step 20: preprocessing, after obtaining the initial text in step 10, judge and process typos and typos, and obtain a preprocessing text with correct content;

[0064] Step 30: Construct a text corpus, construct a text corpus with words as the smallest unit, extract attributes, perform semantic weight calculations, and obtain word meaning weights, and based on this, perform association weight calculations to obtain association weights of associated words;

[0065] Step 40: Synonym analysis, map the original feature words as the basic unit of text feature extraction to synonymous concepts as the unit of feature extraction, and use the weight of each synonymous concept class obtained from the text corpus to find the correspo...

Embodiment 3

[0081] The invention provides a method for text semantic analysis and feature value extraction, which specifically includes the following steps:

[0082] Step 10: Text extraction, using a text extraction tool to extract text from the target document;

[0083] Step 20: preprocessing, after obtaining the initial text in step 10, judge and process typos and typos, and obtain a preprocessing text with correct content;

[0084] Step 30: Construct a text corpus, construct a text corpus with words as the smallest unit, extract attributes, perform semantic weight calculations, and obtain word meaning weights, and based on this, perform association weight calculations to obtain association weights of associated words;

[0085] Step 40: Synonym analysis, map the original feature words as the basic unit of text feature extraction to synonymous concepts as the unit of feature extraction, and use the weight of each synonymous concept class obtained from the text corpus to find the correspo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a text semantic analysis and feature value extraction method, and particularly relates to the technical field of text automatic information processing. The method specificallycomprises the following steps: step 10, text extraction; step 20, preprocessing; step 30, text corpus construction; step 40, synonymy analysis; step 50, weight gain; step 60, feature value extraction;step 70, similarity calculation; step 80, text similarity calculation. According to the characteristic value extraction method based on semantic analysis disclosed in the invention, semantic characteristics of vocabularies in texts are analyzed, characteristic values are determined through a multi-weighting method, then vocabularies are not adopted as characteristic value representation, synonymous concepts are adopted as the characteristic values, the characteristic values are applied to text classification, therefore, the classification precision is improved, the dimensionality of the feature values is greatly compressed, the basic features and attributes of the text types are better reflected, and the text information processing performance is improved to a great extent.

Description

technical field [0001] The present invention relates to the technical field of text automatic information processing, and more specifically, the present invention relates to a method for text semantic analysis and feature value extraction. Background technique [0002] With the continuous development of the Internet, electronic texts, as an important carrier of information, also emerge in large numbers, so the automatic processing of electronic texts has become a very important field of information processing. [0003] However, in the current research on text automatic information processing, researchers often only improve the later processing algorithms, and usually use simple word frequency probability statistics methods to extract feature values ​​in text, resulting in low efficiency in text similarity judgment. Unable to progress further. Contents of the invention [0004] In order to overcome the above-mentioned defects of the prior art, the embodiment of the present...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/33G06F16/35G06F40/247G06F40/30
CPCG06F16/3344G06F16/3346G06F40/247G06F40/30G06F16/35
Inventor 薛非赵相安席欢刘雪涛高强耿伟波
Owner 中国人民解放军军事科学院军事科学信息研究中心
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap