Natural language word segmentation method and system, natural language classification method and system

A natural language and construction method technology, applied in natural language data processing, text database clustering/classification, unstructured text data retrieval, etc. The effect of improving classification accuracy

Active Publication Date: 2021-07-16
MASHANG CONSUMER FINANCE CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among the existing open source word segmentation tools, they often rely on the accuracy of the open source word segmentation tools, and additional processing of proper nouns in natural language is required. Obviously, this method is too cumbersome

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Natural language word segmentation method and system, natural language classification method and system
  • Natural language word segmentation method and system, natural language classification method and system
  • Natural language word segmentation method and system, natural language classification method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0034] Embodiment 1 of the present invention discloses a method for constructing natural language word segmentation, such as figure 1 As shown, the method includes:

[0035] Step S11: Obtain the Ngram word segmentation of natural language;

[0036] Step S12: Non-continuous combination of Ngram word segmentation according to position sequence order to obtain combined word segmentation.

[0037] In this embodiment, firstly, the Ngram word segmentation of the n...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present application discloses a method for constructing natural language word segmentation. The method includes: obtaining Ngram word segmentation of natural language, and discontinuously combining the Ngram word segmentation according to the sequence of positions to obtain the combined word segmentation. It can be seen that on the basis of the original Ngram word segmentation, the obtained Ngram word segmentation is combined according to the order of the position sequence. Through this method, the expressive ability of natural language is increased, and the classification accuracy of natural language is improved. Moreover, in this solution, the window size is further set for the combined word segmentation, so as to avoid generating too many combined word segmentation feature quantities, and improve the classification speed of natural language. Correspondingly, the present invention also discloses a natural language word segmentation construction system, a natural language classification method and system, which also have the above beneficial effects.

Description

technical field [0001] The invention relates to the field of natural language processing, in particular to a natural language word segmentation method and system, and a natural language classification method and system. Background technique [0002] With the development of science and technology, the Internet has become an important means for people to acquire knowledge. Among them, technologies such as information retrieval, text classification and man-machine dialogue have penetrated into all aspects of people's lives, and people have to use natural language processing more or less (Natural Language Processing, NLP) research results to obtain or mine all kinds of knowledge and information on the Internet, therefore, natural language processing has become one of the most popular subjects in this century. [0003] In natural language processing, a word is the smallest meaningful language component that can move independently, while Chinese uses a word as the basic writing un...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F40/284G06F40/289G06F16/33G06F16/35
CPCG06F16/3344G06F16/35G06F40/284G06F40/289
Inventor 罗欢权圣
Owner MASHANG CONSUMER FINANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap