Natural language processing-based multi-language analysis method and device

A natural language processing, multi-language technology, applied in natural language data processing, digital data processing, special data processing applications, etc., can solve the problems of rapid adaptation to difficult multi-language scenarios, single domain, and a large number of manual operations.

Active Publication Date: 2018-06-22
北京百分点科技集团股份有限公司
View PDF3 Cites 73 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present application provides a multilingual analysis method and device based on natural language processing to solve the problem that the traditional multilingual analysis method needs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Natural language processing-based multi-language analysis method and device
  • Natural language processing-based multi-language analysis method and device
  • Natural language processing-based multi-language analysis method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0066] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with specific embodiments of the present application and corresponding drawings. Apparently, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0067] The natural language processing used in this application is linguistically irrelevant multilingual analysis technology, which refers to text content in multiple natural languages, such as Spanish, French, German, etc., using statistical natural language processing methods to perform text-based Semantic analysis and understanding.

[0068] This...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a natural language processing-based multi-language analysis method and device. The method comprises the following steps of: selecting to input a natural language text information language category through a language detection training model; obtaining word embedding expression information of corresponding words which can be recognized by a computer through a trained word vector model, and extracting a keyword of the obtained word embedding expression information through a TF-IDF manner; calculating an article vector and a category vector of each preset category according to the keyword and a keyword weight, and calculating a similarity between an article of natural language text information and each preset category so as to determine a text classification result ofthe natural language text information; and inputting the word embedding expression information of the natural language text information into a trained convolutional neural network and a parallel-framework text emotion analysis model of a bidirectional gate circulation unit, and obtaining a final emotion tendency value through calculation. According to the method and device, the problem that traditional multi-language analysis method needs to know domain knowledges of related linguistics and needs plenty of manpower to carry out operation is solved.

Description

technical field [0001] This application relates to the technical fields of data mining, machine learning, artificial intelligence, and multilingual text analysis technology applications, and in particular to a multilingual analysis method and device based on natural language processing. Background technique [0002] With the vigorous development of Internet information, it is necessary to process various languages ​​in Internet information. Natural language processing (NLP) is the field of interaction between computers and human (natural) language that computer science, artificial intelligence, and linguistics focus on. It is an important direction in the field of computer science and artificial intelligence. The research scope of natural language processing covers various theories and methods that can realize effective communication between humans and computers in natural language. The fields involved include natural semantic understanding, retrieval, information extraction...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/27G06F17/30G06K9/62
CPCG06F16/35G06F40/216G06F40/284G06F18/24155
Inventor 苏海波刘钰苏萌刘译璟杨哲铭马晓雪
Owner 北京百分点科技集团股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap