Social Text Dependency Syntax Analysis System Based on Deep Neural Network

Abstract

A social text dependency syntax analysis system based on a deep neural network, involving the field of computer information processing technology, aimed at the problem of sparse social text data in the prior art, including: social text crawling module, preprocessing module, and basic bilinear attention module , a stacked bilinear attention module and a joint decoding and training module; the social text crawling module is used to crawl social text from social media sites; the preprocessing module is used to filter the obtained social text , and the generation of initialization word vectors; the base bilinear attention module is used for pre-training with regular text; the stacked bilinear attention module is used for predicting social text; the joint decoding and training The module is used to calculate the empirical risk function of the stacked bilinear attention module, and perform backpropagation gradient adjustment parameters, fit the training function, and finally use GPU parallel computing to accelerate model training.

Description

technical field [0001] The invention relates to the technical field of computer information processing, in particular to a social text-dependent syntax analysis system based on a deep neural network. Background technique [0002] Dependency analysis is a basic and important task in natural language processing, and many applications need to perform dependency analysis on sentences to provide syntactic results for corresponding tasks. Through the powerful computing power of the computer, the dependent syntactic structure of the sentence is identified. Dependency syntax trees are roughly divided into two categories according to their structure: Project and Non-project dependency syntax structures; according to decoding algorithms: Graph-based and Transition-based dependencies algorithm. The deep neural network partially overcomes the gradient dispersion and explosion of the traditional neural network, and has developed rapidly in recent years, and has made great progress in v...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to propose a social text dependency syntax analysis system based on a deep neural network for the problem of sparse social text data in the prior art

Images