Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Quantum language model modeling system fusing syntactic information and application thereof

A language model and syntax technology, applied in the field of quantum computing and deep learning, to achieve the effect of improving semantic modeling ability

Pending Publication Date: 2022-08-02
TIANJIN UNIV +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The relevance and dependency information of each node in the sentence's dependency structure tree provides important grammatical knowledge, which makes up for the lack of grammar in the existing distributed word vector representation, and further expands the application of quantum language models

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Quantum language model modeling system fusing syntactic information and application thereof
  • Quantum language model modeling system fusing syntactic information and application thereof
  • Quantum language model modeling system fusing syntactic information and application thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The technical solutions of the present invention will be described in detail below with reference to the accompanying drawings. Those skilled in the art know that with the development of technology and the emergence of new scenarios, the technical solutions of the present invention are also applicable to similar technical problems.

[0057] like Figure 1 to Figure 2 As shown, the present invention provides a method for constructing a quantum language model integrating syntactic information. The system includes a data preprocessing and syntactic structure generation module, a syntactic-guided word vector expression module, and a semantic and grammatical information fusion sentence expression module. .

[0058] 1. Data preprocessing and syntactic structure generation module

[0059] The data preprocessing and syntactic structure generation module mainly performs preliminary processing on the data for Dependency Parse. First, each sentence in the data set is processed ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a syntactic information fused quantum language model modeling method, which starts from a quantum system for representing sentences, and introduces syntactic structure information into a model so as to improve the modeling capability of a quantum language model. Comprising a data preprocessing and syntactic structure generation module, a syntactic-guided word representation module and a semantic and syntactic information fused sentence representation module. The data preprocessing and syntactic structure generation module processes sentences into a syntactic structure tree form; the syntax-guided word vector expression module is used for training word vector expression of words by utilizing dependency information of each sentence; a semantic and grammar information fused sentence expression module converts the word vector generated in the previous step into a density matrix, and sentence expression guided by syntax is further obtained and used for training of downstream tasks; on the basis of generation and expression of a syntactic structure tree reconstruction density matrix, lexical term dependency of sentences is modeled by utilizing dependency relationships.

Description

technical field [0001] The invention belongs to the field of quantum computing and deep learning, and particularly relates to a quantum language model modeling system integrating syntactic information and its application. technical background [0002] The development of language has injected vitality into the progress of social civilization, and has had a profound impact on politics, economy, ecology, and other aspects. As a core technology in the field of artificial intelligence, natural language processing has a self-evident research value. In natural language processing, language modeling is an important research direction. Its basic task is to use computers to model the inherent laws of human language, so that computers can complete language understanding tasks and language generation tasks. In the continuous exploration of human beings, the language model has undergone a long development and made great progress, and has performed well in tasks such as automatic question...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N10/60G06F40/211G06F40/30
CPCG06N10/60G06F40/211G06F40/30
Inventor 张鹏郭静静樊子鹏罗引
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products