Unlock instant, AI-driven research and patent intelligence for your innovation.

Long sentence compression method and related device

A compression method and long sentence technology, applied in the field of artificial intelligence, can solve problems such as low accuracy

Pending Publication Date: 2022-05-06
HUAWEI TECH CO LTD +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the prior art, the long sentence compression method based on the bidirectional encoder representation from transformers (BERT) compression model only uses one layer of data in the BERT model, and the compression accuracy is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Long sentence compression method and related device
  • Long sentence compression method and related device
  • Long sentence compression method and related device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The embodiment of the present application provides a long sentence compression method, which is used to improve the accuracy of the compressed target long sentence by using multi-layer data in the BERT model.

[0034] refer to figure 1 , a schematic diagram of the BETT model in the embodiment of this application. The goal of the BERT model is to use large-scale unlabeled corpus training to obtain a representation of the text containing rich semantic information, that is: the semantic representation of the text, and then the semantic representation of the text Indicates fine-tuning in a specific natural language processing (natural language processing, NLP) task, and finally applied to the NLP task.

[0035] In the NLP method based on deep neural networks, the words / words in the text are usually represented by one-dimensional vectors (generally called "word vectors"); on this basis, the neural network will convert each word or word in the text The one-dimensional word v...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a long sentence compression method which comprises the steps that after data processing equipment obtains an original long sentence, the original long sentence is processed according to a BERT model, a BERT long sentence is obtained, the content of the BERT long sentence corresponds to the content of the original long sentence in a one-to-one mode, and the content of the BERT long sentence is compressed by utilizing multi-layer data in the BERT model. The BERT long sentence is processed by the data processing equipment through a preset algorithm, the compressed target long sentence is obtained, and according to the technical scheme provided by the embodiment of the invention, when the original long sentence is compressed, the accuracy of the compressed target long sentence is improved by utilizing the multi-layer data in the BERT model.

Description

technical field [0001] The embodiments of the present application relate to the field of artificial intelligence, and in particular to a long sentence compression method and related devices. Background technique [0002] With the fast-paced development of cities, people pay more attention to effectively extracting key information from product descriptions, travel descriptions and other introduction materials to save time and cost. Among them, long sentence compression is an indispensable link, and long sentence compression is a technology that compresses "redundant long sentences" into "short and concise sentences". Based on the long sentence compression technology, the core topic components of the sentence can be retained, and the redundant meaningless components of the sentence can be deleted. [0003] According to whether the compression result comes directly from the original long sentence, long sentence compression can be divided into two types: "generative" (not direc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/211G06F40/284G06F40/30
CPCG06F40/211G06F40/284G06F40/30
Inventor 冯骁骋秦兵刘挺肖腾朝冷立学陈开济张庆龙
Owner HUAWEI TECH CO LTD