Unlock instant, AI-driven research and patent intelligence for your innovation.

A Multimodal Abstract Generation Method by Fusing Image Filters

A technology of fusing images and filters, applied in the field of text summarization, can solve problems such as poor flexibility, poor coherence, wrong content selection, etc., to achieve the effect of easy reading and improved quality

Active Publication Date: 2022-08-09
FUZHOU UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, ignoring the factual details of the abstract leads to problems such as incorrect content selection, poor coherence, and poor flexibility.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Multimodal Abstract Generation Method by Fusing Image Filters
  • A Multimodal Abstract Generation Method by Fusing Image Filters
  • A Multimodal Abstract Generation Method by Fusing Image Filters

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The present invention will be further described below with reference to the accompanying drawings and embodiments.

[0045] It should be noted that the following detailed description is exemplary and intended to provide further explanation of the application. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.

[0046] It should be noted that the terminology used herein is for the purpose of describing specific embodiments only, and is not intended to limit the exemplary embodiments according to the present application. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural as well, furthermore, it is to be understood that when the terms "comprising" and / or "including" are used in this specification, it indicates that There are features, steps, operations, devices, components and / ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention involves a multi -mode abstract generation method of a fusion image filter, including steps: to obtain the hidden representation of the input text, obtain the text context vector of the text; extract the global image feature vector of the input image, and perform weighted and calculated the image above and below the context vector vector of the image.; The context vector of the text is fused with the image context vector to obtain the fusion vector of multi -mode information; the image filter is used to filter the noise in the image, select the most significant image features, update the weight of the context vector of the image, and the update is updated.Later fusion vectors; one -way long and short -term memory networks are used as decoders, and the updated fusion vector decodes the final text summary.Starting from the integration of image information and text information, the present invention makes full use of different models of information to improve the quality of text abstracts, and can be applied to larger data set application scenarios.

Description

technical field [0001] The invention relates to the technical field of text summaries, in particular to a method for generating multimodal summaries by fusing image filters. Background technique [0002] Currently, there are many techniques available for research in the field of text summarization. Automatic summarization methods can be roughly divided into two categories: extractive summarization and generative summarization. The basic method of extractive summary is to extract some important sentences from the original text to form a summary, and the research focuses on the judgment, screening and sorting of the importance of sentences. The basic idea of ​​generative summarization is to condense its thoughts and concepts on the basis of understanding the semantics of the original text to achieve semantic reconstruction. [0003] Currently, there are some extractive summarization methods based on traditional methods. Unsupervised summarization is mainly done using graph ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/34G06K9/62G06N3/04G06N3/08
CPCG06F16/345G06N3/049G06N3/08G06V10/30G06N3/044G06N3/045G06F18/253
Inventor 廖祥文陈俊杰陈志豪丘永旺朱雨航
Owner FUZHOU UNIV