Unlock instant, AI-driven research and patent intelligence for your innovation.

Text processing method, device, computer equipment and storage medium

A text processing and text technology, applied in the computer field, can solve the problems of low efficiency and time-consuming non-redundant features of text data, and achieve the effect of avoiding low efficiency, improving efficiency, and enriching methods

Active Publication Date: 2021-09-28
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since it takes a lot of time to manually identify redundant phrases, the efficiency of extracting non-redundant features of text data is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text processing method, device, computer equipment and storage medium
  • Text processing method, device, computer equipment and storage medium
  • Text processing method, device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

[0032] Cloud technology (Cloud technology) is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on cloud computing business model applications. At present, the background services of technical network systems require a lot of computing and storage resources, such as video websites, picture websites and more portal websites. With the rapid development and application of the Internet indust...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the present application discloses a text processing method, device, computer equipment, and storage medium. The text processing method can be applied to the field of artificial intelligence. The text processing method includes: obtaining the text to be processed, the text includes N phrases, and N is a positive integer ; N phrases are encoded to obtain N phrase features; N phrase features are respectively redundantly identified to determine the first aggregation weight of each phrase feature; the first aggregation weight indicates that the phrase corresponding to the phrase feature belongs to non-redundant The probability of remaining phrases; according to the first aggregation weight of each phrase feature, the N phrase features are aggregated into non-redundant text features of the text, and the non-redundant text features are output. By adopting the present application, the efficiency of extracting non-redundant text features of text can be improved.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to a text processing method, device, computer equipment and storage medium. Background technique [0002] Semantic redundancy widely exists in various text data, such as news, live commentary, spoken dialogue, etc. Redundant information will cause interference and noise to text understanding, semantic transformation, etc., and even distort the original meaning. Recognition and filtering can improve the effect of natural language understanding tasks in the field of artificial intelligence, and it is also a key link in many text processing fields to improve the effect of downstream tasks. [0003] At present, in order to extract the non-redundant features of text data, the redundant phrases in the text are manually identified, and then the text features of the text composed of the remaining non-redundant phrases are extracted. The text features can be used as non-redun...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F40/126G06F40/216G06F40/30G06F16/35G06N3/04G06N3/08
CPCG06F40/126G06F40/216G06F40/30G06F16/35G06N3/049G06N3/08G06N3/047G06N3/045
Inventor 刘志煌谢智贤
Owner TENCENT TECH (SHENZHEN) CO LTD