Text processing method and device

A text processing and text technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problem of insufficient error correction accuracy, and achieve the effect of avoiding the accumulation of grammatical errors and improving accuracy

Active Publication Date: 2019-11-26
TENCENT TECH (SHENZHEN) CO LTD
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Based on this, it is necessary to provide a text processing method, device, computer-readable storage medium and computer equi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text processing method and device
  • Text processing method and device
  • Text processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] In order to make the purpose, technical solutions, and advantages of this application clearer, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the application, and are not used to limit the application.

[0043] figure 1 It is an application environment diagram of the text processing method in an embodiment. Reference figure 1 , The text processing method is applied to a text processing system. The text processing system includes a terminal 110 and a server 120. The terminal 110 and the server 120 are connected through a network. The terminal 110 may specifically be a desktop terminal or a mobile terminal, and the mobile terminal may specifically be at least one of a mobile phone, a tablet computer, and a notebook computer. The server 120 may be implemented as an independent server or a server cluster compo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a text processing method and device. The method comprises the steps of obtaining a to-be-corrected initial text; performing spelling error correction processing on the initialtext to obtain a corresponding corrected text; conducting grammar error correction processing on the correction text through a forward codec and a reverse codec which are pre-trained, and obtaiing afirst candidate text and a second candidate text; performing language evaluation processing based on the first candidate text and the second candidate text to obtain an evaluation score; and determining a target text corresponding to the initial text according to the evaluation score and according to the first candidate text and the second candidate text. According to the scheme provided by the invention, the text error correction accuracy can be improved.

Description

Technical field [0001] This application relates to the technical field of language processing, in particular to a text processing method and device. Background technique [0002] With the development of computer technology, language error correction technology has emerged. Language error correction refers to the correction of unreasonable combination patterns in sentences, such as "a orange" in English sentences, singular nouns that obviously start with a vowel The indefinite article should be "an", not "a". [0003] Traditional language error correction technology is based on rules. If you need to achieve better results, you need to establish many complex rules. This method has been surpassed by deep learning models. At present, most deep learning models often use forward encoding and decoding methods. In most scenarios, the error correction effect of forward decoding is obvious, because the language itself is created in this way. But in some scenarios, some information in the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/27
Inventor 方俊林炳怀黄江泉
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products