Text disturbance detection method, disturbance restoration method, disturbance processing method and devices
A detection method and text technology, applied in the direction of electronic digital data processing, natural language data processing, character and pattern recognition, etc., can solve the problems of text review model error response, poor text review effect, etc., to improve the text review effect, eliminate Text perturbation, the effect of reducing the risk of text review
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
no. 1 example
[0061] Such as figure 1 As shown, the present application provides a text disturbance detection method, comprising the following steps:
[0062] Step 101: Perform word segmentation on the first text to obtain a first word sequence.
[0063] The above-mentioned first text can be understood as text published by the user on the Internet, such as articles, comments, posts, etc. published by the user through Internet platforms such as blogs and microblogs.
[0064] In this step, performing word segmentation on the first text may be understood as performing word segmentation on the first text, so as to divide the first text into multiple words. When segmenting the first text, the first text may be segmented at the granularity of the smallest semantic unit.
[0065] In the first word sequence obtained by performing word segmentation on the first text, the order of words is the same as the order in which each word appears in the first text. That is to say, performing word segmentat...
no. 2 example
[0110] like Figure 5 As shown, the present application provides a text disturbance restoration method, comprising the following steps:
[0111] Step 201: Replace the first disturbing word in the first word sequence with a mask mark to obtain a second word sequence.
[0112] Wherein, the above-mentioned first word sequence is a word sequence obtained by segmenting the first text. For the relevant description of the first word sequence, reference may be made to the relevant content in the first embodiment, and the same beneficial effect can be achieved, so in order to avoid repetition, details are not repeated here.
[0113] The above-mentioned first disturbance word may be a certain disturbance word in the first text, or all the disturbance words in the first text.
[0114] When the number of disturbance words in the first word sequence is greater than 1, these disturbance words form a disturbance word set. A single disturbance word in the disturbance word set can be masked...
no. 3 example
[0165] like Figure 7 As shown, the present application provides a text perturbation processing method, comprising the following steps:
[0166] Step 301: Segment the first text to obtain the first word sequence;
[0167] Step 302: Obtain a context vector representation of each word in the first word sequence, where the context vector representation is a vector representation that incorporates context information of the current word;
[0168] Step 303: According to the context vector representation of each word in the first word sequence, detect disturbing words in the first word sequence, where the disturbing words include the first disturbing word;
[0169] Step 304: replacing the first disturbance word in the first word sequence with a mask mark to obtain a second word sequence;
[0170] Step 305: Obtain an estimated context vector representation of the mask flag, where the estimated context vector representation is a vector representation that incorporates context inform...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com