Unlock instant, AI-driven research and patent intelligence for your innovation.

Abnormal text detection method and device, computer readable medium and electronic equipment

A detection method and anomaly technology, which are applied in the fields of unstructured text data retrieval, computation, neural learning methods, etc., can solve the problem of low positioning accuracy of abnormal segments, and achieve the effect of improving accuracy and precision and improving detection accuracy.

Pending Publication Date: 2022-05-13
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of this application is to provide a method, device, computer-readable medium and electronic equipment for detecting abnormal texts, so as to solve the problem of low positioning accuracy of abnormal segments in texts in the related art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Abnormal text detection method and device, computer readable medium and electronic equipment
  • Abnormal text detection method and device, computer readable medium and electronic equipment
  • Abnormal text detection method and device, computer readable medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be thorough and complete, and will fully convey the concepts of example embodiments to those skilled in the art.

[0063] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of the embodiments of the application. However, those skilled in the art will appreciate that the technical solutions of the present application may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be employed. In other instances, well-known methods,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an abnormal text detection method and device, a computer readable medium and electronic equipment, and can be used for scenes such as artificial intelligence and natural language processing. The method comprises the following steps: acquiring a to-be-detected text consisting of a plurality of characters; feature extraction is carried out on the to-be-detected text to obtain a feature sequence of the to-be-detected text, and the feature sequence comprises context features corresponding to multiple characters in the to-be-detected text; performing mapping processing on the feature sequence through a plurality of preset models to obtain a processing result corresponding to each preset model; wherein the processing result of the preset model comprises the abnormal probability of the feature fragment in the feature sequence; the lengths of the feature fragments corresponding to the processing results of different preset models are different; and determining an abnormal fragment in the to-be-detected text according to the abnormal probability of the feature fragment indicated by each preset model processing result. According to the method, the to-be-detected text is detected through the models with various granularities, so that the accuracy and precision of the detection result are improved.

Description

technical field [0001] The application belongs to the technical field of computer and artificial intelligence, and in particular relates to a detection method, device, computer-readable medium and electronic equipment for abnormal text. Background technique [0002] In many cases, it is necessary to revise the text data to solve abnormal problems such as typos, semantic and grammatical errors in the text. Currently, in natural language processing, a common detection method is to identify abnormal locations in text through sequence annotation models. Sequence labeling is to give a text sequence, analyze each element in the text sequence, determine the abnormal probability of each element, and finally identify the elements with higher abnormal probability as abnormal elements. However, the sequence labeling method usually has the problem of positioning offset, that is, there is a certain gap between the identified abnormal elements and the real abnormal elements. Therefore, t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/33G06F40/253G06F40/30G06N3/04G06N3/08
CPCG06F16/3344G06F40/30G06F40/253G06N3/08G06N3/045
Inventor 岳天驰
Owner TENCENT TECH (SHENZHEN) CO LTD