Text processing method and device
A text processing and text technology, applied in the direction of electronic digital data processing, special data processing applications, natural language data processing, etc., can solve the problems of a lot of cost to piece together abnormal content, unrecognizable judgment of piece together abnormal text, etc., to avoid time and The effect of human cost
Pending Publication Date: 2021-11-26
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The purpose of this application is to provide a text processing method and device, which overcomes at least to a certain extent the technical problems in the related art that the patchwork abnormal text on user-made content cannot be recognized and judged, and the manual review of the patchwork abnormal content requires a lot of cost
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0063] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be thorough and complete, and will fully convey the concepts of example embodiments to those skilled in the art.
[0064] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of the embodiments of the application. However, those skilled in the art will appreciate that the technical solutions of the present application may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be employed. In other instances, well-known methods,...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention belongs to the technical field of artificial intelligence, and particularly relates to a text processing method and device. The text processing method comprises the following steps: performing clause detection on a text to obtain one or more clauses; when the text comprises a plurality of clauses, performing named entity recognition on the plurality of clauses to obtain named entities contained in the plurality of clauses; determining whether different clauses of each clause pair in the plurality of clauses have semantic relation or not according to named entities contained in the plurality of clauses; when at least a preset number of target clauses exist in the multiple clauses, judging that the text is an abnormal text, wherein a clause pair composed of any two clauses in the at least preset number of target clauses is a clause pair without semantic relation. Based on the method, the pieced abnormal text can be efficiently and accurately identified, and the situation that a large amount of time and labor cost are consumed due to the fact that low-quality pieced content is manually audited is avoided.
Description
technical field [0001] This application belongs to the technical field of artificial intelligence, and specifically relates to a text processing method and device. Background technique [0002] Nowadays, all kinds of user-generated content are exploding. Under various short video platforms, video platforms, and text content platforms, low-quality content needs to be reviewed, and patchwork titles are one of the attributes of low-quality content. Patchwork titles can be video titles, news titles, article titles, etc. In related technologies, it is impossible to judge and identify the patchwork of abnormal titles, making it impossible to control the quality of information flows such as videos, news, and articles. [0003] However, if we manually review the titles of videos, news, articles and other information streams to eliminate low-quality content, it will require a lot of manpower input, high labor costs and slow efficiency, which is not suitable for new and fast user-ma...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/295G06F40/30G06F40/126G06F40/194G06F16/35
CPCG06F40/295G06F40/30G06F40/126G06F40/194G06F16/35
Inventor 刘绍腾杨天舒
Owner TENCENT TECH (SHENZHEN) CO LTD