Text processing method and apparatus
A text processing and text data technology, which is applied in the fields of electrical digital data processing, special data processing applications, unstructured text data retrieval, etc., can solve the problems of subjectivity in text category labeling, low classification efficiency, and heavy manual workload
Active Publication Date: 2018-05-29
IFLYTEK CO LTD
View PDF5 Cites 7 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, when the amount of text is large, the manual workload is heavy, the classification efficiency is very low, and different people may have deviations in the understanding of the text, and there is subjectivity in the labeling of text categories.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0091] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with aspects of the invention as recited in the appended claims.
[0092] figure 1 It is a flow chart showing a text processing method according to an exemplary embodiment of the present invention. As an example, the method can be used in mobile phones, tablet computers, desktop computers, notebook computers, servers and other devices.
[0093] see figure 1 As shown, the method may include the following steps:
[0094] Step S101, acquiring text data to be p...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
Embodiments of the present invention provide a text processing method and apparatus. The method comprises: obtaining to-be-processed text data; according to a first text classification model and a second text classification model, obtaining two candidate categories of the text data respectively, wherein the first text classification model is used to classify the text data according to the title ofthe text data and the sentences contained in the text data, and the second text classification model is used to classify the text data according to the specified sentence in the sentences contained in the text data; and according to the obtained two candidate categories, determining the category of the text data. According to the embodiments of the present invention, the to-be-classified text isclassified from two perspectives of the title+full text and the specified sentence, two candidate categories are obtained, and then the category of the text is finally determined, so that efficiency of text classification is effectively improved, accuracy of text classification is improved, and the influence of human subjectivity on the classification results is reduced.
Description
technical field [0001] The invention relates to the field of natural language processing, in particular to a text processing method and device. Background technique [0002] With the development of information technology, the amount of text information faced by people is also growing explosively, and the processing technology of text information is also constantly evolving. Taking the field of education as an example, the current automatic marking technology has begun to emerge, and more and more schools or educational institutions have begun to use automatic marking technology to automatically mark students' test papers. Many test papers contain composition, but composition is a highly subjective test question, and it is difficult for the machine to directly give the score of the composition. [0003] In the process of realizing the present invention, the inventor found that when correcting compositions, whether to go off topic is one of the main concerns of scoring. There...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F17/27
CPCG06F16/35G06F40/30
Inventor 王栋宋巍付瑞吉王士进胡国平秦兵刘挺
Owner IFLYTEK CO LTD