Text processing method and device, electronic equipment and storage medium
A technology for text processing and processing methods, which is applied in the fields of electronic digital data processing, text database query, special data processing applications, etc., can solve the problems of low entity accuracy and poor anti-interference ability, etc. , the effect of high accuracy
Active Publication Date: 2021-05-07
CHINA ELECTRONICS CORP 6TH RES INST
View PDF16 Cites 3 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] At this stage, open source entity extraction models are usually used to identify entities in text, such as the CRF model, but the existing entity extraction models have poor anti-interference ability. In the presence of interference, the entities identified by the entity extraction model low accuracy
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0043] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only It is a part of the embodiments of this application, not all of them. The components of the embodiments of the application generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations. Accordingly, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of the application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a text processing method and device, electronic equipment and a storage medium, and the processing method comprises the steps: obtaining a character feature vector of each character in a to-be-processed text; inputting the character feature vector of each character in the to-be-processed text into a pre-trained text processing model, and obtaining a character category of each character output by the text processing model, wherein the text processing model is obtained by training a disturbance sample text added with a random feature vector; and based on the character category of each character in the to-be-processed text, extracting a plurality of entities from the to-be-processed text, and determining the entity category of each entity. The text processing model is trained by using the disturbance sample text added with the random feature vector, so that the stability of the text processing model is improved, the accuracy of the character category output by the entity extraction model is high when interference exists, and the accuracy of the identified entity and the entity category is further improved.
Description
technical field [0001] The present application relates to the technical field of natural language processing, and in particular, relates to a text processing method, device, electronic equipment, and storage medium. Background technique [0002] In the field of natural language processing technology, entities represent specific things, individual subjects, supporters of phenomena, etc., such as names, organizations, etc., in the process of text processing, because entities can represent various objects in the text, therefore, The main content of the text can be determined by identifying entities in the text. [0003] At this stage, open source entity extraction models are usually used to identify entities in text, such as the CRF model, but the existing entity extraction models have poor anti-interference ability. In the presence of interference, the entities identified by the entity extraction model Accuracy is low. Contents of the invention [0004] In view of this, th...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/33G06F16/35G06F40/216G06F40/295
CPCG06F16/3344G06F16/3346G06F16/35G06F40/216G06F40/295
Inventor 黄兵张尼薛继东张宏斌赵耀孙世豪李庆科许凤凯
Owner CHINA ELECTRONICS CORP 6TH RES INST