Text processing method and device, equipment and storage medium

A text processing and text technology, applied in data processing applications, electronic digital data processing, natural language data processing, etc., can solve the problems of high manual labeling costs and low processing efficiency, and achieve the goal of improving text processing efficiency and reducing labor costs Effect

Pending Publication Date: 2021-08-03
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] The structured information extraction and processing of natural language text in related technologies, especially in the application scenario of constructing a product category system based on product information in the field of commercial promotion, is usually constructed by combining customer expression and manual labeling. The amount of data in the order of one hundred thousand to one million has the defects of high manual labeling cost and low processing efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text processing method and device, equipment and storage medium
  • Text processing method and device, equipment and storage medium
  • Text processing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0046] Refer below Figure 1 to Figure 11 A text processing method according to an embodiment of the present disclosure is described.

[0047] Such as figure 1 As shown, the method according to an embodiment of the present disclosure includes the following steps:

[0048] S101: Obtain a text set to be processed and a structured text set; wherein, the text set to be p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a text processing method and device, equipment and a storage medium, and relates to the fields of artificial intelligence, natural language processing and big data. According to the specific implementation scheme, the following steps are included: obtaining a to-be-processed text set and a structured text set; constructing a first template representation corresponding to each reference structured text; furthermore, performing structured processing on each to-be-processed text to obtain a candidate structured text of each to-be-processed text, and constructing a second template representation corresponding to the candidate structured text; and matching the first template representation with the second template representation, determining the second template representation corresponding to a template matching result meeting a preset condition, and adding the candidate structured text corresponding to the determined second template representation to the structured text set. According to the technology disclosed by the invention, the processing efficiency of the natural language text and the extraction precision of the structured information are improved, and the labor cost is reduced.

Description

technical field [0001] The present disclosure relates to the technical field of data processing, in particular to the fields of artificial intelligence, natural language processing, and big data. Background technique [0002] The structured information extraction and processing of natural language text in related technologies, especially in the application scenario of constructing a product category system based on product information in the field of commercial promotion, is usually constructed by combining customer expression and manual labeling. The amount of data in the order of one hundred thousand to one million has the defects of high manual labeling cost and low processing efficiency. Contents of the invention [0003] The disclosure provides a text processing method, device, equipment and storage medium. [0004] According to an aspect of the present disclosure, a text processing method is provided, including: [0005] Obtain a text set to be processed and a stru...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06Q30/06G06F40/279G06F40/30
CPCG06Q30/0631G06F40/279G06F40/30Y02D10/00
Inventor 沈广策吴建伟熊健
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products