Knowledge point crawling method and device, storage medium and terminal

Abstract

The invention discloses a knowledge point crawling method and device, a storage medium and a terminal. The knowledge point at least comprises a standard question and a standard answer, and the methodcomprises the following steps: determining target crawling content; determining a corresponding crawler condition according to to-be-crawled knowledge classification, the crawler condition being at least used for indicating a first position and a second position, the first position being a position of the standard question in the target crawling content, and the second position being a position ofthe standard answer in the target crawling content; and traversing the target crawling content according to the crawler condition so as to extract information at least at a first position and a second position of the target crawling content and generate the knowledge point. Through the scheme provided by the invention, the knowledge points can be automatically crawled, the data crawling precisionis high, and the problems that a target user with a huge number of knowledge points cannot construct the knowledge points or the knowledge point construction speed is low and the manual workload is huge are favorably solved.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a knowledge point crawling method and device, a storage medium, and a terminal. Background technique [0002] With the widespread application of intelligent customer service robots, more and more users have begun to pay attention to the construction of knowledge points. [0003] In the prior art, when constructing knowledge points, the common practice is to manually prepare a fixed document template, and then fill in the standard questions, standard answers, answer dimensions and other information of knowledge points in the template. Although this processing method can accurately fill in the data, the manual workload is huge, and the limit for one person to organize per day does not exceed 200 pieces of knowledge. [0004] For target users with less knowledge points, such construction speed and workload are still acceptable. However, for target users with a larg...

AI Technical Summary

Problems solved by technology

However, for target users with a large number of knowledge points, the existing processing method of manually extracting knowledge points is powerless, resulting in the target users with a large number of knowledge points being unable to build knowledge points, or the call construction speed is extremely slow, and the manual workload is huge

Images