Unlock instant, AI-driven research and patent intelligence for your innovation.

A data acquisition method, device, electronic equipment and storage medium

A data collection and data determination technology, applied in the field of data processing, can solve the problems of slow development speed and low data collection efficiency, and achieve the effect of improving development speed and data collection efficiency

Active Publication Date: 2021-11-26
BEIJING KINGSOFT DIGITAL ENTERTAINMENT CO LTD +2
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Therefore, when collecting data, programmers are required to write a set of corresponding collection codes according to the crawler process for each website that needs data collection, which will lead to slow development speed and low data collection efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data acquisition method, device, electronic equipment and storage medium
  • A data acquisition method, device, electronic equipment and storage medium
  • A data acquisition method, device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0115] As an implementation manner of the embodiment of the present invention, the above method may also include:

[0116] Build a knowledge graph based on the collected data.

[0117] After the data collected by the above data collection method, the electronic device can build a knowledge map based on the collected data. Wherein, the knowledge map may be a knowledge map of various fields, for example, it may be a medical knowledge map, a legal knowledge map, a video development knowledge map, and the like.

[0118] Among them, the specific method of constructing the knowledge graph based on the collected data can adopt any method in the field of knowledge graph construction, as long as the corresponding knowledge graph can be constructed, and no specific limitation or description is made here.

[0119] It can be seen that, in this embodiment, after the electronic device collects the data obtained by using the above data collection method, the electronic device can construct ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An embodiment of the present invention provides a data collection method, device, electronic equipment, and storage medium. The method includes: determining the target website for data collection; Rules; complete data collection based on pre-set functional components and target collection rules. Since there is no need to manually write a set of corresponding collection codes for each website, only the functional components in the data collection process need to be pre-set, and the collection rules formulated for different websites can collect data from each website, which greatly improves the development speed and data collection efficiency.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data collection method, device, electronic equipment and storage medium. Background technique [0002] In the current Internet era, data collection is required for many usage scenarios. For example, before building a knowledge map, a large amount of data needs to be collected from various websites; evaluating the usage status of applications requires collecting a large amount of user behavior data. [0003] Due to the differences in the structure and protocol of each website, when collecting data, programmers are required to write a set of corresponding collection codes for each website that needs to collect data, and the collection codes cannot be used in common. For example, when collecting data required for knowledge graph construction, crawler technology is usually used to crawl data from various websites. A crawler usually mainly includes two parts: reques...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/951G06F8/41
Inventor 李长亮梁传坚汪美玲唐剑波
Owner BEIJING KINGSOFT DIGITAL ENTERTAINMENT CO LTD