Data acquisition method, device and system and computer storage medium

A data acquisition and data technology, applied in the computer field, can solve the problems of inflexible expansion, violation of the open-closed principle, and long development cycle of data acquisition modules.

Pending Publication Date: 2021-05-18
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The design violates the principle of opening and closing, modification can easily lead to ripple effects, the code reuse rate is low, and the new data acquisition module has a long development cycle, low efficiency, and cannot be flexibly expanded

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data acquisition method, device and system and computer storage medium
  • Data acquisition method, device and system and computer storage medium
  • Data acquisition method, device and system and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] An embodiment of the present invention provides a data acquisition method, which can be applied to systems such as recommendation systems and search systems that include data acquisition processes.

[0056] First, related nouns involved in the embodiments of the present invention are introduced.

[0057] Index, is a database term. In a relational database, an index is a storage structure that sorts the values ​​of one or more columns in a database table. The function of the index is equivalent to the table of contents of the book, and the required content can be quickly found according to the page number in the table of contents. Indexes are usually divided into forward and reverse indexes. In practical application, inverted index is more called inverted index.

[0058] Inverted index, inverted index comes from the need to find records based on the value of the attribute in practical applications. Each item in the inverted index table includes an attribute value and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data acquisition method and device. The device comprises at least one data acquisition module; different data acquisition modules correspond to different data acquisition algorithms. The device further comprises a determination module used for determining at least one target data acquisition module corresponding to a target service type in the at least two service types; the target data acquisition module corresponds to at least one target user feature identifier and at least one target index identifier; the user feature management module is used for acquiring target first user features corresponding to the at least one target user feature identifier; and the index management module is used for accessing indexes corresponding to the at least one target index identifier according to the target first user feature to obtain a first data set. According to the embodiment of the invention, a plurality of processing logics in a traditional data acquisition architecture are decoupled, the design accords with an opening and closing principle, the code reuse rate is high, and the expansion is easy.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data acquisition method, device, system and computer storage medium. Background technique [0002] With the development of information technology, people have gradually entered the era of information overload. In order to solve the problem that users want to find the information they are interested in from a large amount of information, and information producers want the information they produce to get attention, the recommendation system came into being. The recommendation system needs to explore the user's behavior and find out the user's individual needs, so as to accurately recommend the information that the user needs to the user. [0003] Recommender systems involve two key issues, recall and ranking. Among them, recall refers to triggering as many correct results (that is, recalled data) as possible from the original data (generally understood as a full set o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/951G06F16/9535G06F16/9538
CPCG06F16/951G06F16/9535G06F16/9538
Inventor 李兴飞魏晓宇钱磊周德懋
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products