Processing architecture for self-service data extracting and data extracting method thereof
A processing unit and data warehouse technology, applied in the field of big data, can solve problems such as low efficiency, wrong user data extraction process, large data volume, etc., to achieve the effect of facilitating accurate marketing
Active Publication Date: 2016-07-27
唯品会(广州)软件有限公司
View PDF5 Cites 8 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The embodiment of the present invention provides a processing framework for self-service data fetching and its data fetching method, which solves the need for targeted extraction when large-scale marketing needs to be done on the e-commerce platform side in the current e-commerce trade process User data is convenient for precise marketing. However, the existing data volume is too large, which can easily lead to errors in the process of extracting user data, resulting in inefficient technical problems
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0040] The embodiment of the present invention provides a processing framework for self-service data fetching and its data fetching method, which solves the need for targeted extraction when large-scale marketing is required on the e-commerce platform side during the current e-commerce trade process User data is convenient for precise marketing. However, the existing data volume is too large, which can easily lead to errors in the extraction process of user data, resulting in inefficient technical problems.
[0041] In order to make the purpose, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the following The described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the presen...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The embodiment of the invention discloses a processing architecture for self-service data extracting and a data extracting method thereof. The technical problems that in the trading process of current e-commerce, when an e-commerce platform side needs a large-scale marketing, the targeted user data extraction is needed to facilitate precision marketing, but the existing data volume is too large, mistakes are easily produced in the user data extracting process and the efficiency is low are solved. The processing architecture for the self-service data extracting, disclosed by the embodiment of the invention, comprises a Presto query engine, a data warehouse and a distributed file system. The data extracting method comprises the following steps: through the Presto query engine, obtaining a screening instruction, extracting SQL (Structured Query Language) statements meeting the screening instruction from the data warehouse, generating a result table corresponding to the SQL statements, storing in the distributed file system and exporting the data meeting the screening instruction.
Description
technical field [0001] The present invention relates to the technical field of big data, in particular to a processing framework for self-service data retrieval and a data retrieval method thereof. Background technique [0002] Big data is just a manifestation or characteristic of the Internet at the present stage. There is no need to myth it or maintain awe of it. Against the background of technological innovation represented by cloud computing, these data are difficult to collect and use. Big data is beginning to be easily utilized. Through continuous innovation in all walks of life, big data will gradually create more value for human beings. [0003] E-commerce is a commercial activity centered on commodity exchange by means of information network technology; it can also be understood as electronic transactions on the Internet (Internet), intranet (Intranet) and value-added network (VAN, ValueAddedNetwork) The activities of activities and related services are the electro...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F17/30G06Q30/02
Inventor 孙健陈泽军方晓东江文颖彭钰芹王成谢麟炯徐琴许丹杨炎张学伟
Owner 唯品会(广州)软件有限公司