Big data acquisition method

An acquisition method and big data technology, applied in the field of data transactions, to facilitate maintenance and management, ensure stability and correctness, and simplify development work

Active Publication Date: 2017-05-10
贵州数据宝网络科技有限公司
View PDF5 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention provides a big data acquisition method to solve the problem that the program of the existing data trading platform can only achieve one-to-one data acquisition, and realize the purpose of one-to-many automatic data acquisition through a method flow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data acquisition method
  • Big data acquisition method
  • Big data acquisition method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0081] image 3 It is a flowchart of a data acquisition method in Embodiment 1 of the present invention. Such as image 3 As shown, the following steps S301-S317 are included:

[0082] S301: Receive a data acquisition request from a data requesting end through a network application program interface; wherein, the data acquisition request includes query parameters input by a user.

[0083] S302: Verify whether the user identity information of the data requesting end is passed; if passed, execute S303; otherwise, the data requesting end fails to call the network application program interface, and ends the process.

[0084] S303: Obtain the number of remaining data requests and the balance of the user corresponding to the identity information of the currently verified user.

[0085] In this embodiment, only paying users have the right to obtain data. After the user’s identity information is verified, it is also necessary to obtain the remaining number of data requests and the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a big data acquisition method used for solving the problem that only one-to-one data acquisition can be realized through a program of an existing data trading platform. According to the big data acquisition method, multiple data source configuration templates matched with a data acquisition request of a data request terminal with a data acquisition permission are acquired from a prearranged template library; one acquired data source template is selected, and whether a data source corresponding to the data source template meets the requirement of the data acquisition request or not is judged; if the data source meets the requirement, the data source is determined as a target data source; when data is acquired from the target data source and the acquired data is normal, the data returned by the target data source is converted into data in a predetermined format, and then the data in the predetermined format is returned to the data request terminal. Through the method, data can be acquired from different data supply terminals through automatic switching of the data source configuration templates, the purpose of acquiring the data from multiple data supply terminals through the data trading platform is achieved, and the software development workload on the data trading platform is reduced.

Description

technical field [0001] The invention relates to the technical field of data transactions, in particular to a method for acquiring big data. Background technique [0002] With the maturity and development of big data technology, big data is more and more widely used in business, and more and more service providers provide data. However, since each service provider has its own specific way of providing data, data demanders Generally, it is necessary to send a request to the service provider who provides the data through the data transaction platform. The current data transaction platform needs to write a program to realize the above data transaction process for each service provider, that is, the data transaction program of the existing data transaction platform can only Realize one-to-one data transactions. In this way, if the data transaction platform needs to connect to multiple service providers, it is necessary to develop multiple sets of programs. The development of prog...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/252
Inventor 汤寒林
Owner 贵州数据宝网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap