Unlock instant, AI-driven research and patent intelligence for your innovation.

Data acquiring method and device

A data acquisition and data source technology, applied in the Internet field, can solve the problems of increasing the amount of back-end data source requests and longer response time, and achieve the effect of reducing data request time and improving processing speed

Active Publication Date: 2017-01-04
ALIBABA GRP HLDG LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, the amount of requests to the back-end data source is increased, and the response time becomes longer

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data acquiring method and device
  • Data acquiring method and device
  • Data acquiring method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] Embodiment 1, data acquisition method.

[0028] Wherein, the method of this embodiment is mainly implemented by computer equipment; the computer equipment here includes but not limited to PCs (such as desktop PCs), mobile terminals, and clouds composed of several PCs.

[0029] image 3 It is a flow chart of the data acquisition method in this embodiment.

[0030] image 3 Among them, the method of this embodiment mainly includes: step S100, step S110, step S120, step S130, step S140, and step S150.

[0031] S100. Create a transaction for the data acquisition request.

[0032] The data acquisition request is, for example, a user's request for searching with a keyword, and the data to be acquired is a search result of a page containing the keyword or related to the keyword.

[0033]A transaction is a unit of program execution that accesses and possibly updates various data items in a database. Transactions are usually caused by the execution of user programs written ...

Embodiment 2

[0057] Embodiment 2, a specific data acquisition method. The procedure of this method is as follows image 3 shown.

[0058] Figure 4 In this embodiment, when a data acquisition request is received, go to step S200.

[0059] S200. Start processing the data acquisition request, for example, select a thread from the thread pool, and use the thread to process the data acquisition request.

[0060] S210. Create a transaction for the data acquisition request. For example, a transaction identifier is set for the data acquisition request, and the transaction identifier is bound to the thread variable (threadlocal) corresponding to the thread that processes the current data acquisition request, so that the thread that processes the current data acquisition request clearly knows that a transaction has been completed. create. Allocate a context cache space for the transaction in the local cache space, and bind the allocated context cache space to the thread variable (threadlocal) ...

Embodiment 3

[0074] Embodiment 3, data acquisition device.

[0075] Such as Figure 4 As shown, a data acquisition device 3 includes: a creation unit 300, creating a transaction for a data acquisition request; a determination unit 310, within the transaction, determining a plurality of initial data requests for different data sources and using each data source Subsequent data requests for the response data returned by the multiple initial data requests; the generating unit 320 generates the multiple initial data requests; the requesting unit 330, according to the multiple initial data requests, concurrently within the transaction Request data from the corresponding data source in the form of: receiving cache unit 340, receiving and caching the response data returned by the data source; providing unit 350, using the cached response data to provide corresponding responses for subsequent data requests in the transaction data.

[0076] Optionally, the receiving cache unit 340 caches the resp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data acquiring method and a data acquiring device. The data acquiring method comprises the following steps: creating a transaction with respect to a data acquisition request in the transaction, determining a plurality of initial data requests with respect to different data sources as well as subsequent data requests of response data that is reversed back with respect to the plurality of initial data requests by means of the respective data sources; generating the plurality of initial data requests; requesting the corresponding data sources for data respectively in the form of concurrence in the transaction according to the plurality of initial data requests; and receiving and caching the response data that is reversed back by the data sources; and providing corresponding response data for the subsequent data requests in the transaction by means of the cached response data. According to the data acquiring method disclosed by the invention, the data acquisition speed of an application is increased.

Description

technical field [0001] The present invention relates to the technical field of the Internet, in particular to a data acquisition method and device. Background technique [0002] In the field of Internet technology, many application systems will involve the process of obtaining corresponding data from the data source, and often need to obtain data from the data source multiple times. For application systems with high modularity, it is required that the various modules of the application system have very low coupling, that is, the modules need to be isolated from each other, and the modification of one module will not affect other modules. In some application scenarios, the modules need to cooperate with each other. For example, different modules may need the same data, so different modules may request the same data from the same data source. [0003] For example, enterprise-level search front-end applications generally request back-end data engines through http services. Fo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/00G06F16/9574
Inventor 黄华刘义军张美德赵国涛
Owner ALIBABA GRP HLDG LTD