Data acquisition method and device

A technology of data collection and communication data, which is applied in the field of information processing, can solve problems such as data collection failure, and achieve the effect of improving the success rate of data collection

Active Publication Date: 2019-09-20
BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present disclosure provides a data acquisition method, device, electronic equipment, and computer-readable storage medium, so as to at least solve the problem of data acquisition failure in related technologies

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data acquisition method and device
  • Data acquisition method and device
  • Data acquisition method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0069] figure 1 It is a flowchart of a data collection method provided in Embodiment 1 of the present disclosure. The execution subject of the data collection method provided in this embodiment may be the data collection device provided in the embodiment of the present disclosure, and the device can be integrated into a mobile terminal device ( For example, in smart phones, tablet computers, etc.), notebooks or fixed terminals (desktop computers), the data acquisition device can be implemented by hardware or software. Such as figure 1 shown, including the following steps:

[0070] In step S11, the communication data between the communication module and the network application is acquired.

[0071] Wherein, the communication module may be a cluster of communication devices, such as a cluster of real Android machines or a cluster of Android emulators.

[0072] Wherein, the communication data may be network request data and / or network response data between the communication mo...

Embodiment 2

[0113] figure 2 It is a flow chart of a data collection method provided by Embodiment 2 of the present disclosure. This embodiment is a specific embodiment for describing the present disclosure in detail. The execution subject of this embodiment includes an interceptor, a communication module and a manager. Such as figure 2 shown, including the following steps:

[0114] In step S21, the interceptor obtains the communication instruction from the manager through a pull method or a push method.

[0115] In step S22, the communication module communicates with the network application.

[0116] In step S23, the interceptor acquires the communication data between the communication module and the network application program, and writes the communication data into the distributed message queue.

[0117] In step S24, the interceptor reads the communication data from the distributed message queue.

[0118] In step S25, the interceptor converts the communication data into a unified ...

Embodiment 3

[0124] image 3It is a block diagram of a data acquisition device 30 provided in Embodiment 3 of the present disclosure. The device can be integrated into a mobile terminal device (for example, a smart phone, a tablet computer, etc.), a notebook or a fixed terminal (desktop computer), and the data collection device can be implemented by hardware or software. refer to image 3 , the device 30 includes a communication data acquisition module 31, a template acquisition module 32 and a target data acquisition module 33; wherein,

[0125] Communication data obtaining module 31 is used for obtaining the communication data of communication module and network application program;

[0126] The template acquisition module 32 is used to extract a template for target data matching the communication interface of the communication data;

[0127] The target data acquisition module 33 is configured to acquire target data from the communication data according to the target data extraction t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data acquisition method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: obtaining the communication data of a communication module and a network application program; obtaining a target data extraction template matched with the communication interface of the communication data; and obtaining target data from the communication data according to the target data extraction template. The target data extraction template matched with the communication interface of the communication data is acquired, the target data is acquired from the communication data according to the target data extraction template, and the data acquisition method is not affected by API request parameters, has universality and can improve the data acquisition success rate.

Description

technical field [0001] The present disclosure relates to the technical field of information processing, and in particular to a data collection method, device, electronic equipment, and computer-readable storage medium. Background technique [0002] In the prior art, the general method of collecting data is: by obtaining the API (Application Programming Interface, Application Programming Interface) interface provided by the network application program, sending HTTP (HyperText Transfer Protocol, hypertext transfer protocol) according to the relevant request parameters of the API interface ) / HTTPS (Hyper TextTransfer Protocol over Secure Socket Layer or Hypertext Transfer ProtocolSecure, Hypertext Transfer Security Protocol) request, with the response result of the web application, the target business data is obtained by parsing the response result. [0003] However, the above method mainly has the following problems: the request parameters of the API interfaces of different ne...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/54
CPCG06F9/547
Inventor 彭丹
Owner BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap