Data acquisition method and device, storage medium and electronic device

A collection method and data technology, applied in the computer field, can solve problems such as code logic problems, business code intrusion, and no solution found, and achieve the effect of improving effectiveness, avoiding zero code intrusion, and reducing invalid data.

Active Publication Date: 2021-10-26
深圳市信润富联数字科技有限公司
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Regarding the collection scheme in the related technology, there are the following problems: by adding the code method of data collection in the business code, this will cause code intrusion to the business code, and the logic of the collected code has problems, which may affect the actual business operation, business The code and the code for collecting data are closely linked, and the code is highly coupled, which is not conducive to business expansion
[0004] For the above-mentioned problems existing in related technologies, no effective solution has been found yet

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data acquisition method and device, storage medium and electronic device
  • Data acquisition method and device, storage medium and electronic device
  • Data acquisition method and device, storage medium and electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] The method embodiment provided in Embodiment 1 of the present application may be executed in a server, a computer, an industrial computer, or a similar computing device. Take running on a computer as an example, figure 1 It is a block diagram of the hardware structure of a computer according to the embodiment of the present invention. Such as figure 1 As shown, the computer may include one or more ( figure 1 Only one is shown in ) processor 102 (processor 102 may include but not limited to processing devices such as microprocessor MCU or programmable logic device FPGA) and memory 104 for storing data. Optionally, the above computer can also A transmission device 106 for communication functions and an input and output device 108 are included. Those of ordinary skill in the art can understand that, figure 1 The shown structure is only for illustration, and it does not limit the structure of the above-mentioned computer. For example, a computer may also include figur...

Embodiment 2

[0101] In this embodiment, a data collection device is also provided, which is used to implement the above embodiments and preferred implementation modes, and what has been explained will not be repeated. As used below, the term "module" may be a combination of software and / or hardware that realizes a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.

[0102] Figure 5 is a structural block diagram of a data acquisition device according to an embodiment of the present invention, such as Figure 5 As shown, the device includes: a monitoring module 50, a transmission module 52, and a sending module 54, wherein,

[0103] The monitoring module 50 is used to monitor the incremental data generated by the log file of the client;

[0104] A transmission module 52, configured to transmit the incremental dat...

Embodiment 3

[0114] An embodiment of the present invention also provides a storage medium, in which a computer program is stored, wherein the computer program is set to execute the steps in any one of the above method embodiments when running.

[0115] Optionally, in this embodiment, the above-mentioned storage medium may be configured to store a computer program for performing the following steps:

[0116] S1, monitor the incremental data generated by the log file of the client;

[0117] S2, using the sink node to transmit the incremental data to the subscription message system;

[0118] S3. Receive a data pull request from the database, and send target data matching a target topic to the database from the message subscription system, where the data pull request carries an identification field of the target topic.

[0119] Optionally, in this embodiment, the above-mentioned storage medium may include but not limited to: U disk, read-only memory (Read-Only Memory, ROM for short), random a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data collection method and device, a storage medium and an electronic device. The method comprises the steps of monitoring the incremental data generated by a log file of a client; transmitting the incremental data to a subscription message system by adopting an aggregation node sink; receiving a data pulling request of a database, and issuing the target data matched with a target topic to the database from the subscription message system, wherein the data pulling request carries an identification field of the target topic. Through the present invention, the technical problem of low data acquisition rate in the related technologies is solved, and meanwhile, the redundancy of business service codes is reduced.

Description

technical field [0001] The present invention relates to the field of computers, in particular to a data collection method and device, a storage medium, and electronic equipment. Background technique [0002] In the related technology, in the current market data collection scheme, the common way is to directly add the logic code of data collection in the system code, after executing the relevant business, continue to execute the code logic of data collection, and save the data to be collected into the database. According to the current data collection methods, it can meet the requirements, can help solve the problem of data collection, and can solve practical problems. [0003] Regarding the collection scheme in the related technology, there are the following problems: by adding the code method of data collection in the business code, this will cause code intrusion to the business code, and the logic of the collected code has problems, which may affect the actual business ope...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/18G06F16/215G06F16/22G06F21/55G06F11/34
CPCG06F16/1815G06F16/215G06F21/552G06F16/22G06F11/3476
Inventor 熊皓成建洪罗启铭杜冬冬陈功覃江威吴育校刘小双廖宏军冯建设
Owner 深圳市信润富联数字科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap