Data collection method and system

A data acquisition system and data acquisition technology, applied in the field of data processing, can solve the problems of large time cost, money cost, consumption, etc., and achieve the effect of shortening the data acquisition cycle

Pending Publication Date: 2020-01-14
BANK OF CHINA
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a data acquisition method and system, which can solve the problem in the prior art that data acquisition consumes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data collection method and system
  • Data collection method and system
  • Data collection method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0035] It can be seen from the background art that the existing data collection method is to develop corresponding data interfaces for target data of different data types, and collect the target data through the data interfaces. However, it generally takes at least 3 months from the proposal of collection requirements to development, testing, and production. The current app needs to collect many types of data, a wide range, high difficulty in burying points, a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data collection method and system. The method comprises the following steps: acquiring behavior data of target software, calling a J2SE service, writing the behavior data into a Kafka system according to a preset configuration table comprising a corresponding relationship among a data type of the behavior data, a Topic class and a data storage path, extracting the behavior data from the Kafka system through streaming calculation, and storing the behavior data. According to the invention, behavior data of a new data type is collected; correspondingly modifying the datatype of the behavior data in the configuration preset configuration table into the data type to which the behavior data of the target software belongs, the behavior data of the target software can becollected without developing a data interface and modifying a program code, so that the data collection period is greatly shortened. The behavior data of the target software can be collected according to the data type of the target software and the corresponding relationship between the Topic class and the data storage path.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data collection method and system. Background technique [0002] Using big data to guide operation strategies and improve user experience, and at the same time semi-automatic or automatic analysis of data to quickly locate problems in the monitored system is currently the main means of traffic refinement operation. Among them, for mobile phone software (Application, APP), the big data for subsequent analysis is generally obtained by collecting data from the APP. [0003] In the existing data collection method, corresponding data interfaces are developed for target data of different data types, and the target data is collected through the data interfaces. However, it generally takes at least 3 months from the proposal of collection requirements to development, testing, and production. The current app needs to collect many types of data, a wide range, high difficulty in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/25G06F16/28
CPCG06F16/2282G06F16/258G06F16/284
Inventor 钟华剑康伟王鹏晴陈世强李晓东徐雅光刘利刚刘宪伟张广斌刘子成
Owner BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap