Loose-coupling and high-expansibility burying-point-free data acquisition method based on Android
A collection method and expansibility technology, applied in the direction of database index, relational database, database model, etc., can solve the problem of not being provided, and achieve the effect of reducing server load, reducing development workload, and collecting data more efficiently
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0030] In step a), the Android original log is filtered by configuring the corresponding level and TAG, and the filtered Android original log is stored in memory. The JSON structured data in step a) includes terminal ID, business name, event name, occurrence time and custom information. In step a), the JSON structured data is uploaded to the head-end server through the APK. Spit data to the Kafka topic through the APK. The advantage of Kafka is high throughput and low latency. Kafka can process hundreds of thousands of messages per second, and its latency is as low as a few milliseconds. It is also scalable. Kafka cluster supports hot Extended, with persistence and reliability, messages are persisted to local disks, and data backup is supported to prevent data loss. Allow the cluster to fail to find that node (if the number of replicas is n, allow n-1 nodes to fail), and support thousands of clients to read and write at the same time.
Embodiment 2
[0032] The data aggregation index module in step c) is composed of logstash and Elasticsearch. Logstash receives Kafka-type JSON structured data and mysql-type JSON structured data and transfers them to Elasticsearch. Elasticsearch treats Kafka-type JSON structured data and mysql-type JSON Structured data is indexed and aggregated so that the corresponding data is indexed according to each field.
Embodiment 3
[0034] In step d), the data aggregation index module is composed of klbana. Through the Elasticsearch index, simple rule calculations can be performed on the data, corresponding data tables and pie charts can be produced, and configuration import and export functions are supported.
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More 

