Log data screening method and device
A data screening and log technology, applied in the field of communication, can solve the problem of low user screening efficiency and achieve the effect of improving efficiency
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
no. 1 example
[0024] This embodiment provides a log data screening method, figure 1 is the flowchart of the method, such as figure 1 As shown, the method includes the following processing:
[0025] Step 101: Receive selection instructions of screening parameters and screening rules;
[0026] In this step 101, the selection instruction may specifically be issued by the user to select a specified screening rule, and the screening parameter may be input by the user through an input device, and the parameter may be a specific value, text information or a character string, wherein, Filtering rules can specifically include the following:
[0027] Logical operations for filtering log data with a logical relationship and / or filtering log data with a logical relationship and / or filtering log data with a non-logical relationship. The logical operations involved here are AND, OR, and non-logical operations, such as , specify to filter a certain log data can only be abc or bca can not be aaa.
[00...
no. 2 example
[0039] In this embodiment, taking the off-line statistical analysis platform hadoop as an example, the process of filtering log data using the log data filtering method provided in the first embodiment above is described.
[0040] First, combined with the image 3 A brief description of the architecture of the system involved in this embodiment:
[0041]Wherein, the data layer includes an application program (APP) and a log server, the transport layer includes a log aggregation system and a distributed file system, and the computing layer includes hadoop and hbase. The screening process involved in this embodiment is implemented in the computing layer.
[0042] Such as Figure 4 As shown, the log data screening process involved in this embodiment includes:
[0043] Step 401: Initialize the screening rules: when the screening calculation starts, first read the pre-stored screening rules from the database;
[0044] Step 402: input log data;
[0045] Step 403: the filter uses...
no. 3 example
[0048] This embodiment provides a log data screening device, such as Figure 5 As shown, the device 50 includes the following components:
[0049] The first receiving module 51 is configured to receive selection instructions of screening parameters and screening rules;
[0050] The second receiving module 52 is configured to receive log data;
[0051] The filtering module 53 is configured to use a filtering rule corresponding to the selection instruction to filter the received log data according to the filtering parameters.
[0052] Further, the above-mentioned device 50 may further include: a display module, configured to display a preset filtering rule and / or display an identifier of the preset filtering rule before receiving the filtering parameters.
[0053] Wherein, the above-mentioned screening module 53 specifically includes:
[0054] The first filtering unit is configured to filter the log data according to the selected filtering rule and parameters corresponding to...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More