Unlock instant, AI-driven research and patent intelligence for your innovation.

Log retrieval system, method and device, electronic equipment and storage medium

A retrieval system and log technology, applied in the computer field, can solve problems that affect the efficiency of log retrieval and cannot meet the service requirements of big data business systems

Pending Publication Date: 2020-10-23
BEIJING DIDI INFINITY TECH & DEV
View PDF3 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, because the log solution using the ELK architecture needs to collect all log data generated by the big data business system to ElasticSearch before log retrieval, a large amount of log data storage will not only bring great challenges to disk resources, but also It will affect the efficiency of log retrieval, so it cannot meet the service requirements of the current big data business system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log retrieval system, method and device, electronic equipment and storage medium
  • Log retrieval system, method and device, electronic equipment and storage medium
  • Log retrieval system, method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0081] Such as figure 1 As shown, it is a schematic structural diagram of the log retrieval system provided by the embodiment of the present application. The log retrieval system includes: a user management module 101, a log index storage module 102 and a plurality of log retrieval modules 103, and each of the log retrieval modules 103 is distributed deployed on the corresponding server;

[0082] The user management module 101 is configured to receive a log retrieval request sent by a client, and transmit the log retrieval request to the log index storage module 102; After the log retrieval request matches the server identification and the log timestamp, the log timestamp is transmitted to the log retrieval module 103 corresponding to the server identification, and receives the log record returned by the log retrieval module 103;

[0083] The log index storage module 102 is configured to receive the log retrieval request, find a server ID and a log timestamp matching the log ...

Embodiment 2

[0110] Based on the same inventive concept, the embodiment of the present application also provides a log retrieval method and device corresponding to the log retrieval system. Since the principle of solving the problem of the method and device in the embodiment of the present application is similar to the above-mentioned log retrieval system in the embodiment of the present application, Therefore, the implementation of the method and device can refer to the implementation of the system, and the repetition will not be repeated.

[0111] Such as Figure 4 As shown, it is a flow chart of a log retrieval method provided by the embodiment of the present application. The method is applied to the user management module in the log retrieval system, and the log retrieval system includes the user management module and the log index storage module. and a plurality of log retrieval modules, each of the log retrieval modules is deployed in a distributed manner on a corresponding server, t...

Embodiment 3

[0157] Such as Figure 8As shown, it is a schematic structural diagram of an electronic device 800 provided in the embodiment of the present application. The electronic device 800 includes: a processor 801, a storage medium 802 and a bus 803. The storage medium 802 stores execution instructions. When the electronic device 800 is running , the processor communicates with the storage medium 802 through a bus, and when the machine-readable instructions are executed by the processor 801, the following processing is performed:

[0158] Receive the log retrieval request sent by the client;

[0159] The log retrieval request is transmitted to the log index storage module, and the server identification and log timestamp matching the log retrieval request are searched through the log index storage module;

[0160] The log time stamp is transmitted to a log retrieval module corresponding to the server identifier, and the log retrieval module searches for a log record matching the log t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a log retrieval system, method and device, electronic equipment and a storage medium. The system comprises: a user management module that receives a log retrieval request sent by a user side, and sends a log retrieval request to a log index storage module; the log index storage module that is used for searching a server identifier and a log timestamp matched with the log retrieval request, and returning the searched server identifier and the log timestamp to the user management module; the user management module that is used for sending the log timestamp to the log retrieval module corresponding to the server identifier, and receiving the log record matched with the log timestamp and found by the log retrieval module, so that the efficiency of log retrieval is improved while disk storage resources are saved.

Description

technical field [0001] The present application relates to the field of computer technology, in particular, to a log retrieval system, method, device, electronic equipment and storage medium. Background technique [0002] With the rapid development of cloud computing, mobile Internet, and Internet of Things, the era of big data has come. Collecting, analyzing, and retrieving logs of big data business systems (such as online car-hailing service systems) are the basis for analyzing problems in the system. [0003] The commonly used log solutions in related technologies mostly adopt the ELK (Elasticsearch-Logstash-Kibana) architecture. The ELK architecture refers to the system built by Elasticsearch, Logstash and Kibana. Among them, ElasticSearch, as an open source distributed search engine, can be used for For log retrieval, Logstash can be used for log collection, filtering, etc., and Kibana can be used for log display. [0004] However, because the log solution using the EL...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/18G06F16/14
CPCG06F16/1815G06F16/148
Inventor 杨晨晨奚媛
Owner BEIJING DIDI INFINITY TECH & DEV