Streaming storage method and device oriented to application observation

An application-oriented, stream-based technology, applied in the storage field, can solve problems such as inability to perform unified access and effective aggregation

Pending Publication Date: 2022-08-09
中债金科信息技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It can be seen intuitively that two technology stacks are still used in this architecture, and the storage layer is still isolated from each other. This makes the three indicators of Metrics, Loggi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Streaming storage method and device oriented to application observation
  • Streaming storage method and device oriented to application observation
  • Streaming storage method and device oriented to application observation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0074] In order to make those skilled in the art better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only It is a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this application.

[0075] Various non-limiting embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0076] Exemplary method

[0077] see figure 1 , which is a schematic flowchart of an application observation-oriented streaming storage method provided by an embodiment of the presen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an application-oriented streaming storage method and device, which can obtain a to-be-stored data stream and store each stream included in the to-be-stored data stream into a memory, and the memory comprises a block cache, a variable memory table and an immutable memory table. The circulation sequence of the to-be-stored streams in the memory is block cache in sequence. A variable memory table and an immutable memory table, and the to-be-stored data stream comprises one or more of a log, an index or a call log; brushing data in the immutable memory table to a storage medium, and forming at least one Segment to be stored in a first storage area; and storing the address of the storage area corresponding to each segment in the at least one segment, the key Key corresponding to each segment and the segment identifier corresponding to each segment into a second storage area in the storage medium. According to the scheme, the problem of repeated writing can be avoided, and sequential data reading can be supported, so that the access performance of the storage medium is improved.

Description

technical field [0001] The present application relates to the field of storage, and in particular, to an application observation-oriented streaming storage method and device. Background technique [0002] In the IT system, Logs, Traces, and Metrics are three important indicators that can be observed by applications, which can basically meet the needs of various monitoring, alarming, analysis, and troubleshooting. However, in actual scenarios, they have their own applicable forms. [0003] In the traditional mode, in order to achieve unified analysis and display of data in these three dimensions, the general system dimension is Metrics, which is generally collected by Prometheus components and stored in time series database TSDB; for LOG or Trace, it is mainly based on message middleware (Kafka), Elasticsearch, etc. complete data storage after collection. It can be seen intuitively that two technology stacks are still used in this architecture, and the storage layers are sti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06G06F16/2455
CPCG06F3/064G06F3/0644G06F3/0656G06F3/0646G06F3/0685G06F16/24568
Inventor 朱浩毕晓晗唐华云王一平刘文林黄烁刘悦
Owner 中债金科信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap