A method and device for data analysis

A data analysis and data technology, applied in the field of data analysis, can solve the problems of occupying storage space, reducing performance, data inconsistency, etc., and achieve the effect of reducing system computing resource occupation, increasing access speed, and improving overall machine performance

Active Publication Date: 2021-12-10
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The I / O process of the storage system is complex, and a large number of exception handling scenarios intersect with each other. At the same time, large loads and multi-threading are key scenarios that cause data inconsistency. The positioning cost of data inconsistency is huge, not only occupying storage computing resources Performance, the log method will also occupy a large amount of storage space, and a large number of log reads and writes will slow down the system I / O processing performance
It is more complicated to locate data inconsistencies at the customer site, and the most commonly used method is to rely on logs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for data analysis
  • A method and device for data analysis

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0046] First of all, when the consistency check module is initialized, a certain amount of memory space will be allocated in the memory for saving the consistency check information. Note that the amount of memory space allocated here is proportional to the size of the consistency check data.

[0047] Secondly, the consistency verification module provides a grainSize granular data consistency verification information recording interface based on the thin volume of the storage system. When the data is placed on the disk, it will record the consistency check information of the data, first calculate the fingerprint value of the data, obtain the PBA of the data after the disk is placed, record the time stamp and other information, and maintain this information through the hash list.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a method and device for data analysis. The method includes the following steps: allocating a memory space with a preset storage amount in the memory; to the memory space; in response to receiving an instruction on the operation of the data, read the verification information stored in the disk; compare the verification information read from the disk with the verification information stored in the memory space; respond to the comparison If the results are inconsistent, the memory storage information is stored in the disk, and the memory storage information is parsed to analyze the cause of the data inconsistency. By using the method of the invention, the cause of data inconsistency can be quickly and effectively analyzed, the occupancy of system computing resources is reduced, the efficiency is improved, the access speed of consistent information is improved, and the performance of the whole machine is improved.

Description

technical field [0001] This field relates to the field of computers, and more particularly to a method and device for data analysis. Background technique [0002] The storage system is the container that carries the user's production data, and at the same time it is the fusion of efficient data utilization and disaster recovery backup. In today's rapid development of data, it is the most basic and most important of the storage system to ensure the integrity and safety of the user's data. a bottom line. The I / O process of the storage system is complex, and a large number of exception handling scenarios intersect with each other. At the same time, large loads and multi-threading are key scenarios that cause data inconsistency. The positioning cost of data inconsistency is huge, not only occupying storage computing resources Performance, the log method will also occupy a large amount of storage space, and a large number of log reads and writes will slow down the system I / O pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0614G06F3/0611
Inventor 赵书龙
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products