Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data analysis method and device

A data analysis and data technology, applied in the field of data analysis, can solve the problems of occupying storage space, reducing performance, data inconsistency, etc., and achieve the effect of reducing system computing resource occupation, increasing access speed, and improving overall machine performance

Active Publication Date: 2020-05-19
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF9 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The I / O process of the storage system is complex, and a large number of exception handling scenarios intersect with each other. At the same time, large loads and multi-threading are key scenarios that cause data inconsistency. The positioning cost of data inconsistency is huge, not only occupying storage computing resources Performance, the log method will also occupy a large amount of storage space, and a large number of log reads and writes will slow down the system I / O processing performance
It is more complicated to locate data inconsistencies at the customer site, and the most commonly used method is to rely on logs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data analysis method and device
  • Data analysis method and device
  • Data analysis method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0046] First of all, when the consistency check module is initialized, a certain amount of memory space will be allocated in the memory for saving the consistency check information. Note that the amount of memory space allocated here is proportional to the size of the consistency check data.

[0047] Secondly, the consistency verification module provides a grainSize granular data consistency verification information recording interface based on the thin volume of the storage system. When the data is placed on the disk, it will record the consistency check information of the data, first calculate the fingerprint value of the data, obtain the PBA of the data after the disk is placed, record the time stamp and other information, and maintain this information through the hash list.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data analysis method and device. The method comprises the following steps: allocating a memory space with a preset memory space in a memory; in response to writing of the datainto the disk, storing verification information of the data in the disk and sending the verification information to the memory space; in response to a received instruction of operating the data, reading verification information stored in the disk; comparing the verification information read from the disk with the verification information stored in the memory space; and in response to the inconsistency of the comparison result, storing the memory storage information in a disk, and analyzing the memory storage information to analyze the reason why the data is inconsistent. By using the method provided by the invention, the reason of data inconsistency can be quickly and effectively analyzed, the occupation of system computing resources is reduced, the efficiency is improved, the access speed of consistency information is improved, and the performance of the whole machine is improved.

Description

technical field [0001] This field relates to the field of computers, and more particularly to a method and device for data analysis. Background technique [0002] The storage system is the container that carries the user's production data, and at the same time it is the fusion of efficient data utilization and disaster recovery backup. In today's rapid development of data, it is the most basic and most important of the storage system to ensure the integrity and safety of the user's data. a bottom line. The I / O process of the storage system is complex, and a large number of exception handling scenarios intersect with each other. At the same time, large loads and multi-threading are key scenarios that cause data inconsistency. The positioning cost of data inconsistency is huge, not only occupying storage computing resources Performance, the log method will also occupy a large amount of storage space, and a large number of log reads and writes will slow down the system I / O pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0614G06F3/0611
Inventor 赵书龙
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products