Unlock instant, AI-driven research and patent intelligence for your innovation.

A storage verification method and system for text data

A text data and text technology, which is applied in the text data storage verification system and the field of text data storage verification, can solve the problems such as the inability to apply big data storage verification, increase practicability, realize storage loss verification, The effect of reducing performance consumption

Active Publication Date: 2019-11-26
ALIBABA GRP HLDG LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, although some systems provide a message verification mechanism to verify whether the storage operation is successful, this detection mechanism is only a partial detection mechanism and cannot be applied to the storage verification of big data in the cloud era.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A storage verification method and system for text data
  • A storage verification method and system for text data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0075] In order to make the above objects, features and advantages of the present application more obvious and comprehensible, the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0076] The cloud platform can provide users with big data processing and storage capabilities. Many services of users on the cloud platform, such as the pv (view volume) log of a certain website, need to be written to the network side device of the cloud platform.

[0077] Assume that there are 1,000 front-end devices on the website, and each device generates access.log logs in real time. If the access.log logs of these 1,000 machines are written to the network-side devices of the cloud platform in real time, the business’s data quality requirements have exceeded Many businesses are not allowed to lose any data. At this time, a mechanism is needed to ensure the integrity of the data.

[0078] When storin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Disclosed are a storage checking method and system for text data. The method comprises: one or more application devices packaging one or more pieces of generated text data into one or more text data packets (101), the text data packets comprising attribute information; one or more transmission devices storing one or more text data packets in one or more pre-set storage devices (102); when storage succeeds, recording the attribute information in a pre-set statistical table (103); and when a checking device receives a storage checking request, performing storage checking according to the statistical table (104). In the method, by packaging text data, the text data on which statistics need to be made are reduced by many times, so that a statistical quantity value is greatly reduced, thereby greatly reducing the checking processing capacity, reducing the performance consumption of a system, greatly improving the practicability during big data processing, and realizing the overall storage checking for big data in cloud.

Description

technical field [0001] The present application relates to the technical field of computer processing, in particular to a text data storage verification method and a text data storage verification system. Background technique [0002] With the advent of the cloud era, more and more platforms generate big data from sources such as social networks, e-commerce, and access records, that is, very large amounts of data, for example, between 100T and 100P a day, or even larger The amount of data, and the total number of machines producing these data is between 10,000 and 1 million, or even more. [0003] Data generated by many services under the cloud, such as pv (view volume) logs generated by websites, generally need to be stored in real time to verify the integrity of the data and ensure the accuracy of data mining and other processing. [0004] At present, although some systems provide a message verification mechanism to verify whether the storage operation is successful, this ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/08
CPCG06F11/08
Inventor 李强
Owner ALIBABA GRP HLDG LTD