Data processing method and device and computer readable storage medium

A data processing and data technology, applied in the field of data processing, can solve problems involving full metadata modification and submission, and low metadata update efficiency

Pending Publication Date: 2019-08-16
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since every update of metadata will involve the modification and submission of the full amount of metadata, the update efficiency of metadata is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device and computer readable storage medium
  • Data processing method and device and computer readable storage medium
  • Data processing method and device and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0077] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0078] See figure 1 , figure 1 It is a schematic diagram of a data processing scenario provided by an embodiment of the present invention. like figure 1 As shown, the server 100 includes thread s3 and public memory. Wherein, the thread s3 is a metadata management thread, and the thread s3 may be provided by zk (zookeeper, a distributed application coordination service), and the thread s3 includes a business thread s1 and a submission thread s2. Wherein, the ser...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data processing method and device and a computer readable storage medium, and the method comprises the steps: obtaining a modification request for full-quantity metadata, and determining target data and to-be-modified data in the full-quantity metadata according to the modification request of the full-quantity metadata; wherein the target data is data obtained after the to-be-modified data is modified; generating first modification mapping information according to the to-be-modified data and the target data; submitting the first modification mappinginformation to a metadata management thread, and if submitting is successful, modifying the full-amount metadata based on the first modification mapping information to obtain modified full-amount metadata; wherein the modified total metadata comprises target data. By adopting the embodiment of the invention, the modification and submission efficiency of the metadata can be improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data processing method, device and computer-readable storage medium. Background technique [0002] In a distributed system, metadata needs to be modified frequently, and the modified metadata needs to be resubmitted to the system. Therefore, higher requirements are placed on the efficiency of metadata modification and submission. [0003] In the prior art, it is mainly to modify the full amount of metadata, and then submit the modified full amount of metadata to achieve the purpose of updating the full amount of metadata. However, since every update of metadata involves modification and submission of the full amount of metadata, the update efficiency of metadata is low. Contents of the invention [0004] Embodiments of the present invention provide a data processing method, device, and computer-readable storage medium, which improve the efficiency of updating...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/14G06F9/54
CPCG06F9/546G06F11/1464G06F2209/548
Inventor 刘永城黄福堂史佳婧韩明瑞
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products