Method, apparatus and system for processing data

A technology for processing data and data, applied in the computer field, can solve the problem that the data processing capability of a single machine cannot meet the processing requirements, and achieve the effect of improving data processing performance

Active Publication Date: 2019-03-22
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF6 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But the ensuing problem is that the data processing capability of a single machine cannot meet the processing requirements of today's massive da

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, apparatus and system for processing data
  • Method, apparatus and system for processing data
  • Method, apparatus and system for processing data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, rather than to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

[0024] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.

[0025] figure 1 is an exemplary system architecture 100 to which an embodiment of the present application may be applied.

[0026] Such as figure 1 As shown, the system architecture 100 can include a first end 101, a second end 102, a third end 103, HDFS (distributed file ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method, apparatus and system for processing data are disclosed in embodiment of that present application. One embodiment of the method includes determining a slice number of key-value pair data based on a key in response to receiving key-value pair data to be processed. A target slice numb is determined from a preset slice tree accord to that slice number, wherein the slice tree is a binary treestructure, the node represents at least one slice number, and the node corresponds to a storage directory. The key-value pair data is pushed to the second end corresponding to the target slice numberfor the second end to write the key-value pair data to the storage directory corresponding to the second end. This embodiment improves data processing efficiency.

Description

technical field [0001] The embodiments of the present application relate to the field of computer technologies, and in particular to systems, methods, and devices for processing data. Background technique [0002] Today's Internet technology continues to develop, data has exploded, and the scale of data on the network has increased dramatically. There are huge business opportunities in chaotic data, and value can be extracted from massive data. But the ensuing problem is that the data processing capability of a single machine cannot meet the processing requirements of today's massive data applications, and distributed computing based on large-scale computing clusters has become the main way to improve data performance in the future. Contents of the invention [0003] Embodiments of the present application provide methods and devices for processing data. [0004] In the first aspect, the embodiment of the present application provides a method for processing data, including...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/182G06F16/2458G06F9/50
CPCG06F9/5066
Inventor 李豪宋展张建伟
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap