Data processing method and device

A data processing and data technology, applied in the field of big data processing, can solve the problem that data processing is difficult to balance efficiency and security, and achieve the effect of high security and improved efficiency

Inactive Publication Date: 2016-04-27
CHINA MOBILE GRP GUANGDONG CO LTD +1
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] It can be seen that in the existing technology, the data in the big data environment is scattered

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The following embodiments of the present invention provide a data processing method, which can improve the efficiency of processing large data and has high security.

[0050] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0051] figure 1 Shown is the flowchart of the data processing method of the embodiment of the present invention, as figure 1 As shown, the embodiment of the present invention provides a data processing method, including:

[0052] Step 101, receiving a connection request sent by a data producer...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiments of the invention disclose a data processing method and device. The processing method includes: receiving a connection request sent by a data producer; judging whether the connection request sent by the data producer is a legal connection request or not; if the connection request is legal, obtaining the format of data to be received; searching for a data set matching the format of the data to be received, and if a matched data set is obtained, adding the data to be received to the matched data set, and if no matched data set is obtained, establishing a new data set, adding the data to be received to this new data set and using the format of the data as the data format of the new data set. The method can improve the big data processing efficiency with high security.

Description

technical field [0001] The invention relates to the field of big data processing, in particular to a data processing method and processing device. Background technique [0002] Big data has the characteristics of large volume, high speed, variety and reality. Due to the huge amount of data or information involved in the big data environment and the variety of data types, it is difficult to use the usual methods to process it. [0003] Data processing in a big data environment includes data reception and data distribution. Data reception can also be called data storage, and data distribution can also be called data reading. Different data reading scenarios or different data application scenarios have different corresponding data storage. For example, there are memory-based cache storage, efficient KV databases for reading and writing, relational databases for managing important data, and dedicated Mapreduce-like services for data mining. [0004] Data processing in a big d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
Inventor 罗朝彤屈强何庆许敬伟魏丽丽周乐坤潘汉权孙宝寅张磊任海峰
Owner CHINA MOBILE GRP GUANGDONG CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products