Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and device

A data processing and data technology, applied in the computer field, can solve the problems of complex, difficult full table scan, low efficiency, etc., to achieve the effect of improving efficiency, overcoming low efficiency and reducing the scope

Active Publication Date: 2018-02-23
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF4 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] For relational databases, when the amount of data reaches the level of T bytes or P bytes, full table scanning is very difficult, and it is more complicated to divide databases and tables;
[0006] The number of queries in non-relational databases is limited, and the efficiency is very low when performing aggregation calculations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0036] In the embodiment of the present invention, a multi-dimensional three-dimensional structure is constructed for data storage, and all data is processed by a three-dimensional algorithm and then added to the multi-dimensional three-dimensional structure, combined with the deduplication table to realize multi-dimensional query and analysis of data. It should be noted t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method and a device, and relates to the technical field of computers. The method includes the following specific steps of acquiring a data set to be processedand determining dimension combinations of the data set, performing processing on the data set based on the dimension combinations to obtain a corresponding dimension table set, wherein each dimensiontable in the dimension table set is corresponding to a dimension combination, and carrying out multi-dimensional query based on the dimension table set. The data processing method and the device canachieve efficient multi-dimensional query and analysis of the data.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing method and device. Background technique [0002] With the development and application of database technology, the amount of data stored in databases has transitioned from megabytes (M) and gigabytes (G) in the 1980s to current terabytes (T) and gigabytes ( P) bytes. At the same time, the user's query requirements are becoming more and more complex. The data involved is not only to query or manipulate one or a few data records in a relational table, but to perform data processing on thousands of data records in multiple tables. Analysis and comprehensive processing of information. For example, there are 10 billion plug-in data, which include plug-in name field, plug-in version field, client version field, and operating system version field. In this 10 billion pieces of data, the query client version is 5.6.0, the number of plug-ins whose operating sys...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/2264G06F16/2282
Inventor 李树前朱德伟
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products