Data processing method and device

A data processing and data technology, applied in the computer field, can solve the problems of inconvenient query, low time series data storage efficiency, low query efficiency, etc., to avoid loss, improve security, and improve query efficiency.

Pending Publication Date: 2021-08-24
ALIBABA GRP HLDG LTD
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although time-series data comes from different sources, new timelines will always be created and old timelines will be gradually eliminated due to the version upgrade of the acquisition device, system upgrade, or disappearance of acquisition objects due to various reasons. As the amount of data continues to increase, It leads to low storage efficiency of time series data, and brings inconvenience to subsequent queries, which also leads to a decrease in query efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the specification. However, this specification can be implemented in many other ways different from those described here, and those skilled in the art can make similar extensions without violating the connotation of this specification, so this specification is not limited by the specific implementations disclosed below.

[0027] Terms used in one or more embodiments of this specification are for the purpose of describing specific embodiments only, and are not intended to limit one or more embodiments of this specification. As used in one or more embodiments of this specification and the appended claims, the singular forms "a", "the", and "the" are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of the present specification refers t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data processing method and device. The data processing method comprises the steps of receiving a data storage request for to-be-stored data of a target object, wherein attribute information of the to-be-stored data and an object label of the target object are carried in the data storage request; determining a creation timestamp and a newest timestamp of to-be-stored data based on attribute information of the to-be-stored data, determining a data partitioning strategy based on the creation timestamp and the newest timestamp, and creating data partitions according to the data partitioning strategy; determining to-be-stored data of the target object in each data partition, and determining index data corresponding to the to-be-stored data; and constructing a first index table based on the data partitions corresponding to the index data, target objects corresponding to the data partitions and object tags of the target objects, and performing data storage on the to-be-stored data of each data partition based on the first index table.

Description

technical field [0001] The embodiments of this specification relate to the field of computer technology, and in particular to a data processing method. One or more embodiments of this specification also relate to a data processing apparatus, a computing device, and a computer-readable storage medium. Background technique [0002] As the application of the Internet or the Internet of Things becomes more and more widespread, detection systems or Internet of Things devices in the Internet generate more and more time-series-based data, which are called time-series data. Although time-series data comes from different sources, new timelines will always be created and old timelines will be gradually eliminated due to the version upgrade of the acquisition device, system upgrade, or disappearance of acquisition objects due to various reasons. As the amount of data continues to increase, This leads to low storage efficiency of time series data, and brings inconvenience to subsequent...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/13G06F16/14G06F16/172G06F16/18
CPCG06F16/13G06F16/144G06F16/172G06F16/1815
Inventor 吴兴博胡建洪张友东杨成虎
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products