Unlock instant, AI-driven research and patent intelligence for your innovation.

A data processing method, apparatus, device and storage medium

A data processing and data technology, applied in the computer field, can solve the problems of reducing data processing efficiency, large manpower, long processing cycle, etc., to achieve the effect of improving data processing efficiency, avoiding processing and storage, and improving data value density

Active Publication Date: 2020-09-01
JINGDONG TECH HLDG CO LTD
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The data processing method in the prior art requires a lot of manpower, and the processing cycle is long, which greatly reduces the data processing efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing method, apparatus, device and storage medium
  • A data processing method, apparatus, device and storage medium
  • A data processing method, apparatus, device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] figure 1 It is a flow chart of a data processing method provided by Embodiment 1 of the present invention, and this embodiment is applicable to the case of processing model data in a data warehouse. The method can be executed by a data processing device, and the device can be realized by software and / or hardware, and integrated into a device with data processing functions, such as a desktop computer, a notebook computer, and the like. Such as figure 1 As shown, the method specifically includes the following steps:

[0032] S110. Obtain target data in the data warehouse, where the target data is metadata used to describe a data model in the data warehouse.

[0033] Among them, the data warehouse can store data from multiple data sources together, but because these data are stored in different ways, the data of each data source needs to be converted into a specific format and stored in the data warehouse. The data warehouse can filter and integrate various business dat...

Embodiment 2

[0075] Figure 4It is a flow chart of a data processing method provided by Embodiment 2 of the present invention. On the basis of the above embodiments, this embodiment adds "according to the target data, determine the completeness of the target description information of the data model, the standardization of the model and the data Timeliness", and on this basis, change "process the model data corresponding to the data model according to the value of the data" to "according to the value of the data, the completeness of the target description information, the standardization of the model and the timeliness of the data, process the data The data corresponding to the model is processed". The explanations of terms that are the same as or corresponding to those in the foregoing embodiments are not repeated here.

[0076] see Figure 4 The data processing method provided in this embodiment specifically includes the following steps:

[0077] S210. Obtain target data in the data w...

Embodiment 3

[0117] Figure 6 It is a schematic structural diagram of a data processing device provided by Embodiment 3 of the present invention. This embodiment is applicable to the case of processing model data in a data warehouse. The device specifically includes: a target data acquisition module 610 , a data value determination module 620 and a data processing module 630 .

[0118] Among them, the target data acquisition module 610 is used to acquire the target data in the data warehouse, and the target data is metadata used to describe the data model in the data warehouse; the data value determination module 620 is used to determine the data of the data model according to the target data Value degree: the data processing module 630 is configured to process the model data corresponding to the data model according to the value degree of the data.

[0119] Optionally, the target data includes model metadata, scheduling metadata and task execution logs; correspondingly, the data value de...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data processing method and device, equipment and a storage medium, and the method comprises the steps: obtaining target data in a data warehouse, the targetdata being metadata for describing a data model in the data warehouse; determining a data value degree of the data model according to the target data; and processing the model data corresponding to the data model according to the data value degree. Through the technical scheme of the embodiment of the invention, automatic processing of the data can be realized, the data processing efficiency is improved, and the data value density is improved.

Description

technical field [0001] Embodiments of the present invention relate to computer technology, and in particular, to a data processing method, device, device, and storage medium. Background technique [0002] With the rise of artificial intelligence, mobile Internet and Internet of Things, big data is getting bigger and bigger. The rapid development of the big data industry has brought challenges to the data management of enterprises. [0003] At present, data processing mainly focuses on the cleaning of useless data. The data processing method in the prior art is to determine suspected useless data through manual screening based on work experience, and delete these useless data after confirmation by the person in charge of the data. [0004] However, in the process of realizing the present invention, the inventor finds that there are at least the following problems in the prior art: [0005] The data processing method in the prior art requires a lot of manpower, and the proc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/21
CPCG06F16/212
Inventor 周传广吕艳杨睿李超
Owner JINGDONG TECH HLDG CO LTD