Data processing method and device, equipment and storage medium

A data processing and source data technology, applied in the field of data processing, can solve the problems that multi-source heterogeneous data access platforms cannot handle and reduce the workload of data access, so as to reduce workload, improve work efficiency, and have strong scalability. Effect

Pending Publication Date: 2022-04-05
RUN TECH CO LTD BEIJING
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] This application provides a data processing method, device, equipment and storage medium to solve the problem that the multi-source heterogeneous data access platform cannot handle and reduce the workload of data access

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, equipment and storage medium
  • Data processing method and device, equipment and storage medium
  • Data processing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] figure 1 It is a flow chart of a data processing method provided in Embodiment 1 of the present application. The embodiment of the present application is applicable to the case of converting the source data according to the standard format specification. The method may be executed by a data processing device, which may be implemented in software and / or hardware, and specifically configured in an electronic device, which may be a mobile terminal or a fixed terminal.

[0029] see figure 1 , the data processing method provided in the embodiment of the present application, including:

[0030] S110. Obtain the original data generated by the source data platform and the standard data specification of the target data platform.

[0031] Among them, the source data platform can transmit the original data to the target data platform for subsequent logical business processing by the target data platform. In this embodiment, the number of source data platforms may be at least o...

Embodiment 2

[0047] figure 2 It is a flow chart of a data processing method provided in Embodiment 2 of the present application. This embodiment is an optimization of the above solution based on the above embodiments.

[0048] Further, the standard data specification includes a standard format specification; correspondingly, the operation "according to the standard data specification and the storage structure information, convert the format of the original data to obtain the data required by the target data platform. Standard data", which is refined as "according to the standard format specification, determine the standard format of data storage; according to the storage structure information, extract key data information from the original data; according to the key data information and the standard format, and convert the key data information according to the standard format to obtain the standard data required by the target data platform", so as to improve the standard data determinatio...

Embodiment 3

[0067] image 3 It is a flow chart of a data processing method provided in Embodiment 3 of the present application. This embodiment is an optimization of the above solution based on the above embodiments.

[0068] Further, the standard data specification also includes a standard naming specification; correspondingly, after the operation "convert the format of the key data information according to the standard format according to the key data information and the standard format", add Operation "according to the standard naming convention, determine the naming rule and at least one standard field required for naming; obtain the standard field value corresponding to each of the standard fields from the original data according to the storage structure information; According to the above naming rules, each of the standard field values ​​is combined to obtain a new data name; according to the new data name and the key data information after format conversion, the standard data requi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data processing method and device, equipment and a storage medium. The method comprises the steps of obtaining original data generated by a source data platform and a standard data specification of a target data platform; determining storage structure information of the original data according to the identification information of the source data platform; performing format conversion on the original data according to the standard data specification and the storage structure information to obtain standard data required by the target data platform; through the technical scheme, the problem that the multi-source heterogeneous data access platform cannot process is solved, and the workload during data access is reduced.

Description

technical field [0001] The embodiments of the present application relate to the technical field of data processing, and in particular, to a data processing method, device, device, and storage medium. Background technique [0002] Because each data platform may use different data storage formats for data storage, resulting in the existence of multi-source heterogeneous data. Due to differences in data sources, data structures, or data standards, multi-source heterogeneous data have great differences in type, nature, form, and content, which easily lead to barriers to data information sharing and interconnection. [0003] In the existing technology, the traditional processing method of multi-source heterogeneous data is to modify the code at the connected data platform to adapt to the aggregated data. Every time the data structure of other platforms changes, the code needs to be rewritten, and every time Every time coding requires dedicated manpower to do repetitive and compl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F9/445
Inventor 张朋飞万月亮火一莽
Owner RUN TECH CO LTD BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap