Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method, device and apparatus and storage medium

A data processing and database technology, applied in the field of big data, can solve problems such as high pressure and slow data processing efficiency

Pending Publication Date: 2020-05-26
CHINA CONSTRUCTION BANK
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the current processing method is usually based on big data ETL tools (Extract-Transform-Load, data warehouse technology), which requires frequent read and write operations, and the pressure on IO (Input Output, input and output) is relatively high, which leads to Data processing efficiency is slow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, device and apparatus and storage medium
  • Data processing method, device and apparatus and storage medium
  • Data processing method, device and apparatus and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] figure 1 It is a schematic flow chart of a data processing method provided in Embodiment 1 of the present invention. This embodiment is applicable to the conversion of different databases. For details, please refer to figure 2 A structural frame of a data processing system is shown, in which databases in the data processing system can be converted two by two. A data processing method in this embodiment may be performed by a data processing device, the device may be implemented in the form of software and / or hardware, and may be integrated into an electronic device, specifically including the following steps:

[0028] S110. Obtain the first database to which the original data to be queried belongs and the second database to which the mode to be queried belongs.

[0029] In this embodiment, the original data to be queried refers to the data required by the user, and these data can be: bank product transaction flow, bank product basic information, bank transaction instit...

Embodiment 2

[0050] image 3 It is a schematic flow chart of a data processing method provided in Embodiment 1 of the present invention. This embodiment is applicable to the conversion of different databases, and can be executed by a data processing device, which can use software and / or hardware and can be integrated in electronic equipment, which specifically includes the following steps:

[0051] S310. Obtain the first database to which the original data to be queried belongs and the second database to which the mode to be queried belongs.

[0052] S320. Acquire raw data of the first database; where the raw data is data to be stored or data already stored in the first database.

[0053] S330. Obtain data description information in the original data.

[0054] Optionally, obtain data description information in the original data, including:

[0055] If the original data does not carry the data description information, the data description information is acquired from a description inform...

Embodiment 3

[0063] Figure 4 It is a schematic structural diagram of a data processing device provided by Embodiment 3 of the present invention. A data processing device provided in an embodiment of the present invention can execute a data processing method provided in any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method. Such as Figure 4 As shown, the device includes:

[0064] A database acquiring module 401, configured to acquire a first database to which the original data to be queried belongs, and a second database to which the query mode belongs;

[0065] An original data acquisition module 402, configured to acquire the original data of the first database; wherein, the original data is the data to be stored or the stored data of the first database;

[0066] A data format conversion module 403, configured to convert the original data from the first data format supported by the first database to the secon...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data processing method, device and apparatus and a storage medium. The method comprises the steps of obtaining a first database to which to-be-queried original data belongs and a second database to which a to-be-queried mode belongs; acquiring original data of the first database; wherein the original data is to-be-stored data or stored data of the firstdatabase; converting the original data from a first data format supported by the first database to a second data format supported by the second database according to data format conversion relationships of different databases; and storing a conversion result into the second database for a user to inquire the original data from the second database. Therefore, the purposes of improving the data query efficiency and supporting various data query usage scenarios are achieved.

Description

technical field [0001] Embodiments of the present invention relate to the field of big data technology, and in particular, to a data processing method, device, device, and storage medium. Background technique [0002] With the growth of massive data in the financial industry, traditional relational databases and data warehouses face the problems of low data processing efficiency and query efficiency. In this case, big data emerges as the times require. With the rise and development of big data, distributed technology has become increasingly mature. It can not only effectively solve the problem of data storage capacity, but also improve the efficiency of data processing through distributed computing, and provide a better technical ecology to complete the problems of data storage and data processing that cannot be solved by traditional technologies. [0003] However, the current processing method is usually based on big data ETL tools (Extract-Transform-Load, data warehouse t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/2458G06F16/2453
CPCG06F16/258G06F16/2458G06F16/2453
Inventor 鲜伟
Owner CHINA CONSTRUCTION BANK