Data management method, device and system, big data platform and readable storage medium
A technology of a data management system and a big data platform, which is applied in the data processing field of financial technology, and can solve the problems affecting the statistical analysis of historical SMS sending data, low data management efficiency, low efficiency, etc.
Pending Publication Date: 2020-08-18
WEBANK (CHINA)
View PDF0 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, the amount of short messages sent by an enterprise every day can reach millions or even tens of millions. The capacity of traditional relational databases to store short messages is limited. Delete data older than 3 days
In this scenario, the operation and maintenance personnel often need to query historical data information from historical logs or backup data, which is inefficient and will also affect the statistical analysis of historical SMS data.
Therefore, there is a problem of low data management efficiency in the prior art
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0063] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
[0064] refer to figure 1 , figure 1 It is a schematic diagram of the terminal structure of the hardware operating environment involved in the solution of the embodiment of the present invention.
[0065] The terminal in the embodiment of the present invention is a big data platform.
[0066] Such as figure 1 As shown, the terminal may include: a processor 1001 , such as a CPU, a communication bus 1002 , a user interface 1003 , a network interface 1004 , and a memory 1005 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. Optionally, the netw...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to the technical field of financial science and technology, and discloses a data management method, device and system, a big data platform and a readable storage medium. The datamanagement method is applied to a big data platform, the big data platform interacts with a client system and a third party, and the method comprises the following steps: the big data platform acquires issued data of a communication service from the client system at regular time, and acquires returned packet data of the communication service returned by the third party; the issued data is synchronized to the corresponding partition of the issuing table of the first database according to the issuing date, and the returned packet data is synchronized to the corresponding partition of the returned packet table of the first database according to the returned packet date; the returned packet data is associated with the issued data based on the downloaded table and the returned packet table obtained by synchronization, and the intermediate table is updated according to an association result to obtain an updated intermediate table; and statistics is performed on the data in the updated intermediate table according to a preset statistical rule to obtain a data statistical table. The data management efficiency can be improved.
Description
technical field [0001] The present invention relates to the technical field of financial technology (Fintech) data processing, in particular to a data management method, device, system, big data platform and readable storage medium. Background technique [0002] With the development of computer technology, more and more technologies are applied in the financial field, and the traditional financial industry is gradually transforming into Fintech. However, due to the security and real-time requirements of the financial industry, higher requirements are placed on technology. requirements. [0003] With the advent of the big data era, the important role of data has become more prominent. How to carry out statistical management of big data resources and realize the rapid query of target data information is the focus of current data management research. For example, for enterprises, SMS is an important means for enterprises to reach and notify users. Business personnel need to an...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2458G06F16/27G06F16/23
CPCG06F16/2379G06F16/2462G06F16/278
Inventor 卢道和黄叶飞罗锶陈晓峰潘康杰何西代玉常亮李勇叶露瑶
Owner WEBANK (CHINA)