Data check method, device and apparatus

A data and data source technology, applied in the computer field, can solve problems such as single check sequence, low check processing efficiency, and inability to meet the needs of batch transaction data check, and achieve the effect of improving efficiency

Inactive Publication Date: 2017-08-08
ADVANCED NEW TECH CO LTD
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The verification method of the prior art completely adopts the serial verification method. First, read the TA system code and transaction number of the fund transaction record in the fund transaction confirmation file one by one, and then go to the database of the fund transaction system to query and obtain the information stored in the database. The transaction records corresponding to the TA system code and transaction number, and then check whether the transaction shares in the two transaction records are consistent. In this serial check method, each check requires a search of the database, and the check sequence is single. The efficiency of the entire verification process is extremely low
When encountering a large fund transaction volume, it is simply impossible to meet the needs of batch transaction data verification

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data check method, device and apparatus
  • Data check method, device and apparatus
  • Data check method, device and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] Such as image 3 As shown, it is a schematic flow chart of the data checking method in Embodiment 1 of the present invention, which includes:

[0044] Step 101: Obtain multilateral data to be verified from multiple different data sources, wherein each side of data to be verified corresponds to a data source. The execution subject of this step can be figure 2 The data checking device set in the fund trading system.

[0045] Here the data source can correspond to figure 2 The database of the fund transaction system in and the fund transaction confirmation document returned by the TA system, that is, figure 2 The situation exemplified in is a bilateral data check, where the data on one side is the fund transaction record data stored in the database of the fund transaction system, and the other side is the fund transaction confirmation data recorded in the fund transaction confirmation file.

[0046] The fund transaction confirmation data may come from the fund trans...

Embodiment 2

[0063] Such as Figure 4 As shown, the present embodiment relates to a data checking device, which includes:

[0064] The acquiring module 11 is configured to acquire multilateral data to be checked from a plurality of different data sources, wherein each side of the data to be checked corresponds to a data source, wherein the multilateral data to be checked from a plurality of different data sources can be specifically stored as: Fund transaction record data in the fund transaction system, fund transaction confirmation data extracted from transaction confirmation files received from one or more TA systems.

[0065] The hash grouping module 12 is used to split the data to be checked on each side according to the same hash grouping rule to generate multiple groups of sub-data to be checked with the same number of groups and corresponding relationships. Specifically, both the fund transaction record data and the fund transaction confirmation data include the transaction number ...

Embodiment 3

[0070] Such as Figure 5 As shown, the present embodiment relates to another kind of data checking device, and the data checking device of the present embodiment is designed based on the actual application in the fund trading system, and specifically includes the following modules: data source management module 21, data processing module management Module 22 , checking scene management module 23 , task template management module 24 , checking task module 25 , checking engine module 26 , checking report generating module 27 , and business callback module 28 .

[0071] The data source management module 21 is mainly used for data source configuration, and provides data source support for the checking system. The data source can be from a database, a file, or an open storage. The database can be a local general database of the system, or Hbase (a distributed column-oriented open source database) database, Alibaba Cloud OTS (Open Structured Data Service), etc. The files can be vari...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiments of the invention provide a data check method, a device and an apparatus. The method comprises the following steps: acquiring multiple pieces of to-be-checked data from multiple different data sources, wherein each piece of the to-be-checked data corresponds to one data source; splitting each piece of to-be-checked data according to the same hash grouping rule, and generating multiple groups of to-be-checked sub-data which have the same packet number and have a corresponding relationship; and checking the multiple groups of to-be-checked sub-data separately according to the corresponding relationship. According to the data check method, the device and the apparatus provided by the embodiments of the invention, multiple pieces of to-be-checked data from different data sources are hash-grouped, and the data is checked in batch. Thus, effective hash grouping of massive data is carried out, multiple groups of data which have a corresponding relationship and are easy to check are formed, and the efficiency of data check is improved.

Description

technical field [0001] The embodiment of the present invention relates to a data checking method, device and equipment, which belong to the technical field of computers. Background technique [0002] With the development of computer technology, there are more and more cases of massive data interaction between multiple systems and synchronization of massive data in large-scale distributed systems. For the interaction and synchronization of massive data, data verification is crucial. However, the existing data verification methods are inefficient and cannot meet the needs of massive data or large file data verification. [0003] Taking the system architecture of the existing fund transaction process as an example, the fund transaction process of the prior art is as follows: figure 1 As shown, users need to go through figure 1 The data of the multiple systems shown in the figure can only be finally completed after the data is processed. In the figure, the fund subscription pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q40/04G06Q40/06G06F17/30
CPCG06F16/903G06Q40/04G06Q40/06
Inventor 王星星李俊刘柱刘义
Owner ADVANCED NEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products