Data processing method, system and equipment based on multi-modal lock and storage medium

A data processing, multi-modal technology, applied in database management systems, digital data processing, special data processing applications, etc., can solve problems such as the inability to dynamically adjust the real-time traffic transmission window, affecting the real-time response of online services, etc.

Active Publication Date: 2021-12-14
河北幸福消费金融股份有限公司
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] 3. The transmission window cannot be dynamically adjusted according to real-time traffic, which may affect the real-time response of online business

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, system and equipment based on multi-modal lock and storage medium
  • Data processing method, system and equipment based on multi-modal lock and storage medium
  • Data processing method, system and equipment based on multi-modal lock and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0053] image 3 It is a schematic flowchart of a data processing method based on a multi-modal lock according to Embodiment 1 of the present invention.

[0054] Such as image 3 As shown, in one embodiment of the present invention, the data processing method may include: step S31, step S32, step S33, step S34, step S35 and step S36, and the above steps will be described in detail below.

[0055] In step S31, the multi-modal locks of each data processing stage are obtained, and the multi-modal locks include: multi-modal locks for data extraction, multi-modal locks for data cleaning, and multi-modal locks for data aggregation. Multi-modal locks, multi-modal locks for generating reports, and multi-modal locks for data comparison. Wherein, the multi-modal lock can provide no less than one combination operation of data processing, so as to concurrently execute data processing tasks of the same attribute or different attributes. For example, in the data cleaning process, multiple...

Embodiment 2

[0070] Figure 4 It is a schematic flowchart of a data processing method based on a multi-modal lock according to Embodiment 2 of the present invention.

[0071] Such as Figure 4 As shown, in an embodiment of the present invention, the data processing method may include:

[0072] First, trigger the operation of acquiring multi-modal locks in each data processing stage through the peripheral scheduling framework (such as XXL-JOB scheduling platform) to acquire multi-modal locks, and automatically exit the described The data processing thread corresponding to the at least one multimodal lock is subsequently retriggered through the peripheral scheduling framework to the data processing thread corresponding to the at least one multimodal lock. Wherein, the multimodal lock includes but is not limited to one or more of the following: a multimodal lock for data extraction, a multimodal lock for data cleaning, a multimodal lock for data aggregation, Multi-modal lock for report gen...

Embodiment 3

[0084] Figure 5 It is a schematic flowchart of a data processing method based on a multi-modal lock according to Embodiment 3 of the present invention. Figure 5 The flow chart shown takes the transaction details data of the payment system and platform system as the data source, and shows the data processing method of the reconciliation center.

[0085] Among them, the payment system and platform system provide a transaction data query interface, support paging query, and extract a certain amount of data by scanning the primary key. The reconciliation center makes an interface call or direct remote SQL (Structured Query Language) execution, which defines that each system needs to provide standard data elements as shown in Table 1 below:

[0086] Table 1

[0087]

[0088] As shown in Table 1, the standard data for interface calls by the reconciliation center include verification type, transaction date, combined system code, summary category, reconciliation identification ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method, system and device based on a multi-modal lock and a storage medium. The data processing method comprises the steps that a multi-mode lock of each data processing stage is obtained, and each multi-mode lock is of a dynamic lock structure with the data processing stage as a distinguishing boundary and is used for providing at least one data processing combination operation; the multi-modal lock comprises a multi-modal lock used for data extraction, data cleaning, data summarization, report generation and data comparison; and respectively extracting data from a source data supply end according to the multi-mode lock corresponding to each data processing stage, and carrying out cleaning, summarization, report generation and data comparison processing. According to the data processing method provided by the invention, the data processing task of each data processing stage is realized through the multi-modal lock, and the data processing tasks with the same attribute and different attributes are simultaneously and concurrently executed according to the multi-modal lock corresponding to the multiple data processing task combinations, so that the concurrent processing of multiple line tasks is realized; and the data comparison efficiency is improved.

Description

technical field [0001] The present invention relates to the technical field of computer applications, and more specifically, to a data processing method, system, computer equipment and storage medium based on a multimodal lock. Background technique [0002] In the construction of the existing consumer finance industry system, a distributed service architecture will be adopted to deal with increasingly complex business lines (such as cash loans, scene loans and other business types in consumer finance), so it is inevitable that data between systems will The problem of inconsistency leads to difficulties in locating data problems, and it is prone to counting check obstacles, which does not meet the system construction requirements of final data consistency. [0003] In order to meet the final data consistency requirements, it is necessary to pull data resources from various systems for comparison, such as figure 1 As shown, the data comparison method in the existing distribut...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/215G06F16/23G06F16/2457G06F16/25G06F16/27
CPCG06F16/2282G06F16/215G06F16/2365G06F16/254G06F16/252G06F16/27G06F16/24578Y02D10/00
Inventor 王巨鹏姜洪王璐璇黄晓薇雷选平
Owner 河北幸福消费金融股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products