Memory-based data processing method and device

A data processing and memory technology, applied in the field of data processing, can solve problems such as low analysis efficiency, high consumption, and failure to return statistical results in time, and achieve the effect of reducing I/O overhead, reducing memory overhead, and improving data processing efficiency

Active Publication Date: 2016-06-08
CHINA CONSTRUCTION BANK
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when the number of data records increases to a certain extent, frequent reading and writing of the database will consume a large amount of I / O (input / output) resources, resulting in low overall analysis efficiency
In addition, when there are high requirements for timeliness in business, such as real-time risk monitoring of bank transactions, statistical results cannot be returned in time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Memory-based data processing method and device
  • Memory-based data processing method and device
  • Memory-based data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] In order to facilitate the understanding of various aspects, features and advantages of the technical solutions of the present invention, the present invention will be specifically described below in conjunction with the accompanying drawings. It should be understood that the various implementations described below are only for illustration, rather than limiting the protection scope of the present invention.

[0026] Firstly, the names or terms that may be involved in the present invention are explained.

[0027] Dimension: A common property of structured data objects. For example, the dimensions of bank transaction data include customer, transaction IP, transaction date, etc.

[0028] Context relationship: the relationship between structured data objects in two dimensions. For example, bank transaction data can generate relationships based on customer dimension and time series dimension, and relationship can be generated based on transaction IP dimension and time ser...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a memory-based data processing method and device. The method comprises the following steps: writing structural data which comprises a plurality of data records into a first memory area and establishing a plurality of chain tables according to the structural data, wherein pointers which are used for accessing to data elements belonging to different data records, belonging to a same dimensionality and having a same value are stored in data fields of the chain tables; and searching the data elements in the structural data through the chain tables and carrying out data processing according to a statistical index and a calculation method stored in a second memory area. By adopting the memory-based data processing method and device, the I/O overhead can be greatly reduced, the data processing efficiency can be improved and the statistical result can be returned in time.

Description

technical field [0001] The present invention relates to the field of data processing, and more specifically, to a memory-based data processing method and device. Background technique [0002] With the development of information technology, statistical analysis of large amounts of data can be used to help decision-making in many fields. For example, in the field of bank risk monitoring, it is possible to judge whether the customer's transaction is risky by analyzing each transaction behavior of the customer and a certain context related to the transaction, and to decide whether to take action on the customer's transaction. control measures. Different from other data statistical analysis requirements, bank risk monitoring is characterized by the requirement to quickly return the analysis results of customer transactions within a short period of time (for example, 10 minutes or less), which requires high timeliness for data analysis. [0003] In terms of data statistical anal...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2282G06F16/2453
Inventor 梁学甲邓玉覃鹏禤栋雄龚苇梁永健任国力
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products