Automatic data processing method and system

A technology for processing systems and data processing modules, which is applied in the field of computer networks and can solve problems such as increased operation and maintenance costs, inability to be configured, and difficult to manage.

Pending Publication Date: 2021-05-11
杉德银卡通信息服务有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The patent only supports a single type of data source format processing; it cannot perform information notification; it cannot be configured, it is not flexible enough, it increases operation and maintenance costs, and it is difficult to manage

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic data processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] The invention provides a set of framework capable of automatically processing different data. The framework is input as data, and the data type is defined through configuration for distribution processing. After completion, the data is persisted to a designated database. If an abnormal situation occurs, the notification mode can be set to notify the designated personnel in time. If the normal data is subsequently input, the old data can also be compared and processed by itself to ensure the timely validity of the data without human intervention, which reduces the maintenance and development personnel. workload.

[0036] An automated data processing system, such as figure 1 As shown, it includes: automatic processing process module (module 1), data analysis module (module 2), data processing module (module 3), exception handling module (module 4), system notification module (module 5), data source configuration module (Module 6)

[0037] Module 1: Automated Processing ...

Embodiment 2

[0051] Embodiment 2 is a modification of embodiment 1

[0052] Ye Mou is an employee of the business management department of our company. He usually needs to deal with the data analysis of various businesses of the company every day. In the past, because the company had many businesses and needed to use many systems, Ye had to open and log in to different systems to process data, and the format of each data was different, and it took a lot of time to sort through various data every day. To convert and analyze, the work efficiency is very low. After the data automatic processing framework went online, the system helped him integrate various types of data and unify all the data into the company's standard format. Due to the unified data format, various business systems can also be integrated, and the original multiple systems were merged. For one system, Ye only needs to use one system every day to complete the data processing work, and the work efficiency has been greatly imp...

Embodiment 3

[0054] Embodiment 3 is a variation of embodiment 1

[0055] Mr. Han is a merchant of our company. The merchant of Mr. Han supports prepaid cards, Alipay, WeChat, UnionPay scanning code, credit card, etc. in the payment method. Before becoming a merchant of our company, Mr. Han needs to log in to the prepaid account separately every day Card website, Alipay website, WeChat website, UnionPay platform, among different websites, the reconciliation files from different sources are merged by themselves. Since the data format of each platform is different, daily reconciliation has become the biggest headache for Han For the matter, you need to take down each different reconciliation file by yourself, and then calculate it. Sometimes you have to recalculate if you make a mistake, which consumes too much energy. Soon after, Mr. Han became a merchant of our company. Because our company uses an automated data processing framework, it integrates different data into standard data. In this ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an automatic data processing system and method. The automatic data processing system comprises a module M1, wherein the module M1 configures a data source according to a data source configuration module and a preset requirement; a module M2: the automatic processing flow module obtains data source information and configuration information from the configured data source, obtains corresponding data through the obtained data source information, and distributes the obtained corresponding data and configuration information to a data analysis module; a module M3: the data analysis module analyzes the obtained corresponding data according to the configuration information, standardized data are formed after analysis is completed, and the standardized data are sent back to the automatic processing flow module; a module M4: the automatic processing flow module sends the standardized data to the data processing module, the data processing module carries out data processing on the standardized data according to the configuration information, the processed standardized data is sent to the automatic processing flow module, and final persistence operation is carried out on the processed standardized data.

Description

technical field [0001] The present invention relates to the technical field of computer networks, in particular, to a method and system for automatic data processing, and more specifically, to an automatic data processing framework. Background technique [0002] In today's big data era, when the amount of business data is very large, using the minimum human and time investment has become a challenge. [0003] Patent document CN104320433B (application number: 201410509935.2) discloses a data processing method and a distributed data processing system, which can overcome the above-mentioned shortcomings in the prior art. The data processing method of the present invention includes: after the central node of the distributed system receives the data processing task, it determines a node from multiple execution nodes as the task execution node for executing the data processing task, and then provides the data processing task to The task execution node; after obtaining the data pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30
CPCG06F11/3006G06F11/3055G06F11/3093
Inventor 叶凯
Owner 杉德银卡通信息服务有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap