Distributed batch processing method based on database segmentation

A batch processing and database technology, applied in the field of information, can solve the problem of wasting batch processing time and so on

Pending Publication Date: 2020-10-30
武汉众邦银行股份有限公司
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to solve the problem that the existing batch unit is interrupted due to various reasons during operation. At this time, the batch unit is re-run. Since the batch unit includes processing logic and data as a whole, it will start from the initial state. Execution, a huge waste of batch processing time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed batch processing method based on database segmentation
  • Distributed batch processing method based on database segmentation
  • Distributed batch processing method based on database segmentation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In order to make the object, technical solution and advantages of the present invention more clear, the present invention will be further described in detail below in conjunction with the examples. It should be understood that the specific embodiments described here are only used to explain the present invention, and are not intended to limit the present invention, that is, the described embodiments are only some of the embodiments of the present invention, but not all of the embodiments.

[0025] The detailed description of the embodiments of the invention is not intended to limit the scope of the claimed invention but to represent only selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts belong to the protection scope of the present invention.

[0026] It should be noted that relative terms such as the terms "first" and "second" are only used...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of information, provides a distributed batch processing method based on database segmentation, and aims to solve the problem that batch processing time isgreatly wasted due to the fact that an existing batch unit is interrupted due to various reasons during operation and the batch unit needs to be operated again from the beginning at the moment. According to the main scheme, the method comprises the steps that segmentation parameters are defined, whether batch units need to be segmented or not is judged, if yes, segmentation is conducted, and if not, segmentation is conducted; the batch unit A is segmented, and the batch unit A is divided into N small segments of SQL tasks; and a ZK service is called through an RPC remote process to monitor therunning condition of each server, and the segmented SQL task is allocated to a relatively idle server for running.

Description

technical field [0001] The invention relates to the field of information technology, and provides a night-based batch distributed segmentation method. Background technique [0002] Existing technology: the accounting system needs to process a large amount of accounting information in batches at night, and at the same time needs to provide data for upstream and downstream systems or cooperation channels, which requires the system to be extremely efficient in batches at night. Coexist with parallelism, each batch unit has a relatively close dependency, and each batch unit is the minimum factor of batch processing and cannot be split. [0003] Technical flaws: [0004] 1. Based on the current in-line batch operation mechanism, a batch unit cannot be subdivided and can only be run on one server, and the running time of each batch unit is inconsistent, resulting in some servers running at full capacity while other servers may be idle. At the same time, when the batch running ti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2453G06F16/245G06F9/54G06F9/50
CPCG06F9/5027G06F9/5083G06F9/547G06F2209/508G06F16/24532G06F16/24569
Inventor 王智聪李耀彭磊薛伟
Owner 武汉众邦银行股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap