Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Quasi-real-time asynchronous batch processing system, method and device and storage medium

A batch processing and quasi-real-time technology, applied in the field of data processing, can solve the problems of low scheduling processing efficiency and poor scalability, and achieve the effects of convenient dynamic expansion, decoupling, and powerful horizontal expansion capabilities

Pending Publication Date: 2019-04-05
CHINA CONSTRUCTION BANK
View PDF6 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the above technical problems, the present invention provides a quasi-real-time asynchronous batch processing system, method, device and storage medium to solve the problems of low efficiency and poor scalability in current scheduling processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Quasi-real-time asynchronous batch processing system, method and device and storage medium
  • Quasi-real-time asynchronous batch processing system, method and device and storage medium
  • Quasi-real-time asynchronous batch processing system, method and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0023] figure 1 It is a schematic structural diagram of a quasi-real-time asynchronous batch processing system 1 according to an embodiment of the present invention, see figure 1 , the system 1 includes:

[0024] An asynchronous scheduling module 100, configured to perform reservation scheduling processing on application data through an asynchronous scheduling interface;

[0025] A distributed queue module 200, configured to perform distributed message queue processing on the application data; and

[0026] The asynchronous execution module 300 is configured to trigger and execute the distributed message queue.

[0027] In an embodiment of the present invention, the reservation scheduling process includes: real-time execution of the scheduli...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a quasi-real-time asynchronous batch processing system, and the system comprises an asynchronous scheduling module which is used for carrying out reservation scheduling processing on application data through an asynchronous scheduling interface; The distributed queue module is used for performing distributed message queue processing on the application data; And the asynchronous execution module is used for triggering and executing the distributed message queue. According to the method, the existing framework is transformed by using technologies such as sub-library and sub-table, distributed cache, distributed queue and streaming processing technologies, so that the problems of low efficiency and poor expandability in current scheduling processing are solved.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a quasi-real-time asynchronous batch processing system, method, device and storage medium. Background technique [0002] In order to achieve efficient, fast, and stable scheduling and execution, it is necessary to decouple scheduling and execution, so that scheduling can drive execution in one direction, and can smoothly monitor the progress and results of execution, and the queuing and waiting for scheduling cannot occupy execution resources, and the execution process cannot occupy scheduling resources, so the current main solution is to put scheduling and execution on different threads, processes, process pools, or even different computers or computer clusters. It can also be used as needed. Some commercial scheduling frameworks and execution frameworks need to solve the problem of efficient communication and coordination between scheduling and execution. At the same time, the ch...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/54
CPCG06F9/4881G06F9/546
Inventor 聂砂李昕宇洪翔
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com