Online small-batch data processing method and device, equipment and storage medium

A data processing and small batch technology, applied in the field of big data processing, can solve the problems of high scheduling pressure in financial business systems, and achieve the effect of being conducive to stable operation and reducing scheduling pressure.

Pending Publication Date: 2021-07-27
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In addition, there are some businesses between the two in the business, and the processing of these businesses is likely to cause excessive scheduling pressure on the scheduling center of the financial business system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Online small-batch data processing method and device, equipment and storage medium
  • Online small-batch data processing method and device, equipment and storage medium
  • Online small-batch data processing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] In order to better understand the technical solution in the present specification, the technical solutions in the present specification are clear and completely described below in conjunction with the drawings in the present specification. The embodiment is merely a part of the embodiments of the present specification, not all of the embodiments. Based on the embodiments in this specification, one of ordinary skill in the art will belong to all other embodiments obtained by creative labor, and should belong to the scope of this specification.

[0059] The present specification relates to large data processing techniques, which can be applied to business between the financial areas or other fields (for ease of description, here, such as online small batch business) scenes. At present, the distributed batch framework of most business systems is configured with a scheduling center, and the scheduling center will issue a scheduled command to the actuator in accordance with the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an online small-batch data processing method and device, equipment and a storage medium, which can be applied to the financial field or other fields. The method comprises the following steps: generating a next-day operation instance table according to a next-day schedule before daily switching, and writing the next-day operation instance table into a cache module, wherein the job instance table comprises specified execution time of a corresponding operation task; and sending a scheduling updating instruction to an executor, so that the executor obtains the corresponding operation task from the operation instance table of the cache module and executes the operation task according to the appointed execution time of the corresponding operation task. According to the specification, the dispatching pressure of a dispatching center in a service scene between online and batch is relieved.

Description

Technical field [0001] This specification relates to the field of large data processing, in particular, involving a small batch data processing method, device, device, and storage medium. Background technique [0002] Most of the business in the financial business system can be implemented online (ie real time) or batch. Common pairs of guests can be completed online by online transactions, customers are relatively high in real-time requirements for trading results, such as online transfer. Bulk business is mainly for large-scale complex data processing, real-time requirements, such as day-end account clearing, and ending. [0003] In addition, there are some services between the two, which handles these services easily make the scheduling center of the financial business system. Therefore, how to mitigate the scheduling pressure under the business scene of online and bulk, has become the technical problem to be solved urgently. Inventive content [0004] The object of this spec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50G06F9/48G06F9/54G06Q40/04
CPCG06F9/4881G06F9/5011G06F9/5038G06F9/5083G06F9/544G06Q40/04
Inventor 陈凌云何旭敏林欢哲俞丽萍
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap