Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

File distributed writing, reading and processing mechanism and system under micro-service system

A micro-service and distributed technology, applied in the field of data processing, can solve problems such as high latency, strong coupling between services, business risks, etc., to ensure integrity and correctness, high parallel execution of files, and high security of file interaction Effect

Pending Publication Date: 2021-01-22
北京神州数字科技有限公司
View PDF6 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] But at present, there are mainly two types of interactions between microservices. One is to directly call another microservice through a real-time communication protocol (such as tcp / http, etc.). It causes great pressure; the services are strongly coupled and cannot be truly decoupled; the second is to process the batch interaction between microservices through a single file. This processing method will serialize the business that can be processed in parallel and cannot Give full play to the advantages of distributed processing of microservices; and if the middle of the file is tampered with or lost, the server cannot perceive it, which will directly lead to business risks
This leads to the limited processing capacity of the microservice architecture in the process of banking business development

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File distributed writing, reading and processing mechanism and system under micro-service system
  • File distributed writing, reading and processing mechanism and system under micro-service system
  • File distributed writing, reading and processing mechanism and system under micro-service system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] Such as image 3 As shown, this embodiment provides a mechanism for distributed processing of files under the microservice system, including a mechanism for distributed writing of files under the microservice system and a mechanism for distributed reading of files under the microservice system.

[0040] cooperate again figure 1 As shown, the mechanism for distributed writing of files under the microservice system includes:

[0041] S110. Configure information such as file type, business classification, single file record number, file name, and file storage path according to business requirements; for example, in the scenario of intelligent deposit frequency settlement to purchase of a second-class account, the configuration file type is intelligent deposit interest settlement and entry (IDEPOSIT_CAPT ), the business classification is the second-class account entry (EA_IN_CLASS), the number of file records is 10,000, and the file name is IDEPOST_CAPT_${lastRunDate}_exec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a file distributed writing, reading and processing mechanism and system under a micro-service system, and the processing mechanism comprises a distributed file writing processing mechanism under the micro-service system and a matched distributed file reading processing mechanism under the micro-service system, and comprises the following steps: configuring file types and business classification related information; configuring a file generation opportunity; performing data segmentation, and forming a verification file; processing the data in parallel and generating a file, and generating a signature file; performing file sharing; verifying the file information, and segmenting the file information by taking the file as a basic unit; processing each file in parallel,verifying the files, and analyzing the processed files; according to the file distributed processing mechanism and system under the micro-service system, the file can be written in a distributed modeafter service distributed processing is carried out according to the service scene configuration file type; the file user processes the files in a classified and distributed manner according to the service; and the file processing capability and security of the system can be greatly improved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a mechanism and system for distributed writing, reading, and processing of files under a microservice system. Background technique [0002] The development of Internet financial services has put forward higher requirements on the processing capabilities of bank IT systems. Traditional huge single applications (or SOA services with very coarse granularity) can no longer meet the requirements in terms of maintainability, scalability, and rapid iteration. To meet the needs of business development, the microservice architecture has become an inevitable choice for industry development. Choosing an appropriate microservice batch interaction and processing method is a key technology for the microservice architecture to cope with the Internet financial business scenario of massive data processing. [0003] But at present, there are mainly two types of interactions between micros...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/16G06F16/172G06F16/176G06F16/182
CPCG06F16/16G06F16/172G06F16/176G06F16/1827G06F16/183
Inventor 葛良涛
Owner 北京神州数字科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products