Business data processing method and system, server and readable storage medium

A business data and processing system technology, applied in the computer field, can solve the problems of Redis storage engine memory resource waste, poor scalability of memory database, etc., and achieve the effect of enhancing scalability

Pending Publication Date: 2020-12-18
广州海外扛把子网络科技有限公司
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the automation capabilities of the above business data processing systems need to be improved, and the scalability of the memory database is poor, and the pers

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Business data processing method and system, server and readable storage medium
  • Business data processing method and system, server and readable storage medium
  • Business data processing method and system, server and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0076] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0077] In the following, the implementation environment involved in the service data processing method provided by the embodiment of the present application will be briefly described.

[0078] The implementation environment includes a business data processing system, and the business data processing system may include such as figure 1 The shown data source server 101, index server 102, multiple service servers and HDFS (Hadoop Distributed FileSystem, Hadoop Distributed File System) 104, it should be noted that, figure 1 The target server 103 is only exemplarily shown, and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a business data processing method and system, a server and a readable storage medium. The method comprises the following steps that: an index server acquires original incremental service data, and performs data fragmentation on the original incremental service data to obtain incremental fragmentation service data; the index server processes the incremental fragmentation service data to obtain incremental service data with a preset data structure, and stores the incremental service data in a distributed file system HDFS; the index server updates the data version information in the target server based on the incremental service data, and sends a data version updating notification to the target server; and the target server pulls incremental service data correspondingto the updated data version information from the HDFS according to the updated data version information, and loads the incremental service data to a memory for the client to access. By adopting the method, the automation capability and the expandability of the business data processing system can be improved, and the memory resource waste can be reduced.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a business data processing method, system, server and readable storage medium. Background technique [0002] With the continuous development of business, the business data processing system needs to process more and more business data. In existing business data processing systems, business data from offline data sources needs to be manually imported into storage engines such as Redis (RemoteDictionary server, remote dictionary service) to provide online services. [0003] Take Redis as an example. Redis is an in-memory database based on memory. Redis data is stored centrally in memory. In order to avoid data loss caused by sudden downtime, RDB (Redis DataBase, the default persistence method of Redis) will periodically store data Copy a copy to memory, and then persist the copied data. [0004] However, the automation capabilities of the above business data processin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/182G06F16/11
CPCG06F16/113G06F16/116G06F16/182
Inventor 陈智铭高翔郭荣洁林锦培
Owner 广州海外扛把子网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products