Method and system for carrying out real-time data synchronization based on rsync

A real-time data, real-time synchronization technology, applied in the direction of electrical digital data processing, special data processing applications, digital data information retrieval, etc., can solve problems affecting bandwidth server performance, occupation, large system resources, etc.

Inactive Publication Date: 2020-08-14
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] This application provides a method and system for real-time data synchronization based on rsync to solve the problems ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for carrying out real-time data synchronization based on rsync
  • Method and system for carrying out real-time data synchronization based on rsync
  • Method and system for carrying out real-time data synchronization based on rsync

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0062] see figure 1 , figure 1 It is a schematic flowchart of a method for synchronizing real-time data based on rsync provided by the embodiment of the present application. Depend on figure 1 As can be seen, the method for performing real-time data synchronization based on rsync in this embodiment mainly includes the following processes:

[0063] S1: Monitor the file system in real time and obtain monitoring data.

[0064] In this embodiment, data synchronization is to synchronize the file system in the main server to each web server. The main server is a file system server, and the rsync server is deployed on the main server. Each web server is a slave server, and rsync is deployed on the slave server. client. The file systems in this embodiment include: common level file systems and massive level file systems, that is, data transmission including constant level file systems and super level file systems, all of which are applicable to the method in this application.

[...

Embodiment 2

[0096] see Figure 4 , Figure 4 It is a schematic structural diagram of a system for performing real-time data synchronization based on rsync provided in the embodiment of the present application. Depend on Figure 4 It can be seen that the system for real-time data synchronization based on rsync in this embodiment mainly includes: a monitoring module, a frequency setting module, a judging module, a full synchronization module and an incremental synchronization module.

[0097] Among them, the monitoring module is used to monitor the file system in real time and obtain monitoring data. The file system is set in the main server. The monitoring data includes: the size of the file system, file attributes and event files. The event file is used to record the occurrence of the file system. Events, events include: modify events, add events, delete events and move events. The frequency setting module is configured to set the data synchronization frequency of the file system accor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for carrying out real-time data synchronization based on rsync. The method comprises the following steps: carrying out the real-time monitoring of a filesystem, and obtaining monitoring data; setting the data synchronization frequency of the file system according to the acquired command; judging whether the size of the current file system is smaller than or equal to a set file system threshold value or not according to the data synchronization frequency; and if so, executing a full-amount synchronization mode, otherwise, executing an incremental synchronization mode. The system comprises a monitoring module, a frequency setting module, a judgment module, a total synchronization module and an increment synchronization module. Through application of the method and the device, the resource occupation of the server can be effectively reduced while the timely synchronization from the server to the client is ensured, the bandwidth is prevented from being influenced, and the overall performance of the server is improved.

Description

technical field [0001] The present application relates to the technical field of server data transmission, in particular to a method and system for real-time data synchronization based on rsync. Background technique [0002] In the field of server data transmission, it is often necessary to transfer files synchronously among multiple hosts. rsync is a remote data synchronization tool commonly used in operation and maintenance work. [0003] At present, the commonly used method for data synchronization based on rsync is usually triggered data synchronization combining rsync+inotify. Specifically, use the inotify mechanism, that is, the monitoring file system operation mechanism to realize real-time data monitoring. When inotify detects a change in the file system, it will trigger rsync to perform data synchronization operations at the first time. [0004] However, in the current method of data synchronization based on rsync, since the monitoring result of the inotify mechani...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/178G06F11/30
CPCG06F11/302G06F16/178
Inventor 亓颖
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products