Warehouse management information system two-stage data synchronization method and device based on time window, equipment and medium

Abstract

The invention discloses a warehouse management information system two-stage data synchronization method and device based on a time window, equipment and a medium, and relates to the technical field of data processing. In response to the data synchronization instruction, obtaining total data from a warehouse database based on a client deployed on a warehouse side and sending the total data to a server deployed on a superior organization side, and updating the received total data to the superior organization database by the server to complete total synchronization; and after the full-amount synchronization is completed, the client periodically acquires incremental data in the warehouse database since a previous time window and sends the incremental data to the server, and the server updates the received incremental data to a superior organ database. According to the invention, efficient synchronization of two-stage data in a warehouse management information system is realized.

Description

Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to a two-level data synchronization method, apparatus, equipment and medium for a warehouse management information system based on a time window. Background Technology

[0002] In warehouse management information systems, a hierarchical deployment architecture is typically adopted, meaning that the superior authority and each subordinate warehouse deploy their own independent warehouse management information systems. The warehouse management information systems deployed in the warehouses need to synchronize their data with the superior authority's warehouse management information system.

[0003] However, in some scenarios, both levels of the system need to have independent inbound and outbound operation capabilities: warehouse keepers need to be able to perform inbound and outbound operations through the system, and warehouse leaders need to be able to view the inventory status of their warehouse through the system; warehouse keepers in administrative offices need to be able to perform inbound and outbound operations through the system, and administrative leaders need to be able to view the inventory status of subordinate warehouses.

[0004] Existing technologies mainly include two types of data synchronization schemes: Data synchronization technologies based on database logs include Oracle Data Guard and Oracle GoldenGate. Oracle Data Guard transmits redo logs from the primary database to the standby database to maintain data synchronization, offering three modes: maximum protection, maximum availability, and maximum performance. However, its architecture is a primary-standby model, where only the primary database is readable and writable, while the standby database is read-only, failing to meet the requirement that both levels of the system need independent inbound and outbound database operation capabilities. Oracle GoldenGate is a powerful and flexible heterogeneous data replication software that can capture transaction logs at the database level and convert them into DDL / DML statements for replay on the target end. It supports bidirectional data synchronization in heterogeneous environments, but its architecture is complex, and its configuration, management, and maintenance are difficult; it requires a separate, expensive license, resulting in high costs; and it carries the risk of data conflicts in bidirectional synchronization scenarios, requiring carefully designed conflict resolution mechanisms, making implementation challenging.

[0005] (ii) Data synchronization technology based on message queues is implemented as follows: After writing data to the local database, the warehouse management information system deployed in the warehouse sends a message to the message queue. This message is then consumed in the superior authority's computer room and written to the superior authority's database. The limitation of this method is that it requires modifying the source code of the original warehouse management information system, inserting message sending code segments at the data update operation points. This not only increases the complexity of system development but may also introduce new error risks, potentially impacting the stable operation of the existing system. Summary of the Invention

[0006] This invention provides a method, apparatus, equipment, and medium for two-level data synchronization in a warehouse management information system based on a time window, which solves the problem of efficient two-level data synchronization in the warehouse management information system.

[0007] To achieve the above objectives, this application adopts the following technical solution: Firstly, a two-level data synchronization method for a warehouse management information system based on a time window is provided, including: Obtain data synchronization instructions; In response to the data synchronization command, the client deployed on the warehouse side retrieves all data from the warehouse database and sends it to the server deployed on the superior authority side. The server then updates the superior authority database with the received all data to complete the full synchronization. After the full synchronization is completed, the client periodically retrieves incremental data from the warehouse database since the previous time window and sends the incremental data to the server. The server then updates the received incremental data to the superior authority's database.

[0008] Secondly, a two-level data synchronization device for a warehouse management information system based on a time window is provided, comprising: The synchronization command acquisition module is used to acquire data synchronization commands; The full synchronization module is used to respond to the data synchronization command, obtain full data from the warehouse database based on the client deployed on the warehouse side and send it to the server deployed on the superior authority side. The server updates the received full data to the superior authority database to complete the full synchronization. The incremental synchronization module is used to periodically obtain incremental data from the warehouse database since the previous time window after the full synchronization is completed, and send the incremental data to the server. The server updates the received incremental data to the superior authority's database.

[0009] Thirdly, an electronic device is provided, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the two-level data synchronization method for a warehouse management information system based on a time window as described in the first aspect.

[0010] Fourthly, a readable storage medium is provided, on which a program or instructions are stored, which, when executed by a processor, implement the steps of the two-level data synchronization method for a warehouse management information system based on a time window as described in the first aspect. Attached Figure Description

[0011] Figure 1A schematic diagram of a two-level data synchronization system architecture for a warehouse management information system based on a time window, provided for an embodiment of this application; Figure 2 A schematic flowchart illustrating a two-level data synchronization method for a warehouse management information system based on a time window, provided for an embodiment of this application; Figure 3 A schematic flowchart illustrating a full synchronization process provided for an embodiment of this application; Figure 4 A schematic flowchart illustrating an incremental synchronization process provided in an embodiment of this application; Figure 5 A schematic diagram of the structure of a two-level data synchronization device for a warehouse management information system based on a time window, provided in an embodiment of this application; Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0012] To further illustrate the technical means and effects adopted by the present invention to achieve its intended purpose, the technical solutions in the embodiments of this application are clearly described. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art are within the scope of protection of this application.

[0013] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0014] The steps described in this application and the flowcharts in the accompanying drawings are not necessarily strictly executed according to the step numbers; the execution order of the steps can be changed. Furthermore, certain steps can be omitted, multiple steps can be combined into one step, and / or one step can be broken down into multiple steps.

[0015] This specification provides a two-level data synchronization method for a warehouse management information system based on a time window, and also relates to a two-level data synchronization device for a warehouse management information system based on a time window, a computer device, and a computer-readable storage medium. The following describes each item in detail with reference to the accompanying drawings and preferred embodiments.

[0016] Please see first. Figure 1 This paper describes the two-level data synchronization system architecture of the warehouse management information system based on time windows provided in the embodiments of this application.

[0017] include: The data synchronization software server is deployed in the computer room of the superior authority; the superior authority's database is also provided on the superior authority's side; the data synchronization software server is equipped with a data synchronization software database. The data synchronization software client is deployed in the warehouse-side computer room; the warehouse side has a warehouse database; the data synchronization software client is equipped with a data synchronization software database.

[0018] The business databases and synchronization software of the warehouse and the organization are deployed separately, so that they do not affect the operation of their respective local systems.

[0019] Please see Figure 2 This application provides a two-level data synchronization method for a warehouse management information system based on a time window, including: Step S1: Obtain data synchronization instructions; Step S2: In response to the data synchronization command, the client deployed on the warehouse side retrieves the full amount of data from the warehouse database and sends it to the server deployed on the superior authority side. The server updates the received full amount of data to the superior authority database to complete the full synchronization. Step S3: After the full synchronization is completed, the client periodically obtains incremental data from the warehouse database since the previous time window and sends the incremental data to the server. The server updates the warehouse database and the superior authority database with the received incremental data.

[0020] Further, step S2: In response to the data synchronization command, the client deployed on the warehouse side retrieves all data from the warehouse database and sends it to the server deployed on the superior authority side. The server updates the superior authority database with the received all data to complete the full synchronization, including: Step S21: The client configures the full data as synchronized table data and records the full synchronization time point in the full synchronization log table; the synchronized table data is exported as a data file and sent to the server.

[0021] Step S22: The server receives and stores the data file in the server database, and sends a full data entry status back to the client.

[0022] Step S23: The client updates the record status in the full synchronization log table according to the full data entry status, and updates the data file in the server database to the superior authority database.

[0023] Further, in step S3: after completing the full synchronization, the client periodically retrieves incremental data from the warehouse database since the previous time window and sends the incremental data to the server. The server updates the warehouse database and the superior authority database with the received incremental data, including: Step S31: The client records the start time and end time of the time window in the incremental synchronization time window table; based on the last update time field in the incremental synchronization time window table, it queries the incremental data updated within the time window and sends it to the server; wherein, the start time is the last full synchronization time or the last incremental synchronization end time.

[0024] Step S32: The server receives and stores the incremental data in the server database, and sends feedback on the incremental data entry status to the client.

[0025] Step S33: The client updates the record status in the incremental synchronization log table according to the incremental entry status, and updates the incremental data in the server database to the warehouse database and the superior authority database.

[0026] Step S34: After updating the incremental synchronization log table, the client determines whether to enter the next synchronization time window; if yes, then repeat steps S31 to S33; if no, then end.

[0027] In specific implementation, refer to the full synchronization process. Figure 3 After the client starts the process, it first configures the data to be synchronized, records the time in the full synchronization log table, exports the synchronization table data as a JSON file, and sends it to the server. The server receives the data sent by the client, stores it in the database table, sends the full data entry status to the client, and the client receives the entry status from the server, updates the record status in the full synchronization log table, and updates the data in the server's database to the superior authority's database. The process ends.

[0028] In the incremental synchronization process, see Figure 4After the client starts, it records the start and end times in the incremental synchronization time window table. The start time is the full synchronization time or the last incremental synchronization time, and the end time is the current time. Then, based on the last update time in the log, it queries the incremental data within the current time window and sends it to the server. The server receives the data and stores it in the database table, and sends the incremental entry status to the client. The client receives the entry status from the server, updates the record status in the incremental synchronization log table, updates the data in the server's database to the warehouse database and the superior authority's database, and determines whether to enter the next synchronization time window. If yes, the above steps are repeated; otherwise, the process ends.

[0029] This application's embodiment achieves data synchronization without intrusion by independently deploying client and server synchronization software, without modifying the existing warehouse system's code or database configuration. This solves the pain points of high costs and potential risks associated with modifying existing systems, and eliminates the need for expensive licenses like those required for Oracle GoldenGate, significantly reducing deployment costs. In the two-level synchronization process, full synchronization handles the initial data initialization, while incremental synchronization is executed cyclically through time windows, ensuring near real-time data transmission while avoiding the performance overhead of real-time capture. Furthermore, unlike traditional synchronization methods where success is untraceable, this application improves the monitorability and reliability of the synchronization process through time and status feedback from the server and client.

[0030] See Figure 5 Corresponding to the above-described embodiment of the two-level data synchronization method for a warehouse management information system based on time windows, this application embodiment provides a two-level data synchronization device for a warehouse management information system based on time windows, comprising: Synchronization instruction acquisition module 1001 is used to acquire data synchronization instructions; The full synchronization module 1002 is used to respond to the data synchronization command, obtain full data from the warehouse database based on the client deployed on the warehouse side and send it to the server deployed on the superior authority side. The server updates the received full data to the superior authority database to complete the full synchronization. The incremental synchronization module 1003 is used to, after the full synchronization is completed, periodically obtain incremental data from the warehouse database since the previous time window and send the incremental data to the server. The server updates the warehouse database and the hierarchical organization database with the received incremental data.

[0031] Furthermore, the full synchronization module 1002 is specifically used for: The client configures the full data as synchronized table data and records the full synchronization time point in the full synchronization log table; the synchronized table data is exported as a data file and sent to the server. The server receives and stores the data file in the server database, and sends a full data entry status back to the client. The client updates the record status in the full synchronization log table according to the full data entry status, and updates the data file in the server database to the superior authority database.

[0032] Furthermore, the incremental synchronization module 1003 is specifically used for: The client records the start and end times of the time window in the incremental synchronization time window table; based on the last update time field in the incremental synchronization time window table, it queries the incremental data updated within the time window and sends it to the server; wherein, the start time is the last full synchronization time or the last incremental synchronization end time. The server receives and stores the incremental data in the server database, and sends the incremental data entry status back to the client. The client updates the record status in the incremental synchronization log table according to the incremental entry status, and updates the incremental data in the server database to the warehouse database and the superior authority database.

[0033] Furthermore, the incremental synchronization module 1003 is specifically used for: after updating the incremental synchronization log table, the client determines whether to enter the next synchronization time window; if not, the process ends; if so, the following steps are repeated: The client records the start and end times of the time window in the incremental synchronization time window table; based on the last update time field in the incremental synchronization time window table, it queries the incremental data updated within the time window and sends it to the server. The server receives and stores the incremental data in the server database, and sends the incremental data entry status back to the client. The client updates the record status in the incremental synchronization log table according to the incremental entry status, and updates the incremental data in the server database to the warehouse database and the superior authority database.

[0034] The above-mentioned two-level data synchronization device for the warehouse management information system based on time windows implements the steps and processes of the above-mentioned two-level data synchronization method for the warehouse management information system based on time windows, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0035] See Figure 6 Corresponding to the above-described embodiment of the two-level data synchronization method for a warehouse management information system based on time windows, this application provides an electronic device. The electronic device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, it implements the steps and processes of the above-described embodiment of the two-level data synchronization method for a warehouse management information system based on time windows, and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0036] The memory 1009 can be used to store software programs and various data. The memory 1009 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback function, image playback function, etc.). Furthermore, the memory 1009 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1009 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0037] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into the processor 1010.

[0038] Corresponding to the above-described embodiment of the two-level data synchronization method for a warehouse management information system based on time windows, this application embodiment also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the steps and processes of the above-described embodiment of the two-level data synchronization method for a warehouse management information system based on time windows, and achieve the same technical effect. To avoid repetition, these will not be described again here.

[0039] The processor is the processor in the electronic device described in the above embodiments of this application. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk.

[0040] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0041] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0042] It is understood that the embodiments of this application have been described above in conjunction with the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. As those skilled in the art will know, various changes or equivalent substitutions can be made to these features and embodiments without departing from the spirit and scope of the invention. Furthermore, those skilled in the art, under the guidance or instruction of this application, can modify these features and embodiments to adapt to specific situations and materials without departing from the spirit and scope of the invention. Therefore, this invention is not limited to the specific embodiments disclosed herein, and all embodiments falling within the scope of the claims of this application are within the protection scope of this invention.

Claims

1. A two-stage data synchronization method for a warehouse management information system based on a time window, characterized in that, include: Obtain data synchronization instructions; In response to the data synchronization command, the client deployed on the warehouse side retrieves all data from the warehouse database and sends it to the server deployed on the superior authority side. The server then updates the superior authority database with the received all data to complete the full synchronization. After the full synchronization is completed, the client periodically retrieves incremental data from the warehouse database since the previous time window and sends the incremental data to the server. The server then updates the warehouse database and the superior authority database with the received incremental data.

2. The two-level data synchronization method for a warehouse management information system based on a time window according to claim 1, characterized in that, In response to the data synchronization command, the client deployed on the warehouse side retrieves full data from the warehouse database and sends it to the server deployed on the superior authority side. The server then updates the superior authority's database with the received full data to complete the full synchronization, including: The client configures the full data as synchronized table data and records the full synchronization time point in the full synchronization log table; the synchronized table data is exported as a data file and sent to the server. The server receives and stores the data file in the server database, and sends a full data entry status back to the client. The client updates the record status in the full synchronization log table according to the full data entry status, and updates the data file in the server database to the superior authority database.

3. The two-level data synchronization method for a warehouse management information system based on a time window according to claim 1, characterized in that, After completing the full synchronization, the client periodically retrieves incremental data from the warehouse database since the previous time window and sends the incremental data to the server. The server then updates the warehouse database and the superior authority database with the received incremental data, including: The client records the start and end times of the time window in the incremental synchronization time window table; based on the last update time field in the incremental synchronization time window table, it queries the incremental data updated within the time window and sends it to the server; wherein, the start time is the last full synchronization time or the last incremental synchronization end time. The server receives and stores the incremental data in the server database, and sends the incremental data entry status back to the client. The client updates the record status in the incremental synchronization log table according to the incremental entry status, and updates the incremental data in the server database to the warehouse database and the superior authority database.

4. The two-level data synchronization method for a warehouse management information system based on a time window according to claim 3, characterized in that, After updating the incremental synchronization log table, the client determines whether to enter the next synchronization time window; if not, the process ends; if so, the following steps are repeated: The client records the start and end times of the time window in the incremental synchronization time window table; Based on the last update time field in the incremental synchronization time window table, query the incremental data updated within the time window and send it to the server. The server receives and stores the incremental data in the server database, and sends the incremental data entry status back to the client. The client updates the record status in the incremental synchronization log table according to the incremental entry status, and updates the incremental data in the server database to the warehouse database and the superior authority database.

5. A two-stage data synchronization device for a warehouse management information system based on a time window, characterized in that, include: The synchronization command acquisition module is used to acquire data synchronization commands; The full synchronization module is used to respond to the data synchronization command, obtain full data from the warehouse database based on the client deployed on the warehouse side and send it to the server deployed on the superior authority side. The server updates the received full data to the superior authority database to complete the full synchronization. The incremental synchronization module is used to periodically obtain incremental data from the warehouse database since the previous time window after the full synchronization is completed, and send the incremental data to the server. The server updates the warehouse database and the superior authority database with the received incremental data.

6. The two-level data synchronization device for a warehouse management information system based on a time window according to claim 5, characterized in that, The full synchronization module is specifically used for: The client configures the full data as synchronized table data and records the full synchronization time point in the full synchronization log table; the synchronized table data is exported as a data file and sent to the server. The server receives and stores the data file in the server database, and sends a full data entry status back to the client. The client updates the record status in the full synchronization log table according to the full data entry status, and updates the data file in the server database to the superior authority database.

7. The two-level data synchronization device for a warehouse management information system based on a time window according to claim 5, characterized in that, The incremental synchronization module is specifically used for: The client records the start and end times of the time window in the incremental synchronization time window table; based on the last update time field in the incremental synchronization time window table, it queries the incremental data updated within the time window and sends it to the server; wherein, the start time is the last full synchronization time or the last incremental synchronization end time. The server receives and stores the incremental data in the server database, and sends the incremental data entry status back to the client. The client updates the record status in the incremental synchronization log table according to the incremental entry status, and updates the incremental data in the server database to the warehouse database and the superior authority database.

8. The two-level data synchronization device for a warehouse management information system based on a time window according to claim 7, characterized in that, The incremental synchronization module is further used for: After updating the incremental synchronization log table, the client determines whether to enter the next synchronization time window; if not, the process ends; if so, the following steps are repeated: The client records the start and end times of the time window in the incremental synchronization time window table; Based on the last update time field in the incremental synchronization time window table, query the incremental data updated within the time window and send it to the server. The server receives and stores the incremental data in the server database, and sends the incremental data entry status back to the client. The client updates the record status in the incremental synchronization log table according to the incremental entry status, and updates the incremental data in the server database to the warehouse database and the superior authority database.

9. An electronic device, comprising: The electronic device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, it implements the steps of the two-level data synchronization method for a warehouse management information system based on a time window as described in any one of claims 1 to 4.

10. A readable storage medium, characterized by, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the two-level data synchronization method for a warehouse management information system based on a time window as described in any one of claims 1 to 4.

Images