File data synchronous conversion method and device, equipment and storage medium

Abstract

The invention relates to the technical field of file data synchronous conversion, and discloses a file data synchronous conversion method and device, equipment and a storage medium. By obtaining a file data synchronous demand list, the file data conversion processing capacity of each synchronous database is considered; the method comprises the following steps of: optimizing and solving a conversion execution strategy of a file data synchronization demand list by taking the shortest total delay duration when a plurality of file data synchronization contents are executed as a target, and executing a conversion processing synchronous database by reasonably distributing each file data synchronization content; and the efficiency of executing file data synchronous conversion among a plurality of database systems is improved. Meanwhile, the conversion execution strategy is dynamically updated by monitoring the difference between the actual execution time period and the standard execution time period of the file data synchronization action, and the possible data volume change of the synchronous database is considered, so that the environmental adaptability of the file data synchronization conversion process is improved; the superiority and accuracy of the overall operation performance of the system can be obviously improved.

Description

Technical Field

[0001] The present invention relates to the technical field of file data synchronous conversion, and in particular to a file data synchronous conversion method, device, equipment and storage medium. Background Art

[0002] File data synchronization conversion is a technology that converts file data in a database system to another database system according to user needs. This technology is widely used in today's multi-database management systems (such as file data synchronization between subsidiaries or departments in a group enterprise, data backup and disaster recovery of important data between multiple databases in a distributed system, etc.).

[0003] In practical applications, the efficiency of file data synchronization conversion between two database systems has a significant impact on the superiority and accuracy of system operation performance. The synchronization conversion process usually includes data format conversion actions and data transmission and transfer actions. With the continuous improvement of data transmission network bandwidth, the impact of data transmission and transfer actions on file data synchronization conversion efficiency has gradually diminished. The optimization research on data format conversion actions has become particularly important. The efficiency of file data synchronization conversion between two database systems is affected by many factors, such as format conversion content (such as conversion between integers and floating-point numbers, conversion from XML data format to JSON data format), format conversion subject (the data format conversion execution subject can be the main database before data is sent or the conversion database after data is sent) and conversion subject processing capacity (caused by different hardware resources of different format conversion subjects). Therefore, when facing the scenario of multiple database systems performing file data synchronization conversion with each other, there are problems such as low file data synchronization conversion efficiency, great optimization difficulty, and impact on the superiority and accuracy of the overall system operation performance.

[0004] Therefore, how to improve the efficiency of synchronous file data conversion between multiple database systems, reduce the difficulty of optimization, and improve the superiority and accuracy of the overall system performance is a technical problem that needs to be solved urgently. Summary of the invention

[0005] The present invention provides a file data synchronous conversion method, device, equipment and storage medium, aiming to solve at least one of the above technical problems.

[0006] To achieve the above object, the present invention provides a method for synchronously converting file data, comprising the following steps:

[0007] Obtaining a file data synchronization requirement list, and extracting a number of file data synchronization information of each synchronization database within a target period stored in the file data synchronization requirement list;

[0008] Determine the conversion processing time of each file data synchronization content in the synchronization data main library and the synchronization data conversion library respectively according to the first identification information of the synchronization data main library, the second identification information of the synchronization data conversion library and the file data synchronization content in each piece of the file data synchronization information;

[0009] Based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, taking into account the file data conversion processing capabilities of the synchronization data main library and the synchronization data conversion library, and taking the shortest total delay time when a number of file data synchronization contents are executed as the goal, a conversion execution strategy for the file data synchronization requirement list is generated;

[0010] Driving the file data synchronization converters connected to the plurality of synchronization databases to execute the file data synchronization action for each piece of file data synchronization information according to the conversion execution strategy; wherein the conversion execution strategy includes a target synchronization database and a standard execution period for executing the file data conversion action for the file data synchronization content corresponding to each piece of file data synchronization information;

[0011] The actual execution time periods of a plurality of file data synchronization actions in each file data synchronization conversion execution cycle within the target time period are monitored, and the conversion execution strategy is updated based on the standard execution time period and the actual execution time period.

[0012] Optionally, the step of obtaining a file data synchronization requirement list and extracting a plurality of file data synchronization information of each synchronization database within a target period stored in the file data synchronization requirement list specifically includes:

[0013] Acquire the file data synchronization requirements of each synchronization database; wherein the file data synchronization requirements are configured as file data synchronization requirements predefined by the user for the functions of the synchronization database; wherein the file data synchronization requirements include a synchronization data subject library for executing the file data synchronization action, a synchronization data conversion library, file data synchronization content and a file data synchronization trigger time;

[0014] querying the first identification information of the synchronization data subject library and the second identification information of the synchronization data conversion library, and generating file data synchronization information corresponding to each file data synchronization requirement based on the first identification information, the second identification information, the file data synchronization content and the file data synchronization trigger time;

[0015] The file data synchronization information of each synchronization database whose file data synchronization trigger time is within the target time period is aggregated to construct a file data synchronization requirement list.

[0016] Optionally, according to the first identification information of the synchronization data main library, the second identification information of the synchronization data conversion library, and the file data synchronization content in each piece of the file data synchronization information, determine the conversion processing time steps of each file data synchronization content in the synchronization data main library and the synchronization data conversion library respectively, specifically including:

[0017] According to the first identification information of the synchronization data main library and the second identification information of the synchronization data conversion library in each piece of the file data synchronization information, match several conversion processing historical records of the synchronization data main library and the synchronization data conversion library when converting and processing the same file data synchronization content in the synchronization database conversion processing historical database;

[0018] Based on the average value of the conversion processing times corresponding to several conversion processing historical records, determine the conversion processing times of the file data synchronization content in each piece of the file data synchronization information in the synchronization data main library and the synchronization data conversion library respectively.

[0019] Optionally, based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, considering the file data conversion processing capabilities of the synchronization data main library and the synchronization data conversion library, with the goal of minimizing the total delay duration when several file data synchronization contents are executed, generate the conversion execution strategy steps of the file data synchronization requirement list, specifically including:

[0020] Based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, with the constraint that after the conversion processing actions of the file data synchronization content in each piece of the file data synchronization information are assigned to the synchronization data main library or the synchronization data conversion library, each synchronization database executes the conversion processing actions of each file data synchronization content assigned to it in the order of the file data synchronization trigger time in the file data synchronization requirement list, and with the optimization goal of minimizing the sum of the differences between the completion times when the conversion processing actions of each file data synchronization content are executed by the corresponding synchronization database and the file data synchronization trigger time, optimize and solve whether the conversion processing actions of the file data synchronization content in each piece of the file data synchronization information are assigned to the synchronization data main library or the synchronization data conversion library;

[0021] According to the assignment result of whether the conversion processing actions of the file data synchronization content in each piece of the file data synchronization information are assigned to the synchronization data main library or the synchronization data conversion library and the standard execution period when each file data synchronization content is executed by the corresponding synchronization database, generate the conversion execution strategy of the file data synchronization requirement list.

[0022] Optionally, a file data synchronization converter connected to a plurality of synchronization databases is driven to execute a file data synchronization action for each file data synchronization information according to the conversion execution strategy; wherein the conversion execution strategy includes a target synchronization database and a standard execution period step for executing a file data conversion action for file data synchronization content corresponding to each file data synchronization information, specifically including:

[0023] Sending the conversion execution strategy of the file data synchronization requirement list to a file data synchronization converter connected to a plurality of synchronization databases, driving the file data synchronization converter to execute the file data synchronization action of each file data synchronization information according to the conversion execution strategy;

[0024] The file data synchronization action is configured to include a data sending action of sending the file data synchronization content in each file data synchronization information from the synchronization data main library to the synchronization data conversion library and a conversion processing action of converting the file data synchronization content in each file data synchronization information from the data format of the synchronization data main library to the data format of the synchronization data conversion library;

[0025] The execution subject of the conversion processing action is configured as a target synchronization database for executing the file data conversion action for executing the file data synchronization content corresponding to each file data synchronization information recorded in the conversion execution strategy of the file data synchronization requirement list.

[0026] Optionally, the standard execution period during which each file data synchronization content is executed by the corresponding synchronization database is determined in the following manner:

[0027] Calculate the conversion processing time of the file data synchronization content assigned to each synchronization database, and determine the execution order of each file data synchronization content according to the order of the file data synchronization trigger time in the file data synchronization requirement list;

[0028] Determine whether the end time of each synchronization database after executing the previous file data synchronization content is later than the file data synchronization trigger time of the next file data synchronization content; if so, immediately execute the conversion processing action of the next file data synchronization content; if not, execute the conversion processing action at the file data synchronization trigger time of the next file data synchronization content;

[0029] According to the conversion processing action of each synchronization database executing each file data synchronization content, a standard execution time period for each file data synchronization content to be executed by the corresponding synchronization database is determined.

[0030] Optionally, monitoring the actual execution time periods of a plurality of file data synchronization actions in each file data synchronization conversion execution cycle within the target time period, and updating the conversion execution strategy step based on the standard execution time period and the actual execution time period specifically includes:

[0031] Monitor the actual execution time periods of a plurality of file data synchronization actions in each file data synchronization conversion execution cycle within the target time period, and calculate the overall time period overlap ratio between the actual execution time periods of the plurality of file data synchronization actions and the corresponding standard execution time periods;

[0032] It is determined whether the overall time period overlap ratio is less than a preset ratio value. If so, the file data synchronization requirement list is re-acquired to generate a conversion execution strategy for a subsequent file data synchronization conversion execution cycle.

[0033] In addition, in order to achieve the above-mentioned purpose, the present invention also provides a file data synchronous conversion device, comprising:

[0034] An acquisition module, used to acquire a file data synchronization requirement list, and extract several pieces of file data synchronization information of each synchronization database within a target period stored in the file data synchronization requirement list;

[0035] A determination module, configured to determine the conversion processing time of each file data synchronization content in the synchronization data main library and the synchronization data conversion library respectively according to the first identification information of the synchronization data main library, the second identification information of the synchronization data conversion library and the file data synchronization content in each piece of the file data synchronization information;

[0036] A generating module, configured to generate a conversion execution strategy for a file data synchronization requirement list based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, taking into account the file data conversion processing capabilities of the synchronization data main library and the synchronization data conversion library, and taking the shortest total delay time when a number of file data synchronization contents are executed as a goal;

[0037] An execution module, used to drive the file data synchronization converters connected to the plurality of synchronization databases to execute the file data synchronization action for each file data synchronization information according to the conversion execution strategy; wherein the conversion execution strategy includes a target synchronization database and a standard execution period for executing the file data conversion action for the file data synchronization content corresponding to each file data synchronization information;

[0038] The updating module is used to monitor the actual execution time periods of several file data synchronization actions in each file data synchronization conversion execution cycle within the target time period, and update the conversion execution strategy based on the standard execution time period and the actual execution time period.

[0039] In addition, in order to achieve the above-mentioned purpose, the present invention also provides a file data synchronous conversion device, which includes: a memory, a processor, and a file data synchronous conversion program stored on the memory and executable on the processor, and when the file data synchronous conversion program is executed by the processor, the steps of the file data synchronous conversion method described above are implemented.

[0040] In addition, in order to achieve the above-mentioned purpose, the present invention also provides a storage medium, on which a file data synchronous conversion program is stored, and when the file data synchronous conversion program is executed by a processor, the steps of the above-mentioned file data synchronous conversion method are implemented.

[0041] The beneficial effects of the present invention are as follows: a method, device, equipment and storage medium for synchronous conversion of file data are proposed, by extracting several pieces of file data synchronization information of each synchronous database within the target period stored in the file data synchronization requirement list, determining the conversion processing time of each file data synchronization content in the synchronous data main library and the synchronous data conversion library respectively, based on the conversion processing time and the file data synchronization trigger time, considering the file data conversion processing capacity of each synchronous database, taking the shortest total delay time when several file data synchronization contents are executed as the goal, optimizing and solving the conversion execution strategy of the file data synchronization requirement list, by reasonably allocating the synchronous database for each file data synchronization content to perform conversion processing, improving the efficiency of multiple database systems in performing file data synchronous conversion with each other. At the same time, by monitoring the difference between the actual execution period and the standard execution period of the file data synchronization action to dynamically update the conversion execution strategy, considering the possible changes in the amount of data in the synchronous database, improving the environmental adaptability of the file data synchronous conversion process, and significantly improving the superiority and accuracy of the overall operating performance of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 A schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention;

[0043] Figure 2 A schematic diagram of a flow chart of an embodiment of a method for synchronously converting file data of the present invention;

[0044] Figure 3 The present invention is a structural block diagram of a device for synchronously converting file data in an embodiment of the present invention.

[0045] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0046] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0047] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0048] like Figure 1 As shown, Figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention.

[0049] like Figure 1 As shown, the device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or it may be a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0050] Those skilled in the art will understand that Figure 1 The structure of the device shown in the figure does not constitute a limitation of the device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0051] like Figure 1 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a file data synchronization conversion program.

[0052] exist Figure 1 In the terminal shown, the network interface 1004 is mainly used to connect to the backend server and perform data communication with the backend server; the user interface 1003 is mainly used to connect to the client (user end) and perform data communication with the client; and the processor 1001 can be used to call the file data synchronization conversion program stored in the memory 1005 and perform the following operations:

[0053] Obtaining a file data synchronization requirement list, and extracting a number of file data synchronization information of each synchronization database within a target period stored in the file data synchronization requirement list;

[0054] Determine the conversion processing time of each file data synchronization content in the synchronization data main library and the synchronization data conversion library respectively according to the first identification information of the synchronization data main library, the second identification information of the synchronization data conversion library and the file data synchronization content in each piece of the file data synchronization information;

[0055] Based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, taking into account the file data conversion processing capabilities of the synchronization data main library and the synchronization data conversion library, and taking the shortest total delay time when a number of file data synchronization contents are executed as the goal, a conversion execution strategy for the file data synchronization requirement list is generated;

[0056] Driving the file data synchronization converters connected to the plurality of synchronization databases to execute the file data synchronization action for each piece of file data synchronization information according to the conversion execution strategy; wherein the conversion execution strategy includes a target synchronization database and a standard execution period for executing the file data conversion action for the file data synchronization content corresponding to each piece of file data synchronization information;

[0057] The actual execution time periods of a plurality of file data synchronization actions in each file data synchronization conversion execution cycle within the target time period are monitored, and the conversion execution strategy is updated based on the standard execution time period and the actual execution time period.

[0058] The specific embodiments of the present invention applied to the device are basically the same as the embodiments of the following application file data synchronous conversion method, and will not be described in detail here.

[0059] The embodiment of the present invention provides a method for synchronously converting file data, referring to Figure 2 , Figure 2 The figure is a flowchart of an embodiment of the method for synchronous conversion of file data of the present invention.

[0060] In this embodiment, the file data synchronous conversion method includes the following steps:

[0061] S100: Acquire a file data synchronization requirement list, and extract a number of file data synchronization information of each synchronization database within a target period stored in the file data synchronization requirement list;

[0062] S200: Determine the conversion processing time of each file data synchronization content in the synchronization data main library and the synchronization data conversion library respectively according to the first identification information of the synchronization data main library, the second identification information of the synchronization data conversion library and the file data synchronization content in each piece of the file data synchronization information;

[0063] S300: Based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, taking into account the file data conversion processing capabilities of the synchronization data main library and the synchronization data conversion library, and taking the shortest total delay time when a number of file data synchronization contents are executed as the goal, a conversion execution strategy for the file data synchronization requirement list is generated;

[0064] S400: driving a file data synchronization converter connected to a plurality of synchronization databases to execute a file data synchronization action for each piece of file data synchronization information according to the conversion execution strategy; wherein the conversion execution strategy includes a target synchronization database and a standard execution period for executing a file data conversion action for a file data synchronization content corresponding to each piece of file data synchronization information;

[0065] S500: monitoring the actual execution time periods of a plurality of file data synchronization actions in each file data synchronization conversion execution cycle within a target time period, and updating the conversion execution strategy based on the standard execution time period and the actual execution time period.

[0066] It should be noted that the efficiency of file data synchronization conversion between two database systems is affected by many factors, such as format conversion content (for example, conversion between integers and floating-point numbers, conversion from XML data format to JSON data format), format conversion subject (the subject executing data format conversion can be the main database before data is sent or the conversion database after data is sent) and conversion subject processing capability (caused by different hardware resources possessed by different format conversion subjects). As a result, when faced with the scenario of multiple database systems performing file data synchronization conversion with each other, there are problems such as low file data synchronization conversion efficiency, great optimization difficulty, and impact on the superiority and accuracy of the overall system operating performance.

[0067] In order to solve the above problems, this embodiment extracts several pieces of file data synchronization information of each synchronization database within the target time period stored in the file data synchronization requirement list, determines the conversion processing time of each file data synchronization content in the synchronization data main library and the synchronization data conversion library respectively, and based on the conversion processing time and the file data synchronization trigger time, considers the file data conversion processing capability of each synchronization database, and takes the shortest total delay time when several file data synchronization contents are executed as the goal, optimizes and solves the conversion execution strategy of the file data synchronization requirement list, and improves the efficiency of performing file data synchronization conversion between multiple database systems by reasonably allocating the synchronization database that performs conversion processing for each file data synchronization content.

[0068] In a preferred embodiment, the step of obtaining a file data synchronization requirement list and extracting a plurality of file data synchronization information of each synchronization database within a target period stored in the file data synchronization requirement list specifically includes:

[0069] S110: Acquire a file data synchronization requirement of each synchronization database; wherein the file data synchronization requirement is configured as a file data synchronization requirement predefined by a user for a function of the synchronization database; wherein the file data synchronization requirement includes a synchronization data subject library for executing a file data synchronization action, a synchronization data conversion library, file data synchronization content, and a file data synchronization trigger time;

[0070] S120: querying the first identification information of the synchronization data main library and the second identification information of the synchronization data conversion library, and generating file data synchronization information corresponding to each file data synchronization requirement based on the first identification information, the second identification information, the file data synchronization content and the file data synchronization trigger time;

[0071] S130: Summarize the file data synchronization information of each synchronization database whose file data synchronization trigger time is within the target period, and construct a file data synchronization requirement list.

[0072] In this embodiment, the file data synchronization requirement list is obtained by obtaining the file data synchronization requirements pre-defined by the user for the functions of each synchronization database, and based on the file data synchronization requirements, the first identification information of the synchronization data subject library, the second identification information of the synchronization data conversion library, the file data synchronization content and the file data synchronization trigger time in each file data synchronization information are determined, and finally the file data synchronization information corresponding to each synchronization database is summarized to construct the final file data synchronization requirement list.

[0073] In a preferred embodiment, according to the first identification information of the synchronization data main library, the second identification information of the synchronization data conversion library and the file data synchronization content in each piece of the file data synchronization information, determining the conversion processing time steps of each file data synchronization content in the synchronization data main library and the synchronization data conversion library respectively includes:

[0074] S210: According to the first identification information of the synchronization data main library and the second identification information of the synchronization data conversion library in each piece of the file data synchronization information, matching, in a synchronization database conversion processing history database, a plurality of conversion processing history records when the synchronization data main library and the synchronization data conversion library convert and process the same file data synchronization content;

[0075] S220: Determine the conversion processing time of the file data synchronization content in each piece of the file data synchronization information in the synchronization data main library and the synchronization data conversion library respectively based on the average value of the conversion processing time corresponding to the plurality of conversion processing history records.

[0076] In this embodiment, the first identification information of the synchronization data main library and the second identification information of the synchronization data conversion library in each file data synchronization information are utilized, and the conversion processing time for the same file data synchronization content of each synchronization database in the process of completing the conversion processing historical task is obtained. The average value of several conversion processing times for the same file data synchronization content is used as the conversion processing time of the corresponding synchronization database in processing the file data synchronization content. In this way, the file data conversion processing capability of each synchronization database is reasonably measured, and the accuracy of the file data synchronization execution strategy is improved.

[0077] In a preferred embodiment, based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, taking into account the file data conversion processing capabilities of the synchronization data main library and the synchronization data conversion library, and taking the shortest total delay time when a number of file data synchronization contents are executed as the goal, a conversion execution strategy step of generating a file data synchronization requirement list specifically includes:

[0078] S310: Based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, after the conversion processing action of the file data synchronization content in each piece of the file data synchronization information is assigned to the synchronization data main library or the synchronization data conversion library, each synchronization database executes the conversion processing action of each file data synchronization content assigned in the order of the file data synchronization trigger time in the file data synchronization requirement list as a constraint condition, after the conversion processing action of the file data synchronization content in each piece of the file data synchronization information is assigned to the synchronization data main library or the synchronization data conversion library, the cumulative sum of the difference between the completion time and the file data synchronization trigger time of each conversion processing action of the file data synchronization content executed by the corresponding synchronization database after the conversion processing action of the file data synchronization content in each piece of the file data synchronization information is assigned to the synchronization data main library or the synchronization data conversion library is minimized as the optimization goal, and the optimization solution is made as to whether the conversion processing action of the file data synchronization content in each piece of the file data synchronization information is assigned to the synchronization data main library or the synchronization data conversion library;

[0079] S320: Generate a conversion execution strategy for the file data synchronization requirement list according to the allocation result of whether the conversion processing action of the file data synchronization content in each file data synchronization information is allocated to the synchronization data main library or the synchronization data conversion library and the standard execution period of each file data synchronization content being executed by the corresponding synchronization database.

[0080] On this basis, the file data synchronization converters connected to the plurality of synchronization databases are driven to execute the file data synchronization action for each file data synchronization information according to the conversion execution strategy; wherein the conversion execution strategy includes a target synchronization database and a standard execution period step for executing the file data conversion action for the file data synchronization content corresponding to each file data synchronization information, specifically including:

[0081] S410: sending the conversion execution strategy of the file data synchronization requirement list to the file data synchronization converters connected to a plurality of synchronization databases, driving the file data synchronization converters to execute the file data synchronization action of each file data synchronization information according to the conversion execution strategy;

[0082] The file data synchronization action is configured to include a data sending action of sending the file data synchronization content in each file data synchronization information from the synchronization data main library to the synchronization data conversion library and a conversion processing action of converting the file data synchronization content in each file data synchronization information from the data format of the synchronization data main library to the data format of the synchronization data conversion library;

[0083] The execution subject of the conversion processing action is configured as a target synchronization database for executing the file data conversion action for executing the file data synchronization content corresponding to each file data synchronization information recorded in the conversion execution strategy of the file data synchronization requirement list.

[0084] Furthermore, the standard execution period during which each file data synchronization content is executed by the corresponding synchronization database is determined in the following manner:

[0085] S321: Calculate the conversion processing time of the file data synchronization content assigned to each synchronization database, and determine the execution order of each file data synchronization content according to the order of the file data synchronization triggering time in the file data synchronization requirement list;

[0086] S322: Determine whether the end time of each synchronization database after executing the previous file data synchronization content is later than the file data synchronization trigger time of the next file data synchronization content; if so, immediately execute the conversion processing action of the next file data synchronization content; if not, execute the conversion processing action at the file data synchronization trigger time of the next file data synchronization content;

[0087] S323: According to the conversion processing action of each synchronization database executing each file data synchronization content, a standard execution time period during which each file data synchronization content is executed by the corresponding synchronization database is determined.

[0088] In this embodiment, by extracting several pieces of file data synchronization information of each synchronization database within the target time period stored in the file data synchronization requirement list, the conversion processing time of each file data synchronization content in the synchronization data main library and the synchronization data conversion library is determined respectively. Based on the conversion processing time and the file data synchronization trigger time, the file data conversion processing capability of each synchronization database is considered, and each synchronization database executes the conversion processing action of each file data synchronization content assigned to it in the order of the file data synchronization trigger time in the file data synchronization requirement list as a constraint condition. The optimization goal is to minimize the cumulative sum of the difference between the completion time of each file data synchronization content conversion action executed by the corresponding synchronization database and the file data synchronization trigger time. The conversion processing action of the file data synchronization content in each file data synchronization information is optimized to be assigned to the synchronization data main library or the synchronization data conversion library. By reasonably allocating the synchronization database that performs the conversion processing for each file data synchronization content, the efficiency of performing file data synchronization conversion between multiple database systems is improved.

[0089] In a preferred embodiment, the actual execution period of several file data synchronization actions in each file data synchronization conversion execution cycle within the target period is monitored, and the conversion execution strategy step is updated based on the standard execution period and the actual execution period, specifically including:

[0090] S510: monitoring the actual execution time periods of a plurality of file data synchronization actions in each file data synchronization conversion execution cycle within the target time period, and calculating the overall time period overlap ratio between the actual execution time periods of the plurality of file data synchronization actions and the corresponding standard execution time periods;

[0091] S520: Determine whether the overall time period overlap ratio is less than a preset ratio value, and if so, reacquire the file data synchronization requirement list and generate a conversion execution strategy for a subsequent file data synchronization conversion execution cycle.

[0092] In this embodiment, the conversion execution strategy is dynamically updated by monitoring the difference between the actual execution period and the standard execution period of the file data synchronization action, taking into account the possible changes in the amount of data in the synchronization database, thereby improving the environmental adaptability of the file data synchronization conversion process and significantly improving the superiority and accuracy of the overall system operating performance.

[0093] Reference Figure 3 , Figure 3 It is a structural block diagram of an embodiment of the file data synchronous conversion device of the present invention.

[0094] like Figure 3 As shown, the file data synchronous conversion device proposed in the embodiment of the present invention includes:

[0095] An acquisition module 10 is used to acquire a file data synchronization requirement list, and extract a plurality of file data synchronization information of each synchronization database within a target period stored in the file data synchronization requirement list;

[0096] The determination module 20 is used to determine the conversion processing time of each file data synchronization content in the synchronization data main library and the synchronization data conversion library respectively according to the first identification information of the synchronization data main library, the second identification information of the synchronization data conversion library and the file data synchronization content in each file data synchronization information;

[0097] A generating module 30 is used to generate a conversion execution strategy for a file data synchronization requirement list based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, taking into account the file data conversion processing capabilities of the synchronization data main library and the synchronization data conversion library, and taking the shortest total delay time when a number of file data synchronization contents are executed as a goal;

[0098] An execution module 40 is used to drive the file data synchronization converters connected to the plurality of synchronization databases to execute the file data synchronization action for each file data synchronization information according to the conversion execution strategy; wherein the conversion execution strategy includes a target synchronization database and a standard execution period for executing the file data conversion action for the file data synchronization content corresponding to each file data synchronization information;

[0099] The updating module 50 is used to monitor the actual execution time periods of several file data synchronization actions in each file data synchronization conversion execution cycle within the target time period, and update the conversion execution strategy based on the standard execution time period and the actual execution time period.

[0100] Other embodiments or specific implementations of the file data synchronous conversion device of the present invention can refer to the above-mentioned method embodiments, which will not be described in detail here.

[0101] In addition, the present invention also proposes a file data synchronous conversion device, which includes: a memory, a processor, and a file data synchronous conversion program stored on the memory and executable on the processor, and when the file data synchronous conversion program is executed by the processor, the steps of the file data synchronous conversion method described above are implemented.

[0102] The specific implementation of the file data synchronous conversion device of the present application is basically the same as the various embodiments of the above-mentioned file data synchronous conversion method, and will not be repeated here.

[0103] In addition, the present invention also proposes a readable storage medium, the readable storage medium includes a computer readable storage medium, on which a file data synchronization conversion program is stored. The readable storage medium may be Figure 1The memory 1005 in the terminal may also be at least one of a ROM (Read-Only Memory) / RAM (Random Access Memory), a magnetic disk, and an optical disk. The readable storage medium includes a number of instructions for enabling a file data synchronous conversion device having a processor to execute the file data synchronous conversion method described in each embodiment of the present invention.

[0104] The specific implementation of the readable storage medium of the present application is basically the same as the various embodiments of the above-mentioned file data synchronous conversion method, and will not be repeated here.

[0105] It is understood that, in the description of this specification, the description with reference to the terms "one embodiment", "another embodiment", "other embodiments", or "first to Nth embodiments" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0106] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0107] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0108] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0109] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for synchronous conversion of file data, characterized in that: The following steps are involved: Obtaining a file data synchronization requirement list, and extracting a number of file data synchronization information of each synchronization database within a target period stored in the file data synchronization requirement list; Determine the conversion processing time of each file data synchronization content in the synchronization data main library and the synchronization data conversion library respectively according to the first identification information of the synchronization data main library, the second identification information of the synchronization data conversion library and the file data synchronization content in each piece of the file data synchronization information; Based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, taking into account the file data conversion processing capabilities of the synchronization data main library and the synchronization data conversion library, and taking the shortest total delay time when a number of file data synchronization contents are executed as the goal, a conversion execution strategy for the file data synchronization requirement list is generated; Driving the file data synchronization converters connected to the plurality of synchronization databases to execute the file data synchronization action for each piece of file data synchronization information according to the conversion execution strategy; wherein the conversion execution strategy includes a target synchronization database and a standard execution period for executing the file data conversion action for the file data synchronization content corresponding to each piece of file data synchronization information; The actual execution time periods of a plurality of file data synchronization actions in each file data synchronization conversion execution cycle within the target time period are monitored, and the conversion execution strategy is updated based on the standard execution time period and the actual execution time period.

2. The method for synchronously converting file data according to claim 1, characterized in that: The steps of obtaining a file data synchronization requirement list and extracting a plurality of file data synchronization information of each synchronization database within a target period stored in the file data synchronization requirement list specifically include: Acquire the file data synchronization requirements of each synchronization database; wherein the file data synchronization requirements are configured as file data synchronization requirements predefined by the user for the functions of the synchronization database; wherein the file data synchronization requirements include a synchronization data subject library for executing the file data synchronization action, a synchronization data conversion library, file data synchronization content and a file data synchronization trigger time; querying the first identification information of the synchronization data subject library and the second identification information of the synchronization data conversion library, and generating file data synchronization information corresponding to each file data synchronization requirement based on the first identification information, the second identification information, the file data synchronization content and the file data synchronization trigger time; The file data synchronization information of each synchronization database whose file data synchronization trigger time is within the target time period is aggregated to construct a file data synchronization requirement list.

3. The method for synchronous conversion of file data according to claim 1, characterized in that: According to the first identification information of the synchronization data main library, the second identification information of the synchronization data conversion library and the file data synchronization content in each piece of the file data synchronization information, determining the conversion processing time steps of each file data synchronization content in the synchronization data main library and the synchronization data conversion library respectively includes: According to the first identification information of the synchronization data main library and the second identification information of the synchronization data conversion library in each piece of the file data synchronization information, matching, in a synchronization database conversion processing history database, several conversion processing history records of the synchronization data main library and the synchronization data conversion library when converting and processing the same file data synchronization content; Based on an average value of conversion processing time corresponding to a plurality of conversion processing history records, the conversion processing time of the file data synchronization content in each piece of the file data synchronization information in the synchronization data main body library and the synchronization data conversion library is determined.

4. The method for synchronous conversion of file data according to claim 1, characterized in that: Based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, taking into account the file data conversion processing capabilities of the synchronization data main library and the synchronization data conversion library, and taking the shortest total delay time when a number of file data synchronization contents are executed as the goal, a conversion execution strategy step of generating a file data synchronization requirement list specifically includes: Based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, after the conversion processing action of the file data synchronization content in each piece of the file data synchronization information is assigned to the synchronization data main library or the synchronization data conversion library, each synchronization database executes the conversion processing action of each file data synchronization content assigned in the order of the file data synchronization trigger time in the file data synchronization requirement list as a constraint condition, and after the conversion processing action of the file data synchronization content in each piece of the file data synchronization information is assigned to the synchronization data main library or the synchronization data conversion library, the cumulative sum of the differences between the completion time and the file data synchronization trigger time executed by the corresponding synchronization database of each conversion processing action of the file data synchronization content is the shortest as the optimization goal, and the optimization solution is made as to whether the conversion processing action of the file data synchronization content in each piece of the file data synchronization information is assigned to the synchronization data main library or the synchronization data conversion library; A conversion execution strategy for the file data synchronization requirement list is generated based on the allocation result of whether the conversion processing action of the file data synchronization content in each file data synchronization information is allocated to the synchronization data main library or the synchronization data conversion library and the standard execution period during which each file data synchronization content is executed by the corresponding synchronization database.

5. The method for synchronous conversion of file data according to claim 4, characterized in that: The file data synchronization converters connected to the plurality of synchronization databases are driven to execute the file data synchronization action for each file data synchronization information according to the conversion execution strategy; wherein the conversion execution strategy includes a target synchronization database and a standard execution period step for executing the file data conversion action for the file data synchronization content corresponding to each file data synchronization information, specifically including: Sending the conversion execution strategy of the file data synchronization requirement list to a file data synchronization converter connected to a plurality of synchronization databases, driving the file data synchronization converter to execute the file data synchronization action of each file data synchronization information according to the conversion execution strategy; The file data synchronization action is configured to include a data sending action of sending the file data synchronization content in each file data synchronization information from the synchronization data main library to the synchronization data conversion library and a conversion processing action of converting the file data synchronization content in each file data synchronization information from the data format of the synchronization data main library to the data format of the synchronization data conversion library; The execution subject of the conversion processing action is configured as a target synchronization database for executing the file data conversion action for executing the file data synchronization content corresponding to each file data synchronization information recorded in the conversion execution strategy of the file data synchronization requirement list.

6. The method for synchronous conversion of file data according to claim 5, characterized in that: The standard execution period for each file data synchronization content to be executed by the corresponding synchronization database is determined in the following way: Calculate the conversion processing time of the file data synchronization content assigned to each synchronization database, and determine the execution order of each file data synchronization content according to the order of the file data synchronization trigger time in the file data synchronization requirement list; Determine whether the end time of each synchronization database after executing the previous file data synchronization content is later than the file data synchronization trigger time of the next file data synchronization content; if so, immediately execute the conversion processing action of the next file data synchronization content; if not, execute the conversion processing action at the file data synchronization trigger time of the next file data synchronization content; According to the conversion processing action of each synchronization database executing each file data synchronization content, a standard execution time period for each file data synchronization content to be executed by the corresponding synchronization database is determined.

7. The method for synchronous conversion of file data according to claim 6, characterized in that: The steps of monitoring the actual execution time periods of a plurality of file data synchronization actions in each file data synchronization conversion execution cycle within the target time period, and updating the conversion execution strategy based on the standard execution time period and the actual execution time period specifically include: Monitor the actual execution time periods of a plurality of file data synchronization actions in each file data synchronization conversion execution cycle within the target time period, and calculate the overall time period overlap ratio between the actual execution time periods of the plurality of file data synchronization actions and the corresponding standard execution time periods; It is determined whether the overall time period overlap ratio is less than a preset ratio value. If so, the file data synchronization requirement list is re-acquired to generate a conversion execution strategy for a subsequent file data synchronization conversion execution cycle.

8. A file data synchronous conversion device, characterized in that: include: An acquisition module, used to acquire a file data synchronization requirement list, and extract several pieces of file data synchronization information of each synchronization database within a target period stored in the file data synchronization requirement list; A determination module, configured to determine the conversion processing time of each file data synchronization content in the synchronization data main library and the synchronization data conversion library respectively according to the first identification information of the synchronization data main library, the second identification information of the synchronization data conversion library and the file data synchronization content in each piece of the file data synchronization information; A generating module, configured to generate a conversion execution strategy for a file data synchronization requirement list based on the conversion processing time and the file data synchronization trigger time in each piece of the file data synchronization information, taking into account the file data conversion processing capabilities of the synchronization data main library and the synchronization data conversion library, and taking the shortest total delay time when a number of file data synchronization contents are executed as a goal; An execution module, used to drive the file data synchronization converters connected to the plurality of synchronization databases to execute the file data synchronization action for each file data synchronization information according to the conversion execution strategy; wherein the conversion execution strategy includes a target synchronization database and a standard execution period for executing the file data conversion action for the file data synchronization content corresponding to each file data synchronization information; The updating module is used to monitor the actual execution time periods of several file data synchronization actions in each file data synchronization conversion execution cycle within the target time period, and update the conversion execution strategy based on the standard execution time period and the actual execution time period.

9. A file data synchronous conversion device, characterized in that: The file data synchronous conversion device includes: a memory, a processor, and a file data synchronous conversion program stored in the memory and executable on the processor. When the file data synchronous conversion program is executed by the processor, the steps of the file data synchronous conversion method according to any one of claims 1 to 7 are implemented.

10. A storage medium, characterized in that: The storage medium stores a file data synchronous conversion program, which, when executed by a processor, implements the steps of the file data synchronous conversion method according to any one of claims 1 to 7.

Images