Software System Data Processing Method, Apparatus and Computer Readable Storage Medium

By converting the original file set into a structured data set and using the application scheduling task platform for automated processing, the problem of manual scheduling and operation of existing actuarial software systems is solved, and efficient data processing and external systems are connected.

CN111414260BActive Publication Date: 2025-05-27CHINA PING AN LIFE INSURANCE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202010141365.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-03-03
Publication Date
2025-05-27
Estimated Expiration
2040-03-03

AI Technical Summary

Technical Problem

Existing actuarial software systems such as prophet software systems require manual dispatch and operation and cannot be directly connected and integrated with external systems, resulting in data silos and inefficient.

Method used

Provide a software system data processing method, which obtains the original file set from the preset software system, converts it into a structured data set and stores it into a relational database, performs merge and extraction operations, generates a file set that can be identified by the software system, and uses the application scheduling task platform to realize automatic uploading and downloading of data.

Benefits of technology

It realizes the automated processing of software systems and external data, opens up the data transmission channel, improves data processing efficiency, and solves the problem of data silos.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111414260B_ABST
    Figure CN111414260B_ABST
Patent Text Reader

Abstract

The present invention relates to big data technology, and discloses a method for processing software system data, including: obtaining an original file set from a preset software system, converting the original file set into a structured data set, and storing the structured data set in a relational database; performing a merging and extraction operation on the structured data set to obtain a file set recognizable by the software system, and uploading the recognizable file set to the software system; receiving an operation instruction input by a user, parsing and processing the operation instruction to obtain a scheduling task; according to the scheduling task, and using a pre-created application scheduling task platform to upload and / or download the recognizable file set in the software system, so as to realize the automated processing of the data of the software system. The present invention also proposes a software system data processing device and a computer-readable storage medium. The present invention realizes the efficient processing of the data of the software system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of big data technology, and in particular, to a data processing method, apparatus and computer-readable storage medium based on a software system. Background Art

[0002] Existing actuarial software systems, such as the prophet software system, require manual scheduling and operation and cannot be directly docked and integrated with external systems. It is like a data island where data cannot enter or exit, and all data needs to be downloaded in txt or csv format through manual means and then uploaded and downloaded. Additionally, in the case of a large amount of data, it is necessary to keep an eye on and check the progress of the software operation model manually, which is very inflexible and inefficient. Summary of the Invention

[0003] The present invention provides a data processing method, apparatus and computer-readable storage medium for a software system, and its main purpose is to provide a technical solution for data processing of a software system to users.

[0004] To achieve the above object, a data processing method for a software system provided by the present invention includes:

[0005] Obtaining an original file set from a preset software system, converting the original file set into a structured data set, and storing the structured data set in a relational database;

[0006] Performing a merging and extraction operation on the structured data set to obtain a file set recognizable by the software system, and uploading the recognizable file set to the software system;

[0007] Receiving an operation instruction input by the user, parsing and processing the operation instruction to obtain a scheduling task;

[0008] According to the scheduling task, and using a pre-created application scheduling task platform to upload and / or download the recognizable file set in the software system, so as to realize automated data processing of the software system.

[0009] Optionally, the converting the original file set into a structured data set includes:

[0010] Converting the original file set into a requirements document set through a preset tool, performing a preprocessing operation on the requirements document set to obtain a document configuration table set, and performing data mapping on the document configuration table set to obtain the structured data set.

[0011] Optionally, the performing a preprocessing operation on the requirements document set to obtain a document configuration table set includes:

[0012] Perform a fuzzy search on the requirement document set according to the transaction type of the requirement documents in the requirement document set to obtain a requirement document set of the same type. Use a brute-force matching algorithm to deduplicate the requirement document set of the same type, and configure the deduplicated requirement document set in the form of a data table to obtain the document configuration table set.

[0013] Optionally, the merging and extraction operation includes:

[0014] Perform a summary process on the structured data set to obtain a summary data set. Use the modulo method for the number of digits to split the summary data set into a split task data set, and use a data warehouse tool to convert the split task data set into a file set recognizable by the software system.

[0015] Optionally, the parsing process includes:

[0016] Identify the instruction category of the operation instruction input by the user, and restore the operation instruction after category identification to obtain a ciphertext data field. Obtain the operation object and processing method of the instruction in the ciphertext data field, thereby obtaining the scheduling task and completing the parsing process.

[0017] In addition, to achieve the above object, the present invention also provides a software system data processing device, which includes a memory and a processor. A software system data processing program that can run on the processor is stored in the memory. When the software system data processing program is executed by the processor, the following steps are implemented:

[0018] Obtain an original file set from a preset software system, convert the original file set into a structured data set, and store it in a relational database;

[0019] Perform a merging and extraction operation on the structured data set to obtain a file set recognizable by the software system, and upload the recognizable file set to the software system;

[0020] Receive the operation instruction input by the user, and obtain a scheduling task after parsing the operation instruction;

[0021] According to the scheduling task, use a pre-created application scheduling task platform to upload and / or download the recognizable file set in the software system, thereby realizing the automated data processing of the software system.

[0022] Optionally, the conversion of the original file set into a structured data set includes:

[0023] Convert the original document set into a requirements document set through a preset tool, perform a preprocessing operation on the requirements document set to obtain a document configuration table set, and perform data mapping on the document configuration table set to obtain the structured data set.

[0024] Optionally, the performing a preprocessing operation on the requirements document set to obtain a document configuration table set includes:

[0025] Perform a fuzzy search on the requirements document set according to the transaction types of the requirements documents in the requirements document set to obtain a requirements document set of the same type, perform a duplicate removal operation on the requirements document set of the same type using a brute-force matching algorithm, and configure the requirements document set after duplicate removal in the form of a data table to obtain the document configuration table set.

[0026] Optionally, the merging and extraction operation includes:

[0027] Perform a summary process on the structured data set to obtain a summary data set, perform a multi-threaded task split on the summary data set through a bit remainder method to obtain a split task data set, and use a data warehouse tool to convert the split task data set into a file set recognizable by the software system.

[0028] In addition, to achieve the above object, the present invention further provides a computer-readable storage medium, on which a software system data processing program is stored, and the software system data processing program can be executed by one or more processors to implement the steps of the software system data processing method as described above.

[0029] The software system data processing method, device and computer-readable storage medium proposed by the present invention, when a user performs software system data processing, perform a preprocessing operation on the acquired original data to obtain a file set recognizable by the software system, upload the file set to the software system, and in combination with a pre-constructed application scheduling task platform, and upload and / or download the file set from the software system according to the user's operation instruction, opening a data transmission channel between the software system and the outside world, so as to present an efficient data processing result to the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 It is a schematic flowchart of a software system data processing method provided by an embodiment of the present invention;

[0031] Figure 2 It is a schematic internal structure diagram of a software system data processing device provided by an embodiment of the present invention;

[0032] Figure 3 It is a schematic module diagram of a software system data processing program in a software system data processing device provided by an embodiment of the present invention.

[0033] The realization, functional features and advantages of the present invention will be further described in conjunction with embodiments and with reference to the accompanying drawings. Specific Embodiments

[0034] It should be understood that the specific embodiments described herein are merely used to explain the present invention and are not used to limit the present invention.

[0035] The present invention provides a method for processing software system data. Referring to Figure 1 As shown, it is a flowchart of a method for processing software system data provided by an embodiment of the present invention. This method can be executed by a device, and the device can be implemented by software and / or hardware.

[0036] In this embodiment, the method for processing software system data includes:

[0037] S1. Obtain an original file set from a preset software system, convert the original file set into a structured data set, and store it in a relational database.

[0038] In a preferred embodiment of the present invention, the preset software system may be the Prophet software system. The Prophet software system is a comprehensive actuarial operating system, including life insurance, non-life insurance and other parts, and can provide a series of service functions such as profit testing, asset evaluation, business model setting, etc. for the financial service industry, thus meeting a large number of technical requirements of financial service companies including insurance companies. Among them, the original file set includes: life insurance policy transaction data set, applicant identity information data set, life insurance product transaction type data set, etc.

[0039] The conversion of the original file set into a structured data set includes: through a preset tool, such as a PRD (Product Requirement Document) tool, converting the original file set into a requirement document set, performing a preprocessing operation on the requirement document set to obtain a document configuration table set, and performing data mapping on the document configuration table set to obtain the structured data set. Among them, the requirement document set includes a business requirement document and a market requirement document.

[0040] Further, in a preferred embodiment of the present invention, the preprocessing operation on the requirement document set to obtain a document configuration table set includes: performing a fuzzy search on the requirement document set according to the transaction type of each requirement document in the requirement document set to obtain a requirement document set of the same type, using a brute-force matching algorithm to perform a duplicate removal operation on the requirement document set of the same type, and configuring the de-duplicated requirement document set in the form of a data table to obtain the document configuration table set.

[0041] Further, in a preferred embodiment of the present invention, storing the structured data set in a relational database includes: establishing a data table after selecting a definition method of the relational database schema according to the user's requirements, and importing the structured data set into the relational database through the indexes in the data table to complete the storage operation. Preferably, the preset relational database in the present invention is an Oracle database.

[0042] S2. Perform a merge extraction operation on the structured data set to obtain a file set recognizable by the software system, and use a file synchronization tool to upload the recognizable file set to the software system.

[0043] Since the structured data set stored in the relational database is classified according to the document configuration table and stored in different category storage addresses in the relational database, it cannot be directly uploaded and / or downloaded in the above-mentioned preset prophet software system. Therefore, preferably, the present invention performs a merge extraction operation on the structured data set that needs to be uploaded and downloaded, and generates a file set recognizable by the prophet software system. Among them, the file set recognizable by the prophet software system in the present invention can be a txt file set. Specifically, the merge extraction operation includes: performing a summary process on the structured data set to obtain a summary data set, performing a multi-threaded task split on the summary data set by the bit remainder method to obtain a split task data set, using a data warehouse tool to convert the split task data set into a file set recognizable by the prophet software system, and using a file synchronization tool to synchronously upload the recognizable file set to the prophet software system. Preferably, the file synchronization tool in the present invention includes a filesync file synchronization tool, and the data warehouse tool includes a hive tool. For example: in the relational database, the structure data of life insurance, personal insurance, and health insurance are stored at addresses A, B, and C respectively. When performing the merge extraction operation, first perform a thread split, split the merge extraction task into tasks a, b, c, and d of different threads, and use task a to merge and extract the structure data at address A; use task b to merge and extract the structure data at address B; use task c to merge and extract the structure data at address C; use task d to merge and extract the structure data at address D, so as to accelerate the upload of the structure data.

[0044] S3. Receive the operation instruction input by the user, and parse and process the operation instruction to obtain a scheduling task.

[0045] Preferably, the parsing process in the present invention includes: identifying the instruction category of the operation instruction input by the user, restoring the operation instruction after category identification to obtain a ciphertext data field, and obtaining the operation object and processing method of the instruction in the ciphertext data field, so as to obtain the scheduling task and complete the parsing process. For example, the operation instruction input by the user is A. Identify the instruction category of the operation instruction A, restore the operation instruction A after category identification, and obtain the ciphertext data field {0212, 2321, 3430}. Obtain the operation object and processing method of the instruction in the ciphertext data field {0212, 2321, 3430}. For example, the code 0212 in the ciphertext data field corresponds to the operation of uploading data; the code 2321 in the ciphertext data field indicates that the processing object of this operation is life insurance data, etc.; the code 3430 indicates that the data storage time is Time = 003430s.

[0046] S4. According to the scheduling task, and by using the pre-created application scheduling task platform, upload and / or download the recognizable file set in the software system, so as to realize the automatic processing of software data.

[0047] In a preferred embodiment of the present invention, the application scheduling task platform is created through the Java programming language. The application scheduling task platform is used to regularly start and control the above-mentioned required call tasks, and then complete the upload and download of the recognizable file set in the prophet software system, so as to realize the automatic processing of the data of the prophet software system.

[0048] The present invention also provides a software system data processing device. Refer to Figure 2 As shown, it is a schematic internal structure diagram of the software system data processing device provided by an embodiment of the present invention.

[0049] In this embodiment, the software system data processing device 1 can be a PC (Personal Computer, personal computer), or a terminal device such as a smart phone, a tablet computer, a portable computer, etc., or a server, etc. The software system data processing device 1 at least includes a memory 11, a processor 12, a communication bus 13, and a network interface 14.

[0050] Among them, the memory 11 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (such as SD or DX memory, etc.), magnetic memory, magnetic disk, optical disk, etc. The memory 11 can be an internal storage unit of the software system data processing device 1 in some embodiments, such as the hard disk of the software system data processing device 1. The memory 11 can also be an external storage device of the software system data processing device 1 in other embodiments, such as a plug-in hard disk equipped on the software system data processing device 1, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc. Further, the memory 11 can also include both the internal storage unit of the software system data processing device 1 and the external storage device. The memory 11 can be used not only to store application software installed in the software system data processing device 1 and various types of data, such as the code of the software system data processing program 01, etc., but also to temporarily store data that has been output or will be output.

[0051] In some embodiments, the processor 12 can be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chips, and is used to run the program code stored in the memory 11 or process data, such as executing the software system data processing program 01, etc.

[0052] The communication bus 13 is used to realize the connection and communication between these components.

[0053] The network interface 14 can optionally include a standard wired interface, a wireless interface (such as a WI-FI interface), and is usually used to establish a communication connection between the device 1 and other electronic devices.

[0054] Optionally, the device 1 can also include a user interface. The user interface can include a display, an input unit such as a keyboard. Optionally, the user interface can also include a standard wired interface, a wireless interface. Optionally, in some embodiments, the display can be an LED display, a liquid crystal display, a touch liquid crystal display, and an OLED (Organic Light-Emitting Diode) toucher, etc. Among them, the display can also be appropriately referred to as a display screen or a display unit, and is used to display the information processed in the software system data processing device 1 and to display a visual user interface.

[0055] Figure 2Only the software system data processing device 1 with components 11 - 14 and the software system data processing program 01 is shown. Those skilled in the art can understand that Figure 1 the shown structure does not constitute a limitation on the software system data processing device 1. It may include fewer or more components than those shown, or combine certain components, or have a different component arrangement.

[0056] In Figure 2 the illustrated embodiment of the device 1, the software system data processing program 01 is stored in the memory 11. When the processor 12 executes the software system data processing program 01 stored in the memory 11, the following steps are implemented:

[0057] Step 1: Obtain the original file set from a preset software system, convert the original file set into a structured data set, and store it in a relational database.

[0058] In a preferred embodiment of the present invention, the preset software system may be the prophet software system. The prophet software system is a comprehensive actuarial operation system, including life insurance, non - life insurance, and other parts. It can provide a series of service functions such as profit testing, asset evaluation, business model setting, etc. for the financial service industry, thus meeting a large number of technical requirements of financial service companies including insurance companies. Among them, the original file set includes: life insurance policy transaction data set, applicant identity information data set, life insurance product transaction type data set, etc.

[0059] The conversion of the original file set into a structured data set includes: using a preset tool, such as a PRD (Product Requirement Document) tool, to convert the original file set into a requirement document set, performing a pre - processing operation on the requirement document set to obtain a document configuration table set, and performing data mapping on the document configuration table set to obtain the structured data set. Among them, the requirement document set includes a business requirement document and a market requirement document.

[0060] Further, in a preferred embodiment of the present invention, the pre - processing operation on the requirement document set to obtain a document configuration table set includes: performing a fuzzy search on the requirement document set according to the transaction type of each requirement document in the requirement document set to obtain a requirement document set of the same type, using a brute - force matching algorithm to perform a duplicate - removal operation on the requirement document set of the same type, and configuring the de - duplicated requirement document set in the form of a data table to obtain the document configuration table set.

[0061] Further, in a preferred embodiment of the present invention, storing the structured data set in a relational database includes: establishing a data table after selecting a definition method of the relational database schema according to the user's requirements, and importing the structured data set into the relational database through indexes in the data table to complete the storage operation. Preferably, the preset relational database in the present invention is an Oracle database.

[0062] Step 2: Perform a merging and extraction operation on the structured data set to obtain a file set recognizable by the software system, and use a file synchronization tool to upload the recognizable file set to the software system.

[0063] Since the structured data set stored in the relational database is classified according to the document configuration table and stored in different category storage addresses in the relational database, it cannot be directly uploaded and / or downloaded in the above-mentioned preset prophet software system. Therefore, preferably, the present invention performs a merging and extraction operation on the structured data set that needs to be uploaded and downloaded, and generates a file set recognizable by the prophet software system. Among them, the file set recognizable by the prophet software system in the present invention can be a txt file set. Specifically, the merging and extraction operation includes: performing a summary process on the structured data set to obtain a summary data set, performing a multi-threaded task splitting on the summary data set through the remainder-taking method of digits to obtain a split task data set, using a data warehouse tool to convert the split task data set into a file set recognizable by the prophet software system, and using a file synchronization tool to synchronously upload the recognizable file set to the prophet software system. Preferably, the file synchronization tool in the present invention includes a filesync file synchronization tool, and the data warehouse tool includes a hive tool. For example: in the relational database, the structural data of life insurance, personal insurance, and health insurance are stored at addresses A, B, and C respectively. When performing the merging and extraction operation, first perform thread splitting, split the merging and extraction task into tasks a, b, c, and d of different threads, and use task a to merge and extract the structural data at address A; use task b to merge and extract the structural data at address B; use task c to merge and extract the structural data at address C; use task d to merge and extract the structural data at address D, so as to accelerate the upload of the structural data.

[0064] Step 3: Receive the operation instruction input by the user, and obtain a scheduling task after parsing and processing the operation instruction.

[0065] Preferably, the parsing process in the present invention includes: identifying the instruction category of the operation instruction input by the user, restoring the operation instruction after category identification to obtain a ciphertext data field, and obtaining the operation object and processing method of the instruction in the ciphertext data field, so as to obtain the scheduling task and complete the parsing process. For example, the operation instruction input by the user is A. Identify the instruction category of the operation instruction A, restore the operation instruction A after category identification, and obtain the ciphertext data field {0212, 2321, 3430}. Obtain the operation object and processing method of the instruction in the ciphertext data field {0212, 2321, 3430}. For example, the code 0212 in the ciphertext data field corresponds to the operation of uploading data; the code 2321 in the ciphertext data field indicates that the processing object of this operation is life insurance data, etc.; the code 3430 indicates that the data storage time is Time = 003430s.

[0066] Step 4: According to the scheduling task, and using the pre-created application scheduling task platform, upload and / or download the recognizable file set in the software system, so as to realize the automatic processing of software data.

[0067] In a preferred embodiment of the present invention, the application scheduling task platform is created through the Java programming language. The application scheduling task platform is used to regularly start and control the above-mentioned required call tasks, and then complete the upload and download of the recognizable file set in the prophet software system, so as to realize the automatic processing of the data in the prophet software system.

[0068] Optionally, in other embodiments, the software system data processing program can also be divided into one or more modules. One or more modules are stored in the memory 11 and are executed by one or more processors (processor 12 in this embodiment) to complete the present invention. The module referred to in the present invention refers to a series of computer program instruction segments that can complete specific functions and are used to describe the execution process of the software system data processing program in the software system data processing device.

[0069] For example, referring to Figure 3 As shown, it is a schematic diagram of the program modules of the software system data processing program in an embodiment of the software system data processing device of the present invention. In this embodiment, the software system data processing program can be divided into a data conversion module 10, a merging and extraction module 20, a parsing process module 30, and an upload and download module 40. Exemplarily:

[0070] The data conversion module 10 is used to: obtain the original file set from the preset software system, convert the original file set into a structured data set, and store it in a relational database.

[0071] The merging and extraction module 20 is used to: perform a merging and extraction operation on the structured data set to obtain a file set recognizable by the software system, and upload the recognizable file set to the software system.

[0072] The parsing and processing module 30 is used to: receive the operation instruction input by the user, and obtain a scheduling task after parsing and processing the operation instruction.

[0073] The uploading and downloading module 40 is used to: according to the scheduling task, and use a pre-created application scheduling task platform to upload and / or download the recognizable file set in the software system, so as to realize the automated data processing of the software system.

[0074] The functions or operation steps realized when the above program modules such as the data conversion module 10, the merging and extraction module 20, the parsing and processing module 30, and the uploading and downloading module 40 are executed are substantially the same as those in the above embodiments, and will not be elaborated here.

[0075] In addition, an embodiment of the present invention further provides a computer-readable storage medium, on which a software system data processing program is stored. The software system data processing program can be executed by one or more processors to implement the following operations:

[0076] Obtain an original file set from a preset software system, convert the original file set into a structured data set, and store it in a relational database;

[0077] Perform a merging and extraction operation on the structured data set to obtain a file set recognizable by the software system, and upload the recognizable file set to the software system;

[0078] Receive the operation instruction input by the user, and obtain a scheduling task after parsing and processing the operation instruction;

[0079] According to the scheduling task, and use a pre-created application scheduling task platform to upload and / or download the recognizable file set in the software system, so as to realize the automated data processing of the software system.

[0080] The specific implementation manner of the computer-readable storage medium of the present invention is basically the same as that of the above embodiments of the software system data processing device and method, and will not be repeated here.

[0081] It should be noted that the serial numbers of the above embodiments of the present invention are only for description and do not represent the superiority or inferiority of the embodiments. And the term "including", "comprising" or any other variant thereof in this article is intended to cover non-exclusive inclusion, so that a process, device, article or method including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, device, article or method. Without more limitations, an element defined by the statement "including one..." does not exclude the existence of additional identical elements in the process, device, article or method including the element.

[0082] Through the description of the above embodiments, those skilled in the art can clearly understand that the above embodiment methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art can be embodied in the form of a software product. The computer software product is stored in a storage medium as described above (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions for causing a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0083] The above are only the preferred embodiments of the present invention, and do not limit the patent scope of the present invention accordingly. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present invention, or directly or indirectly applied in other related technical fields, shall be equally included in the patent protection scope of the present invention.

Claims

1. A method for processing software system data, characterized in that, the method includes: Obtain an original file set from a preset software system, convert the original file set into a requirement document set through a preset tool, perform a fuzzy search on the requirement document set according to the transaction types of the requirement documents in the requirement document set to obtain a requirement document set of the same type, perform a duplicate removal operation on the requirement document set of the same type, configure the requirement document set after duplicate removal in the form of a data table to obtain a document configuration table set, perform data mapping on the document configuration table set to obtain a structured data set, select a definition method of a relational database schema according to the user's requirements and then establish a data table, and import the structured data set into different category storage addresses in the relational database through the indexes in the data table; Perform a merge extraction operation on the structured data stored in each category storage address to obtain a file set recognizable by the software system, and upload the recognizable file set to the software system; Receive an operation instruction input by the user, and obtain a scheduling task after parsing and processing the operation instruction; According to the scheduling task, use a pre-created application scheduling task platform to upload and / or download the recognizable file set in the software system, so as to realize the automatic data processing of the software system.

2. The software system data processing method according to claim 1, characterized in that, the merge extraction operation includes: Perform a summary process on the structured data stored in each category storage address to obtain a summary data set, perform a multi-threaded task split on the summary data set through the bit remainder method to obtain a split task data set, and use a data warehouse tool to convert the split task data set into a file set recognizable by the software system.

3. The software system data processing method according to any one of claims 1 to 2, characterized in that, the parsing process includes: Identify the instruction category of the operation instruction input by the user, and restore the operation instruction after category identification to obtain a ciphertext data field, and obtain the operation object and processing method of the instruction in the ciphertext data field, so as to obtain the scheduling task and complete the parsing process.

4. A software system data processing device, characterized in that, the device includes a memory and a processor, and a software system data processing program that can run on the processor is stored on the memory. When the software system data processing program is executed by the processor, the following steps are implemented: Obtain the original file set from a preset software system, convert the original file set into a requirement document set through a preset tool, perform a fuzzy search on the requirement document set according to the transaction types of the requirement documents in the requirement document set to obtain a requirement document set of the same type, perform a deduplication operation on the requirement document set of the same type, configure the deduplicated requirement document set in the form of a data table to obtain a document configuration table set, perform data mapping on the document configuration table set to obtain a structured data set, select a definition method of a relational database schema according to the user's requirements and then create a data table, and import the structured data set into different category storage addresses in the relational database through the indexes in the data table; Perform a merge extraction operation on the structured data stored in each category storage address to obtain a file set recognizable by the software system, and upload the recognizable file set to the software system; Receive an operation instruction input by the user, and obtain a scheduling task after parsing and processing the operation instruction; According to the scheduling task, use a pre-created application scheduling task platform to upload and / or download the recognizable file set in the software system, so as to realize the automated data processing of the software system.

5. The software system data processing device according to claim 4, wherein, the merge extraction operation includes: Perform a summary process on the structured data stored in each category storage address to obtain a summary data set, perform a multi-threaded task split on the summary data set by the bit remainder method to obtain a split task data set, and use a data warehouse tool to convert the split task data set into a file set recognizable by the software system.

6. A computer-readable storage medium, wherein, A software system data processing program is stored on the computer-readable storage medium, and the software system data processing program can be executed by one or more processors to implement the steps of the software system data processing method according to any one of claims 1 to 3.

Citation Information

Patent Citations

  • System and method for synchronizing structured data between relational databases

    CN108052681A

  • Data processing method, apparatus, medium and electronic device

    CN109460439A