Data processing method and device, equipment and medium
By converting the original files uploaded by the investment manager and generating a unified target file, the problem of inconsistent documents of multiple investment managers is solved, and the client's data processing efficiency and analysis capabilities in financial institutions are improved.
Patent Information
- Application Number
- CN202411076272.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-07
- Publication Date
- 2024-11-12
AI Technical Summary
In the outsourced investment business of financial institutions, the original valuation file formats and data of multiple investment managers are inconsistent, resulting in the reduction of efficiency of the client when reading and analyzing, and the cost of manual communication and problem solving.
After obtaining the original file, check according to the configured inspection rules. If the rules are met, format conversion and data conversion will be performed to generate a target file that conforms to the preset target format and data, and display the target file.
It improves the efficiency of discovering and solving original file problems, unifies file format and data information, facilitates client viewing and analysis, and reduces the difficulty of reading and analyzing target files.
Smart Images

Figure CN118939641A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing, and specifically to a data processing method, device, equipment and medium. Background Art
[0002] At present, financial institutions have outsourced investment business. In outsourced investment business, a client may entrust multiple investment managers at the same time. After the investment management system receives the original valuation files uploaded by each investment manager, it will parse and store the original valuation files uploaded by different investment managers, and then provide them to the client. The client then performs data analysis and regulatory reporting based on the original valuation files uploaded by each investment manager.
[0003] However, these original valuation files will have different working habits due to different investment managers, which will eventually lead to the client seeing a variety of valuation files, reducing the efficiency of reading and analyzing data. In addition, after the client finds that there are problems with the data in the valuation file, it is necessary to communicate with the investment manager to determine whether there are problems with the original valuation file uploaded by the investment manager, which increases the time and communication cost of manually solving the problem. Summary of the invention
[0004] The embodiments of the present application provide a data processing method, apparatus, device and medium for solving the problem of inconsistency of original files uploaded by multiple investment managers.
[0005] In a first aspect, an embodiment of the present application provides a data processing method, the method comprising:
[0006] Get the original file;
[0007] According to the configured inspection rules, the original data in the original file is inspected to obtain an inspection result;
[0008] If the inspection result is that the original data conforms to the configured inspection rule, the original file is format converted according to a preset target format to obtain a reference file conforming to the preset target format; the reference file includes a plurality of original data in the original file;
[0009] The original data in the reference file is converted to obtain a target file, and the target file is displayed.
[0010] In the embodiment of the present application, before the format conversion of the original file is performed, the original data in the original file is first checked according to the configured inspection rules to determine whether the original data in the original file complies with the inspection rules, so that problems with the original file can be discovered in a timely manner and solved in a timely manner, thereby improving the efficiency of solving the problems of the original file; and the format conversion and data conversion of the original file are performed, so that the final target file not only unifies the format of the original file, but also unifies the data information in the original file, which is convenient for the client to view the target file and improves the efficiency of reading the target file and analyzing the target data in the target file.
[0011] In a possible embodiment, performing format conversion processing on the original file according to a preset target format to obtain a reference file conforming to the preset target format includes:
[0012] Obtaining original format information of the original file;
[0013] According to the correspondence between the field information of the original format information and the field information of the preset target format, the field information of the original format information is converted into the corresponding field information of the preset target format to obtain a reference file conforming to the preset target format.
[0014] In a possible embodiment, performing data conversion processing on the original data in the reference file to obtain the target file includes:
[0015] According to the target subject system corresponding to the subject system of the reference file, subject system conversion is performed on the original data in the reference file to obtain a reference file after subject system conversion;
[0016] According to the target object identifier corresponding to the object identifier of the reference file, the original data in the reference file after the subject system conversion is converted to obtain the target file.
[0017] In a possible embodiment, after obtaining the target file, the method further includes:
[0018] Acquire a first data total value of the original data in the original file and a second data total value of the target data in the target file;
[0019] Based on the first data total value and the second data total value, checking the target file;
[0020] If the first data total value is different from the second data total value, a first error message is output.
[0021] In a possible embodiment, the method further includes: parsing the original file according to the configured parsing template to obtain original data in the original file.
[0022] In a possible embodiment, the configured check rule includes an integrity check rule and a cross-reference relationship check rule, and the method further includes:
[0023] If the original data in the original file does not comply with the integrity check rule and / or the cross-reference check rule, a second error message, the integrity check rule and the cross-reference check rule are output.
[0024] In a second aspect, the present application provides a data processing device, the device comprising:
[0025] An acquisition unit, used for acquiring an original file;
[0026] An inspection unit, configured to inspect the original data in the original file according to a configured inspection rule to obtain an inspection result;
[0027] a format conversion unit, configured to, if the inspection result is that the original data conforms to the inspection rule, perform format conversion processing on the original file according to a preset target format to obtain a reference file conforming to the preset target format; the reference file includes a plurality of original data in the original file;
[0028] The data conversion unit is used to perform data conversion processing on the original data in the reference file to obtain a target file and display the target file.
[0029] In a possible embodiment, the format conversion unit is specifically used to:
[0030] Obtaining original format information of the original file;
[0031] According to the correspondence between the field information of the original format information and the field information of the preset target format, the field information of the original format information is converted into the corresponding field information of the preset target format to obtain a reference file conforming to the preset target format.
[0032] In a possible embodiment, the data conversion unit is specifically used to:
[0033] According to the target subject system corresponding to the subject system of the reference file, subject system conversion is performed on the original data in the reference file to obtain a reference file after subject system conversion;
[0034] According to the target object identifier corresponding to the object identifier of the reference file, the original data in the reference file after the subject system conversion is converted to obtain the target file.
[0035] In a possible embodiment, the device further includes:
[0036] A checking unit is used to obtain a first data total value of the original data in the original file and a second data total value of the target data in the target file; based on the first data total value and the second data total value, check the target file; if the first data total value and the second data total value are different, output a first error message.
[0037] In a possible embodiment, the acquisition unit is further used to: parse the original file according to the configured parsing template to obtain the original data in the original file.
[0038] In a possible embodiment, the configured check rule includes an integrity check rule and a cross-reference check rule, and the check unit is further used to:
[0039] If the original data in the original file does not comply with the integrity check rule and / or the cross-reference check rule, a second error message, the integrity check rule and the cross-reference check rule are output.
[0040] In a third aspect, the present application provides an electronic device, including:
[0041] A memory for storing program instructions;
[0042] The processor is used to call the program instructions stored in the memory, and execute the steps included in any one of the data processing methods in the first aspect according to the obtained program instructions.
[0043] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes the data processing method described in any one of the first aspects.
[0044] In a fifth aspect, the present application provides a computer program product, comprising: a computer program code, when the computer program code is run on a computer, the computer executes the data processing method described in any one of the first aspects.
[0045] The technical effects brought about by any one of the implementation methods of the second to fifth aspects can refer to the technical effects brought about by the implementation method of the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technical personnel in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0047] Figure 1 A schematic diagram of an application scenario of a data processing method provided in an embodiment of the present application;
[0048] Figure 2 A flowchart of a data processing method provided in an embodiment of the present application;
[0049] Figure 3 A flowchart of a format conversion processing method provided in an embodiment of the present application;
[0050] Figure 4 A flowchart of a data conversion processing method provided in an embodiment of the present application;
[0051] Figure 5 A flowchart of a data checking method provided in an embodiment of the present application;
[0052] Figure 6 An interactive schematic diagram provided for an embodiment of the present application;
[0053] Figure 7 A structural diagram of a data processing device provided in an embodiment of the present application;
[0054] Figure 8 A structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0055] In order to make the purpose, technical scheme and advantages of the present application clearer, the technical scheme in the embodiment of the present application will be clearly and completely described below in conjunction with the drawings in the embodiment of the present application. Obviously, the described embodiment is only a part of the embodiment of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technical personnel in the field without making creative work are within the scope of protection of the present application. In the absence of conflict, the embodiments in the present application and the features in the embodiments can be arbitrarily combined with each other. In addition, although the logical order is shown in the flow chart, in some cases, the steps shown or described can be performed in an order different from that here.
[0056] The terms "first" and "second" in the specification and claims of the present application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the term "comprising" and any of their variations are intended to cover non-exclusive protection. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. "Multiple" in the present application can mean at least two, for example, two, three or more, and the embodiments of the present application are not limited.
[0057] In the technical solution of this application, the collection, dissemination, and use of data are in compliance with the requirements of relevant national laws and regulations.
[0058] Before introducing the data processing method provided in the embodiment of the present application, in order to facilitate understanding, the technical background of the embodiment of the present application is first introduced in detail below.
[0059] Currently, financial institutions have outsourced investment business. In outsourced investment business, a client may entrust multiple investment managers at the same time.
[0060] After receiving the original valuation files uploaded by each investment manager, the investment management system will parse the original valuation files uploaded by different investment managers into the database, and then provide them to the client, who will then perform data analysis and regulatory reporting based on the original valuation files uploaded by each investment manager. Once the client finds that there is a problem with the data in the original valuation file, he will first check the parsing template during parsing; if there is no problem with the parsing template during parsing, he will communicate with the investment manager and check the original valuation file; if there is a problem with the original valuation file, the investment manager will need to re-upload the original valuation file until the problem is solved.
[0061] However, these original valuation documents may differ due to the operating habits of different investment managers, which will ultimately result in the client seeing a variety of valuation documents, reducing the efficiency of reading and analyzing data.
[0062] In addition, after the client discovers problems with the data in the valuation file, he or she needs to communicate with the investment manager to determine whether there are problems with the original valuation file uploaded by the investment manager, which increases the time and communication costs for manually solving the problem.
[0063] In view of this, the embodiments of the present application provide a data processing method, apparatus, device and medium for solving the problem of inconsistency of original files uploaded by multiple investment managers.
[0064] The inventive concept of the present application can be summarized as follows: after obtaining the original file in the embodiment of the present application, the original data in the original file is first checked according to the configured inspection rules to obtain an inspection result; if the inspection result is that the original data conforms to the configured inspection rules, the original file is format-converted according to a preset target format to obtain a reference file conforming to the preset target format; the reference file includes multiple original data in the original file; the original data in the reference file is data-converted to obtain a target file, and the target file is displayed.
[0065] Therefore, before the format conversion of the original file, the original data in the original file is first checked according to the configured inspection rules to determine whether the original data in the original file meets the inspection rules, so that the problems of the original file can be discovered in time and solved in time, thereby improving the efficiency of solving the problems of the original file; and the format conversion and data conversion of the original file are performed, so that the final target file not only unifies the format of the original file, but also unifies the data information in the original file, which is convenient for the client to view the target file and improves the efficiency of reading the target file and analyzing the target data in the target file.
[0066] After introducing the inventive concept of this application, Figure 1 , the application scenarios of the embodiments of the present application are introduced.
[0067] Reference Figure 1 , is an application scenario diagram of a data processing method provided in an embodiment of the present application. Figure 1 As shown, the scenario includes: a terminal device 110 and a server 120, and the terminal device 110 and the server 120 can communicate with each other through a communication network.
[0068] In an optional implementation, the communication network may be a wired network or a wireless network. Therefore, the terminal device 110 and the server 120 may be directly or indirectly connected via a wired or wireless communication. For example, the terminal device 110 may be indirectly connected to the server 120 via a wireless access point, or the terminal device 110 may be directly connected to the server 120 via the Internet, and this application does not limit this.
[0069] In the embodiment of the present application, the terminal device 110 includes but is not limited to mobile phones, tablet computers, laptop computers, desktop computers, e-book readers, intelligent voice interaction devices, smart home appliances, car terminals and other devices; various clients can be installed on the terminal device, and the client can be an application (such as a browser, game software, etc.), or a web page, a mini-program, etc.
[0070] The server 120 is a background server corresponding to the client installed in the terminal device 110. The server 120 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.
[0071] It should be noted that the data processing method in the embodiments of the present application can be deployed in an electronic device, which may be a server or a terminal device.
[0072] The server can be Figure 1 The server 120 shown in FIG. Figure 1 Other servers other than server 120 shown in FIG.
[0073] Specifically, after the investment manager uploads the original file to the investment management system, the original file arrives at the backend server corresponding to the application, and the backend server executes the data processing method provided in the embodiment of the present application to convert the original file into a target file. When the client logs in to the investment management system to view the file, the target file is displayed to the client.
[0074] The terminal device can be Figure 1 The terminal device 110 shown in FIG. Figure 1 Other terminal devices other than the terminal device 110 shown in FIG.
[0075] Specifically, after the investment manager uploads the original file to the investment management system, the original file arrives at the terminal device, and the terminal device executes the data processing method provided in the embodiment of the present application to convert the original file into a target file. When the client logs into the investment management system to view the file, the target file is displayed to the client.
[0076] Figure 1 The figure is only an example. In fact, the number of terminal devices 110 and servers 120 is not limited and is not specifically limited in the embodiments of the present application.
[0077] In the embodiment of the present application, when there are multiple servers 120, the multiple servers 120 can form a blockchain, and the server 120 is a node on the blockchain; as the data processing method disclosed in the embodiment of the present application, the configured inspection rules, preset target format, the target subject system corresponding to the subject system of the reference file, the target object identifier corresponding to the object identifier of the reference file, etc. involved therein can be saved on the blockchain.
[0078] The following describes the data processing method provided by the exemplary embodiment of the present application in combination with the application scenarios described above according to the accompanying drawings. It should be noted that the above application scenarios are only shown to facilitate understanding of the spirit and principles of the present application, and the implementation methods of the present application are not limited in this regard.
[0079] refer to Figure 2 , Figure 2 An exemplary data processing method in an embodiment of the present application is provided. The method can be executed by an electronic device and includes the following steps:
[0080] Step S201, obtaining the original file.
[0081] Among them, in the embodiment of the present application, the original file is the original valuation file, that is, the original valuation table uploaded by each investment manager.
[0082] In a possible embodiment, if the original data in the original file in the embodiment of the present application is processed, it is first necessary to obtain the original data in the original file, which can be specifically performed as follows: according to the configured parsing template, the original file is parsed to obtain the original data in the original file.
[0083] In a possible embodiment, obtaining the original data in the original file may also be performed as follows: parsing the original file according to a configured parsing rule to obtain the original data in the original file.
[0084] Exemplarily, after parsing the original file, the main column information of the original data in the original file includes but is not limited to: portfolio name, valuation date, account code, account name, quantity, unit cost, cost, cost to net value ratio, market price, market value, market value to net value ratio, valuation appreciation, and suspension information. The row information includes: account detail level data and total item level data.
[0085] Among them, the account detail level data has a hierarchy, the last level is the detail level, and the others are non-detail levels. Non-detailed cost, market value, and valuation appreciation are all summaries of the next level of accounts. The first-level account identifier is fixed to 4 digits, for example: the identifiers of the accounts from top to bottom can be: 422X, 4222X, 4223X. The total item level data has no account information and is represented by the total item name, mainly including total securities investment, paid-in capital, total assets, total liabilities, net asset value of funds, net asset value of fund units, etc.
[0086] Among them, the configured parsing template and the configured parsing rules can be set according to actual experience or actual scenario needs, and the embodiments of the present application do not limit this.
[0087] Step S202: Check the original data in the original file according to the configured checking rules to obtain a checking result.
[0088] Furthermore, the check rules configured in the embodiment of the present application include integrity check rules and cross-reference check rules.
[0089] In this application, if the check result is that the original data meets the configured check rules, the original data in the original file must not only meet the integrity check rules, but also meet the cross-reference check rules.
[0090] Specifically, in the embodiment of the present application, the original data in the original file is checked according to the configured check rules to obtain the check result, which can be executed as follows:
[0091] Perform integrity check on the original data in the original file according to the configured integrity check rules;
[0092] If the original data in the original file meets the integrity check rules, a cross-reference check is performed on the original data in the original file according to the configured cross-reference check rules to obtain the check result.
[0093] The configured integrity check rules can be set according to actual needs. For example, for account detail level data, the integrity check rules can be configured as follows: the data values of columns such as account code, account name, cost, and market value cannot be empty, and except for the first-level account, the accounts of other levels must have the previous level account. For total item level data, the integrity check rules can be configured as follows: the data values of columns such as total securities investment, paid-in capital, total assets, total liabilities, net asset value of funds, and net asset value of fund units cannot be empty.
[0094] The configured cross-reference checking rules can be set according to actual needs, and can be some common cross-references of valuation files. For example:
[0095] Total cost column of asset class = cost column summary of first-level accounts beginning with 1 (excluding fair value change accounts) + [3003 securities liquidation amount positive value];
[0096] Total market value column of asset class = market value column summary of first-level accounts starting with 1 (excluding fair value change accounts) + [3003 securities liquidation funds positive value];
[0097] Total cost column of liabilities = Summary of cost columns of first-level accounts beginning with 2 + [3003 Negative value of securities liquidation];
[0098] Total market value column of liabilities = summary of market value columns of primary accounts starting with 2 + [3003 negative value of securities liquidation];
[0099] Fund net asset value cost column = total cost column of assets - total cost column of liabilities;
[0100] Fund net asset value market value column = asset total market value column - liability total market value column;
[0101] Net asset value of fund units = market value of fund net asset value / market value of paid-in capital.
[0102] In a possible embodiment, if the original data in the original file does not comply with the integrity check rule and / or the cross-reference check rule, a second error message, the integrity check rule and the cross-reference check rule are output.
[0103] Specifically, for the original data that does not comply with the integrity check rules and / or the cross-reference check rules, the corresponding combination name, valuation date, the second error message of the failed check, the integrity check rules and the cross-reference check rules are written into the log information table, and then the prompt information is output in the form of a page display for user viewing.
[0104] The second error information is used to indicate that the original data in the original file does not comply with the integrity check rule and / or the cross-reference relationship check rule.
[0105] Therefore, after receiving the second error message, the integrity check rules and the cross-reference check rules, the user can manually check the original data in the original file according to the integrity check rules and the cross-reference check rules to eliminate problems with the original data in the original file as soon as possible.
[0106] Step S203, if the inspection result is that the original data conforms to the configured inspection rule, the original file is format converted according to the preset target format to obtain a reference file conforming to the preset target format; the reference file includes multiple original data in the original file.
[0107] In a possible embodiment, the present application embodiment performs format conversion processing on the original file according to the preset target format to obtain a reference file that conforms to the preset target format, and executes as follows: Figure 3 Steps shown:
[0108] Step S301, obtaining original format information of the original file;
[0109] Step S302, according to the correspondence between the field information of the original format information and the field information of the preset target format, the field information of the original format information is converted into the corresponding field information of the preset target format, so as to obtain a reference file conforming to the preset target format.
[0110] Specifically, original data in an original file that meets the configured inspection rules is obtained, and format conversion processing and data conversion processing are performed based on pre-configured configuration information.
[0111] The pre-configured configuration information includes data conversion configuration, data conversion field information configuration, and data conversion condition configuration:
[0112] Data conversion configuration: You can define the interface according to the dimension of the target data in the target file, including interface code, conversion sequence number, target table, query statement information, deletion conditions, unique field information, and post-processor information.
[0113] Among them, one conversion logic corresponds to one interface, and the interface code of the interface is used to associate in different configuration tables, and the corresponding conversion logic is executed through the interface code of the interface. The target table is used to store the processed target data and obtain the target file. The query statement information is used to query the SQL statement of the original data in the original file to be processed. The deletion condition is used to delete the target data before data conversion to prevent repeated execution of data doubling. The unique field information is used to ensure the uniqueness of the converted data. The post-processor information is used to configure SQL to uniformly process the converted data.
[0114] Therefore, in specific implementation, the interface code of the interface can be determined according to the data conversion configuration, and the corresponding conversion logic can be executed. At the same time, the original data that needs to be converted and the original data that does not need to be converted can be determined according to the data conversion configuration.
[0115] Data conversion field information configuration: configure conversion rules according to the field information of the preset target format, that is, the correspondence between the field information of the original format information and the field information of the preset target format. For example, configure the field default value, custom function conversion, and other fields that require special processing in the original format information, and configure the field default value, custom function conversion, and other fields that require special processing in the preset target format. Field information includes but is not limited to interface code, field sequence number, field name, field type, and value expression.
[0116] Therefore, the format conversion process can be performed on the original file according to the data conversion configuration and the data conversion field information configuration to obtain a reference file that conforms to the preset target format.
[0117] Step S204, performing data conversion processing on the original data in the reference file to obtain a target file, and displaying the target file.
[0118] In a possible embodiment, the original data in the reference file is converted to obtain a target file, which is executed as follows: Figure 4 Steps shown:
[0119] Step S401, performing subject system conversion on the original data in the reference file according to the target subject system corresponding to the subject system of the reference file, and obtaining the reference file after subject system conversion;
[0120] Step S402, according to the target object identifier corresponding to the object identifier of the reference file, the object identifier of the original data in the reference file after the subject system conversion is converted to obtain the target file.
[0121] Data conversion condition configuration: configure the data conversion rules according to the dimension of the target data in the target file. Data conversion conditions include the corresponding relationship of the account system and the corresponding relationship of the object identifier.
[0122] The subject system correspondence is the correspondence between the subject system of the reference file and the subject system of the target file. The subject system of the target file corresponds to the subject systems of multiple reference files, and the subject system of the target file is a unified valuation subject system.
[0123] In the embodiment of the present application, a public subject system and a special subject system can be configured to support the public subject system. The special subject system can be configured according to a specific data, and the public subject system is applicable to all data.
[0124] The object identification correspondence is a correspondence between the object identification of the reference file and the object identification of the target file. The object identification of the target file corresponds to the object identifications of multiple reference files.
[0125] In the embodiment of the present application, the object identifier correspondence is the securities code correspondence. If it is a standard security, the object identifier of each system is the same, and there is no need to convert the object identifier. If it is a non-standard security, the object identifier maintained by each system is different, and then it is necessary to convert according to the configured object identifier correspondence.
[0126] The data conversion conditions can also include some public information required for checking the valuation file. The data conversion conditions can also include data conversion check conditions. Before performing data conversion on the original data, the original data is first checked to determine whether the original data meets the data conversion check conditions. If not, a log prompt will be issued. In this way, some original data that clearly does not require data conversion can be filtered out according to the data conversion check conditions. The data conversion check conditions mainly include interface coding, conversion field sequence number, check expression information, and check log information. Among them, the conversion field sequence number can specify the column from which the rule is processed. The check expression information is used to configure the conversion rules. The check log information is used to configure standard prompt information to prompt whether the original data meets the data conversion check conditions.
[0127] Therefore, the original data in the reference file can be converted according to the data conversion configuration and the data conversion condition configuration to obtain the target file.
[0128] For example, it is assumed that the target data in the target file mainly includes three parts: securities code-level data with quantity, data without quantity but only involving amount, and total item data, and the corresponding three interface codes are configured. After the format conversion process, when performing data conversion, first delete the converted original data according to the configured deletion conditions such as combination name and valuation date, and then obtain the original data to be converted according to the configured query statement. For example, the query statement such as combination name and valuation date can be used to limit the conversion of only account detail-level data.
[0129] Then, according to the configured data conversion field information, the field information of the original data is converted into the field information of the target data of the target file through the value expression. Then, according to the data conversion condition configuration, data conversion processing is performed, mainly based on the object identifier correspondence, converting the object identifier of the reference file to the corresponding target object identifier, and based on the account system correspondence, converting the account system of the reference file to the corresponding target account system. For example, converting the total item data, according to the data conversion condition configuration, converting the paid-in capital, asset total, liability total, fund asset net value, fund unit net value, yesterday's unit net value, and daily net value growth rate, to generate unified total item object identifier data.
[0130] In this application, data conversion processing only involves data on amounts, mainly deposits, reserves, margins, various investment amounts, interest payable, expenses payable, etc. The data in the original file is converted to the corresponding position in the target file through the configured conversion rules.
[0131] In a possible embodiment, after obtaining the target file in the embodiment of the present application, the method can also perform a secondary check on the target file to avoid errors in the conversion process of the original file to the target file and ensure that all the original data in the original file has been converted. Figure 5 Steps shown:
[0132] Step S501, obtaining a first data total value of original data in an original file and a second data total value of target data in a target file;
[0133] Step S502, checking the target file based on the first data total value and the second data total value;
[0134] Step S503: if the first data total value is different from the second data total value, output a first error message.
[0135] In specific implementation, the original data to be converted is searched according to the combination name and valuation date dimensions, and the total value of the first data of all rows of the original data before conversion is checked to see if it is consistent with the total value of the second data of all rows of the target data after conversion. If they are consistent, the original data has been converted correctly, otherwise the converted data is missing, and the first error message is output.
[0136] The first error information is used to indicate that the target data in the target file is inconsistent with the original data in the original file. The first error information may also include prompt information, information indicating inconsistent target data, such as asset code, asset name, valuation date, summary value before conversion, summary value after conversion, summary value difference, etc.
[0137] Therefore, after receiving the first error message and the data conversion condition configuration, the user can compare the original data in the original file with the target data in the target file according to the data conversion condition configuration, and eliminate problems in the conversion process as soon as possible.
[0138] like Figure 6 The diagram is an interactive diagram provided by the embodiment of the present application, which includes investment managers (1, 2, 3, ..., n), terminal device 1, terminal device 2, and client.
[0139] The investment managers (1, 2, 3, ..., n) log in to the investment management system on the terminal device 1, upload their respective original files, and then the investment management system executes the data processing method provided in the embodiment of the present application, converts the original files into target files, and saves the target files. The client logs in to the investment management system on the terminal device 2, and checks the target files through page query.
[0140] The terminal device 1 and the terminal device 2 may be the same terminal device or different terminal devices.
[0141] Therefore, in the embodiment of the present application, before the format conversion of the original file is performed, the original data in the original file is first checked according to the configured inspection rules to determine whether the original data in the original file complies with the inspection rules, so that problems with the original file can be discovered in a timely manner and solved in a timely manner, thereby improving the efficiency of solving the problems of the original file; and the format conversion and data conversion of the original file are performed, so that the final target file not only unifies the format of the original file, but also unifies the data information in the original file, which is convenient for the client to view the target file and improves the efficiency of reading the target file and analyzing the target data in the target file.
[0142] Based on the same inventive concept, the present application embodiment provides a data processing device, please refer to Figure 7The device includes: an acquisition unit 701, a checking unit 702, a format conversion unit 703 and a data conversion unit 704, wherein:
[0143] An acquisition unit 701 is used to acquire an original file;
[0144] The checking unit 702 is used to check the original data in the original file according to the configured checking rules to obtain a checking result;
[0145] The format conversion unit 703 is used to, if the inspection result is that the original data conforms to the inspection rule, perform format conversion processing on the original file according to a preset target format to obtain a reference file conforming to the preset target format; the reference file includes multiple original data in the original file;
[0146] The data conversion unit 704 is used to perform data conversion processing on the original data in the reference file to obtain a target file, and display the target file.
[0147] In a possible embodiment, the format conversion unit 703 is specifically configured to:
[0148] Obtaining original format information of the original file;
[0149] According to the correspondence between the field information of the original format information and the field information of the preset target format, the field information of the original format information is converted into the corresponding field information of the preset target format to obtain a reference file conforming to the preset target format.
[0150] In a possible embodiment, the data conversion unit 704 is specifically configured to:
[0151] According to the target subject system corresponding to the subject system of the reference file, subject system conversion is performed on the original data in the reference file to obtain a reference file after subject system conversion;
[0152] According to the target object identifier corresponding to the object identifier of the reference file, the original data in the reference file after the subject system conversion is converted to obtain the target file.
[0153] In a possible embodiment, the device further includes:
[0154] A checking unit is used to obtain a first data total value of the original data in the original file and a second data total value of the target data in the target file; based on the first data total value and the second data total value, check the target file; if the first data total value and the second data total value are different, output a first error message.
[0155] In a possible embodiment, the acquiring unit 701 is further configured to:
[0156] The original file is parsed according to the configured parsing template to obtain the original data in the original file.
[0157] In a possible embodiment, the configured check rules include integrity check rules and cross-reference relationship check rules;
[0158] The checking unit 702 is further used for:
[0159] If the original data in the original file does not comply with the integrity check rule and / or the cross-reference check rule, a second error message, the integrity check rule and the cross-reference check rule are output.
[0160] The data processing device provided in the embodiment of the present application has the same beneficial effects as the data processing method in the above embodiment, which will not be described one by one here.
[0161] After introducing the data processing method and the data processing device according to the exemplary embodiments of the present application, next, an electronic device provided according to the embodiment of the present application is introduced.
[0162] The present application embodiment provides an electronic device, which can implement the data processing method discussed above. Figure 8 , the device includes a memory 801 , one or more processors 802 , and a bus 803 .
[0163] The memory 801 is used to store computer programs executed by the processor 802. The memory 801 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and programs required for running the instant messaging function, etc.; the data storage area may store various instant messaging information and operation instruction sets, etc.
[0164] The memory 801 may be a volatile memory, such as a random-access memory (RAM); the memory 9801 may also be a non-volatile memory, such as a read-only memory, a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD), or the memory 801 may be any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 801 may be a combination of the above memories.
[0165] The processor 802 may include one or more central processing units (CPU) or a digital processing unit, etc. The processor 802 is used to implement the data processing method in the above embodiment when calling the computer program stored in the memory 801 .
[0166] The specific connection medium between the memory 801 and the processor 802 is not limited in the embodiment of the present application. Figure 8 In the embodiment, the memory 801 and the processor 802 are connected via a bus 803. The bus 803 is connected to the processor 802 via a bus 803. Figure 8 The connections between other components are shown in bold lines, and are not intended to be limiting. Bus 803 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 8 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0167] In an exemplary embodiment, the present application provides a computer-readable storage medium, and a computer program product includes: a computer program code, when the computer program code is run on a computer, the computer executes any data processing method in the above-mentioned embodiment. Since the principle of solving the problem by the above-mentioned computer-readable storage medium is similar to the data processing method in the embodiment, the implementation of the above-mentioned computer-readable storage medium can refer to the implementation of the method, and the repeated parts will not be repeated.
[0168] In an exemplary embodiment, the present application also provides a computer program product, which includes: computer program code, when the computer program code is run on a computer, the computer executes any data processing method in the above-mentioned embodiment. Since the principle of solving the problem by the above-mentioned computer program product is similar to the data processing method in the embodiment, the implementation of the above-mentioned computer program product can refer to the implementation of the method, and the repeated parts will not be repeated.
[0169] It should be understood by those skilled in the art that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0170] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0171] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0172] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of user-operated steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0173] Obviously, a person skilled in the art may make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. A data processing method, characterized in that: The method comprises: Get the original file; According to the configured inspection rules, the original data in the original file is inspected to obtain an inspection result; If the inspection result is that the original data conforms to the configured inspection rule, the original file is format converted according to a preset target format to obtain a reference file conforming to the preset target format; the reference file includes a plurality of original data in the original file; The original data in the reference file is converted to obtain a target file, and the target file is displayed.
2. The method according to claim 1, characterized in that The step of converting the original file into a format according to a preset target format to obtain a reference file conforming to the preset target format includes: Obtaining original format information of the original file; According to the correspondence between the field information of the original format information and the field information of the preset target format, the field information of the original format information is converted into the corresponding field information of the preset target format to obtain a reference file conforming to the preset target format.
3. The method according to claim 1, characterized in that The step of performing data conversion processing on the original data in the reference file to obtain the target file includes: According to the target subject system corresponding to the subject system of the reference file, subject system conversion is performed on the original data in the reference file to obtain a reference file after subject system conversion; According to the target object identifier corresponding to the object identifier of the reference file, the original data in the reference file after the subject system conversion is converted to an object identifier to obtain the target file.
4. The method according to claim 1, characterized in that: After obtaining the target file, the method further includes: Acquire a first data total value of the original data in the original file and a second data total value of the target data in the target file; Based on the first data total value and the second data total value, checking the target file; If the first data total value is different from the second data total value, a first error message is output.
5. The method according to claim 1, characterized in that The method further comprises: The original file is parsed according to the configured parsing template to obtain the original data in the original file.
6. The method according to any one of claims 1 to 5, characterized in that: The configured check rules include integrity check rules and cross-reference relationship check rules, and the method further includes: If the original data in the original file does not comply with the integrity check rule and / or the cross-reference check rule, a second error message, the integrity check rule and the cross-reference check rule are output.
7. A data processing device, characterized in that: The device comprises: An acquisition unit, used for acquiring an original file; An inspection unit, configured to inspect the original data in the original file according to a configured inspection rule to obtain an inspection result; a format conversion unit, configured to, if the inspection result is that the original data conforms to the inspection rule, perform format conversion processing on the original file according to a preset target format to obtain a reference file conforming to the preset target format; the reference file includes a plurality of original data in the original file; The data conversion unit is used to perform data conversion processing on the original data in the reference file to obtain a target file and display the target file.
8. An electronic device, characterized in that: include: A memory for storing program instructions; A processor is used to call the program instructions stored in the memory, and execute the data processing method according to any one of claims 1 to 6 according to the obtained program instructions.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes the data processing method according to any one of claims 1 to 6.
10. A computer program product, characterized in that The computer program product comprises: a computer program code, and when the computer program code is run on a computer, the computer is enabled to execute the data processing method according to any one of claims 1 to 6.
Citation Information
Cited By
Data inspection method and device based on EnergyPlus simulation result and medium
CN119621558A
