Information processing methods, apparatus, computer equipment and storage media

Abstract

This application relates to information processing methods, apparatus, computer equipment, and storage media, and pertains to the fields of fintech or other related fields. The method includes: acquiring N sets of resource processing information for a target reconciliation task; determining key element information for each resource processing event within each resource processing information set; determining the target shard corresponding to each resource processing event based on preset sharding device partitioning information and the reconciliation element information of each resource processing event; splitting multiple resource processing events belonging to the same target shard according to the information splitting method of the target reconciliation task to obtain multiple sets of split element information for the target shard; and performing reconciliation operations on the split element information sets with the same identifier in the N sets of resource processing information based on multi-threading of each node in a distributed system to obtain the reconciliation result of the target reconciliation task. This method can solve the problem of slow reconciliation of large amounts of data and improve reconciliation processing efficiency.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to an information processing method, apparatus, computer equipment, storage medium, and computer program product. Background Technology

[0002] For resource processing information comparison processes in financial scenarios, such as reconciliation, memory-based reconciliation is usually adopted, which requires loading all content into memory at once. This poses a risk of memory overflow for large amounts of data. Alternatively, multi-session reconciliation can be used, but this method has strict requirements for the upstream file provider. If the conditions are not met, reconciliation cannot be performed, resulting in poor flexibility and slow reconciliation for large amounts of data, leading to low reconciliation efficiency. Summary of the Invention

[0003] Therefore, it is necessary to provide an information processing method, apparatus, computer equipment, storage medium, and computer program product that can solve the above-mentioned technical problems.

[0004] In a first aspect, this application provides an information processing method, the method comprising:

[0005] Obtain N sets of resource processing information for the target reconciliation task. For each set of resource processing information, determine the key element information of each resource processing event in the set of resource processing information; wherein, N≥2, the key element information is the information obtained by performing a recording operation on the resource processing event; the key element information includes reconciliation element information.

[0006] Based on the preset sharding device partitioning information and the reconciliation element information for each resource processing event, determine the target shard corresponding to each resource processing event;

[0007] For multiple resource processing events belonging to the same target shard, according to the information splitting method of the target reconciliation task, the key element information of each resource processing event in the multiple resource processing events is split to obtain a set of multiple split element information of the target shard.

[0008] Based on the multi-threading of each node in the distributed system, the reconciliation operation is performed on the split element information set with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task.

[0009] In one embodiment, obtaining the set of N resource processing information for the target reconciliation task includes:

[0010] For the target reconciliation task, N sets of original resource information are obtained from outside the reconciliation system. For each set of original resource information, a legality verification is performed based on the resource processing details and inspection information in the set of original resource information.

[0011] If the legality verification passes, the resource processing information set is obtained based on the resource processing details in the original resource information set and stored in the reconciliation system.

[0012] In one embodiment, determining the key element information of each resource processing event in each resource processing information set includes:

[0013] For each set of resource processing information, verify the key element information of each resource processing event in the set of resource processing information;

[0014] If the verification passes, the information format of the key elements of each resource processing event is converted into the target format that matches the reconciliation system.

[0015] In one embodiment, determining the target shard corresponding to each resource processing event based on preset sharding device partitioning information and reconciliation element information for each resource processing event includes:

[0016] Obtain preset sharding device partitioning information; the sharding device partitioning information includes partitioning feature values ​​calculated based on multiple sharding devices;

[0017] Determine the feature value corresponding to each reconciliation element;

[0018] For each resource processing event, the target shard corresponding to the resource processing event is determined from the multiple sharding devices by comparing the feature value of the element and the partitioning feature value.

[0019] In one embodiment, for multiple resource processing events belonging to the same target shard, the key element information of each resource processing event in the multiple resource processing events is split according to the information splitting method of the target reconciliation task, to obtain a set of multiple split element information belonging to the target shard, including:

[0020] Obtain preset splitting configuration information; the splitting configuration information includes different information splitting methods and the method identifier corresponding to each information splitting method;

[0021] The information splitting method that matches the method identifier of the target reconciliation task shall be used as the information splitting method of the target reconciliation task.

[0022] According to the information splitting method, the key element information of each resource processing event in the multiple resource processing events is split to obtain a set of multiple split element information of the target segment.

[0023] In one embodiment, the step of splitting the key element information of each of the multiple resource processing events according to the information splitting method to obtain a set of multiple split element information of the target fragment includes:

[0024] Based on the preset splitting operation information corresponding to the information splitting method, obtain the information truncation position and information truncation length;

[0025] Based on the information capture position and the information capture length, the key element information of each resource processing event in the multiple resource processing events is split to obtain multiple sets of split element information of the target segment; each set of split element information has a corresponding identifier.

[0026] In one embodiment, before the step of performing a reconciliation operation on the split element information sets with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task, the method further includes:

[0027] By using a sorting thread pool, and according to the sorting method corresponding to the preset sorting operation information, the multiple splitting element information sets of the target segment are sorted for each target segment, thereby obtaining a splitting element information set with different identifiers corresponding to each resource processing information set in the target segment.

[0028] In one embodiment, the reconciliation operation on the split element information sets with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task includes:

[0029] The set of split element information with the same identifier under the same target segment is used as a comparison group to construct multiple task contents for the N resource processing information sets;

[0030] The reconciliation processing thread pool is used to reconcile the contents of the multiple tasks to obtain the reconciliation result of each target shard, which is used as the reconciliation result of the target reconciliation task.

[0031] Secondly, this application also provides an information processing apparatus, the apparatus comprising:

[0032] The reconciliation information acquisition module is used to acquire N sets of resource processing information for the target reconciliation task, and for each set of resource processing information, determine the key element information of each resource processing event in the set of resource processing information; wherein, N≥2, the key element information is the information obtained by performing a recording operation on the resource processing event; the key element information includes reconciliation element information;

[0033] The target sharding determination module is used to determine the target sharding corresponding to each resource processing event based on the preset sharding device partitioning information and the reconciliation element information of each resource processing event.

[0034] The information splitting module is used to split the key element information of each resource processing event in the multiple resource processing events belonging to the same target shard according to the information splitting method of the target reconciliation task, so as to obtain a set of multiple split element information of the target shard.

[0035] The reconciliation processing module is used to perform reconciliation operations on the split element information sets with the same identifier in the N resource processing information sets based on the multi-threading of each node in the distributed system, so as to obtain the reconciliation result of the target reconciliation task.

[0036] Thirdly, this application also provides a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps of the information processing method described above.

[0037] Fourthly, this application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements the steps of the information processing method described above.

[0038] Fifthly, this application also provides a computer program product. The computer program product includes a computer program that, when executed by a processor, implements the steps of the information processing method described above.

[0039] The aforementioned information processing method, apparatus, computer equipment, storage medium, and computer program product acquire N resource processing information sets (N≥2) for a target reconciliation task. For each resource processing information set, key element information for each resource processing event within that set is determined. This key element information is obtained by performing recording operations on the resource processing event and includes reconciliation element information. Then, based on preset sharding device partitioning information and the reconciliation element information for each resource processing event, the target shard corresponding to each resource processing event is determined. For multiple resource processing events belonging to the same target shard, multiple shards are split according to the information splitting method of the target reconciliation task. The key element information of each resource processing event is used to obtain multiple sets of split element information for the target shard. Then, based on the multi-threading of each node in the distributed system, reconciliation operations are performed on the split element information sets with the same identifier in N resource processing information sets to obtain the reconciliation result of the target reconciliation task. This realizes fast reconciliation of a distributed system based on sharding, information splitting, and multi-threaded processing. By dividing the resource processing information set into different shards and then splitting the information in each shard, the multi-machine advantages and multi-threaded processing technology of the distributed system are used for reconciliation processing, which can solve the problems of slow reconciliation of large amounts of data and memory overflow, and improve the efficiency of reconciliation processing. Attached Figure Description

[0040] Figure 1 This is a flowchart illustrating an information processing method in one embodiment;

[0041] Figure 2a This is a schematic diagram of the processing chain of a reconciliation system in one embodiment;

[0042] Figure 2b This is a schematic diagram of a reconciliation system architecture in one embodiment;

[0043] Figure 3a This is a schematic diagram of a receiving module processing flow in one embodiment;

[0044] Figure 3b This is a schematic diagram of a conversion module processing flow in one embodiment;

[0045] Figure 4a This is a schematic diagram of a file splitting submodule processing flow in one embodiment;

[0046] Figure 4b This is a schematic diagram of a file sorting submodule processing flow in one embodiment;

[0047] Figure 4c This is a schematic diagram of a file reconciliation submodule processing flow in one embodiment;

[0048] Figure 4d This is a schematic diagram of a reconciliation thread pool processing flow in one embodiment;

[0049] Figure 5 This is a flowchart illustrating another information processing method in one embodiment;

[0050] Figure 6 This is a structural block diagram of an information processing device in one embodiment;

[0051] Figure 7 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0052] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0053] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties; correspondingly, this application also provides a corresponding user authorization entry point for users to choose to authorize or refuse.

[0054] In one embodiment, such as Figure 1 As shown, an information processing method is provided. This embodiment applies the method to a system including a terminal and a server, such as an accounting system, and implements the method through the interaction between the terminal and the server. In this embodiment, the method includes the following steps:

[0055] Step 101: Obtain N sets of resource processing information for the target reconciliation task. For each set of resource processing information, determine the key element information of each resource processing event in the set of resource processing information; wherein, N≥2, the key element information is the information obtained by performing a recording operation on the resource processing event; the key element information includes reconciliation element information.

[0056] The target reconciliation task can be a task that checks and reconciles N account files (i.e. resource processing information sets) according to the set verification conditions. Each account file contains the corresponding record content (i.e. key element information) of multiple transaction events (i.e. resource processing events), such as order number, amount, date, etc.

[0057] As an example, the reconciliation element information can be a field that confirms whether the corresponding resource processing event was successful, such as a field that determines whether the reconciliation of a record was successful. It can be an order number or other record elements, and no specific restrictions are imposed in this embodiment.

[0058] In practical applications, reconciliation tasks can be processed based on the reconciliation system. For a target reconciliation task, N sets of original resource information can be obtained from outside the reconciliation system. For each set of original resource information, the legality can be verified based on the resource processing details and inspection information in the set. If the legality verification passes, the resource processing information set can be obtained based on the resource processing details in the original resource information set and stored inside the reconciliation system. Furthermore, for each set of resource processing information, the key element information of each resource processing event in the set can be verified. If the verification passes, the information format of the key element information of each resource processing event can be converted into a target format that matches the reconciliation system.

[0059] Specifically, such as Figure 2a The reconciliation system processing flow diagram shown indicates that the reconciliation system may include an external receiving module, a conversion module, and a reconciliation module. The external receiving module receives detailed files from both parties (i.e., resource processing details from the original resource information set) for the target reconciliation task. It verifies the validity of these detailed files, which are located on an external file server. After successful verification, the files are renamed and uploaded to an internal file server for use by the conversion module. The conversion module converts specific reconciliation file formats. By converting detailed files from both parties with different formats to the file format specified by the reconciliation system (i.e., the target format), it obtains record content (i.e., key element information) in the target format that matches the reconciliation system.

[0060] In an optional embodiment, the external receiving module can continuously detect whether the detailed files of both parties on the external network file server have arrived. If they have arrived, the module can perform a validity check on the received files. After the check passes, the files can be transferred from the external network file server to the internal network file server, and the module can be notified to start further processing.

[0061] Step 102: Determine the target shard corresponding to each resource processing event based on the preset sharding device partitioning information and the reconciliation element information of each resource processing event;

[0062] In a specific implementation, preset sharding device partitioning information can be obtained. This sharding device partitioning information may include partitioning feature values ​​calculated based on multiple sharding devices. Then, the feature value corresponding to each reconciliation element information can be determined. Furthermore, for each resource processing event, by comparing the feature value and the partitioning feature value, the target shard corresponding to the resource processing event can be determined from multiple sharding devices.

[0063] For example, after the conversion module reads each line of record in the detail file for format conversion, based on the key element information of the target format (such as the record content corresponding to each line), the hash value (i.e., element feature value) can be calculated according to the set reconciliation elements (i.e., reconciliation element information). Then, the records of each line can be split into different shard files (i.e., the target shard corresponding to each resource processing event) for use by the reconciliation module.

[0064] In one example, the conversion module can perform another validity check on the file after receiving the file arrival notification. After the check passes, it can calculate the hash value based on the reconciliation elements of each record in the file to calculate the shard number (such as the shard identifier of the target shard) of each record based on the total number of shards (such as the number of sharding devices). When writing each record to the shard file, it can arrange the order and length of the fields according to the preset new file format (i.e., the target format that matches the reconciliation system).

[0065] Step 103: For multiple resource processing events belonging to the same target shard, according to the information splitting method of the target reconciliation task, split the key element information of each resource processing event in the multiple resource processing events to obtain a set of multiple split element information of the target shard.

[0066] In practical applications, the information splitting method that matches the method identifier of the target reconciliation task can be selected as the information splitting method of the target reconciliation task based on the preset splitting configuration information. Then, according to the information splitting method, the key element information of each resource processing event in multiple resource processing events can be split to obtain a set of multiple splitting element information of the target shard.

[0067] Step 104: Based on the multi-threading of each node in the distributed system, perform a reconciliation operation on the split element information sets with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task.

[0068] In the specific implementation, the reconciliation module can be used to perform reconciliation processing. It divides each shard file (i.e., multiple resource processing events belonging to the same target shard) into multiple smaller files (i.e., multiple sets of split element information belonging to the target shard), and then sorts and reconciles these multiple smaller files, and records the reconciliation results in the database.

[0069] In one example, such as Figure 2b The reconciliation system architecture diagram shown may include external network file server group 1, external receiving module business server group 2, internal network file server group 3, conversion module business server group 4, conversion module database server group 5, distributed batch scheduling center 6, reconciliation module business server group 7-10, and reconciliation module database server group 11-14.

[0070] like Figure 2b As shown, the external file server group can be deployed in an isolated zone. It can be used by external companies to store detailed files and by the external receiving module's business server group to download detailed files. Since all servers in this group are deployed in an isolated zone, external companies need to enable firewalls to allow access, effectively isolating and protecting the reconciliation system. This external file server group can be a highly available service group, with one primary and one backup server deployed across campuses to ensure that if one campus experiences an anomaly, the other campus can still be used externally. When the primary server is inaccessible, external companies can place files on the backup server; at least one server in the group must contain the detailed files.

[0071] like Figure 2b As shown, the external receiving module business server group, conversion module business server group, and reconciliation module business server group can be server groups within the reconciliation system that complete the functions of their respective business modules. Each business server group can contain two containers, one primary and one backup. The two containers within the same module's business server group have the same function, while the containers between different modules have different functions. For example, the eight containers in reconciliation module business server groups 7-10 have the same function, but their functions are different from those of the two containers in the external receiving module business server group. Each business server group can have high availability capabilities; when the primary container goes offline abnormally, the backup container can support business processing. Each container can accept scheduling from the distributed batch scheduling center, including but not limited to commands such as start, pause, end, and offline. Each container can access all servers in the internal network file server group, but only the containers in the external receiving module business server group can access the external network file server group.

[0072] like Figure 2bAs shown, an intranet file server group can be a group of servers deployed in the intranet zone, which can be used for file storage and processing within the reconciliation system. This intranet file server group is also a highly available service group. All servers are deployed in the intranet zone, and the availability of at least one server in the group is sufficient to ensure stable operation of the business. The file servers can be Linux servers, including servers in the external file server group.

[0073] like Figure 2b As shown, the conversion module database server group and the reconciliation module database server group can form a high-availability database cluster with one primary and three backups. Under normal circumstances, each container's read and write operations are performed on the primary database; in case of an anomaly, the system can perform a primary-backup switch, ensuring that read and write operations are performed on the backup database. The primary and backup databases synchronize data using a semi-synchronous method to ensure data real-time performance and eventual consistency. A relational database can be used to store the data.

[0074] like Figure 2b As shown, a distributed batch scheduling center can be an application that schedules and controls the execution of batch jobs. This application can include a front-end console, a registry center, a database server group, and a business server group. It can read job definitions from the database, arrange the daily job execution sequence diagram according to dependencies or scheduled startup, and modify the directory path content in the registry center so that containers subscribed to the directory path changes can receive different instructions initiated by the application, such as start, pause, end, and log off. The distributed batch scheduling center can also act as a controller that connects the functional implementations of all modules. Through this distributed batch scheduling center, external task receiving, transformation, and reconciliation tasks can be invoked sequentially.

[0075] In yet another example, such as Figure 2b As shown, the internal relationships within the reconciliation system are as follows: The external receiving module business server group 2 downloads files from the external network file server group 1 and uploads them to the internal network file server group 3. Then, the conversion module business server group 4 and the reconciliation module business servers groups 7-10 can access the files on the internal network file server group 3 using different Linux commands to complete functions such as downloading, splitting, sorting, and uploading. The processing results can be stored in the conversion module database server group 5 and the reconciliation module database server groups 11-14, respectively. Each server is controlled and scheduled by the distributed batch scheduling center 6 to complete the corresponding business module functions sequentially.

[0076] Compared to traditional methods, the technical solution in this embodiment leverages the advantages of distributed systems and adopts a divide-and-conquer approach, splitting large files into smaller files and assigning them to independent containers for processing, thereby improving reconciliation efficiency. By having containers directly send Linux commands to the file server for file splitting, sorting, and reconciliation, the time and bandwidth resources consumed by frequent file uploads and downloads are reduced. Furthermore, the high execution efficiency of Linux commands further reduces time overhead. By utilizing multi-threading technology for reconciliation, the time consumption of reconciliation can be reduced, and memory consumption can be reduced by reading only one line of record at a time after sorting.

[0077] In an optional embodiment, the technical solution of this embodiment can make full use of each device when there are multiple devices but insufficient device performance, thereby improving the utilization rate of the devices; each module in the reconciliation system can run independently and repeatedly, and in the event of a container crash or network anomaly, the interrupted module can be restarted after repair; by storing abnormal data and reconciliation results in the database, relevant personnel can export reports from the database to judge and verify the situation, which helps to discover abnormal problems in a timely manner.

[0078] In the above information processing method, N sets of resource processing information for the target reconciliation task are obtained, where N≥2. For each set of resource processing information, the key element information of each resource processing event in the set is determined. Then, based on the preset sharding device partitioning information and the reconciliation element information of each resource processing event, the target shard corresponding to each resource processing event is determined. For multiple resource processing events belonging to the same target shard, the key element information of each resource processing event in the multiple resource processing events is split according to the information splitting method of the target reconciliation task, resulting in multiple split element information sets of the target shard. Then, based on the multi-threading of each node in the distributed system, the reconciliation operation of the split element information sets with the same identifier in the N sets of resource processing information is executed to obtain the reconciliation result of the target reconciliation task. This method realizes fast reconciliation of a distributed system based on sharding, information splitting, and multi-threaded processing. By dividing the resource processing information set into different shards and then splitting the information in each shard, the multi-machine advantage and multi-threaded processing technology of the distributed system are used for reconciliation processing, which can solve the problems of slow reconciliation of large amounts of data and memory overflow, and improve the efficiency of reconciliation processing.

[0079] In one embodiment, obtaining the set of N resource processing information for the target reconciliation task may include the following steps:

[0080] For the target reconciliation task, N sets of original resource information are obtained from outside the reconciliation system. For each set of original resource information, a legality check is performed based on the resource processing details and inspection information in the set. If the legality check passes, the resource processing information set is obtained based on the resource processing details in the set of original resource information and stored inside the reconciliation system.

[0081] In practical applications, such as Figure 3a The flowchart of the container processing in the receiving module shown illustrates that the external receiving task is published through the distributed batch scheduling center. The main container of the business server group of the external receiving module can receive the task and start the job process. The container can read directories A and B (i.e., N sets of original resource information) from the external file server and determine whether the detailed files and inspection files (i.e., resource processing details and inspection information) of companies A and B corresponding to the target reconciliation task already exist in the directories. If all files have arrived, the detailed files and inspection files can be downloaded from the external file server to the container. Then, the size, file name, last modification date, and other elements of the detailed files are verified to be consistent with those described in the inspection files. If the verification is successful, the detailed files can be renamed (i.e., N sets of resource processing information) and uploaded to directories C and D of the internal file server. The downloaded detailed files and inspection files in the container can also be deleted. The distributed batch scheduling center can also be notified that the normal operation has been completed and the subsequent jobs can continue to run.

[0082] In one example, if the files are not all received, it can be determined whether the current time has exceeded the preset reception time (e.g., the latest waiting time for the reception task, which can be set via parameterization). If the latest waiting time for the reception task has been exceeded, an alarm message indicating that the files have not arrived on time can be sent, and the distributed batch scheduling center can be notified of the operational anomaly, causing subsequent jobs to stop running. If the latest waiting time for the reception task has not been exceeded, a preset sleep time can be waited for (e.g., 5 minutes, which can be set via parameterization). After the waiting time has expired, the process can return to the step of determining whether the files in the directory are all received.

[0083] In another example, if the verification of the detail file fails, an alarm message indicating that the detail file and the verification file are inconsistent can be sent, and the distributed batch scheduling center can be notified of the abnormal operation, and subsequent jobs will stop running.

[0084] In this embodiment, N sets of original resource information are obtained from outside the reconciliation system for the target reconciliation task. For each set of original resource information, the legality is verified based on the resource processing details and inspection information in the set. If the legality verification is successful, the resource processing information set is obtained based on the resource processing details in the set of original resource information and stored inside the reconciliation system. By preprocessing the externally received data, data support is provided for further execution of the reconciliation task.

[0085] In one embodiment, determining the key element information of each resource processing event in each resource processing information set may include the following steps:

[0086] For each set of resource processing information, verify the key element information of each resource processing event in the set; if the verification passes, convert the information format of the key element information of each resource processing event into a target format that matches the reconciliation system.

[0087] In one example, such as Figure 3b The flowchart of the container processing in the conversion module shown illustrates that conversion tasks are published through a distributed batch scheduling center. The main container of the conversion module's business server group can receive the tasks and start the job process. It can download the renamed detail files from the C and D directories of the intranet file server to the container. By starting two threads, the two renamed detail files can be read line by line. For each record in the read detail file, the content of each record can be parsed according to different detail file formats, and the integrity and format of key elements such as order number, amount, and date can be checked (i.e., verifying the key element information of each resource processing event in the resource processing information set). If the verification passes, the record content can be converted and assigned according to the file format specified by the reconciliation system (i.e., the target format that matches the reconciliation system). For example, the file format can be formatted in the order of order number, date, and amount.

[0088] In another example, if the key element verification fails, the failed record content can be registered in the main database of the conversion module database server group, and the source file corresponding to the record can be marked. Then, the data can be exported through the exception table to notify the external company of the exception record.

[0089] In this embodiment, by verifying the key element information of each resource processing event in each resource processing information set, and then converting the information format of the key element information of each resource processing event into a target format that matches the reconciliation system if the verification passes, the differences between different detailed files of different systems can be masked, the format of the reconciliation file can be customized, and the reconciliation processing efficiency can be improved.

[0090] In one embodiment, determining the target shard corresponding to each resource processing event based on preset sharding device partitioning information and reconciliation element information for each resource processing event may include the following steps:

[0091] Obtain preset sharding device partitioning information; the sharding device partitioning information includes partitioning feature values ​​calculated based on multiple sharding devices; determine the element feature value corresponding to each reconciliation element information; for each resource processing event, determine the target shard corresponding to the resource processing event from the multiple sharding devices by comparing the element feature value and the partitioning feature value.

[0092] In specific implementations, such as Figure 3b As shown, after the reconciliation file format is converted, the field in each record that determines whether the reconciliation was successful can be used as a reconciliation element to calculate the hash value (i.e., determine the element feature value corresponding to each reconciliation element information). For example, if the reconciliation element is the order number, the hash value can be calculated based on the order number. Then, based on the calculated hash value and the total number of business server groups in the reconciliation module (such as the number of sharding devices), the group corresponding to the record (i.e., the target shard) can be calculated, and the record can be written to the corresponding shard file.

[0093] For example, in the reconciliation system architecture diagram, the total number of business server groups for the reconciliation module is 4, so the total number of shards is 4. According to the sharding calculation algorithm, the default value of the algorithm (i.e., the partitioning feature value), such as 9223372036854775807 (2^63-1), can be divided into 4 parts. Then, based on the calculated hash value, it can be compared with 1 / 4, 2 / 4, 3 / 4, and 4 / 4 of 9223372036854775807 in sequence until the hash value is less than or equal to one of them. Then, the corresponding numerator can be used as the target shard number. For example, the shard files corresponding to Company A can be obtained as: A shard file 1, A shard file 2, A shard file 3, and A shard file 4.

[0094] In one example, it can be determined whether the current detail file has been read completely. When the reading is complete, the generated fragment files can be re-uploaded to directories E and F of the intranet file server respectively. For example, all fragment files of Company A are uploaded to directory E of the intranet file server, and those of Company B are uploaded to directory F. After the upload is completed, the detail files and fragment files in the container can be deleted, and the distributed batch scheduling center can be notified that the normal operation has been completed and the subsequent jobs can continue to run.

[0095] In another example, the fragmented file format generated by the conversion module allows for the addition of fields and adjustment of field order based on actual business needs. The fragmented file can be a fixed-length file, meaning the length of each field is fixed, and padding can be applied according to rules when the length is insufficient. This ensures a fixed size for each line, facilitating byte-by-byte reading, and also fixes the position of each field. This avoids misalignment and out-of-order issues during file segmentation by the file splitting module, and allows for byte-by-byte truncation when parsing each field's value to prevent misalignment. For example, when reading the file, a preset number of bytes (e.g., 44 bytes) can be read each time to obtain the content of each line, allowing the content of each field to be obtained according to its length.

[0096] In this embodiment, by obtaining the preset sharding device partitioning information, the feature value corresponding to each reconciliation element information is determined. Then, for each resource processing event, the target shard corresponding to the resource processing event is determined from multiple sharding devices by comparing the feature value and the partitioning feature value. Sharding can be performed using only the reconciliation elements in the detail file, without having to calculate all the record content, and without relying on the detail file, thus improving the efficiency of reconciliation processing.

[0097] In one embodiment, the step of splitting the key element information of each resource processing event belonging to the same target shard into multiple resource processing events according to the information splitting method of the target reconciliation task, to obtain multiple split element information sets belonging to the target shard, may include the following steps:

[0098] Obtain preset splitting configuration information; the splitting configuration information includes different information splitting methods and the method identifier corresponding to each information splitting method; take the information splitting method that matches the method identifier of the target reconciliation task as the information splitting method of the target reconciliation task; according to the information splitting method, split the key element information of each resource processing event in the multiple resource processing events to obtain a set of multiple splitting element information of the target shard.

[0099] In practical applications, such as Figure 2a As shown, the reconciliation module can include a file splitting submodule, a file sorting submodule, and a file reconciliation submodule. The file splitting submodule can be used to split a fragmented file into multiple smaller fragmented files (i.e., multiple sets of split element information) according to certain rules. This file splitting submodule has an independent start and end point, and its interaction with upstream and downstream modules can be controlled by a distributed batch scheduling center. The file sorting submodule can be used to sort the contents of the smaller fragmented files in ascending order, generating multiple sorted files. The file reconciliation submodule can be used to reconcile accounts based on the pairwise corresponding sorted files and can register the reconciliation results in the database.

[0100] In one example, the reconciliation module processing chain can be as follows: After the conversion module completes, the distributed batch scheduling center can initiate a file splitting task. On each shard container, the file splitting submodule can process the A and B shard files belonging to that shard and split them into multiple smaller shard files. For example, taking shard file 1 of shard 1 as an example, it can be split into shard file 1-1, shard file 1-2, shard file 1-3, etc., and the split smaller shard files can be uploaded to the intranet file server.

[0101] After the splitting is complete, the distributed batch scheduling center can initiate a file sorting task. On each shard container, the file sorting submodule can process the A and B sub-shard files belonging to that shard. By sorting all the sub-shard files in ascending order according to their file content, sorted files can be generated. For example, taking the A sorted file belonging to shard 1 as an example, we can get A sorted file 1-1, A sorted file 1-2, etc. After sorting, the distributed batch scheduling center can initiate a file reconciliation processing task. Each shard container can download the A and B sorted files with the same sequence number for reconciliation, such as reconciling A sorted file 1-1 with B sorted file 1-1.

[0102] In yet another example, such as Figure 4a The file splitting submodule flowchart illustrates the container processing flow. File splitting tasks are published through a distributed batch scheduling center. The main container of the reconciliation module's business server group receives the task and initiates the job process. It can read splitting parameters (i.e., splitting configuration information) from the configuration, which can be represented using a numeric dictionary (i.e., different information splitting methods and their corresponding method identifiers). For example, 0 indicates no splitting, 1 indicates splitting by 1 bit, 2 indicates splitting by 2 bits, and other values ​​can represent unusable parameters. If the value of the splitting parameter is not any of 0, 1, or 2, it can be processed as 0 (no splitting). The value of the splitting parameter can be determined; if it is 1 or 2, it can be processed according to the corresponding splitting method. Based on Linux commands, small file chunks are obtained, and the distributed batch scheduling center is notified that the process is complete, allowing subsequent jobs to continue. Therefore, after splitting, it's possible to determine whether to further split the file chunks based on actual reconciliation efficiency. Certain fields of the record content can be selected as the splitting criteria, such as selecting the first or first two fields, which is both flexible and effective.

[0103] In an optional embodiment, if the value is not 1 or 2, the Linux cp command can be used to copy the A and B shard files, which are located in the internal network file server directories E and F respectively and belong to the current container shard number, to the G directory of the internal network file server. The files can be named A shard file shard number-0 and B shard file shard number-0 respectively. For example, taking the files in shard 1 as an example, we can get A shard file 1-0 and B shard file 1-0.

[0104] In this embodiment, by obtaining preset splitting configuration information, the information splitting method that matches the method identifier of the target reconciliation task is used as the information splitting method of the target reconciliation task. Then, according to the information splitting method, the key element information of each resource processing event in multiple resource processing events is split, and multiple splitting element information sets of the target shard are obtained. This allows for the splitting of large files in each shard, providing data support for further sorting and reconciliation of small files in the shards.

[0105] In one embodiment, splitting the key element information of each of the multiple resource processing events according to the information splitting method to obtain a set of multiple split element information of the target shard may include the following steps:

[0106] Based on the preset splitting operation information corresponding to the information splitting method, obtain the information truncation position and information truncation length; according to the information truncation position and information truncation length, split the key element information of each resource processing event in the multiple resource processing events to obtain multiple splitting element information sets of the target segment; each splitting element information set has a corresponding identifier.

[0107] In practice, the target directory and filename to be split can be obtained through Linux commands (i.e., preset split operation information), and parameters such as the split start position and split length (i.e., information truncation position and information truncation length) can be determined. Then, each line of the A and B shard files, which are located in the E and F directories of the intranet file server and belong to the current container shard number, can be output to the smaller shard file according to the specified number of split bits.

[0108] For example, Linux commands can be used for text and data processing. These commands can output the content of the same field position in each line of a record to the same file, and this output file name can be part of the file name. For instance, the output file number can be composed of the line record, the start position of the split, and the split length. Specifically, when selecting the number, the extracted content can be chosen to be numbers or letters, thus determining the maximum number of split files and ensuring that the file name does not contain abnormal characters.

[0109] In one example, numbers can be used as sequence numbers (i.e., each set of split element information has a corresponding identifier). A split length of 1 digit can split into a maximum of 10 files, and 2 digits can split into a maximum of 100 files. The target directory here is the G directory of the intranet file server. The final file names can be A split file split number-sequence number, B split file split number-sequence number. For example, the file names of split 1 can be A split file 1-0, B split file 1-0, A split file 1-1, and B split file 1-1. Since the content of the files is uncertain, each split may not necessarily split into 10 or 100 files. There may be situations where the sequence numbers of A and B split files are inconsistent. For example, A split file 1 may only have sequence numbers 0 and 1, and B split file 1 may only have sequence numbers 0 and 2. In such cases, further sorting processing is required.

[0110] In this embodiment, by obtaining the information truncation position and information truncation length according to the preset splitting operation information corresponding to the information splitting method, and then splitting the key element information of each resource processing event in multiple resource processing events according to the information truncation position and information truncation length, a set of multiple splitting element information of the target shard is obtained. It is possible to use Linux commands to split large sharded files into multiple small sharded files, providing data support for further sorting and reconciliation of the small sharded files.

[0111] In one embodiment, before the step of performing a reconciliation operation on the split element information sets with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task, the following steps may be included:

[0112] By using a sorting thread pool, and according to the sorting method corresponding to the preset sorting operation information, the multiple splitting element information sets of the target segment are sorted for each target segment, thereby obtaining a splitting element information set with different identifiers corresponding to each resource processing information set in the target segment.

[0113] In one example, such as Figure 4b The flowchart of the container processing in the file sorting submodule shown below illustrates that the file sorting task is published through the distributed batch scheduling center. The main container of the reconciliation module's business server group can receive the task and start the job process. Then, a fixed-size thread pool (i.e., the sorting processing thread pool) can be created to obtain all filenames belonging to the current shard number in the G directory of the intranet file server. For example, for shard 1, all filenames with sequence numbers in shards A and B can be obtained. Then, the task content can be constructed, such as passing in the filename and the directory where the file is located, and submitting the same number of tasks as the total number of files to the thread pool. If it is determined that there are no unexecuted tasks in the thread pool, the distributed batch scheduling center can be notified that the normal operation has been completed and the subsequent jobs can continue to run.

[0114] Specifically, when an idle thread in the thread pool receives a task, it can sort the file in ascending order according to its ASCII code (i.e., the sorting method corresponding to the preset sorting operation information) using the Linux `sort` command, based on the filename and directory provided in the task. The sorted file can then be named `X_sort_file_fragment_number -_sequence_number` (e.g., `X` represents Company A or Company B), and subsequently output to directory H on the internal network file server. If there are currently no idle threads in the thread pool, it needs to wait for other tasks to complete.

[0115] In this embodiment, by using a sorting processing thread pool, the multiple splitting element information sets of the target shard are sorted according to the sorting method corresponding to the preset sorting operation information. This results in a splitting element information set with different identifiers corresponding to each resource processing information set in the target shard. This can solve the problem of inconsistent sequence numbers of small files in the shards after splitting, and provides data support for further reconciliation of small files in the shards.

[0116] In one embodiment, performing a reconciliation operation on the split element information sets with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task may include the following steps:

[0117] The set of split element information with the same identifier under the same target shard is taken as a comparison group, and multiple task contents are constructed for the N resource processing information sets; the multiple task contents are reconciled through the reconciliation processing thread pool to obtain the shard reconciliation result of each target shard, which is used as the reconciliation result of the target reconciliation task.

[0118] In practical applications, such as Figure 4cThe flowchart shown in the file reconciliation submodule illustrates the container processing flow. The core file reconciliation task is published through a distributed batch scheduling center. The main container of the reconciliation module's business server group receives the task and initiates the job process. A fixed-size thread pool (i.e., the reconciliation processing thread pool) is then created. This pool retrieves all filenames belonging to the current shard number from the H directory of the intranet file server. Filenames are categorized by shard number and sequence number, grouping those with the same shard number and sequence number (i.e., sets of split element information with the same identifier) ​​to construct task content (e.g., passing in the shard number, sequence number, and the directory where the file is located). Tasks equal to the number of groups can be submitted to the thread pool. When an idle thread in the thread pool receives a task, it downloads the file to the container for reconciliation processing based on the shard number, sequence number, and the file's directory provided in the task. If there are no idle threads in the current thread pool, it waits for other tasks to complete. If no unexecuted tasks are found in the thread pool, the distributed batch scheduling center is notified that the operation has completed, and subsequent jobs can continue. Therefore, based on the distributed system, each container node can use multi-threading for processing, which can further accelerate the processing efficiency within the limited resources of a single container and make up for the shortcomings of reconciliation using file read and write methods.

[0119] In one example, such as Figure 4d The flowchart shown illustrates the processing flow of the reconciliation thread pool. When an idle thread receives a task and starts working, it can download the corresponding fragment number and sequence number file from the intranet file server to the container's local machine based on the passed fragment number, sequence number, and file directory.

[0120] Specifically, the following process can be used to handle different situations of downloaded files:

[0121] Step 1: You can determine whether the A fragment file with the specified fragment number and sequence number has been downloaded. If the A fragment file has been downloaded, you can continue to Step 2. If the A fragment file has not been downloaded, you can continue to Step 3.

[0122] Step 2: You can set the "Read A file or not" flag to Yes (this flag is No by default), which can be used to indicate whether to read A file next time;

[0123] Step 3: You can determine whether the B fragment file with the specified fragment number and sequence number has been downloaded. If the B fragment file has been downloaded, you can continue to Step 4. If the B fragment file has not been downloaded, you can continue to Step 5.

[0124] Step 4: You can set the "Read B file or not" flag to Yes (this flag is No by default), which can be used to indicate whether to read the B file next time;

[0125] Step 5: Determine the value of the "Read file A" flag. If yes, proceed to step 6; otherwise, proceed to step 7.

[0126] Step 6: You can read a line of record in file A according to the reconciliation file format and parse out the content of each field;

[0127] Step 7: Determine the value of the "Read B file?" flag. If yes, proceed to step 8; otherwise, proceed to step 9.

[0128] Step 8: You can read a line of record in file B according to the reconciliation file format and parse out the content of each field;

[0129] Step 9: Determine whether records A and B can both be read. If yes, proceed to step 10; otherwise, proceed to step 11.

[0130] Step 10: The reconciliation elements of the read records A and B can be compared, such as order number, date, amount, etc. If they match, you can continue to step 15; if they do not match, you can continue to step 12.

[0131] Step 11: Since at least one of records A and B cannot be read, we can check whether record A can be read. If it can, it means that record A is not empty and record B is empty, and we can continue to step 13. If not, we can continue to step 17.

[0132] Step 12: Since the reconciliation elements in records A and B are inconsistent, and the sorting module has already sorted the contents of the file in ascending order, we can compare the size according to the ASCII code. Since the smaller value cannot be matched, if the reconciliation element in record A is smaller than the reconciliation element in record B, we can continue to step 13; otherwise, we can continue to step 18.

[0133] Step 13: Since record A can no longer be matched, it means that the record is an extra record content of party A. Party B does not have this record content. The record content can be inserted into the database and the status can be registered as extra of party A. Then you can continue to step 14.

[0134] Step 14: When record A has been processed but record B has not been processed, you can set the "Read A file or not" flag to "Yes" and the "Read B file or not" flag to "No", and then return to step 5;

[0135] Step 15: Since the reconciliation elements of records A and B are consistent, the content of one of the records can be inserted into the database, and the status can be recorded as reconciliation successful. Then you can continue to step 16.

[0136] Step 16: Records A and B have been processed. You can set the "Read A file?" flag to "Yes" and the "Read B file?" flag to "Yes", and then return to step 5.

[0137] Step 17: If record A is empty, we can then check if record B can be read. If it is, it means that record A is empty and record B is not empty, and we can continue to step 18. Otherwise, it means that both records A and B have been read, and we can continue to step 20.

[0138] Step 18: If record B cannot be matched, it means that the record is an extra record from Party B. Party A does not have this record. The record can be inserted into the database and the status can be registered as extra from Party B. Then you can continue to step 19.

[0139] Step 19: When record A has not been processed and record B has been processed, you can set the "Read A file or not" flag to No and the "Read B file or not" flag to Yes, and then return to step 5;

[0140] Step 20: Files A and B have been fully read. Reconciliation process is now complete.

[0141] In this embodiment, by taking the set of split element information with the same identifier under the same target shard as a comparison group, multiple task contents are constructed for N resource processing information sets. Then, the reconciliation processing thread pool is used to reconcile the multiple task contents to obtain the shard reconciliation result of each target shard, which serves as the reconciliation result of the target reconciliation task. Multi-threading technology can be used for reconciliation, which can reduce the time consumption of reconciliation and improve the efficiency of reconciliation processing.

[0142] In one embodiment, such as Figure 5 The diagram illustrates another information processing method. In this embodiment, the method includes the following steps:

[0143] In step 501, N sets of resource processing information for the target reconciliation task are obtained. For each set of resource processing information, the key element information of each resource processing event in the set is verified. In step 502, if the verification passes, the information format of the key element information of each resource processing event is converted into a target format that matches the reconciliation system. In step 503, preset sharding device partitioning information is obtained; the sharding device partitioning information includes partitioning feature values ​​calculated based on multiple sharding devices. In step 504, the element feature value corresponding to each reconciliation element information is determined. For each resource processing event, the target shard corresponding to the resource processing event is determined from multiple sharding devices by comparing the element feature value and the partitioning feature value. In step 505, for multiple resource processing events belonging to the same target shard, the key element information of each resource processing event in the multiple resource processing events is split according to the information splitting method of the target reconciliation task, resulting in multiple split element information sets for the target shard. In step 506, the sorting thread pool sorts multiple splitting element information sets of each target segment according to the sorting method corresponding to the preset sorting operation information, obtaining splitting element information sets with different identifiers corresponding to each resource processing information set in the target segment. In step 507, splitting element information sets with the same identifier under the same target segment are grouped together as a comparison group to construct multiple task contents for N resource processing information sets. In step 508, the reconciliation thread pool performs reconciliation processing on the multiple task contents to obtain the segment reconciliation result for each target segment, which serves as the reconciliation result for the target reconciliation task. It should be noted that the specific limitations of the above steps can be found in the specific limitations of an information processing method described above, and will not be repeated here.

[0144] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0145] Based on the same inventive concept, this application also provides an information processing apparatus for implementing the information processing method described above. The solution provided by this apparatus is similar to the implementation scheme described in the above method; therefore, the specific limitations in one or more information processing apparatus embodiments provided below can be found in the limitations of the information processing method described above, and will not be repeated here.

[0146] In one embodiment, such as Figure 6 As shown, an information processing apparatus is provided, comprising:

[0147] The reconciliation information acquisition module 601 is used to acquire N sets of resource processing information for the target reconciliation task, and for each set of resource processing information, determine the key element information of each resource processing event in the set of resource processing information; wherein, N≥2, the key element information is the information obtained by performing a recording operation on the resource processing event; the key element information includes reconciliation element information;

[0148] The target shard determination module 602 is used to determine the target shard corresponding to each resource processing event based on the preset sharding device partitioning information and the reconciliation element information of each resource processing event.

[0149] The information splitting module 603 is used to split the key element information of each resource processing event in the multiple resource processing events belonging to the same target shard according to the information splitting method of the target reconciliation task, so as to obtain a set of multiple split element information of the target shard.

[0150] The reconciliation processing module 604 is used to perform reconciliation operations on the split element information sets with the same identifier in the N resource processing information sets based on the multi-threading of each node in the distributed system, so as to obtain the reconciliation result of the target reconciliation task.

[0151] In one embodiment, the reconciliation information acquisition module 601 includes:

[0152] The first verification submodule is used to obtain N sets of original resource information from outside the reconciliation system for the target reconciliation task, and to perform legality verification for each set of original resource information based on the resource processing details and inspection information in the set of original resource information.

[0153] The reconciliation information acquisition submodule is used to obtain the resource processing information set based on the resource processing details in the original resource information set, and store it inside the reconciliation system, provided that the legality verification passes.

[0154] In one embodiment, the reconciliation information acquisition module 601 includes:

[0155] The second verification submodule is used to verify the key element information of each resource processing event in each resource processing information set;

[0156] The format conversion submodule is used to convert the information format of key elements of each resource processing event into a target format that matches the reconciliation system, provided that the verification passes.

[0157] In one embodiment, the target fragment determination module 602 includes:

[0158] The partitioning information acquisition submodule is used to acquire preset partitioning information of the partitioning devices; the partitioning information of the partitioning devices includes partitioning feature values ​​calculated based on multiple partitioning devices;

[0159] The feature value determination submodule is used to determine the feature value corresponding to each reconciliation feature information.

[0160] The feature value comparison submodule is used to determine the target shard corresponding to the resource processing event from the multiple sharding devices by comparing the feature value of the element with the partitioning feature value for each resource processing event.

[0161] In one embodiment, the information splitting module 603 includes:

[0162] The configuration information acquisition submodule is used to acquire preset configuration information; the configuration information includes different information splitting methods and the method identifier corresponding to each information splitting method.

[0163] The splitting method determination submodule is used to determine the information splitting method that matches the method identifier of the target reconciliation task as the information splitting method of the target reconciliation task.

[0164] The information splitting submodule is used to split the key element information of each resource processing event in the multiple resource processing events according to the information splitting method, and obtain a set of multiple split element information of the target segment.

[0165] In one embodiment, the sub-module obtained by splitting the information includes:

[0166] The truncation parameter acquisition unit is used to acquire the information truncation position and information truncation length according to the preset splitting operation information corresponding to the information splitting method;

[0167] The split element information set obtaining unit is used to split the key element information of each resource processing event in the multiple resource processing events according to the information truncation position and the information truncation length, and obtain multiple split element information sets of the target segment; each split element information set has a corresponding identifier.

[0168] In one embodiment, the apparatus further includes:

[0169] The sorting module is used to sort multiple splitting element information sets of each target segment according to a sorting method corresponding to a preset sorting operation information through a sorting processing thread pool, thereby obtaining a splitting element information set with different identifiers corresponding to each resource processing information set in the target segment.

[0170] In one embodiment, the reconciliation processing module 604 includes:

[0171] The task content construction submodule is used to take the set of split element information with the same identifier under the same target segment as a comparison group and construct multiple task contents for the N resource processing information sets;

[0172] The reconciliation result acquisition submodule is used to perform reconciliation processing on the multiple task contents through the reconciliation processing thread pool to obtain the reconciliation result of each target shard, which serves as the reconciliation result of the target reconciliation task.

[0173] Each module in the aforementioned information processing device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.

[0174] In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 7 As shown, the computer device includes a processor, memory, and a network interface connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The database stores information processing data. The network interface communicates with external terminals via a network connection. When the computer program is executed by the processor, it implements an information processing method.

[0175] Those skilled in the art will understand that Figure 7 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0176] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0177] Obtain N sets of resource processing information for the target reconciliation task. For each set of resource processing information, determine the key element information of each resource processing event in the set of resource processing information; wherein, N≥2, the key element information is the information obtained by performing a recording operation on the resource processing event; the key element information includes reconciliation element information.

[0178] Based on the preset sharding device partitioning information and the reconciliation element information for each resource processing event, determine the target shard corresponding to each resource processing event;

[0179] For multiple resource processing events belonging to the same target shard, according to the information splitting method of the target reconciliation task, the key element information of each resource processing event in the multiple resource processing events is split to obtain a set of multiple split element information of the target shard.

[0180] Based on the multi-threading of each node in the distributed system, the reconciliation operation is performed on the split element information set with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task.

[0181] In one embodiment, the processor, when executing a computer program, also implements the steps of the information processing method described in the other embodiments above.

[0182] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program performing the following steps when executed by a processor:

[0183] Obtain N sets of resource processing information for the target reconciliation task. For each set of resource processing information, determine the key element information of each resource processing event in the set of resource processing information; wherein, N≥2, the key element information is the information obtained by performing a recording operation on the resource processing event; the key element information includes reconciliation element information.

[0184] Based on the preset sharding device partitioning information and the reconciliation element information for each resource processing event, determine the target shard corresponding to each resource processing event;

[0185] For multiple resource processing events belonging to the same target shard, according to the information splitting method of the target reconciliation task, the key element information of each resource processing event in the multiple resource processing events is split to obtain a set of multiple split element information of the target shard.

[0186] Based on the multi-threading of each node in the distributed system, the reconciliation operation is performed on the split element information set with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task.

[0187] In one embodiment, when the computer program is executed by a processor, it also implements the steps of the information processing method described in the other embodiments above.

[0188] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:

[0189] Obtain N sets of resource processing information for the target reconciliation task. For each set of resource processing information, determine the key element information of each resource processing event in the set of resource processing information; wherein, N≥2, the key element information is the information obtained by performing a recording operation on the resource processing event; the key element information includes reconciliation element information.

[0190] Based on the preset sharding device partitioning information and the reconciliation element information for each resource processing event, determine the target shard corresponding to each resource processing event;

[0191] For multiple resource processing events belonging to the same target shard, according to the information splitting method of the target reconciliation task, the key element information of each resource processing event in the multiple resource processing events is split to obtain a set of multiple split element information of the target shard.

[0192] Based on the multi-threading of each node in the distributed system, the reconciliation operation is performed on the split element information set with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task.

[0193] In one embodiment, when the computer program is executed by a processor, it also implements the steps of the information processing method described in the other embodiments above.

[0194] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0195] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0196] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. An information processing method, characterized in that, The method includes: Obtain N sets of resource processing information for the target reconciliation task. For each set of resource processing information, determine the key element information of each resource processing event in the set of resource processing information; wherein, N≥2, the key element information is the information obtained by performing a recording operation on the resource processing event; the key element information includes reconciliation element information. Obtain preset sharding device partitioning information; the sharding device partitioning information includes partitioning feature values ​​calculated based on multiple sharding devices; Determine the feature value corresponding to each reconciliation element; For each resource processing event, the target shard corresponding to the resource processing event is determined from the plurality of sharding devices by comparing the feature value of the element and the partitioning feature value. For multiple resource processing events belonging to the same target shard, according to the information splitting method of the target reconciliation task, the key element information of each resource processing event in the multiple resource processing events is split to obtain a set of multiple split element information of the target shard. Based on the multi-threading of each node in the distributed system, the reconciliation operation is performed on the split element information set with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task.

2. The method according to claim 1, characterized in that, The set of N resource processing information for obtaining the target reconciliation task includes: For the target reconciliation task, N sets of original resource information are obtained from outside the reconciliation system. For each set of original resource information, a legality verification is performed based on the resource processing details and inspection information in the set of original resource information. If the legality verification passes, the resource processing information set is obtained based on the resource processing details in the original resource information set and stored in the reconciliation system.

3. The method according to claim 1, characterized in that, For each set of resource processing information, the key element information of each resource processing event in the set of resource processing information is determined, including: For each set of resource processing information, verify the key element information of each resource processing event in the set of resource processing information; If the verification passes, the information format of the key elements of each resource processing event is converted into the target format that matches the reconciliation system.

4. The method according to claim 1, characterized in that, For multiple resource processing events belonging to the same target shard, based on the information splitting method of the target reconciliation task, the key element information of each resource processing event in the multiple resource processing events is split, resulting in multiple split element information sets for the target shard, including: Obtain preset splitting configuration information; the splitting configuration information includes different information splitting methods and the method identifier corresponding to each information splitting method; The information splitting method that matches the method identifier of the target reconciliation task shall be used as the information splitting method of the target reconciliation task. According to the information splitting method, the key element information of each resource processing event in the multiple resource processing events is split to obtain a set of multiple split element information of the target segment.

5. The method according to claim 4, characterized in that, The key element information of each resource processing event in the multiple resource processing events is split according to the information splitting method to obtain a set of multiple split element information of the target fragment, including: Based on the preset splitting operation information corresponding to the information splitting method, obtain the information truncation position and information truncation length; Based on the information capture position and the information capture length, the key element information of each resource processing event in the multiple resource processing events is split to obtain multiple sets of split element information of the target segment; each set of split element information has a corresponding identifier.

6. The method according to claim 1, characterized in that, Before the step of performing a reconciliation operation on the split element information sets with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task, the method further includes: By using a sorting thread pool, and according to the sorting method corresponding to the preset sorting operation information, the multiple splitting element information sets of the target segment are sorted for each target segment, thereby obtaining a splitting element information set with different identifiers corresponding to each resource processing information set in the target segment.

7. The method according to any one of claims 1 to 6, characterized in that, The reconciliation operation performed on the split element information sets with the same identifier in the N resource processing information sets to obtain the reconciliation result of the target reconciliation task includes: The set of split element information with the same identifier under the same target segment is used as a comparison group to construct multiple task contents for the N resource processing information sets; The reconciliation processing thread pool is used to reconcile the contents of the multiple tasks to obtain the reconciliation result of each target shard, which is used as the reconciliation result of the target reconciliation task.

8. An information processing device, characterized in that, The device includes: The reconciliation information acquisition module is used to acquire N sets of resource processing information for the target reconciliation task, and for each set of resource processing information, determine the key element information of each resource processing event in the set of resource processing information; wherein, N≥2, the key element information is the information obtained by performing a recording operation on the resource processing event; the key element information includes reconciliation element information; The target sharding determination module is used to obtain preset sharding device partitioning information; the sharding device partitioning information includes partitioning feature values ​​calculated based on multiple sharding devices; determine the element feature value corresponding to each reconciliation element information; for each resource processing event, determine the target shard corresponding to the resource processing event from the multiple sharding devices by comparing the element feature value and the partitioning feature value; The information splitting module is used to split the key element information of each resource processing event in the multiple resource processing events belonging to the same target shard according to the information splitting method of the target reconciliation task, so as to obtain a set of multiple split element information of the target shard. The reconciliation processing module is used to perform reconciliation operations on the split element information sets with the same identifier in the N resource processing information sets based on the multi-threading of each node in the distributed system, so as to obtain the reconciliation result of the target reconciliation task.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.

11. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.

Images