Account details data processing method, device, server and client
By using the transit data cache service component and the transit file storage service platform in the node server of the distributed system instead of the traditional database, the problems of low processing efficiency and long waiting time in the big data scenario are solved, and more efficient data processing and better user experience are achieved.
Patent Information
- Application Number
- CN202210679113.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-16
- Publication Date
- 2025-06-06
- Estimated Expiration
- 2042-06-16
AI Technical Summary
In the big data scenario, when the system receives a large number of account detailed data download requests in a short time, the number of management servers is limited, resulting in low processing efficiency, long waiting time for users, and frequent database operations affect system performance.
By introducing the transit data cache service component and the transit file storage service platform into the node server of the distributed system, data processing is performed instead of the traditional database. The method includes receiving a target task creation request, querying the transfer data cache service component, creating a task status set, and uploading and saving account details data on the transfer file storage service platform through preset data processing.
It effectively reduces frequent operations on the database in big data scenarios, reduces the impact on system performance, improves processing efficiency, shortens users' waiting time, and improves user interaction experience.
Smart Images

Figure CN115033617B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of big data technology, and in particular to methods, devices, servers and clients for processing account detail data. Background Art
[0002] In some data processing scenarios involving big data, the system (for example, the back-end system of a bank, etc.) often receives a large number of download requests for account details within a short period of time.
[0003] Based on the existing methods, most of the corresponding data processing can only be completed by calling the management server responsible for managing the database in the system to perform read and write operations on the database (for example, the centralized library). However, due to the relatively limited number of management servers in the system, most of the download requests need to wait in the task pool of the database, resulting in low overall processing efficiency and long waiting time for users. In addition, based on the above method, the system database needs to be frequently operated, which is limited by the performance of the database, further affecting the overall processing efficiency and the overall performance of the system.
[0004] To address the above problems, no effective solution has been proposed yet. Summary of the invention
[0005] This specification provides a method, device, server and client for processing account detail data, which can effectively reduce frequent operations on the database in big data scenarios, reduce the performance impact on the system, improve overall processing efficiency, shorten user waiting time, and enable users to obtain a better interactive experience.
[0006] This specification provides a method for processing account details data, which is applied to a node server in a distributed system, including:
[0007] Receiving a target task creation request initiated by a target client for downloading account details data of a target user; wherein the target task creation request carries at least a user identifier of the target user;
[0008] In response to the target task creation request, query the transit data cache service component according to the user ID of the target user to determine whether there is a target task state set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores multiple task state sets; the task state set is used to record the task state;
[0009] When it is determined that the target task state set does not exist in the transit data cache service component, create a target task state set in the transit data cache service component with the user identifier of the target user as the key value;
[0010] According to the target task status set, preset data processing is performed to upload and save a target detail file of the target user's account detail data in the transit file storage service platform; wherein the target detail file corresponds to the user ID of the target user; and the transit file storage service platform stores multiple detail files corresponding to multiple user IDs.
[0011] In one embodiment, the transit data cache service component includes NOS; correspondingly, the transit file storage service platform includes OAAS.
[0012] In one embodiment, according to the target task state set, by performing preset data processing, the process includes:
[0013] Perform the current preset data processing in the following manner:
[0014] Obtain the current task status of the target task through the transit data cache service component;
[0015] According to the current task status, determine whether the target detailed file has been uploaded and saved in the transit file storage service platform;
[0016] When it is determined that the target detailed file has not been uploaded and saved in the transit file storage service platform, a matching business server is called to obtain and obtain an intermediate detailed file based on the account detailed data related to the target user;
[0017] Uploading the intermediate detailed file to the transit file storage service platform; wherein the intermediate detailed file is used to generate a target detailed file in the transit file storage service platform;
[0018] Receive and update the target task status set in the transit data cache service component based on the processing prompt information fed back by the transit file storage service platform for the intermediate detail file.
[0019] In one embodiment, a matching business server is called to obtain and obtain an intermediate detail file based on the account detail data related to the target user, including:
[0020] According to the target task status set, the business type of the current account detail data to be obtained is determined as the current business type;
[0021] According to the current business type, the matching business server is called to obtain and obtain the intermediate detail file according to the account detail data related to the target user and belonging to the current business type.
[0022] In one embodiment, during the process of performing the preset data processing, the method further includes:
[0023] Receive a current task status update request for a target task initiated by a target client according to a preset polling rule;
[0024] In response to the current task status update request, the current task status of the target task is obtained by querying the target task status set in the transit data cache service component;
[0025] According to the current task status of the target task, the current task progress information about the target task is fed back to the target client.
[0026] In one embodiment, the method further comprises:
[0027] Receiving a target download request for a target detailed file initiated by a target client; wherein the target client initiates the target download request when determining that the upload and storage of the target detailed file in the transit file storage service platform is completed according to the task progress information;
[0028] In response to the target download request, the target detailed file is obtained through the transit file storage service platform;
[0029] The target detail file is sent to the target client; and the target task status set in the transit data cache service component is updated.
[0030] In one embodiment, when it is determined that the target task state set does not exist in the transit data cache service component, the method further includes:
[0031] Generate target polling prompts about target tasks;
[0032] The target polling prompt is sent to the target client to trigger the target client to initiate a current task status update request for the target task according to a preset polling rule.
[0033] This specification also provides a method for processing account details data, which is applied to a target client and includes:
[0034] Receiving and responding to a creation operation of a target user, generating a target task creation request for downloading account details data of the target user; wherein the target task creation request carries at least a user identifier of the target user;
[0035] The target task creation request is sent to the node server; wherein the node server responds to the target task creation request, and creates a target task status set in the transit data cache service component when it is determined that there is no target task status set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores multiple task status sets; according to the target task status set, a target detail file of the account detail data of the target user is uploaded and saved in the transit file storage service platform by performing preset data processing; wherein the target detail file corresponds to the user ID of the target user; and the transit file storage service platform stores multiple detail files corresponding to multiple user IDs;
[0036] Get the target detailed file through the node server.
[0037] In one embodiment, after sending the target task creation request to the node server, the method further includes:
[0038] Receive target polling prompts about target tasks from the node server;
[0039] In response to the target polling prompt, a current task status update request for the target task is initiated to the node server according to a preset polling rule;
[0040] Receive the current task progress information about the target task fed back by the node server.
[0041] In one embodiment, the method further comprises:
[0042] According to the current task progress information, determine whether the target detailed file has been uploaded and saved in the transit file storage service platform;
[0043] When it is determined that the upload and storage of the target detailed file is completed in the transit file storage service platform, a target download request for the target detailed file is generated; and the target download request is sent to the node server;
[0044] Receive the target details file sent by the node server.
[0045] This specification also provides a device for processing account details data, which is applied to a node server in a distributed system, including:
[0046] A receiving module, configured to receive a target task creation request initiated by a target client for downloading the account details data of a target user; wherein the target task creation request carries at least a user identifier of the target user;
[0047] A query module, for responding to the target task creation request, querying the transit data cache service component according to the user ID of the target user, so as to determine whether there is a target task state set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores a plurality of task state sets; the task state set is used to record the task state;
[0048] A creation module, used for creating a target task status set with a user ID of a target user as a key value in the transit data cache service component when it is determined that the target task status set does not exist in the transit data cache service component;
[0049] A processing module is used to upload and save a target detail file of account detail data of a target user in a transit file storage service platform by performing preset data processing according to a target task status set; wherein the target detail file corresponds to a user ID of the target user; and the transit file storage service platform stores multiple detail files corresponding to multiple user IDs.
[0050] This specification also provides a device for processing account details data, which is applied to a target client and includes:
[0051] A generating module, configured to receive and respond to a creation operation of a target user, and generate a target task creation request for downloading the target user's account details data; wherein the target task creation request carries at least a user identifier of the target user;
[0052] A sending module, used for sending the target task creation request to the node server; wherein, the node server responds to the target task creation request, and creates a target task status set with the user ID of the target user as the key value in the transit data cache service component when it is determined that there is no target task status set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores a plurality of task status sets; according to the target task status set, by performing preset data processing, a target detail file of the account detail data of the target user is uploaded and saved in the transit file storage service platform; wherein, the target detail file corresponds to the user ID of the target user; and the transit file storage service platform stores a plurality of detail files corresponding to the plurality of user IDs;
[0053] The acquisition module is used to obtain the target detailed file through the node server.
[0054] The present specification also provides a server, comprising a processor and a memory for storing processor executable instructions, wherein the processor implements the steps of the method for processing account detail data when executing the instructions.
[0055] This specification also provides a client, including a processor and a memory for storing processor executable instructions, and the processor implements the steps of the method for processing account detail data when executing the instructions.
[0056] The present specification also provides a computer-readable storage medium having computer instructions stored thereon, which, when executed by a processor, implement the steps of the method for processing account detail data.
[0057] Based on the account detail data processing method, device, server and client provided in this specification, a target task creation request for downloading the target user's account detail data initiated by a target client can be received and responded to by a node server in a distributed system, and a transit data cache service component can be queried according to the user ID of the target user to determine whether there is a target task status set with the user ID of the target user as the key value in the transit data cache service component; wherein, the transit data cache service component stores task status sets for multiple tasks; when it is determined that the target task status set does not exist in the transit data cache service component, a target task status set can be created in the transit data cache service component; and according to the target task status set, a target detail file of the target user's account detail data can be uploaded and saved in the transit file storage service platform by performing preset data processing; wherein, the transit file storage service platform stores multiple detail files corresponding to multiple user IDs; and then the node server can obtain the target detail file through the transit file storage service platform and send the target detail file to the target client. Since the data processing for downloading the user's account details is completed by combining the use of the transit data cache service component and the transit file storage service platform instead of the database, it can effectively reduce the frequent operations on the database in the big data scenario, reduce the performance impact on the distributed system, improve the overall processing efficiency, shorten the user's waiting time, and enable users to obtain a better interactive experience. In addition, since the transit data cache service component and the transit file storage service platform are combined to replace the database, it is no longer necessary to rely on the relatively limited number of management servers responsible for managing the database in the distributed system, but any node server in the distributed system can be called to respond to the client to complete the data processing for downloading the user's account details, so that more data processing resources in the distributed system can be fully called, the queuing time of the task can be shortened, and the overall processing efficiency can be further improved, and the waiting time of the user can be shortened. Also, due to the introduction of the polling mechanism, before downloading the target detail file, the client can automatically send a task status update request to the node server according to the preset polling rules; accordingly, the node server can respond to the task status update request, and promptly obtain and feedback the latest task progress information of the target task to the client through the transit data storage service component, so that the client can promptly feedback the latest task progress information of the target task to the user, thereby reducing the user's blank waiting time and further improving the user's interactive experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0058] In order to more clearly illustrate the embodiments of this specification, the drawings required for use in the embodiments will be briefly introduced below. The drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0059] Figure 1 It is a flowchart of a method for processing account details data provided by an embodiment of this specification;
[0060] Figure 2 It is a schematic diagram of an embodiment of a method for processing account details data provided by an embodiment of this specification in a scenario example;
[0061] Figure 3 It is a schematic diagram of an embodiment of a method for processing account details data provided by an embodiment of this specification in a scenario example;
[0062] Figure 4 It is a schematic diagram of an embodiment of a method for processing account details data provided by an embodiment of this specification in a scenario example;
[0063] Figure 5 It is a schematic diagram of an embodiment of a method for processing account details data provided by an embodiment of this specification in a scenario example;
[0064] Figure 6 is a flowchart of a method for processing account details data provided by another embodiment of the present specification;
[0065] Figure 7 It is a schematic diagram of the structure of a server provided by an embodiment of this specification;
[0066] Figure 8 It is a schematic diagram of the structure of an account detail data processing device provided by an embodiment of the present specification;
[0067] Fig. 9 It is a schematic diagram of the structural composition of an account detail data processing device provided in another embodiment of the present specification. DETAILED DESCRIPTION
[0068] In order to enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this specification.
[0069] See also Figure 1 As shown, the embodiment of this specification provides a method for processing account details data, wherein the method is specifically applied to a node server side in a distributed system. When implemented specifically, the method may include the following contents:
[0070] S101: receiving a target task creation request initiated by a target client for downloading account details data of a target user; wherein the target task creation request carries at least a user identifier of the target user;
[0071] S102: responding to the target task creation request, querying the transit data cache service component according to the user ID of the target user to determine whether there is a target task state set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores multiple task state sets; the task state set is used to record the task state;
[0072] S103: when it is determined that the target task status set does not exist in the transit data cache service component, create a target task status set in the transit data cache service component with the user identifier of the target user as a key value;
[0073] S104: According to the target task status set, preset data processing is performed to upload and save a target detail file of account detail data of the target user in the transit file storage service platform; wherein the target detail file corresponds to the user ID of the target user; and the transit file storage service platform stores multiple detail files corresponding to multiple user IDs.
[0074] Based on the above embodiments, the node servers in the distributed system use a combination of a transit data cache service component and a transit file storage service platform to replace the relational database to complete the data processing for downloading the user's account details data, which can effectively reduce the frequent operations on the database in the big data scenario, get rid of the limitations of the database performance bottleneck, and reduce the performance impact on the distributed system; at the same time, it is no longer dependent on the relatively limited management server responsible for managing the database, and can respond to the client to complete the corresponding data processing by using any node server in the distributed system, which can fully call on more data processing resources in the distributed system and shorten the queuing time of the task, thereby effectively improving the overall processing efficiency, shortening the user's waiting time, and allowing the user to obtain a relatively good interactive experience.
[0075] In some embodiments, the above-mentioned method for processing account details data can be specifically applied to any node server in a distributed system, rather than being limited to one or two servers. In this way, when dealing with task data processing with a large amount of data in a short period of time in a big data scenario, the data processing resources in the distributed system can be fully utilized, the task queue time can be shortened, and the overall processing efficiency can be improved.
[0076] For details, see Figure 2 As shown, the above-mentioned distributed system can specifically be a backend business data processing system, for example, the backend system of XX Bank.
[0077] Correspondingly, the node server can be an application server in the backend system of XX Bank. Of course, the node server can also be a management server in the backend system of XX Bank, or other types of servers.
[0078] Among them, the above-mentioned node server may specifically include a background server applied to one side of the distributed system, which can realize functions such as data transmission and data processing. Specifically, the node server may be, for example, an electronic device with data calculation, storage and network interaction functions. Alternatively, the node server may also be a software program running in the electronic device to provide support for data processing, storage and network interaction. In this embodiment, the number of servers included in the node server is not specifically limited. The node server may specifically be one server, or several servers, or a server cluster formed by several servers.
[0079] The node server mentioned above can specifically be connected to the client held by the user.
[0080] The client terminal may specifically include a front end applied to the user side and capable of realizing functions such as data collection and data transmission. Specifically, the client terminal may be, for example, an electronic device such as a desktop computer, a tablet computer, a laptop computer, a smart phone, etc. Alternatively, the client terminal may also be a software application that can be run in the above electronic devices. For example, it may be an XX electronic banking APP running on a smart phone.
[0081] For specific implementation, see Figure 2 As shown, when the target user wants to download his account details data, he can log in to the software application on his smartphone (i.e., the target client) and click the "Download Account Details" icon in the application interface to initiate a creation operation. Correspondingly, the target client can respond to the target user's creation operation and generate a target task creation request for downloading the target user's account details data. The target task can specifically be a download task for downloading the target user's account details data. The target task creation request carries at least the user ID of the target user.
[0082] Specifically, the user identification of the target user may be identification information that can indicate the target user, such as the name, user name, registered mobile phone number, etc. of the target user. Of course, the user identifications listed above are only a schematic illustration. During specific implementation, other suitable identification information may also be introduced and used as the user identification of the target user according to specific circumstances and processing requirements. This specification does not limit this.
[0083] It should be noted that all information and data related to users in this manual are obtained and used with the knowledge and consent of the users. In addition, the acquisition, storage, use and processing of the above information and data are in compliance with the relevant provisions of national laws and regulations.
[0084] When the target user initiates the creation operation through the application interface, the target user can also make customized settings through the application interface, for example, setting the start time, end time, business type and other customized parameters of the account details data to be downloaded. Accordingly, the generated creation request can also carry the above customized parameters. This can meet the user's diverse downloading needs for account details data and further improve the user's interactive experience.
[0085] See also Figure 2As shown, any node server in the distributed system can receive and respond to the target task creation request, and perform data processing related to the target task by combining the transit data cache service component and the transit file storage service platform, including: generating a target detail file of the target user's account detail data that meets user needs; and promptly feeding back the above target detail file to the target client.
[0086] In the process of processing data related to the target task in the above manner, the task status in the target task status set can be recorded and updated through the transit data cache service component; based on the target task status set in the transit data cache service component, the matching business server is called to generate an intermediate detail file about the target user's account detail data, and uploaded and saved to the transit file storage service platform; the required target detail file is finally generated and saved through the transit file storage service platform. In this way, the data processing related to the target task can be completed more efficiently, the waiting time of the target user can be reduced, and the target user can obtain a better interactive experience.
[0087] In addition, in the process of processing data related to the target task in the above manner, it is also possible to interact with the client in real time based on the preset polling rules, so that the client can implement and obtain and display the latest task progress information about the target task to the target user, reducing the blank waiting time of the target user. At the same time, it is also possible to enable the target client to timely generate and send a target download request for the target detail file when it is determined that the upload and storage of the target detail file has been completed in the transit file storage service platform according to the task progress information, so that the target detail file can be downloaded in time and displayed to the target user. Thereby, the overall processing efficiency can be further improved, so that the target user can obtain a relatively better interactive experience.
[0088] In some embodiments, the target user's account details data may specifically be a collection of the target user's account details data for different time periods and / or different business types. Accordingly, the method for processing account details data provided in this specification may support the target user to aggregate and download account details data with a relatively large amount of data.
[0089] In some embodiments, the transit data cache service component may specifically include NOS; correspondingly, the transit file storage service platform may specifically include OAAS.
[0090] Among them, the above-mentioned NOS can specifically be a Redis data cache service component. Using this component in the big data scenario in the distributed system can effectively optimize data access efficiency, improve the high availability and service continuity of the access process, and has the characteristics of lightweight and high-speed caching. It can more efficiently and stably support query and access operations in big data scenarios.
[0091] The above OAAS can be specifically an object storage service platform that can provide storage services for unstructured object files such as pictures, documents, audio and video in a service-oriented manner. Among them, the above OAAS is different from conventional databases and does not need to be connected to a dedicated management server; and in the big data scenario, when performing operations such as storage, query, and retrieval on file data with large data volumes, it has relatively better efficiency and reliability.
[0092] Based on the above embodiments, by introducing and combining NOS and OAAS that are more suitable for big data scenarios to replace conventional relational databases to participate in data processing related to downloading user account details data, the overall processing efficiency can be effectively improved and the processing time can be shortened.
[0093] In some embodiments, the transit data cache service component stores multiple task status sets. Each task status set uses the user ID of the user holding the account for the task as a key value to distinguish different task status sets. Each task status set may record all task states related to the task. Each task status set may use the user ID of the user corresponding to the task as a key value (e.g., key value).
[0094] The transit file storage service platform stores multiple detail files corresponding to multiple user IDs. Each detail file is associated with a task state set stored in the transit data cache service component, and contains detail files corresponding to the task state set (including intermediate detail files and final detail files, etc.). Each detail file corresponds to a user ID of a user, which can be specifically understood as a collection of account detail data of the corresponding user.
[0095] In some embodiments, when implementing Figure 3 As shown, after receiving the target task creation request initiated by the target client, the node server can first respond to the target task creation request, and query the transit data cache service component according to the user identifier of the target user to determine whether there is a target task status set with the user identifier of the target user as the key value in the transit data cache service component.
[0096] Specifically, when it is determined that the target task state set does not exist in the transit data cache service component, a target task state set with the user ID of the target user as the key value can be created in the transit data cache service component. After completing the target task state set, the task state can be initialized in the target task state set; when the initialization is successful, a prompt message about the successful creation of the target task state set can be fed back to the target client. On the contrary, when the initialization fails, a prompt message about the failure to create the target task state set can be fed back to the target client, so as to prompt the target user to re-initiate the target task creation request through the target client after self-examination.
[0097] When it is determined that a target task state set already exists in the transit data cache service component, there is no need to create a target task state set in the transit data cache service component, and the existing target task state set can be directly used to participate in subsequent data processing.
[0098] During specific use, according to the target task status, if it is determined that the transit file storage service platform has saved the complete target detail file corresponding to the target task, the target detail file can be directly obtained through the transit file storage service platform; and the target detail file can be sent to the target client.
[0099] Specifically, for example, the node server can, based on the existing target task status, directly feed back to the target client the task progress information used to characterize the uploaded and saved target detail files that have been completed in the transit file storage service platform, if it is determined that the transit file storage service platform has already stored the target detail files that meet the target user's needs, so that the target client can initiate a target download request. Correspondingly, the node server can respond to the target download request, directly pull the corresponding target detail files from the transit file storage service platform, and send the target detail files to the target client.
[0100] When it is determined that the transit file storage service platform has not yet stored a complete target detail file corresponding to the target task, subsequent preset data processing can be performed.
[0101] After the target task status is created in the transit data cache service component, the node server can subsequently perform preset data processing based on the target task status set through interaction with the transit cache service component and the transit file storage service platform to achieve data processing related to the target task, so as to upload and save the target detail file about the target user's account detail data in the transit file storage service platform.
[0102] Among them, the above-mentioned preset data processing includes: calling a matching business server to generate and upload an intermediate detail file related to the account detail data of the target user; and / or, updating the task status in the target task status set; and / or, based on the preset polling rules, real-time feedback of the latest task progress information to the target client.
[0103] In some embodiments, the above-mentioned target task state set is processed by performing preset data processing, referring to Figure 4 As shown, it includes: performing the current preset data processing in the following manner:
[0104] S1: Get the current task status of the target task through the transit data cache service component;
[0105] S2: According to the current task status, determine whether the target detailed file has been uploaded and saved in the transit file storage service platform;
[0106] S3: when it is determined that the target detailed file has not been uploaded and saved in the transit file storage service platform, a matching business server is called to obtain and obtain an intermediate detailed file based on the account detailed data related to the target user;
[0107] S4: uploading the intermediate detailed file to the transit file storage service platform; wherein the intermediate detailed file is used to generate a target detailed file in the transit file storage service platform;
[0108] S5: Receive and update the target task status set in the transit data cache service component according to the processing prompt information fed back by the transit file storage service platform for the intermediate detail file.
[0109] Based on the above embodiment, by performing multiple preset data processing in the above manner, multiple required intermediate detail files can be uploaded and saved in the transit file storage service platform, so that the complete target detail file required by the final target user can be combined.
[0110] In some embodiments, the above-mentioned calling of the matching business server obtains and obtains the intermediate detail file based on the account detail data related to the target user. When implemented specifically, the following contents may be included:
[0111] S1: According to the target task status set, determine the business type of the current account detail data to be obtained as the current business type;
[0112] S2: According to the current business type, call the matching business server to obtain and obtain the intermediate detail file based on the account detail data related to the target user and belonging to the current business type.
[0113] Based on the above embodiment, the node server can first accurately determine the business server that matches the current business type according to the target task status, and then call the above matching business server to accurately generate the intermediate detailed file required for the current time.
[0114] In some embodiments, the above-mentioned business types may specifically include: transaction channel type (for example, online transaction channel, offline transaction channel, etc.), transaction time type (for example, within the current month, one month ago, etc.), transaction location type (for example, region A, region B, etc.), transaction object type (for example, shopping, transfer, investment, etc.), etc.
[0115] Specifically, different node servers in the distributed system can be responsible for data processing of one or several business types. In this way, the above distributed system can effectively utilize the performance advantages of the distributed system and efficiently and stably complete the cumbersome and complex business data processing in the big data scenario.
[0116] In some embodiments, see Figure 5 As shown, in the process of performing the preset data processing, the method may further include the following contents when it is specifically implemented:
[0117] S1: receiving a current task status update request for a target task initiated by a target client according to a preset polling rule;
[0118] S2: Responding to the current task status update request, obtaining the current task status of the target task by querying the target task status set in the transit data cache service component;
[0119] S3: Based on the current task status of the target task, the current task progress information about the target task is fed back to the target client.
[0120] Based on the above embodiments, according to the preset polling rules, the node server and the target client can automatically and in real time exchange data with each other, so that the target client can receive and utilize the current task progress information provided by the node server in real time, obtain the latest task status of the target task, and display the latest task status to the target user in a timely manner, so as to reduce the blank waiting time of the target user and improve the interactive experience of the target user.
[0121] In some embodiments, during specific implementation, when the node server determines that the uploading and saving of the target detail file has not been completed in the transit file storage service platform based on the target task status set, it generates and sends a target polling prompt about the target task to the target client.
[0122] Correspondingly, after receiving the above target polling prompt, the target client can trigger the preset polling rules and periodically (for example, every 5 seconds) initiate a current task status update request for the target task to the node server to obtain the latest task status and display it to the target user. Until the target client determines that the upload and storage of the target detailed file in the transit file storage service platform is completed according to the latest task status, it stops initiating the current task status update request for the target task to the node server.
[0123] In some embodiments, the current task progress information of the target task may specifically include: the completeness of the target detailed file stored in the current transit file storage service platform.
[0124] In some embodiments, the above-mentioned feedback of the current task progress information about the target task to the target client according to the current task state of the target task may include the following when implemented: directly using the current state of the target task as the current task progress information and feeding it back to the target client;
[0125] or,
[0126] According to the current task status of the target task, the completeness of the target detail file saved in the current transit file storage service platform is detected; when it is determined that the target detail file saved in the current transit file storage service platform is complete, a prompt message indicating that the target task is completed can be generated as the progress information of the current task; when it is determined that the target detail file saved in the current transit file storage service platform is incomplete, a prompt message indicating that the target task is not completed can be generated as the progress information of the current task; and then the above progress information of the current task is sent to the target client.
[0127] In some embodiments, see Figure 5 As shown, when the method is implemented specifically, it may also include the following contents:
[0128] S1: receiving a target download request for a target detailed file initiated by a target client; wherein the target client initiates the target download request when determining that the upload and storage of the target detailed file in the transit file storage service platform is completed according to the task progress information;
[0129] S2: responding to the target download request and obtaining the target detailed file through the transit file storage service platform;
[0130] S3: Send the target detail file to the target client; and update the target task status set in the transit data cache service component.
[0131] In specific implementation, the target client may generate and send the target download request based on the latest task progress information and when it is determined that the target detail file has been uploaded and saved in the transit file storage service platform.
[0132] Based on the above embodiment, the target client can download the target detail file required by the target user in a timely manner when the target detail file is uploaded and saved in the transit file storage service platform, thereby further shortening the waiting time of the target user.
[0133] In some embodiments, when it is determined that the target task status set does not exist in the transit data cache service component, the method may further include the following when implemented:
[0134] S1: Generate target polling prompts about the target task;
[0135] S2: Sending the target polling prompt to the target client to trigger the target client to initiate a current task status update request for the target task according to a preset polling rule.
[0136] Based on the above embodiment, the node server can generate and send a target polling prompt to actively remind the target client to send a current task status update request for the target task in real time according to the preset polling rules to ensure that the target user can promptly understand the latest task status of the target task.
[0137] The preset polling rules at least include the polling interval and the polling end condition, which may specifically be: receiving task progress information for indicating that the upload and storage of the target detailed file in the transit file storage service platform has been completed.
[0138] In some embodiments, in order to protect the security of detailed file data of users on the transit file storage service platform, during specific implementation, only the ciphertext data of multiple detailed files are stored in the transit file storage service platform.
[0139] Before specific implementation, corresponding encryption keys and decryption keys can be pre-generated on the transit file storage service platform; and decryption keys are only issued to node servers that have passed security authentication in the distributed system.
[0140] During specific implementation, each time the transit file storage service platform combines the intermediate detail files to obtain a complete detail file, it can first encrypt it using the encryption key to obtain the ciphertext data of the detail file, and save the ciphertext data of the detail file on the transit file service platform; at the same time, delete the detail file in plain text.
[0141] Correspondingly, the node server can only download and obtain the ciphertext data of the required target detail file through the transit file storage service platform. After obtaining the ciphertext data of the target detail file, the node server can use the decryption key to decrypt the target detail file to obtain the target detail file in plain text; and then send the target detail file in plain text to the target client.
[0142] This can prevent the detailed files stored in the transit file storage service platform from being leaked, and can better protect the data security of the user's account detailed data.
[0143] As can be seen from the above, based on the method for processing account detail data provided in the embodiment of this specification, a target task creation request initiated by a target client to download the target user's account detail data can be received and responded to by a node server in a distributed system, and a transit data cache service component can be queried according to the user identifier of the target user to determine whether there is a target task status set with the user identifier of the target user as the key value in the transit data cache service component; wherein, the transit data cache service component stores task status sets for multiple tasks; when it is determined that the target task status set does not exist in the transit data cache service component, a target task status set is created in the transit data cache service component; and according to the target task status set, a preset data processing is performed to upload and save a target detail file of the target user's account detail data in the transit file storage service platform; wherein, the transit file storage service platform stores multiple detail files corresponding to multiple user identifiers; and then the node server can obtain the target detail file through the transit file storage service platform, and send the target detail file to the target client. Since the data processing of downloading the user's account details is completed by combining the transfer data cache service component and the transfer file storage service platform instead of the database, the frequent operations on the database in the big data scenario can be effectively reduced, the performance impact on the distributed system can be reduced, the overall processing efficiency can be improved, the waiting time of the user can be shortened, and the user can obtain a better interactive experience. In addition, since the transfer data cache service component and the transfer file storage service platform are combined to replace the database, it is no longer necessary to rely on the relatively limited number of management servers responsible for managing the database in the distributed system, but any node server in the distributed system can be called to respond to the client to complete the data processing of downloading the user's account details, so that more data processing resources of the distributed system can be fully called, the queuing time of the task can be shortened, the overall processing efficiency can be further improved, and the waiting time of the user can be shortened. In addition, by introducing a polling mechanism, the client can automatically send a task status update request to the node server according to the preset polling rules; accordingly, the node server can respond to the task status update request, and timely obtain and feedback the latest task progress information of the target task to the client through the transfer data storage service component, so that the client can timely feedback the latest task progress of the target task to the user, thereby reducing the blank waiting time of the user and further improving the interactive experience of the user.
[0144] See also Figure 6 As shown, the embodiment of this specification also provides a method for processing account details data, which is applied to the target client. When the method is implemented specifically, it may include the following contents:
[0145] S601: receiving and responding to a creation operation of a target user, generating a target task creation request for downloading account details data of the target user; wherein the target task creation request carries at least a user ID of the target user;
[0146] S602: Sending the target task creation request to the node server; wherein, the node server responds to the target task creation request, and creates a target task status set in the transit data cache service component when it is determined that there is no target task status set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores multiple task status sets; according to the target task status set, by performing preset data processing, a target detail file of the account detail data of the target user is uploaded and saved in the transit file storage service platform; wherein, the target detail file corresponds to the user ID of the target user; and the transit file storage service platform stores multiple detail files corresponding to multiple user IDs;
[0147] S603: Obtain the target detailed file through the node server.
[0148] Based on the above embodiments, the target user can use the target client to interact with the node server in the distributed system to efficiently and accurately download the required target detail file.
[0149] In some embodiments, after sending the target task creation request to the node server, the method may further include the following when implemented:
[0150] S1: Receive target polling prompts about target tasks fed back by the node server;
[0151] S2: In response to the target polling prompt, a current task status update request for the target task is initiated to the node server according to a preset polling rule;
[0152] S3: Receive the current task progress information about the target task fed back by the node server.
[0153] Based on the above embodiment, the target client can initiate a current task status update request for the target task to the node server in real time according to the preset polling rules to obtain the latest task progress information of the target task; and promptly display the task progress information to the target user, so that the target user can promptly understand the latest progress of the target task and reduce the blank waiting time of the target user.
[0154] In some embodiments, the method may further include the following when implemented:
[0155] S1: Determine whether the target detailed file has been uploaded and saved in the transit file storage service platform according to the current task progress information;
[0156] S2: when it is determined that the upload and storage of the target detailed file is completed in the transit file storage service platform, a target download request for the target detailed file is generated; and the target download request is sent to the node server;
[0157] S3: Receive the target detail file sent by the node server.
[0158] Based on the above embodiment, the target client can, based on the task progress information, send a target download request to promptly download the target detail file when it determines that the upload and storage of the target detail file has been completed in the transit file storage service platform; and display the target detail file to the target user, thereby shortening the waiting time of the target user and allowing the target user to have a better interactive experience.
[0159] The embodiment of the present specification also provides a server, including a processor and a memory for storing processor executable instructions, wherein the processor can perform the following steps according to the instructions when specifically implemented: receiving a target task creation request initiated by a target client for downloading target user's account detail data; wherein the target task creation request carries at least the user identification of the target user; in response to the target task creation request, querying the transit data cache service component according to the user identification of the target user to determine whether there is a target task status set with the user identification of the target user as a key value in the transit data cache service component; wherein the transit data cache service component stores multiple task status sets; the task status set is used to record task status; in the case of determining that the target task status set does not exist in the transit data cache service component, creating a target task status set with the user identification of the target user as a key value in the transit data cache service component; according to the target task status set, by performing preset data processing, uploading and saving a target detail file about the target user's account detail data in the transit file storage service platform; wherein the target detail file corresponds to the user identification of the target user; the transit file storage service platform stores multiple detail files corresponding to multiple user identifications.
[0160] In order to complete the above instructions more accurately, refer to Figure 7 As shown, the embodiment of this specification also provides another specific server, wherein the server includes a network communication port 701, a processor 702 and a memory 703, and the above structures are connected through internal cables so that each structure can perform specific data interaction.
[0161] The network communication port 701 may be specifically used to receive a target task creation request initiated by a target client for downloading the target user's account details data; wherein the target task creation request carries at least a user identifier of the target user.
[0162] The processor 702 can be specifically used to respond to the target task creation request, query the transit data cache service component according to the user identifier of the target user, so as to determine whether there is a target task status set with the user identifier of the target user as the key value in the transit data cache service component; wherein, the transit data cache service component stores multiple task status sets; the task status set is used to record the task status; when it is determined that the target task status set does not exist in the transit data cache service component, create a target task status set with the user identifier of the target user as the key value in the transit data cache service component; according to the target task status set, by performing preset data processing, upload and save a target detail file about the account detail data of the target user in the transit file storage service platform; wherein, the target detail file corresponds to the user identifier of the target user; the transit file storage service platform stores multiple detail files corresponding to multiple user identifiers.
[0163] The memory 703 may be specifically used to store corresponding instruction programs.
[0164] In this embodiment, the network communication port 701 can be a virtual port that is bound to different communication protocols so that different data can be sent or received. For example, the network communication port can be a port responsible for web data communication, a port responsible for FTP data communication, or a port responsible for email data communication. In addition, the network communication port can also be a physical communication interface or communication chip. For example, it can be a wireless mobile network communication chip, such as GSM, CDMA, etc.; it can also be a Wifi chip; it can also be a Bluetooth chip.
[0165] In this embodiment, the processor 702 may be implemented in any appropriate manner. For example, the processor may take the form of a microprocessor or processor and a computer-readable medium storing a computer-readable program code (such as software or firmware) executable by the (micro)processor, a logic gate, a switch, an application specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller, etc. This specification does not limit this.
[0166] In this embodiment, the memory 703 may include multiple levels. In a digital system, anything that can store binary data can be a memory; in an integrated circuit, a circuit with a storage function that has no physical form is also called a memory, such as RAM, FIFO, etc.; in a system, a storage device with a physical form is also called a memory, such as a memory stick, TF card, etc.
[0167] The embodiment of the present specification also provides a client, including a processor and a memory for storing processor executable instructions, wherein the processor can perform the following steps according to the instructions when implemented: receiving and responding to a creation operation of a target user, generating a target task creation request for downloading the target user's account detail data; wherein the target task creation request carries at least the user identification of the target user; sending the target task creation request to a node server; wherein the node server responds to the target task creation request, and creates a target task status set in the transit data cache service component when it is determined that there is no target task status set with the user identification of the target user as a key value in the transit data cache service component; wherein the transit data cache service component stores multiple task status sets; according to the target task status set, by performing preset data processing, a target detail file of the target user's account detail data is uploaded and saved in the transit file storage service platform; wherein the target detail file corresponds to the user identification of the target user; the transit file storage service platform stores multiple detail files corresponding to multiple user identifications; and obtaining the target detail file through the node server.
[0168] The embodiment of the present specification also provides a computer storage medium based on the above-mentioned method for processing account detail data, wherein the computer storage medium stores computer program instructions, and when the computer program instructions are executed, the following are achieved: receiving a target task creation request initiated by a target client to download the account detail data of a target user; wherein the target task creation request carries at least the user identification of the target user; in response to the target task creation request, querying the transit data cache service component according to the user identification of the target user to determine whether there is a target task status set with the user identification of the target user as a key value in the transit data cache service component; wherein the transit data cache service component stores multiple task status sets; the task status set is used to record the task status; in the case of determining that the target task status set does not exist in the transit data cache service component, creating a target task status set with the user identification of the target user as a key value in the transit data cache service component; according to the target task status set, by performing preset data processing, uploading and saving a target detail file about the account detail data of the target user in the transit file storage service platform; wherein the target detail file corresponds to the user identification of the target user; and the transit file storage service platform stores multiple detail files corresponding to multiple user identifications.
[0169] The embodiment of the present specification also provides another computer storage medium based on the above-mentioned processing method of account detail data, wherein the computer storage medium stores computer program instructions, and when the computer program instructions are executed, the following are achieved: receiving and responding to the creation operation of the target user, generating a target task creation request for downloading the account detail data of the target user; wherein the target task creation request carries at least the user identification of the target user; sending the target task creation request to the node server; wherein the node server responds to the target task creation request, and creates a target task status set in the transit data cache service component when it is determined that there is no target task status set with the user identification of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores multiple task status sets; according to the target task status set, by performing preset data processing, a target detail file of the account detail data of the target user is uploaded and saved in the transit file storage service platform; wherein the target detail file corresponds to the user identification of the target user; the transit file storage service platform stores multiple detail files corresponding to multiple user identifications; and obtaining the target detail file through the node server.
[0170] In this embodiment, the storage medium includes, but is not limited to, a random access memory (RAM), a read-only memory (ROM), a cache, a hard disk (HDD), or a memory card. The memory may be used to store computer program instructions. The network communication unit may be an interface for network connection communication set in accordance with the standard specified by the communication protocol.
[0171] In this embodiment, the functions and effects specifically implemented by the program instructions stored in the computer storage medium can be explained in comparison with other implementations and will not be described in detail here.
[0172] The embodiment of the present specification also provides a computer program product, comprising a computer program, which implements the following steps when executed by a processor: receiving a target task creation request initiated by a target client to download the account detail data of a target user; wherein the target task creation request carries at least the user identification of the target user; in response to the target task creation request, querying the transit data cache service component according to the user identification of the target user to determine whether there is a target task status set with the user identification of the target user as a key value in the transit data cache service component; wherein the transit data cache service component stores multiple task status sets; the task status set is used to record the task status; in the case of determining that the target task status set does not exist in the transit data cache service component, creating a target task status set with the user identification of the target user as a key value in the transit data cache service component; according to the target task status set, by performing preset data processing, uploading and saving a target detail file about the account detail data of the target user in the transit file storage service platform; wherein the target detail file corresponds to the user identification of the target user; the transit file storage service platform stores multiple detail files corresponding to multiple user identifications.
[0173] See also Figure 8 As shown, at the software level, the embodiment of this specification also provides a device for processing account details data, which may specifically include the following structural modules:
[0174] The receiving module 801 may be specifically configured to receive a target task creation request initiated by a target client for downloading the account details data of a target user; wherein the target task creation request at least carries a user identifier of the target user;
[0175] The query module 802 may be specifically used to respond to the target task creation request, query the transit data cache service component according to the user ID of the target user, to determine whether there is a target task state set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores multiple task state sets; the task state set is used to record the task state;
[0176] The creation module 803 may be specifically used to create a target task status set with a user ID of a target user as a key value in the transit data cache service component when it is determined that the target task status set does not exist in the transit data cache service component;
[0177] The processing module 804 can be specifically used to upload and save a target detail file of the account detail data of the target user in the transit file storage service platform by performing preset data processing according to the target task status set; wherein the target detail file corresponds to the user ID of the target user; and the transit file storage service platform stores multiple detail files corresponding to multiple user IDs.
[0178] In some embodiments, the transit data cache service component may specifically include NOS, etc.; correspondingly, the transit file storage service platform may specifically include OAAS, etc.
[0179] In some embodiments, when the above-mentioned processing module 804 is specifically implemented, it can be implemented in the following manner according to the target task status set by performing preset data processing: Perform the current preset data processing in the following manner: obtain the current task status of the target task through the transit data cache service component; determine whether the upload and save of the target detail file are completed in the transit file storage service platform according to the current task status; when it is determined that the upload and save of the target detail file are not completed in the transit file storage service platform, call the matching business server to obtain and obtain the intermediate detail file based on the account detail data related to the target user; upload the intermediate detail file to the transit file storage service platform; wherein, the intermediate detail file is used to generate the target detail file in the transit file storage service platform; receive and update the target task status set in the transit data cache service component according to the processing prompt information fed back by the transit file storage service platform for the intermediate detail file.
[0180] In some embodiments, when the above-mentioned processing module 804 is implemented, the matching business server can be called in the following manner to obtain and obtain an intermediate detail file based on the account detail data related to the target user: according to the target task status set, the business type of the account detail data to be obtained is determined as the current business type; according to the current business type, the matching business server is called to obtain and obtain an intermediate detail file based on the account detail data related to the target user and belonging to the current business type.
[0181] In some embodiments, the above-mentioned processing module 804 can also be used to receive a current task status update request for a target task initiated by a target client according to a preset polling rule during the process of performing preset data processing; respond to the current task status update request, obtain the current task status of the target task by querying the target task status set in the transit data cache service component; and feedback the current task progress information about the target task to the target client based on the current task status of the target task.
[0182] In some embodiments, when the above-mentioned device is implemented, it can also be used to receive a target download request initiated by a target client regarding a target detail file; wherein, the target client initiates the target download request when determining that the upload and storage of the target detail file in the transit file storage service platform has been completed based on the task progress information; responds to the target download request, obtains the target detail file through the transit file storage service platform; sends the target detail file to the target client; and updates the target task status set in the transit data cache service component.
[0183] In some embodiments, when it is determined that there is no target task status set in the transit data cache service component, the device can also be used to generate a target polling prompt about the target task when it is implemented; the target polling prompt is sent to the target client to trigger the target client to initiate a current task status update request for the target task according to preset polling rules.
[0184] See also Fig. 9 As shown, at the software level, the embodiment of this specification also provides another device for processing account details data, which may specifically include the following structural modules:
[0185] The generating module 901 may be specifically configured to receive and respond to a creation operation of a target user, and generate a target task creation request for downloading the target user's account details data; wherein the target task creation request at least carries a user ID of the target user;
[0186] The sending module 902 may be specifically used to send the target task creation request to the node server; wherein the node server responds to the target task creation request, and when it is determined that there is no target task status set with the user ID of the target user as the key value in the transit data cache service component, creates a target task status set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores a plurality of task status sets; according to the target task status set, by performing preset data processing, a target detail file of the account detail data of the target user is uploaded and saved in the transit file storage service platform; wherein the target detail file corresponds to the user ID of the target user; and the transit file storage service platform stores a plurality of detail files corresponding to the plurality of user IDs;
[0187] The acquisition module 903 may be specifically used to acquire the target detailed file through the node server.
[0188] In some embodiments, after sending the target task creation request to the node server, the device can also be used to receive a target polling prompt about the target task fed back by the node server when it is implemented; respond to the target polling prompt, initiate a current task status update request for the target task to the node server according to preset polling rules; and receive current task progress information about the target task fed back by the node server.
[0189] In some embodiments, when the device is implemented, it can also be used to determine whether the uploading and saving of the target detail file are completed in the transit file storage service platform based on the current task progress information; when it is determined that the uploading and saving of the target detail file are completed in the transit file storage service platform, generate a target download request for the target detail file; and send the target download request to the node server; receive the target detail file sent by the node server.
[0190] It should be noted that the units, devices or modules described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. For the convenience of description, the above devices are described separately by functions divided into various modules. Of course, when implementing this specification, the functions of each module can be implemented in the same or more software and / or hardware, or the modules that implement the same function can be implemented by a combination of multiple sub-modules or sub-units. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0191] As can be seen from the above, the processing device for account detail data provided by the embodiment of this specification can effectively reduce the frequent operations on the database in the big data scenario, reduce the performance impact on the distributed system, improve the overall processing efficiency, shorten the user's waiting time, and enable the user to obtain a better interactive experience because the data processing about the download of the user's account detail data is completed by combining the use of the transit data cache service component and the transit file storage service platform instead of the database. In addition, because the database is replaced by the combination of the transit data cache service component and the transit file storage service platform, it is no longer necessary to rely on the relatively limited number of management servers responsible for managing the database in the distributed system, but any node server in the distributed system can be called to respond to the client to complete the data processing about the download of the user's account detail data, so that more data processing resources of the distributed system can be fully called, the queuing time of the task is shortened, and the overall processing efficiency is further improved, and the waiting time of the user is shortened. Also, by introducing a polling mechanism, the client can automatically send a task status update request to the node server according to the preset polling rules; accordingly, the node server can respond to the task status update request, and promptly obtain and feedback the latest task progress information of the target task to the client through the transit data storage service component, so that the client can promptly feedback the latest task progress of the target task to the user, thereby reducing the user's blank waiting time and further improving the user's interactive experience.
[0192] Although the present specification provides method operation steps as described in the embodiments or flow charts, more or less operation steps may be included based on conventional or non-creative means. The order of steps listed in the embodiments is only one way of executing the order of many steps, and does not represent a unique execution order. When the device or client product in practice is executed, it can be executed in sequence or in parallel according to the method shown in the embodiments or the drawings (for example, a parallel processor or a multi-threaded processing environment, or even a distributed data processing environment). The term "include", "include" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, product or device including a series of elements includes not only those elements, but also includes other elements that are not explicitly listed, or also includes elements inherent to such a process, method, product or device. In the absence of more restrictions, it is not excluded that there are other identical or equivalent elements in the process, method, product or device including the elements. The first, second, etc. words are used to represent the name, and do not represent any particular order.
[0193] Those skilled in the art also know that, in addition to implementing the controller in a purely computer-readable program code, the controller can be made to implement the same function in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers by logically programming the method steps. Therefore, such a controller can be considered as a hardware component, and the devices for implementing various functions included therein can also be considered as structures within the hardware component. Or even, the devices for implementing various functions can be considered as both software modules for implementing the method and structures within the hardware component.
[0194] This specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, classes, etc. that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media including storage devices.
[0195] Through the description of the above embodiments, it can be known that those skilled in the art can clearly understand that the present specification can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present specification can essentially be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a mobile terminal, a server, or a network device, etc.) to execute the methods described in each embodiment of the present specification or some parts of the embodiments.
[0196] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. This specification can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld devices or portable devices, tablet devices, multi-processor systems, microprocessor-based systems, set-top boxes, programmable electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc.
[0197] Although the present specification is described through embodiments, those skilled in the art will appreciate that there are many modifications and changes to the present specification without departing from the spirit of the present specification, and it is intended that the appended claims include these modifications and changes without departing from the spirit of the present specification.
Claims
1. A method for processing account detail data, It is characterized in that Node servers used in distributed systems include: Receiving a target task creation request initiated by a target client for downloading account details data of a target user; wherein the target task creation request carries at least a user identifier of the target user; In response to the target task creation request, query the transit data cache service component according to the user ID of the target user to determine whether there is a target task state set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores multiple task state sets; the task state set is used to record the task state; When it is determined that the target task state set does not exist in the transit data cache service component, create a target task state set in the transit data cache service component with the user identifier of the target user as the key value; According to the target task status set, a target detailed file of the target user's account detailed data is uploaded and saved in the transit file storage service platform by performing preset data processing; wherein the target detailed file corresponds to the user ID of the target user; and the transit file storage service platform stores multiple detailed files corresponding to multiple user IDs; The preset data processing includes: Perform the current preset data processing in the following manner: Obtain the current task status of the target task through the transit data cache service component; According to the current task status, determine whether the target detailed file has been uploaded and saved in the transit file storage service platform; When it is determined that the target detailed file has not been uploaded and saved in the transit file storage service platform, a matching business server is called to obtain and obtain an intermediate detailed file based on the account detailed data related to the target user; Uploading the intermediate detailed file to the transit file storage service platform; wherein the intermediate detailed file is used to generate a target detailed file in the transit file storage service platform; Receive and update the target task status set in the transit data cache service component based on the processing prompt information fed back by the transit file storage service platform for the intermediate detail file.
2. The method according to claim 1, It is characterized in that The transit data cache service component includes NOS; correspondingly, the transit file storage service platform includes OAAS.
3. The method according to claim 1, It is characterized in that Call the matching business server to obtain and obtain the intermediate detail file based on the account detail data related to the target user, including: According to the target task status set, the business type of the current account detail data to be obtained is determined as the current business type; According to the current business type, the matching business server is called to obtain and obtain the intermediate detail file according to the account detail data related to the target user and belonging to the current business type.
4. The method according to claim 1, It is characterized in that During the process of performing the preset data processing, the method further includes: Receive a current task status update request for a target task initiated by a target client according to a preset polling rule; In response to the current task status update request, the current task status of the target task is obtained by querying the target task status set in the transit data cache service component; According to the current task status of the target task, the current task progress information about the target task is fed back to the target client.
5. The method according to claim 4, It is characterized in that The method further comprises: Receiving a target download request for a target detailed file initiated by a target client; wherein the target client initiates the target download request when determining that the upload and storage of the target detailed file in the transit file storage service platform is completed according to the task progress information; In response to the target download request, the target detailed file is obtained through the transit file storage service platform; The target detail file is sent to the target client; and the target task status set in the transit data cache service component is updated.
6. The method according to claim 4, It is characterized in that In the case where it is determined that the target task state set does not exist in the transit data cache service component, the method further includes: Generate target polling prompts about target tasks; The target polling prompt is sent to the target client to trigger the target client to initiate a current task status update request for the target task according to a preset polling rule.
7. A method for processing account detail data, It is characterized in that Applied to target clients, including: Receiving and responding to a creation operation of a target user, generating a target task creation request for downloading account details data of the target user; wherein the target task creation request carries at least a user identifier of the target user; The target task creation request is sent to the node server; wherein the node server responds to the target task creation request, and creates a target task status set in the transit data cache service component when it is determined that there is no target task status set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores multiple task status sets; according to the target task status set, a target detail file of the account detail data of the target user is uploaded and saved in the transit file storage service platform by performing preset data processing; wherein the target detail file corresponds to the user ID of the target user; and the transit file storage service platform stores multiple detail files corresponding to multiple user IDs; Get the target detailed file through the node server; The preset data processing includes: Perform the current preset data processing in the following manner: Obtain the current task status of the target task through the transit data cache service component; According to the current task status, determine whether the target detailed file has been uploaded and saved in the transit file storage service platform; When it is determined that the target detailed file has not been uploaded and saved in the transit file storage service platform, a matching business server is called to obtain and obtain an intermediate detailed file based on the account detailed data related to the target user; Uploading the intermediate detailed file to the transit file storage service platform; wherein the intermediate detailed file is used to generate a target detailed file in the transit file storage service platform; Receive and update the target task status set in the transit data cache service component based on the processing prompt information fed back by the transit file storage service platform for the intermediate detail file.
8. The method according to claim 7, It is characterized in that After sending the target task creation request to the node server, the method further includes: Receive target polling prompts about target tasks from the node server; In response to the target polling prompt, a current task status update request for the target task is initiated to the node server according to a preset polling rule; Receive the current task progress information about the target task fed back by the node server.
9. The method according to claim 8, It is characterized in that The method further comprises: According to the current task progress information, determine whether the target detailed file has been uploaded and saved in the transit file storage service platform; When it is determined that the upload and storage of the target detailed file is completed in the transit file storage service platform, a target download request for the target detailed file is generated; and the target download request is sent to the node server; Receive the target details file sent by the node server.
10. A device for processing account details data, It is characterized in that Node servers used in distributed systems include: A receiving module, configured to receive a target task creation request initiated by a target client for downloading the account details data of a target user; wherein the target task creation request carries at least a user identifier of the target user; A query module, for responding to the target task creation request, querying the transit data cache service component according to the user ID of the target user, so as to determine whether there is a target task state set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores a plurality of task state sets; the task state set is used to record the task state; A creation module, used for creating a target task status set with a user ID of a target user as a key value in the transit data cache service component when it is determined that the target task status set does not exist in the transit data cache service component; A processing module, configured to upload and save a target detailed file of account detailed data of a target user in a transit file storage service platform by performing preset data processing according to a target task status set; wherein the target detailed file corresponds to a user ID of the target user; and the transit file storage service platform stores a plurality of detailed files corresponding to a plurality of user IDs; Wherein, the processing module is specifically used for: The current preset data processing is performed in the following manner: the current task status of the target task is obtained through the transit data cache service component; based on the current task status, it is determined whether the uploading and saving of the target detail file are completed in the transit file storage service platform; when it is determined that the uploading and saving of the target detail file are not completed in the transit file storage service platform, a matching business server is called to obtain and obtain an intermediate detail file based on the account detail data related to the target user; the intermediate detail file is uploaded to the transit file storage service platform; wherein the intermediate detail file is used to generate the target detail file in the transit file storage service platform; and the target task status set in the transit data cache service component is received and updated according to the processing prompt information fed back by the transit file storage service platform for the intermediate detail file.
11. A device for processing account details data, It is characterized in that Applied to target clients, including: A generating module, configured to receive and respond to a creation operation of a target user, and generate a target task creation request for downloading the target user's account details data; wherein the target task creation request carries at least a user identifier of the target user; A sending module, used for sending the target task creation request to the node server; wherein, the node server responds to the target task creation request, and creates a target task status set with the user ID of the target user as the key value in the transit data cache service component when it is determined that there is no target task status set with the user ID of the target user as the key value in the transit data cache service component; wherein the transit data cache service component stores a plurality of task status sets; according to the target task status set, by performing preset data processing, a target detail file of the account detail data of the target user is uploaded and saved in the transit file storage service platform; wherein, the target detail file corresponds to the user ID of the target user; and the transit file storage service platform stores a plurality of detail files corresponding to the plurality of user IDs; The acquisition module is used to obtain the target detailed file through the node server; Wherein, when the device is specifically implemented, it is used for: The current preset data processing is performed in the following manner: the current task status of the target task is obtained through the transit data cache service component; based on the current task status, it is determined whether the uploading and saving of the target detail file are completed in the transit file storage service platform; when it is determined that the uploading and saving of the target detail file are not completed in the transit file storage service platform, a matching business server is called to obtain and obtain an intermediate detail file based on the account detail data related to the target user; the intermediate detail file is uploaded to the transit file storage service platform; wherein the intermediate detail file is used to generate the target detail file in the transit file storage service platform; and the target task status set in the transit data cache service component is received and updated according to the processing prompt information fed back by the transit file storage service platform for the intermediate detail file.
12. A server, It is characterized in that The method comprises a processor and a memory for storing processor-executable instructions, wherein the processor implements the steps of the method according to any one of claims 1 to 6 when executing the instructions.
13. A client, It is characterized in that The method comprises a processor and a memory for storing processor-executable instructions, wherein the processor implements the steps of the method according to any one of claims 7 to 9 when executing the instructions.
14. A computer-readable storage medium, It is characterized in that Computer instructions are stored thereon, and when the instructions are executed by a processor, the steps of the method described in any one of claims 1 to 6, or 7 to 9 are implemented.
Citation Information
Patent Citations
Method, system and equipment for realizing web page acquisition by mobile terminal
CN101446983A
Data exporting method and device and terminal equipment
CN112860780A