A data processing method, device, equipment and storage medium

Abstract

The embodiment of the present invention provides a data processing method, device, equipment and storage medium, wherein the method comprises: when an application component receives a parameter access request, determining a corresponding parameter access package; accessing a correspondingly configured distributed parameter database through the parameter access package, and reading parameter data corresponding to the parameter access request in the distributed parameter database; when the application component receives a maintenance request for a target parameter, maintaining the target parameter in the distributed parameter database based on the maintenance request. The technical solution provided by the embodiment of the present invention can avoid data source switching during the reading process, has high security, and can ensure parameter consistency.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of data processing technology, and in particular, to a data processing method, apparatus, device and storage medium. Background Art

[0002] In the banking business system, some parameters are usually added and maintained by the business in the parameter maintenance interface or by accessing data from the outside, and the parameters are put into effect in the parameter database through online transactions. Each application component reads through the component.

[0003] In a distributed system, since each physical unit is autonomous, if it is necessary to access and read locally through components, corresponding components and parameter databases need to be deployed in all physical units. In the case of a large number of physical units, there are a large number of parameter databases, which makes it difficult to maintain all the parameters in a large number of parameter databases correctly, and it is difficult to ensure the consistency of parameters, and there are also security risks in the parameter reading process. Summary of the invention

[0004] The embodiments of the present invention provide a data processing method, apparatus, device and storage medium, which can avoid switching of data sources during parameter processing, have high security, and can ensure consistency of parameters.

[0005] In a first aspect, an embodiment of the present invention provides a data processing method, including:

[0006] When the application component receives the parameter access request, it determines the corresponding parameter access program package;

[0007] Accessing a correspondingly configured distributed parameter database through the parameter access program package, and reading parameter data corresponding to the parameter access request in the distributed parameter database;

[0008] When the application component receives a maintenance request for a target parameter, the application component maintains the target parameter in the distributed parameter database based on the maintenance request.

[0009] In a second aspect, an embodiment of the present invention further provides a data processing device, including:

[0010] A first determination module, configured to determine a corresponding parameter access program package when the application component receives a parameter access request;

[0011] An access module, used to access a correspondingly configured distributed parameter database through the parameter access program package, and read parameter data corresponding to the parameter access request in the distributed parameter database;

[0012] A maintenance module is used to maintain the target parameter in the distributed parameter database based on the maintenance request when the application component receives a maintenance request for the target parameter.

[0013] In a third aspect, an embodiment of the present invention further provides a data processing device, including:

[0014] one or more processors;

[0015] a storage device for storing one or more programs,

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the method provided by the embodiment of the present invention.

[0017] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method provided by the embodiment of the present invention.

[0018] The technical solution provided by the embodiment of the present invention is that when an application component receives a parameter access request, it accesses the corresponding configured distributed parameter database through a parameter access program package, and receives parameter data corresponding to the parameter access request fed back by the distributed parameter database, that is, the parameters are stored in the distributed parameter database, and the parameters are read by accessing the distributed parameter database, and the parameters are maintained in the distributed parameter database, so that the consistency of the parameters can be guaranteed. During the parameter reading process, the distributed parameter database is accessed through the corresponding parameter access program package, and there is no data source switching during the parameter reading process, so the security is relatively high. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1a is a flow chart of a data processing method provided by an embodiment of the present invention;

[0020] Figure 1b is a schematic diagram of a distributed parameter database provided by an embodiment of the present invention;

[0021] Figure 2 A data processing method flow chart provided by an embodiment of the present invention

[0022] Figure 3 A data processing method flow chart provided by an embodiment of the present invention

[0023] Figure 4 A data processing method flow chart provided by an embodiment of the present invention

[0024] Figure 5 A data processing method flow chart provided by an embodiment of the present invention

[0025] Figure 6is a structural block diagram of a data processing device provided by an embodiment of the present invention;

[0026] Figure 7 It is a structural schematic diagram of a data processing device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0027] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0028] Figure 1a This is a flow chart of a data processing method provided by an embodiment of the present invention. The method can be executed by a data processing device, the device can be implemented by software and / or hardware, the device can be configured in a system to which an application component belongs, and the device can be configured in electronic devices such as computers and mobile terminals. The method can be applied to scenarios where relevant technologies for banking services are processed.

[0029] like Figure 1a As shown, the technical solution provided by the embodiment of the present invention includes:

[0030] S110: When the application component receives the parameter access request, it determines the corresponding parameter access program package.

[0031] In the embodiment of the present invention, the parameter access request may be a request for accessing banking business parameters, wherein the parameters may be banking business parameters, which are used to improve the performance of the banking business system and facilitate business operations. Some abstract business data are stored as parameters in the system and are uniformly called and managed by various subsystems to control the normal operation of the business. Changes in these business parameter data may affect the correct processing of business operations and the safe operation of the system, such as pricing parameters, product parameters, interest rates, and rate parameters.

[0032] In an embodiment of the present invention, an application component may be a functional component in a banking system, and the banking system may include application components such as deposits and withdrawals. When a user needs to know certain parameters through the banking system, the corresponding application component may be triggered. When the user triggers the application component, the application component receives a parameter access request and determines a corresponding parameter access package. The parameter access package and the business access package are independent of each other. The parameter access package is used to access a distributed parameter database, and the business access package is used to access a business database. The distributed parameter data may store various banking business parameters, and the business database may store business-related data.

[0033] In this embodiment, optionally, when the application component receives the parameter access request, before determining the corresponding parameter access program package, it may also include: determining that the parameter access program package of the application component is statically configured with the distributed parameter database.

[0034] In an embodiment of the present invention, during the development of a banking business system, by planning the program code, the program code for accessing different data sources (which may be different databases) can be placed in different program packages, and the correspondence between the program package and the data source is specified in the configuration to complete the static configuration. This solution is simple to configure, there is no switching of data sources during the access and reading process, and the security is relatively high.

[0035] In an embodiment of the present invention, the identifiers of all parameters can be stored in a parameter table, and the parameter table can be stored in a public product parameter package. The parameter identifiers in the parameter table in the public product parameter package are configured correspondingly to the parameter access program package, so that all parameters can be read, a distributed parameter database can be accessed through the parameter program access package, and read-only access to read-only parameters can be achieved. There is no cross-library transaction, and the security is relatively high.

[0036] S120: Access a correspondingly configured distributed parameter database through the parameter access program package, and read parameter data corresponding to the parameter access request in the distributed parameter database.

[0037] In an embodiment of the present invention, different program packages may correspond to different data sources, that is, different program packages may correspond to different databases, wherein a parameter access program package is configured corresponding to a distributed parameter database, and parameters are stored in the distributed parameter database. The correspondingly configured distributed parameter database can be accessed by running the parameter access program package, and parameter data corresponding to the parameter access request can be read from the distributed parameter database.

[0038] In the embodiment of the present invention, Figure 1b As shown, the distributed cluster can be located in two computer rooms, each of which has four machines, Pak1-Pak4. The physical unit where the application component is located can access the distributed parameter database through a static data source. That is, the distributed cluster can be accessed through the parameter access package corresponding to the parameter, and the distributed parameter database can be accessed through the distributed cluster. Among them, the distributed cluster can be a distributed parameter cluster, a distributed batch processing cluster, etc. The distributed cluster can be called a distributed application processing cluster, which refers to a cluster used for application processing in a distributed system. Among them, the distributed parameter database can be horizontally expanded to meet concurrent data access requirements.

[0039] S130: When the application component receives a maintenance request for a target parameter, the application component maintains the target parameter in a distributed parameter database based on the maintenance request.

[0040] In the embodiment of the present invention, the maintenance request may refer to a synchronization request. When the target parameter needs to be synchronized, the user may trigger a corresponding operation through the application component, so that the application component receives the maintenance request of the target parameter, sends the target parameter to the distributed cluster based on the maintenance request, and the distributed cluster maintains the target parameter in the distributed parameter database. The distributed cluster may include a distributed parameter cluster, a distributed batch processing cluster, etc.

[0041] On the basis of the above embodiment, the method provided by the embodiment of the present invention may further include: when the application component receives a business access request, determining a corresponding business access package; accessing a corresponding configured business database through the business access package, and reading business data corresponding to the business access request in the business database; wherein the parameter access package is independent of the business access package used to access the business database. Specifically, if the user needs to query business data, the business access operation can be triggered in the relevant application component, so that the business component receives the business access request and accesses the corresponding configured business database through the business access package.

[0042] In an embodiment of the present invention, optionally, when the application component receives a service access request, before determining the corresponding service access package, it may also include: determining that the service access package is statically configured with the service database. Wherein, the service access package is configured correspondingly to the service database, and when service access is required, the service database is accessed through the corresponding service access package, and there may be no switching of data sources, which has high security. In an embodiment of the present invention, the parameter access package and the service access package are independent of each other, and different data sources (databases) are accessed through different packages, and there may be no switching of data sources, which has high security. The parameter access package is statically configured with the distributed parameter database, and the service access package is statically configured with the service database, so that the distributed parameter database and the service database can be accessed, and there is no need to modify the application component, and there is no intrusion into the application component, which reduces the development cost.

[0043] The distributed parameter database is separated from the business database. When one of the databases fails, they will not affect each other. When a parameter replica database in the distributed parameter database fails, it will not affect the use of application components.

[0044] In the related art, in the banking business system, some parameters are usually added and maintained by the business in the parameter maintenance interface or by accessing data from the outside, and the parameters are put into effect in the parameter database through online transactions. Each application component reads through the component.

[0045] In the banking business system, banking business parameters such as interest rate parameters, exchange rate parameters, fee rate parameters, product parameters, etc. are usually added and maintained by the business in the parameter maintenance interface or by accessing data from the outside, and the parameters are put into effect in the parameter library through online transactions. Each application component reads and accesses the components provided by the parameter component.

[0046] In the old system, various parameters are maintained in a unique parameter database through parameter maintenance transactions. The addition, deletion, and modification of the database can be achieved through atomic transactions, and the application component can directly call the component to access the parameter database to read the parameters, thereby realizing the complete business logic.

[0047] In a distributed system, since each physical unit is autonomous, in order to access and read locally through components, corresponding components and parameter databases need to be deployed in all physical units. In the case of a large number of physical units, there are a large number of parameter databases. How to ensure that all these parameter databases are correctly effective and ensure the global consistency, real-time and atomicity of parameter maintenance has become a problem that needs to be solved urgently.

[0048] Among them, the real-time nature of parameter maintenance may mean that after the parameters are maintained (or updated) in other databases corresponding to the public service unit, they need to take effect in the parameter data of the distributed system within a short time interval; wherein the public service unit may be a cluster dedicated to public services in the distributed system, wherein the public service unit may include a host system. Global consistency may mean that the effectiveness of parameters must be consistent among all physical units, and some physical units cannot still be using old parameters; atomicity / isolation may mean that parameter maintenance may require the maintenance of multiple tables, wherein there is a correlation between tables, therefore, parameter maintenance operations must ensure atomicity, and there cannot be partial maintenance. Data during the maintenance process should not be read by application services.

[0049] In the old system, since there is only one parameter database, the maintenance of adding, modifying, deleting and reading parameters in the parameter database are all completed through atomic transactions. In the existing distributed system, there are several solutions:

[0050] (1) Online synchronous replication: This is achieved by combining transactions and synchronously calling online transactions on all physical units. The parameter database maintenance (which can refer to synchronization) is considered successful only when all physical units have successful transactions. If the online transaction on any physical machine in the execution chain fails, the transaction of the previous successful physical machine will be corrected. This method needs to wait for all parameter databases to be successfully maintained before responding to the user. As long as one physical unit fails, all rollbacks are required, which will affect the user experience. Using this solution may result in a long period of unsuccessful maintenance, resulting in the inability of parameters to take effect in time and causing production problems. Therefore, the above-mentioned online synchronous replication technology is not suitable for the scenario of using banking business parameters in distributed systems, and this solution cannot guarantee the real-time nature of parameters.

[0051] (2) Database replication technology: Through the underlying technology of the database itself, for maintenance requests, the master database of the parameter cluster will perform maintenance (write) operations and synchronize the data to all parameter databases before responding to users. This method requires the master database and the parameter database to use the same database product and relies on a specific database, which limits the selection of databases. For scenarios where multiple data tables are synchronized at one time, it is difficult to ensure the association between multiple data tables. Therefore, in scenarios where banking business parameters are used in distributed systems, this solution cannot guarantee the atomicity / isolation of parameters.

[0052] (3) Asynchronous replication technology: that is, through a message mechanism such as Redis, EDA, MQ, etc., after the main database maintenance is completed, a message is pushed to the parameter database in all physical units. After the push, it is not guaranteed that the maintenance is completed correctly on all physical units. Among them, in this method, the parameter database will synchronize data asynchronously. This method ensures the availability of the system, but sacrifices the consistency of the data. For banking business parameters, inconsistent parameters on different physical units at the same time will cause financial risks. For example, if the interest rates of different branches are inconsistent at the same time, it will cause regulatory problems. This solution cannot guarantee the consistency of parameters.

[0053] The technical solution provided by the embodiment of the present invention avoids deploying parameter databases on each physical machine by storing parameters in a distributed parameter database. When an application component on each physical machine receives a parameter request for a target parameter, the target parameter can be maintained in the distributed parameter database, avoiding the situation of maintaining the parameter database on each physical machine, thereby ensuring the consistency, real-time, and atomicity or isolation of the parameters of each physical unit. The distributed parameter database does not involve maintenance (synchronization) in multiple locations and has high real-time performance. The distributed parameter database is accessed through one access point (distributed cluster) and there will be no differences between different nodes, thereby ensuring consistency and reducing the risk of inconsistent parameter maintenance. The embodiment of the present invention accesses the corresponding configured distributed parameter database through the corresponding parameter access program package, so that there is no switching of data sources during the parameter reading process and the security is relatively high.

[0054] The technical solution provided by the embodiment of the present invention is that when an application component receives a parameter access request, it accesses the corresponding configured distributed parameter database through a parameter access program package, and receives parameter data corresponding to the parameter access request fed back by the distributed parameter database, that is, the parameters are stored in the distributed parameter database, and the parameters are read by accessing the distributed parameter database, and the parameters are maintained in the distributed parameter database, so that the consistency of the parameters can be ensured. During the parameter reading process, the distributed parameter database is accessed through the corresponding parameter access program package, and there is no data source switching during the parameter reading process, so the security is relatively high.

[0055] Figure 2 is a flow chart of a data processing method provided by an embodiment of the present invention. In this embodiment, optionally, when the application component receives a maintenance request for a target parameter, maintaining the target parameter in the distributed parameter database based on the maintenance request includes:

[0056] When the application component receives a maintenance request for a first parameter, the application component sends the maintenance request for the first parameter to a distributed routing layer, and routes the maintenance request for the first parameter to a distributed parameter cluster through the distributed routing layer;

[0057] The first parameter is maintained in the distributed parameter database by the distributed parameter cluster based on the received maintenance request.

[0058] like Figure 2 As shown, the technical solution provided by the embodiment of the present invention includes:

[0059] S210: When the application component receives the parameter access request, it determines the corresponding parameter access program package.

[0060] S220: Access a correspondingly configured distributed parameter database through the parameter access program package, and read parameter data corresponding to the parameter access request in the distributed parameter database.

[0061] S230: When the application component receives a maintenance request for a first parameter, the application component sends the maintenance request for the first parameter to a distributed routing layer, and routes the maintenance request for the first parameter to a distributed parameter cluster through the distributed routing layer.

[0062] In the embodiment of the present invention, the maintenance request may be a synchronization request. The first parameter may be part of the interest rate index, the exchange rate parameter, and a small amount of product parameters, wherein the interest rate index and the exchange rate parameter may be externally accessed quotation data with high real-time and consistency requirements, and these parameters may be maintained through online transactions. That is, by sending the maintenance request of the first parameter to the distributed routing layer, the maintenance request of the first parameter is routed to the distributed parameter cluster through the distributed routing layer.

[0063] S240: Maintaining the first parameter in the distributed parameter database based on the received maintenance request through the distributed parameter cluster.

[0064] In the embodiment of the present invention, the first parameter is maintained in a distributed parameter database through a distributed parameter cluster.

[0065] Therefore, when the application component receives a maintenance request for the first parameter, the maintenance request for the first parameter is sent to the distributed routing layer, the maintenance request for the first parameter is routed to the distributed parameter cluster through the distributed routing layer, and the first parameter is maintained in the distributed parameter database through the distributed parameter cluster, that is, the first parameter is maintained in the distributed parameter database through online transactions, which can have good atomicity or isolation.

[0066] Figure 3 is a flow chart of a data processing method provided by an embodiment of the present invention. In this embodiment, optionally,

[0067] When the application component receives a maintenance request for the target parameter, maintaining the target parameter in the distributed parameter database based on the maintenance request includes:

[0068] When the application component receives the real-time maintenance request for the second parameter, sending the real-time maintenance request for the second parameter to the distributed batch processing cluster;

[0069] The second parameter is maintained in the distributed parameter database based on the real-time maintenance request through the distributed batch processing cluster.

[0070] like Figure 3As shown, the technical solution provided by the embodiment of the present invention includes:

[0071] S310: When the application component receives a parameter access request, it determines a corresponding parameter access program package.

[0072] S320: Access a correspondingly configured distributed parameter database through the parameter access program package, and read parameter data corresponding to the parameter access request in the distributed parameter database.

[0073] S330: When the application component receives the real-time maintenance request for the second parameter, the real-time maintenance request for the second parameter is sent to the distributed batch processing cluster.

[0074] In the embodiment of the present invention, the second parameter may be a specific partial product parameter, and the application component may be a product component. The product component may be a savings card component, etc. The maintenance request may be a synchronization request. The real-time maintenance request of the second parameter may be a real-time batch processing request.

[0075] S340: Maintaining the second parameter in the distributed parameter database based on the real-time maintenance request through the distributed batch processing cluster.

[0076] In the embodiment of the present invention, after receiving the real-time maintenance request, the distributed batch processing cluster performs real-time batch processing and maintains the second parameter in the distributed parameter database.

[0077] Therefore, when the application component receives the real-time maintenance request for the second parameter, the real-time maintenance request for the second parameter is sent to the distributed batch processing cluster, and the second parameter is maintained in the distributed parameter database through the distributed batch processing cluster, that is, the second parameter is maintained in the distributed parameter database in the form of real-time batches, which has good atomicity or isolation.

[0078] Figure 4 is a flow chart of a data processing method provided by an embodiment of the present invention. In this embodiment, when the application component receives a maintenance request for a target parameter, the target parameter is maintained in the distributed parameter database based on the maintenance request, including:

[0079] When the application component receives the end-of-day maintenance request for the third parameter, the application component sends the end-of-day maintenance request for the third parameter to the distributed batch processing cluster;

[0080] The third parameter is maintained in the distributed parameter database based on the end-of-day maintenance request at the last moment of each day through the distributed batch processing cluster.

[0081] like Figure 4As shown, the technical solution provided by the embodiment of the present invention includes:

[0082] S410: When the application component receives a parameter access request, it determines a corresponding parameter access program package.

[0083] S420: Access a correspondingly configured distributed parameter database through the parameter access program package, and read parameter data corresponding to the parameter access request in the distributed parameter database.

[0084] S430: When the application component receives the end-of-day maintenance request for the third parameter, the application component sends the end-of-day maintenance request for the third parameter to the distributed batch processing cluster.

[0085] In the embodiment of the present invention, the third parameter may include a pricing parameter and a setting part of the product parameter. Wherein, the application component may be a pricing management component or a product development component.

[0086] S440: Maintaining the third parameter in the distributed parameter database based on the end-of-day maintenance request at the last moment of each day through the distributed batch processing cluster.

[0087] In the embodiment of the present invention, the distributed batch processing cluster maintains the third parameter in the distributed parameter database at the last moment of each day or at a set time based on the received end-of-day maintenance request.

[0088] Therefore, when the application component receives the end-of-day maintenance request of the third parameter, the end-of-day maintenance request of the third parameter is sent to the distributed batch processing cluster. The distributed batch processing cluster maintains the third parameter in the distributed parameter database based on the end-of-day maintenance request at the last moment of each day, that is, the third parameter is maintained in the distributed parameter database in the end-of-day batch mode, so that the consistency of the parameters can be ensured.

[0089] Figure 5 is a flow chart of a data processing method provided by an embodiment of the present invention. In this embodiment, optionally, before maintaining the target parameter in a distributed parameter database based on the maintenance request, it also includes: maintaining the target parameter in other databases based on the maintenance request;

[0090] After maintaining the target parameters in the distributed parameter database based on the maintenance request, it also includes: when the target parameters are successfully maintained in the other databases and the target parameters are failed to be maintained in the distributed parameter database, if the application component receives the maintenance request for the target parameters again, it refuses to generate an error message and re-maintains the target parameters in the other databases and the distributed parameter database.

[0091] like Figure 5As shown, the technical solution provided by the embodiment of the present invention includes:

[0092] S510: When the application component receives a parameter access request, it determines a corresponding parameter access program package.

[0093] S520: Access a correspondingly configured distributed parameter database through the parameter access program package, and read parameter data corresponding to the parameter access request in the distributed parameter database.

[0094] S530: When the application component receives a maintenance request for a target parameter, the application component maintains the target parameter in other databases based on the maintenance request, and maintains the target parameter in a distributed parameter database based on the maintenance request.

[0095] In the embodiment of the present invention, other databases may be databases other than the distributed parameter database and the business database, and other databases may be maintained by the public service unit. In some cases, some parameters need to be maintained in other databases for corresponding data processing, and also need to be maintained in the distributed parameter database for query, etc.

[0096] In the embodiment of the present invention, specifically, when the application component receives a maintenance request for a target parameter, the maintenance request is sent to the host system, and the host system maintains the target parameter to other databases based on the request, and sends the maintenance request to the distributed cluster, and the distributed cluster maintains the target parameter to the distributed parameter database. The distributed cluster includes a distributed parameter cluster, a distributed batch processing cluster, etc.

[0097] S540: When the target parameter is maintained to the other database successfully and the target parameter is maintained to the distributed parameter database unsuccessfully, if the application component receives a maintenance request for the target parameter again, it refuses to generate an error message and re-maintains the target parameter to the other database and the distributed parameter database.

[0098] In an embodiment of the present invention, when the target parameter is successfully maintained in other databases and the target parameter is failed to be maintained in the distributed parameter database, the target parameter may have been effective in other databases and may be used in transactions. In order to ensure the consistency of data in other databases and the distributed parameter database, without considering the rollback mechanism, the user can trigger the operation of maintaining the target parameter again. When the application component detects the operation, the application component receives the maintenance request of the target parameter again, refuses to generate an error message, and resends the maintenance request of the target parameter to the host system and the distributed cluster to re-maintain the target parameter to other databases and the distributed parameter database. Among them, since the target parameter has been successfully maintained in other databases, the host system can not process the maintenance request of the target parameter, or it can also process the maintenance request of the target parameter to re-maintain the target parameter.

[0099] In the embodiment of the present invention, the maintenance of the target parameter may include the maintenance mode of adding, modifying or deleting. When the modification of the target parameter fails, an alarm may be issued and fault information may be provided, thereby reminding the user and facilitating processing.

[0100] In one implementation of the embodiment of the present invention, optionally, maintaining the target parameter to other databases based on the maintenance request includes: adding the target parameter to other databases based on the target parameter addition request; accordingly, in the case where the target parameter is successfully maintained to the other database and the target parameter is failed to be maintained to the distributed parameter database, if the application component receives the target parameter maintenance request again, it refuses to generate an error message, and re-maintains the target parameter to other databases and the distributed parameter database, including: in the case where the target parameter is successfully added to the other database and the target parameter is failed to be added to the distributed parameter database, if the application component receives the target parameter addition request again, the addition request is sent to the host system to re-maintain the target parameter to other databases, and the error message is refused, and the addition request is sent to the distributed cluster to re-maintain the target parameter to the distributed parameter database. Wherein, in the case where the target parameter is successfully added to other databases and the target parameter is failed to be added to the distributed parameter database, for the maintenance transaction (synchronous transaction) of the application component to transform the original target parameter, for the addition of the target parameter, it is supported to be completed by modifying the transaction when the target parameter already exists.

[0101] In one implementation of the embodiment of the present invention, optionally, maintaining the target parameter to other databases based on the maintenance request includes: modifying the target parameter to other databases based on the modification request of the target parameter; accordingly, in the case where the target parameter is successfully maintained to the other database and the target parameter is failed to be maintained to the distributed parameter database, if the application component receives the maintenance request of the target parameter again, it refuses to generate an error message, and re-maintains the target parameter to other databases and the distributed parameter database, including: in the case where the target parameter is successfully modified to the other database and the target parameter is failed to be modified to the distributed parameter database, if the application component receives the modification request of the target parameter again, the modification request is sent to the host system to re-modify the target parameter to other databases, and the error message is refused, and the modification request is sent to the distributed cluster to re-modify the target parameter to the distributed parameter database. Wherein, for the modification of the target parameter, the application component supports adding (which can be called adding) processing when the target parameter does not exist.

[0102] In one implementation of the embodiment of the present invention, maintaining the target parameter to other databases based on the maintenance request includes: deleting the target parameter in other databases based on the deletion request of the target parameter; accordingly, in the case where the target parameter is successfully maintained in the other database and the target parameter is failed to be maintained in the distributed parameter database, if the application component receives the maintenance request of the target parameter again, refusing to generate an error message, and re-maintaining the target parameter to other databases and the distributed parameter database, including: in the case where the target parameter is successfully deleted in the other database and the target parameter is failed to be deleted in the distributed parameter database, if the application component receives the deletion request of the target parameter again, sending the deletion request to the host system and refusing to generate an error message, and sending the deletion request to the distributed cluster to re-delete the target parameter in the distributed parameter database. Wherein, in the case where the target parameter is successfully deleted in the other database and the target parameter is failed to be deleted in the distributed parameter database, the application component supports refusing (that is, not generating) an error message when the target parameter does not exist in the distributed parameter database, so that the deletion request can be resent to re-delete the target parameter.

[0103] In an embodiment of the present invention, when maintaining the second parameter in a real-time batch manner (for example, it may be deleted), multiple data files may be configured through an application component (product development component, etc.), and real-time maintenance requests for the second parameter may be sent to the host system and the distributed cluster respectively, to generate two real-time batch tasks. When the host system's maintenance of other databases is inconsistent with the distributed cluster's maintenance of the distributed parameter database, the application component does not generate an error message, and supports retransmission of failed tasks. Among them, the application component may support retransmission of failed tasks at a single point. For example, when the maintenance of the third parameter to the distributed parameter cluster fails, and the maintenance to other databases succeeds, the application component may send a maintenance request for the third parameter to the distributed cluster, so as to re-maintain the third parameter in the distributed parameter database through the distributed cluster.

[0104] In an embodiment of the present invention, when maintaining the third parameter by end-of-day batch, the end-of-day maintenance request of the third parameter can be sent to the host system and the distributed cluster respectively by configuring the application component with multiple data files, so as to maintain the third parameter in other databases and distributed parameter databases. When a fault occurs during the maintenance process, the fault information can be displayed to manually handle the exception. For example, when the maintenance status of the third parameter in other databases and distributed databases is inconsistent, manual processing can be performed, and the manual processing method can refer to the method in the relevant technology.

[0105] In the embodiment of the present invention, when maintaining the first parameter by online transaction, if the first parameter maintains other databases and distributed parameter databases partially successfully and partially fails, a failure message may be returned (information of combined transaction failure may be returned), and the user is required to re-initiate the maintenance request for the first parameter (the fallback mechanism of the application component ensures the second resend is successful). If the first parameter is the accessed quotation data, the early warning mechanism may be maintained, and when a failure occurs during the maintenance process, the failure information may be displayed for manual handling of the exception, wherein the failure information may include the failure point, the failure cause, etc.

[0106] Therefore, when the target parameters are maintained to the other databases successfully and the target parameters are maintained to the distributed parameter database unsuccessfully, if the application component receives the maintenance request for the target parameters again, it refuses to generate an error message and re-maintains the target parameters to the other databases and the distributed parameter database. This can avoid inconsistent parameter maintenance in the two databases and maintain the consistency of the two databases.

[0107] Figure 6 is a structural block diagram of a data processing device provided by an embodiment of the present invention, such as Figure 6 As shown, the device includes: a first determination module 610, an access module 620 and a maintenance module 630.

[0108] The first determination module 610 is used to determine the corresponding parameter access program package when the application component receives the parameter access request;

[0109] An access module 620, configured to access a correspondingly configured distributed parameter database through the parameter access program package, and read parameter data corresponding to the parameter access request in the distributed parameter database;

[0110] The maintenance module 630 is configured to maintain the target parameter in the distributed parameter database based on the maintenance request when the application component receives a maintenance request for the target parameter.

[0111] Optionally, the first determination module 610 is further configured to determine a corresponding service access program package when the application component receives a service access request;

[0112] The access module 620 is further configured to access the corresponding configured business database through the business access program package, and read the business data corresponding to the business access request in the business database;

[0113] The parameter access program package and the service access program package are independent of each other.

[0114] Optionally, the maintenance module 630 is used to:

[0115] When the application component receives a maintenance request for a first parameter, the application component sends the maintenance request for the first parameter to a distributed routing layer, and routes the maintenance request for the first parameter to a distributed parameter cluster through the distributed routing layer;

[0116] The first parameter is maintained in the distributed parameter database by the distributed parameter cluster based on the received maintenance request.

[0117] Optionally, the maintenance module 630 is used to:

[0118] When the application component receives the real-time maintenance request for the second parameter, sending the real-time maintenance request for the second parameter to the distributed batch processing cluster;

[0119] The second parameter is maintained in the distributed parameter database based on the real-time maintenance request through the distributed batch processing cluster.

[0120] Optionally, the maintenance module 630 is used to:

[0121] When the application component receives the end-of-day maintenance request for the third parameter, the application component sends the end-of-day maintenance request for the third parameter to the distributed batch processing cluster;

[0122] The third parameter is maintained in the distributed parameter database based on the end-of-day maintenance request at the last moment of each day through the distributed batch processing cluster.

[0123] Optionally, the maintenance module 630 is further configured to maintain the target parameter in other databases based on the maintenance request before maintaining the target parameter in the distributed parameter database based on the maintenance request;

[0124] And after maintaining the target parameters in the distributed parameter database based on the maintenance request, it is used to: when the target parameters are successfully maintained in the other databases and the target parameters are failed to be maintained in the distributed parameter database, if the application component receives the maintenance request for the target parameters again, refuse to generate an error message and re-maintain the target parameters in the other databases and the distributed parameter database.

[0125] Optionally, maintaining the target parameter to other databases based on the maintenance request includes: adding the target parameter to other databases based on an add request for the target parameter;

[0126] Correspondingly, in the case where the target parameter is successfully maintained in the other database and the target parameter is failed to be maintained in the distributed parameter database, if the application component receives the maintenance request of the target parameter again, it refuses to generate an error message and re-maintains the target parameter in the other database and the distributed parameter database, including:

[0127] In the case that the target parameter is successfully added to the other database and the target parameter is failed to be added to the distributed parameter database, if the application component receives a request to add the target parameter again, the add request is sent to the host system to re-maintain the target parameter to the other database, and refuses to generate an error message, and sends the add request to the distributed cluster to re-maintain the target parameter to the distributed parameter database.

[0128] Optionally, maintaining the target parameter to other databases based on the maintenance request includes: modifying the target parameter to other databases based on a modification request for the target parameter;

[0129] Correspondingly, in the case where the target parameter is successfully maintained in the other database and the target parameter is failed to be maintained in the distributed parameter database, if the application component receives the maintenance request of the target parameter again, it refuses to generate an error message and re-maintains the target parameter in the other database and the distributed parameter database, including:

[0130] In the case where the target parameter is successfully modified to the other databases and the target parameter is failed to be modified to the distributed parameter database, if the application component receives a modification request for the target parameter again, the modification request is sent to the host system to modify the target parameter again to the other databases, and refuses to generate an error message, and sends the modification request to the distributed cluster to modify the target parameter again to the distributed parameter database.

[0131] Optionally, maintaining the target parameter in other databases based on the maintenance request includes: deleting the target parameter in other databases based on a deletion request for the target parameter;

[0132] Accordingly, in the case where the target parameter is successfully maintained in the other database and the target parameter is failed to be maintained in the distributed parameter database, if the application component receives the maintenance request of the target parameter again, it refuses to generate an error message and re-maintains the target parameter in the other database and the distributed parameter database, including:

[0133] In the case where the target parameter is successfully deleted from the other databases and the target parameter is failed to be deleted from the distributed parameter database, if the application component receives a deletion request for the target parameter again, the deletion request is sent to the host system and refuses to generate an error message, and the deletion request is sent to the distributed cluster to delete the target parameter again in the distributed parameter database.

[0134] Optionally, the device further comprises an alarm module for giving an alarm and providing fault information when a failure occurs in the target parameter maintenance.

[0135] Optionally, the device further comprises a configuration module, configured to determine that the parameter access program package is statically configured with a distributed parameter database.

[0136] Optionally, the configuration module is further used to determine whether the service access program package and the service database are statically configured.

[0137] The above-mentioned device can execute the method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0138] Figure 7 is a schematic diagram of a data processing device structure provided by an embodiment of the present invention, such as Figure 7 As shown, the device includes:

[0139] one or more processors 710, Figure 7 A processor 710 is taken as an example;

[0140] Memory 720;

[0141] The device may further include: an input device 730 and an output device 740 .

[0142] The processor 710, memory 720, input device 730 and output device 740 in the device may be connected via a bus or other means. Figure 7 The example of connecting through bus is taken in the following.

[0143] The memory 720 is a non-transitory computer-readable storage medium that can be used to store software programs, computer executable programs, and modules, such as program instructions / modules corresponding to a data processing method in an embodiment of the present invention (for example, the attached Figure 6 The processor 710 executes various functional applications and data processing of the computer device by running the software programs, instructions and modules stored in the memory 720, that is, a data processing method of the above method embodiment is implemented, namely:

[0144] When the application component receives the parameter access request, it determines the corresponding parameter access program package;

[0145] Accessing a correspondingly configured distributed parameter database through the parameter access program package, and reading parameter data corresponding to the parameter access request in the distributed parameter database;

[0146] When the application component receives a maintenance request for a target parameter, the application component maintains the target parameter in the distributed parameter database based on the maintenance request.

[0147] The memory 720 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 720 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory 720 may optionally include a memory remotely arranged relative to the processor 710, and these remote memories may be connected to the terminal device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0148] The input device 730 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the computer device. The output device 740 may include a display device such as a display screen.

[0149] An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, a data processing method provided in an embodiment of the present invention is implemented:

[0150] When the application component receives the parameter access request, it determines the corresponding parameter access program package;

[0151] Accessing a correspondingly configured distributed parameter database through the parameter access program package, and reading parameter data corresponding to the parameter access request in the distributed parameter database;

[0152] When the application component receives a maintenance request for a target parameter, the application component maintains the target parameter in the distributed parameter database based on the maintenance request.

[0153] Any combination of one or more computer-readable media may be used. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, device, or device.

[0154] Computer-readable signal media may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0155] Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0156] Computer program code for performing the operations of the present invention may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0157] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A data processing method, characterized in that: include: When the application component receives the parameter access request, it determines the corresponding parameter access program package; Accessing a correspondingly configured distributed parameter database through the parameter access program package, and reading parameter data corresponding to the parameter access request in the distributed parameter database; When the application component receives a maintenance request for a target parameter, maintaining the target parameter in the distributed parameter database based on the maintenance request; Before maintaining the target parameter in the distributed parameter database based on the maintenance request, the method further includes: Maintaining the target parameters in other databases based on the maintenance request; After maintaining the target parameters in the distributed parameter database based on the maintenance request, it also includes: when the target parameters are successfully maintained in the other databases and the target parameters are failed to be maintained in the distributed parameter database, if the application component receives the maintenance request for the target parameters again, it refuses to generate an error message and re-maintains the target parameters in the other databases and the distributed parameter database.

2. The method according to claim 1, characterized in that Also includes: When the application component receives a service access request, determining a corresponding service access program package; Accessing a corresponding configured business database through the business access program package, and reading business data corresponding to the business access request in the business database; The parameter access program package and the service access program package are independent of each other.

3. The method according to claim 1, characterized in that When the application component receives a maintenance request for the target parameter, maintaining the target parameter in the distributed parameter database based on the maintenance request includes: When the application component receives a maintenance request for a first parameter, the application component sends the maintenance request for the first parameter to a distributed routing layer, and routes the maintenance request for the first parameter to a distributed parameter cluster through the distributed routing layer; The first parameter is maintained in the distributed parameter database by the distributed parameter cluster based on the received maintenance request.

4. The method according to claim 1, characterized in that: When the application component receives a maintenance request for the target parameter, maintaining the target parameter in the distributed parameter database based on the maintenance request includes: When the application component receives the real-time maintenance request for the second parameter, sending the real-time maintenance request for the second parameter to the distributed batch processing cluster; The second parameter is maintained in the distributed parameter database based on the real-time maintenance request through the distributed batch processing cluster.

5. The method according to claim 1, characterized in that When the application component receives a maintenance request for the target parameter, maintaining the target parameter in the distributed parameter database based on the maintenance request includes: When the application component receives the end-of-day maintenance request for the third parameter, the application component sends the end-of-day maintenance request for the third parameter to the distributed batch processing cluster; The third parameter is maintained in the distributed parameter database based on the end-of-day maintenance request at the last moment of each day through the distributed batch processing cluster.

6. The method according to claim 1, characterized in that Maintaining the target parameter to other databases based on the maintenance request includes: adding the target parameter to other databases based on the add request of the target parameter; Accordingly, in the case where the target parameter is successfully maintained in the other database and the target parameter is failed to be maintained in the distributed parameter database, if the application component receives the maintenance request of the target parameter again, it refuses to generate an error message and re-maintains the target parameter in the other database and the distributed parameter database, including: In the case that the target parameter is successfully added to the other database and the target parameter is failed to be added to the distributed parameter database, if the application component receives a request to add the target parameter again, the add request is sent to the host system to re-maintain the target parameter to the other database, and refuses to generate an error message, and sends the add request to the distributed cluster to re-maintain the target parameter to the distributed parameter database.

7. The method according to claim 1, characterized in that Maintaining the target parameter to other databases based on the maintenance request includes: modifying the target parameter to other databases based on the modification request of the target parameter; Accordingly, in the case where the target parameter is successfully maintained in the other database and the target parameter is failed to be maintained in the distributed parameter database, if the application component receives the maintenance request of the target parameter again, it refuses to generate an error message and re-maintains the target parameter in the other database and the distributed parameter database, including: In the case where the target parameter is successfully modified to the other databases and the target parameter is failed to be modified to the distributed parameter database, if the application component receives a modification request for the target parameter again, the modification request is sent to the host system to modify the target parameter again to the other databases, and refuses to generate an error message, and sends the modification request to the distributed cluster to modify the target parameter again to the distributed parameter database.

8. The method according to claim 1, characterized in that Maintaining the target parameter in other databases based on the maintenance request includes: deleting the target parameter in other databases based on the deletion request of the target parameter; Accordingly, in the case where the target parameter is successfully maintained in the other database and the target parameter is failed to be maintained in the distributed parameter database, if the application component receives the maintenance request of the target parameter again, it refuses to generate an error message and re-maintains the target parameter in the other database and the distributed parameter database, including: In the case where the target parameter is successfully deleted from the other databases and the target parameter is failed to be deleted from the distributed parameter database, if the application component receives a deletion request for the target parameter again, the deletion request is sent to the host system and refuses to generate an error message, and the deletion request is sent to the distributed cluster to delete the target parameter again in the distributed parameter database.

9. The method according to claim 2, characterized in that: Also includes: When a failure occurs in the target parameter maintenance, an alarm is issued and fault information is provided.

10. The method according to claim 1, characterized in that Also includes: Determine that the parameter access package is statically configured with a distributed parameter database.

11. The method according to claim 2, characterized in that Also includes: Determine that the service access program package is statically configured with the service database.

12. A data processing device, characterized in that: include: A first determination module, configured to determine a corresponding parameter access program package when the application component receives a parameter access request; An access module, used to access a correspondingly configured distributed parameter database through the parameter access program package, and read parameter data corresponding to the parameter access request in the distributed parameter database; a maintenance module, configured to maintain the target parameter in the distributed parameter database based on the maintenance request when the application component receives a maintenance request for the target parameter; Wherein, the maintenance module is further used to maintain the target parameter to other databases based on the maintenance request before maintaining the target parameter to the distributed parameter database based on the maintenance request; And after maintaining the target parameters in the distributed parameter database based on the maintenance request, it is used to: when the target parameters are successfully maintained in the other databases and the target parameters are failed to be maintained in the distributed parameter database, if the application component receives the maintenance request for the target parameters again, refuse to generate an error message and re-maintain the target parameters in the other databases and the distributed parameter database.

13. A data processing device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 11.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 11 is implemented.

Images