Credit platform data collection method and system, computer device and storage medium

Abstract

The application relates to a credit platform data collection method, system, computer equipment and storage medium, which comprises the following steps: receiving a business request of a credit product, and performing permission verification on the business request of the credit product; after the permission verification is passed, selecting a corresponding supplier according to a supplier selection strategy between the credit product and the supplier, determining a corresponding supplier interface according to the credit product and the selected supplier, and performing multi-dimensional fusing on the supplier interface; obtaining an input parameter configuration of the supplier interface, defining a supplier interface parameter name and a corresponding data acquisition input item in the input parameter configuration, inputting the supplier interface parameter name and the data acquisition input item into a data acquisition platform, returning a business parameter value through the data acquisition platform; determining a corresponding data source according to a validity period of the credit product and the business parameter value, obtaining business data from the data source, and publishing the business data to a middleware. The application effectively improves the data collection efficiency.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of credit, in particular to a credit platform data collection method, system, computer device and storage medium. BACKGROUND

[0002] Credit business needs to use a large number of external data sources, and credit data is obtained through external data sources accessed in credit business. After the credit data is obtained and published online, the supplier interface exposed to the upstream system is accessed. Due to the needs of business, the credit personnel will adjust the supplier interface, and each adjustment of the supplier interface requires the credit personnel to modify the code, which increases the complexity of the credit personnel's work, so the data collection efficiency of the credit platform is extremely low. SUMMARY

[0003] Therefore, it is necessary to provide a credit platform data collection method, system, computer device and storage medium capable of improving data collection efficiency in view of the above technical problems.

[0004] In one aspect, a credit platform data collection method is provided, which comprises:

[0005] receiving a business request of a credit product and performing permission verification on the business request of the credit product;

[0006] After the permission verification is passed, a corresponding supplier is selected according to a supplier selection strategy between the credit product and the supplier, a corresponding supplier interface is determined according to the credit product and the selected supplier, and multi-dimensional fusing is performed on the supplier interface;

[0007] obtaining the input parameter configuration of the supplier interface, defining the supplier interface parameter name and the corresponding data acquisition input item in the input parameter configuration, and inputting the supplier interface parameter name and the data acquisition input item into a data acquisition platform, and returning a business parameter value through the data acquisition platform;

[0008] determining a corresponding data source according to the credit product validity period and the business parameter value, obtaining business data from the data source, and publishing the business data to a middleware;

[0009] The supplier selection strategy includes a default supplier strategy, a priority supplier strategy, a decision flow supplier strategy and a business flow supplier strategy.

[0010] In one embodiment, the permission verification on the business request of the credit product comprises:

[0011] authenticating the credit product and its corresponding scene identifier;

[0012] Throttling the service request of the credit product.

[0013] In one of the embodiments, before selecting the corresponding supplier according to the supplier selection strategy between the credit product and the supplier, further comprising:

[0014] Establishing a default supplier strategy;

[0015] Establishing different priority supplier strategies according to different service factors of the supplier interface;

[0016] Establishing a decision flow supplier strategy according to decision logic;

[0017] Establishing a service flow supplier strategy according to service content.

[0018] In one of the embodiments, the multi-dimensional fusing of the supplier interface comprises:

[0019] Based on the non-relational database counting, at least two dimensions of the supplier interface and the supplier interface+scene identification are fused.

[0020] In one of the embodiments, the input of the supplier interface parameter name and the data acquisition input item into the data acquisition platform, and the return of the service parameter value of the credit product by the data acquisition platform, comprises:

[0021] Inputting the supplier interface parameter name and the data acquisition input item into the data acquisition platform;

[0022] The data acquisition platform returns the service parameter value of the credit product and the request time of the credit product by calculation;

[0023] Obtaining the service parameter value of the last service of the credit product and the request time of the last service of the credit product.

[0024] In one of the embodiments, the determination of the corresponding data source according to the validity period of the credit product and the service parameter value comprises:

[0025] Judging whether the service parameter value of the current service of the credit product is consistent with the service parameter value of the last service of the credit product, and whether the request time of the current service of the credit product minus the request time of the last service of the credit product is less than or equal to the validity period of the credit product;

[0026] If the service parameter value of the current service of the credit product is consistent with the service parameter value of the last service of the credit product, and the request time of the current service of the credit product minus the request time of the last service of the credit product is less than or equal to the validity period of the credit product, the data source of the credit product is obtained from the object storage service cache;

[0027] If the business parameter value of the current business of the credit product is inconsistent with the business parameter value of the last business of the credit product, or the request time of the current business of the credit product minus the request time of the last business of the credit product is greater than the validity period of the credit product, the data source of the credit product is obtained from the supplier.

[0028] In one of the embodiments, the publishing the business data to the middleware comprises:

[0029] determining the object storage service cache path of the business data of the credit product;

[0030] publishing the object storage service cache path of the business data of the credit product to the middleware.

[0031] In another aspect, a credit platform data acquisition system is provided, and the credit platform data acquisition system comprises:

[0032] The permission verification module is configured to perform permission verification on the business request of the credit product.

[0033] The supplier strategy module is configured to select a corresponding supplier according to a supplier selection strategy between the credit product and the supplier, and determine a corresponding supplier interface according to the credit product and the selected supplier.

[0034] The fuse module is configured to perform multi-dimensional fusing on the supplier interface.

[0035] The data processing module is configured to obtain an input parameter configuration of the supplier interface, define a supplier interface parameter name and a corresponding data acquisition input item in the input parameter configuration, and input the supplier interface parameter name and the data acquisition input item into a data acquisition platform, and return a business parameter value through the data acquisition platform.

[0036] The business data module is configured to determine a corresponding data source according to a credit product validity period and a business parameter value, obtain business data from the data source, and publish the business data to the middleware.

[0037] In still another aspect, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program:

[0038] receiving a business request of a credit product, and performing permission verification on the business request of the credit product;

[0039] after the permission verification is passed, selecting a corresponding supplier according to a supplier selection strategy between the credit product and the supplier, determining a corresponding supplier interface according to the credit product and the selected supplier, and performing multi-dimensional fusing on the supplier interface.

[0040] Obtaining the input parameter configuration of the supplier interface, defining the supplier interface parameter name and the corresponding data acquisition input item in the input parameter configuration, and inputting the supplier interface parameter name and the data acquisition input item into the data acquisition platform, and returning the business parameter value through the data acquisition platform;

[0041] According to the credit product validity period and the business parameter value, the corresponding data source is determined, the business data is obtained from the data source, and the business data is published to the middleware.

[0042] In another aspect, a computer readable storage medium is provided, the computer readable storage medium stores a program, when the program is executed by a processor, the processor executes the following steps:

[0043] Receiving a business request of a credit product, and performing permission verification on the business request of the credit product;

[0044] After the permission verification is passed, a corresponding supplier is selected according to the supplier selection strategy between the credit product and the supplier, a corresponding supplier interface is determined according to the credit product and the selected supplier, and multi-dimensional fusing is performed on the supplier interface;

[0045] Obtaining the input parameter configuration of the supplier interface, defining the supplier interface parameter name and the corresponding data acquisition input item in the input parameter configuration, and inputting the supplier interface parameter name and the data acquisition input item into the data acquisition platform, and returning the business parameter value through the data acquisition platform;

[0046] According to the credit product validity period and the business parameter value, the corresponding data source is determined, the business data is obtained from the data source, and the business data is published to the middleware.

[0047] The above technical solutions of the present application have the following advantages compared with the prior art:

[0048] The above credit platform data acquisition method, system, computer device and storage medium specify different supplier selection strategies, and encapsulate the supplier selection strategies into the credit platform. The credit personnel no longer needs to directly modify the code for supplier selection. The credit personnel only needs to determine the credit product. The supplier selection strategy is directly encapsulated into the credit platform, and the automatic selection of the supplier is completed by the credit platform, thereby reducing the burden of the credit personnel and effectively improving the efficiency of data acquisition. BRIEF DESCRIPTION OF DRAWINGS

[0049] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained based on these drawings without any creative effort.

[0050] Figure 1 is a first method flow chart of the method credit platform data collection of the present application;

[0051] Figure 2 is a second method flow chart of the credit platform data collection method of the present application;

[0052] Figure 3 is a timing diagram of the credit platform data collection method of the present application;

[0053] Figure 4 is a system structure diagram of the credit platform data collection system of the present application;

[0054] Figure 5 is a device structure diagram of the computer device of the present application. DETAILED DESCRIPTION

[0055] In order to make the purpose, technical solutions and advantages of the present application more clear, the present application will be further described in detail below in combination with the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.

[0056] Embodiment one:

[0057] The credit platform data collection method of the present embodiment, with reference to Figures 1-3 , as shown in Figure 1 is a first method flow chart of the credit platform data collection method of the present application; Figure 2 is a second method flow chart of the credit platform data collection method of the present application;

[0058] Figure 3 is a timing diagram of the credit platform data collection method of the present application.

[0059] The credit platform data collection method comprises the following steps:

[0060] receiving a service request of a credit product, and performing permission verification on the service request of the credit product;

[0061] The risk system investigates the credit of a client in a credit business, and the risk system requests a credit platform to complete data collection work. A process of obtaining credit data for a specific credit product is a series of data acquisition processes completed by the credit platform internally. When a credit personnel starts a credit data collection process of the credit platform, the credit personnel will first receive a credit product selected by the credit personnel in the credit platform. Then, the credit platform will perform permission verification on the credit product. If the permission verification of the credit product is passed, the credit platform will further select a supplier to determine a corresponding supplier interface. If the permission verification of the credit product is not passed, the credit platform will reject the business request of the credit product, thereby improving the security of credit product data acquisition.

[0062] After the permission verification is passed, a corresponding supplier is selected according to a supplier selection strategy between the credit product and the supplier, a corresponding supplier interface is determined according to the credit product and the selected supplier, and the supplier interface is subjected to multi-dimensional fusing.

[0063] After the credit platform receives a business request of a credit product, the credit platform first performs permission verification on the credit product. After the permission verification of the credit product is passed, a corresponding supplier is selected according to a supplier selection strategy between the credit product and the supplier. Then, a corresponding supplier interface is determined according to the credit product and the supplier. After the supplier interface is determined, multi-dimensional fusing can be further performed to prevent excessive business requests and reduce the cost of data acquisition. Generally, one credit product corresponds to one or more suppliers, one supplier corresponds to one or more supplier interfaces, a credit product can determine a supplier according to a supplier selection strategy, and the supplier is determined to further determine a corresponding supplier interface together with the credit product.

[0064] The input parameter configuration of the supplier interface is obtained. In the input parameter configuration, a supplier interface parameter name and a corresponding data acquisition input item are defined, and the supplier interface parameter name and the data acquisition input item are input to a data acquisition platform. A business parameter value is returned through the data acquisition platform.

[0065] After the supplier interface of the credit product is acquired, the input parameter configuration of the supplier interface needs to be acquired, the input parameter configuration including a supplier interface parameter name and a corresponding data acquisition input item, the data acquisition input item being a corresponding field in the data acquisition platform for executing data acquisition. After the supplier interface parameter name and the data acquisition input item are input into the data acquisition platform, the data acquisition platform identifies the supplier interface parameter name and the data acquisition input item. The data acquisition platform executes relevant data processing procedures according to the data acquisition input item. The data acquisition platform finally returns the business parameter value of the credit product. According to the business parameter value, the source of data acquisition of the credit product can be further determined, so as to reduce the cost of data acquisition. Further, for example, an OCR (optical character recognition) credit product (for identifying information of an ID card), when the risk system requests the credit platform to perform data collection, if the photo of the ID card is provided in the risk system, the photo provided by the risk system can be directly used for identification; if the photo of the ID card is not provided in the risk system, the information of the ID card is acquired from the data acquisition platform according to the supplier interface parameter name and the data acquisition input item. In addition, the data acquisition platform stores common information of a user, such as information of an ID card, a name, a mobile phone number, a business license and a bank card.

[0066] According to the credit product validity period and the business parameter value, a corresponding data source is determined, business data is acquired from the data source, and the business data is published to the middleware.

[0067] In order to reduce the cost of data acquisition, for example, vehicle information, real estate information and the like, as long as the corresponding data of the credit product is within the validity period, real-time data does not need to be acquired. Therefore, the data source is divided into two categories, one being data in the cache and the other being real-time data acquired from the supplier. According to the credit product validity period and the business parameter value, it is determined whether data needs to be acquired from the cache or real-time data needs to be acquired from the supplier, so as to reduce the cost of data acquisition. After the data source is determined, the business data is acquired through the data source, and the business data is published to the middleware.

[0068] The supplier selection strategy includes a default supplier strategy, a priority supplier strategy, a decision flow supplier strategy and a business flow supplier strategy.

[0069] The credit personnel in the prior art need to manually modify the code for the selection of the supplier interface, the present application specifies different supplier selection strategies and encapsulates the supplier selection strategies into the credit platform, so that the credit personnel no longer need to directly modify the code for the selection of the supplier, the credit personnel only need to determine the credit product, and the supplier selection strategy is directly encapsulated into the credit platform, and the automatic selection of the supplier is completed by the credit platform, thereby reducing the burden of the credit personnel and effectively improving the efficiency of data collection.

[0070] In one of the embodiments, the business request of the credit product is received, and the business request of the credit product is subjected to authority verification, which comprises:

[0071] The credit product and the corresponding token thereof are authenticated;

[0072] After receiving the business request of the credit product, the credit product and the corresponding token thereof are first authenticated. The authentication is to verify whether the credit product has the authority to request the business, and the token is a unique identifier. The token is used to create the business and the specific use scenario that need to be associated. Before the data is obtained, it is verified whether the token has been authorized to the credit product. If the token has been authorized to the credit product requesting the business, the data acquisition process of the credit product is allowed to be executed; if the token has not been authorized to the credit product requesting the business, the data acquisition process of the credit product is not allowed to be executed, so as to improve the security of the data acquisition of the credit product.

[0073] The business request of the credit product is subjected to flow limiting;

[0074] The flow limiting is used to prevent the problem that in the case that multiple credit products request the same request interface, a certain credit product consumes the resources and other credit products cannot access the request interface. The flow limiting is performed on the credit product. Preferably, the token bucket algorithm is adopted. The principle is that the credit platform puts tokens into the token bucket at a constant speed. If the business request of the credit product needs to be processed, a token needs to be obtained from the token bucket first. When there is no token available in the bucket, the service is refused, so as to perform the flow limiting operation on the business request of the credit product. The supplier charges a fee for the data collection of the request supplier interface. The flow limiting is used to limit the number of business requests of different supplier interfaces, so as to reduce the cost of data collection.

[0075] In one of the embodiments, before the corresponding supplier is selected according to the interface selection strategy between the credit product and the supplier, the following steps are further included:

[0076] A default supplier strategy is established;

[0077] The default supplier strategy refers to selecting a designated supplier when selecting a supplier, and if no supplier selection strategy selected by the credit personnel is received, the default supplier strategy is executed. In addition, the general supplier selection is performed according to a priority supplier strategy, or a decision flow supplier strategy, or a business flow supplier strategy; for example, if the request failure rate of the supplier interface is more than 50% in the last 5 minutes, the default supplier strategy is directly used, which maximizes the high availability and fault tolerance of the credit platform data collection service.

[0078] Different priority supplier strategies are established according to different service factors of the supplier interface.

[0079] The priority supplier strategy refers to a supplier selection strategy established according to different service factors of the supplier interface. For example, the stability of the supplier interface service, the quality of the data, the billing logic, and other factors will affect the selection of the supplier interface. According to the specific actual needs, appropriate service factors can be selected, and the priority supplier strategy corresponding to the service factor can be formulated. The priority supplier strategy is a cost-effective supplier selection strategy.

[0080] The decision flow supplier strategy is established according to the decision logic.

[0081] The decision flow supplier strategy is a supplier selection strategy established according to the decision logic. For example, the credit product is a map & address coding, the suppliers are A map service provider, B map service provider, C map service provider, and D map service provider, and two decision logics of geographic location and mobile phone model are pre-set. For example, A city uses A map service provider interface, B city uses B map service provider interface, A type mobile phone uses C map service provider interface, and B type mobile phone uses D map service provider. The decision flow supplier strategy is established according to the decision logic, and the supplier selection of simple decision logic is realized.

[0082] The business flow supplier strategy is established according to the business content.

[0083] The business flow supplier strategy is a supplier selection strategy established according to the business content. For example, the credit product is a loan data of a certain bank, and a series of complex business information such as the last borrowing time information, the last loan credit information, and the signed authorization agreement are needed for decision-making. At this time, the business flow supplier strategy needs to be selected to select the supplier according to the complex business.

[0084] In one embodiment, before the corresponding supplier is selected according to the supplier selection strategy between the credit product and the supplier, the method further comprises:

[0085] Receiving the supplier selection strategy selected by the credit personnel.

[0086] When the credit platform collects data, the credit personnel selects a suitable supplier selection strategy on the credit platform, and the credit platform receives the supplier selection strategy selected by the credit personnel. If the credit platform does not receive the supplier selection strategy selected by the credit personnel, the default supplier selection strategy is executed.

[0087] In one embodiment, the multi-dimensional fusing of the supplier interface further includes:

[0088] Based on the non-relational database counting, at least two dimensions of the supplier interface and the supplier interface+scene identification are fused.

[0089] The fusing is to avoid too many business requests in a limited time. The reason for so many retries is that the server or the requester itself has a problem. After the introduction of fusing, too many meaningless failed requests can be avoided, and the data collection cost can be controlled. If the service party has a problem, the requester is fused, so that the requester will not continue to blindly call; if the requester itself has a problem, the requester can also be directly failed to avoid meaningless waiting or blocking of itself. In the present application, at least two dimensions of fusing are adopted. One dimension is the total rule, that is, based on the redis (non-relational database) counting, the total access times of the supplier interface are fused; the other is based on the redis counting, the fusing of the supplier interface+token dimension, and the token is the fusing of the specific business scene under the entire interface, such as the first borrowing scene, the re-borrowing scene, etc. Through two dimensions of redis-based fusing, the business processing capacity is improved, and the cost is reduced. In addition, the redis database can also set a time period, and in the fixed time period, the business request times of the credit product are reset to zero, and the counting of the next period is continued. In addition, through the token, the cost of the specific application scene can be analyzed; through the token, the core business and the non-core business can be distinguished, and the token can also fuse the core business and the non-core business to ensure the normal operation of the core business.

[0090] In one embodiment, the input of the supplier interface parameter name and the data acquisition input item into the data acquisition platform, and the return of the business parameter value by the data acquisition platform includes:

[0091] The supplier interface parameter name and the data acquisition input item are input into the data acquisition platform.

[0092] After the supplier interface parameter name and the data acquisition input item are input to the data acquisition platform, the data acquisition platform receives the supplier interface parameter name and the data acquisition input item, identifies the supplier interface parameter name and the data acquisition input item, and then executes a relevant data processing procedure according to a field of the data acquisition input item, so that the data acquisition platform returns a business parameter value.

[0093] The data acquisition platform returns the business parameter value of the current business of the credit product and the request time of the current business of the credit product by calculation.

[0094] The data acquisition platform executes a relevant data processing procedure according to a field of the data acquisition input item, and obtains the MD5 value (business parameter value) of the current business of the credit product requested by the credit product through the supplier interface and the request time of the current business of the credit product by calculation, so as to determine the source of the acquired data according to the MD5 value and the request time.

[0095] The MD5 value of the previous business of the credit product and the request time of the previous business of the credit product are obtained.

[0096] After the MD5 value of the current business of the credit product requested by the credit product through the supplier interface and the request time of the current business of the credit product are obtained by calculation, the MD5 value of the previous business of the credit product and the request time of the previous business of the credit product are obtained, so as to determine the source of the acquired data according to the MD5 value and the request time.

[0097] In one embodiment, before the data acquisition platform returns the MD5 value of the current business of the credit product and the request time of the previous business of the credit product by calculation, the data acquisition platform further includes:

[0098] The credit product effective period of the credit personnel on the credit platform is received.

[0099] After the MD5 value of the current business of the credit product requested by the credit product through the supplier interface and the request time of the current business of the credit product, the MD5 value of the previous business of the credit product requested by the credit product through the supplier interface and the request time of the previous business of the credit product are obtained, the difference between the request time of the current business of the credit product and the request time of the previous business of the credit product is calculated, and it is determined whether the difference is within the product effective period. Therefore, the credit product effective period of the credit personnel on the credit platform is received in advance. The credit product effective period can be determined according to actual conditions, and different credit products correspond to different credit product effective periods.

[0100] In one embodiment, the determination of the corresponding data source according to the credit product effective period and the business parameter value further includes:

[0101] determining whether the MD5 value of the current service of the credit product is consistent with the MD5 value of the last service of the credit product, and whether the request time of the current service of the credit product minus the request time of the last service of the credit product is less than or equal to the validity period of the credit product;

[0102] The data source is determined by the MD5 value and the validity period of the credit product. The specific determination method is: determining whether the MD5 value of the current service of the credit product is consistent with the MD5 value of the last service of the credit product, and whether the request time of the current service of the credit product minus the request time of the last service of the credit product is less than or equal to the validity period of the credit product.

[0103] If the MD5 value of the current service of the credit product is consistent with the MD5 value of the last service of the credit product, and the request time of the current service of the credit product minus the request time of the last service of the credit product is less than or equal to the validity period of the credit product, the data source of the credit product is obtained from the object storage service cache;

[0104] If the MD5 value of the current service of the credit product is consistent with the MD5 value of the last service of the credit product, it means that the current request service and the last request service are the same credit product obtaining data through the same supplier interface. If the request time of the current service of the credit product minus the request time of the last service of the credit product is less than or equal to the validity period of the credit product, it means that the data requested by the current service is still within the validity period, and there is no need to obtain real-time data from the supplier, but only to read from the oss cache (Object Storage Service, object storage service cache). Real-time data acquisition may result in charges from the supplier, so this can reduce costs.

[0105] If the MD5 value of the current service of the credit product is inconsistent with the MD5 value of the last service of the credit product, or the request time of the current service of the credit product minus the request time of the last service of the credit product is greater than the validity period of the credit product, the data source of the credit product is obtained from the supplier.

[0106] If the MD5 value of the current service of the credit product is inconsistent with the MD5 value of the last service of the credit product, it means that the current request service and the last request service are not the same credit product obtaining data through the same supplier interface, so the data obtained by the current request service and the last request service will be different, and therefore the data cannot be obtained from the oss cache. Or if the request time of the current service of the credit product minus the request time of the last service of the credit product is greater than the validity period of the credit product, it means that the data requested by the current service is no longer within the validity period, and the data from the supplier may have changed, so real-time data is obtained from the supplier. Further, the credit gateway is requested, and the credit gateway obtains real-time data from the supplier.

[0107] In one embodiment, the publishing the business data to the middleware comprises:

[0108] determining the object storage service cache path of the business data of the credit product;

[0109] In order to improve the efficiency of the business data in the credit platform, some obtained business data occupies a large space, such as video data, if the business data is transmitted every time in the process of the business data, the resource congestion will be generated, therefore, in the process of the business data, the business data does not need to be transmitted in real time, only the address of the video resource (object storage service cache path) needs to be transmitted, and the specific video resource can be obtained in the last business data flow, so that the processing efficiency of the credit platform is improved.

[0110] The object storage service cache path of the data source of the credit product is published to the middleware.

[0111] After the business data of the credit product is finally obtained, the oss path (object storage service cache path) of the business data can be published to the middleware (rabbitmq, message-oriented middleware), and the node needing to obtain the business data can read from the middleware.

[0112] Embodiment two:

[0113] Referring to Figure 2 , it is a second method flowchart of the credit platform data acquisition method of the present application. Figure 2

[0114] receiving a business request of a credit product, and authenticating the credit product and the corresponding scene identifier;

[0115] When the credit personnel starts the credit data acquisition process, the credit product selected by the credit personnel will be received first, and then the credit platform will perform permission verification on the credit product, that is, authentication and flow limiting. First, the credit product and the corresponding token (scene identifier) are authenticated to verify whether the token has been authorized to the credit product. If the token has been authorized to the credit product, the data acquisition process of the credit product is allowed to be executed. If the token has not been authorized to the credit product, the data acquisition process of the credit product is not allowed to be executed, so as to improve the security of the credit product data acquisition.

[0116] flow limiting the business request of the credit product;

[0117] ​The flow limiting is used to prevent a certain credit product from exhausting resources and making other credit products unable to access the request interface in the case of multiple credit product requests for the same request interface. The flow limiting is performed on the credit product. Preferably, the token bucket algorithm is adopted. The principle is that the credit platform puts tokens into the token bucket at a constant speed. If the business request of the credit product needs to be processed, a token needs to be obtained from the token bucket first. When there is no token available in the bucket, the service is refused, so as to perform the flow limiting operation on the business request of the credit product.

[0118] receiving the supplier selection strategy selected by the credit personnel;

[0119] When the credit platform performs data collection, the credit personnel selects a suitable supplier selection strategy on the credit platform. The credit platform receives the supplier selection strategy selected by the credit personnel. If the credit platform does not receive the supplier selection strategy selected by the credit personnel, the default supplier selection strategy is executed.

[0120] According to the supplier selection strategy between the credit product and the supplier, a corresponding supplier is selected, and according to the credit product and the selected supplier, a corresponding supplier interface is determined.

[0121] After receiving the business request of the credit product, the permission of the credit product is first verified. After the permission verification of the credit product is passed, a corresponding supplier is selected according to the supplier selection strategy between the credit product and the supplier, and then a corresponding supplier interface is determined according to the credit product and the supplier.

[0122] Based on the non-relational database counting, at least two dimensions of the supplier interface and the supplier interface+scene identification are fused;

[0123] At least two dimensions of the fuse are adopted. One dimension is the total rule, that is, the total access times of the supplier interface are fused based on the redis(non-relational database) counting. The other is the fuse of the supplier interface+token dimension based on the redis counting. The token is the fuse of the specific business scene under the entire interface, such as the first borrowing scene and the re-borrowing scene. Through the two dimensions, the redis-based fuse is improved, the business processing capacity is improved, and the cost is reduced.

[0124] Obtaining the input parameter configuration of the supplier interface, in which the supplier interface parameter name and the corresponding data acquisition input item are defined;

[0125] After obtaining the supplier interface of the credit product, the input parameter configuration of the supplier interface needs to be obtained. The input parameter configuration includes the supplier interface parameter name and the corresponding data acquisition input item. The data acquisition input item is the corresponding field of the data acquisition platform for executing data acquisition.

[0126] Receiving the credit product effective period preset by the credit personnel on the credit platform;

[0127] After obtaining the MD5 value of the current business of the credit product through the supplier interface, the request time of the current business of the credit product, the MD5 value of the last business of the credit product through the supplier interface, and the request time of the last business of the credit product, the difference between the request time of the current business of the credit product and the request time of the last business of the credit product is calculated to determine whether the difference is within the product effective period. Therefore, the credit product effective period preset by the credit personnel on the credit platform is received in advance. The credit product effective period can be determined according to actual conditions, and different credit products correspond to different credit product effective periods.

[0128] The supplier interface parameter name and data acquisition input item are input into the data acquisition platform;

[0129] After obtaining the supplier interface of the credit product, the input parameter configuration of the supplier interface needs to be obtained. The input parameter configuration includes the supplier interface parameter name and the corresponding data acquisition input item. The data acquisition input item is the corresponding field in the data acquisition platform for executing data acquisition. After the supplier interface parameter name and the corresponding data acquisition input item are configured, the supplier interface parameter name and the data acquisition input item are input into the data acquisition platform.

[0130] The data acquisition platform calculates the business parameter value of the current business of the credit product and the request time of the current business of the credit product;

[0131] The data acquisition platform executes related data processing procedures according to the fields of the data acquisition input item. The MD5 value (business parameter value) of the current business of the credit product through the supplier interface and the request time of the current business of the credit product are obtained by calculation, so as to determine the source of the obtained data according to the MD5 value and the request time.

[0132] Obtain the business parameter value of the last business of the credit product and the request time of the last business of the credit product;

[0133] After obtaining the MD5 value of the current business of the credit product through the supplier interface and the request time of the current business of the credit product, the MD5 value of the last business of the credit product and the request time of the last business of the credit product are obtained, so as to determine the source of the obtained data according to the MD5 value and the request time.

[0134] Determine whether the business parameter value of the current business of the credit product is consistent with the business parameter value of the last business of the credit product, and whether the request time of the current business of the credit product minus the request time of the last business of the credit product is less than or equal to the credit product effective period;

[0135] determining whether the MD5 value of the current service of the credit product is consistent with the MD5 value of the last service of the credit product, and whether the request time of the current service of the credit product minus the request time of the last service of the credit product is less than or equal to the validity period of the credit product; if the MD5 value of the current service of the credit product is consistent with the MD5 value of the last service of the credit product, it means that the current service request and the last service request are the same credit product through the same supplier interface to obtain data; if the request time of the current service of the credit product minus the request time of the last service of the credit product is less than or equal to the validity period of the credit product, it means that the data requested by the current service is still within the validity period, and there is no need to obtain real-time data from the supplier, but only to read from the oss cache. Real-time data acquisition may incur charges from the supplier, so this can reduce costs; if the MD5 value of the current service of the credit product is not consistent with the MD5 value of the last service of the credit product, it means that the current service request and the last service request are not the same credit product through the same supplier interface to obtain data, so the data obtained by the current service request and the last service request will be different, and therefore the data cannot be obtained from the oss cache; or if the request time of the current service of the credit product minus the request time of the last service of the credit product is greater than the validity period of the credit product, it means that the data requested by the current service is no longer within the validity period, and the data of the supplier may have changed, so real-time data needs to be obtained from the supplier.

[0136] obtaining service data from the data source, and determining the object storage service cache path of the service data of the credit product;

[0137] After obtaining the data source, the service data is obtained from the data source; the oss path (object storage service cache) of the service data of the credit product is determined, so that in the process of transferring the service data, only the address of the video resource needs to be transmitted, that is, the oss path of the service data of the credit product, and the specific video resource can be obtained at the last service data transfer, thereby improving the processing efficiency of the credit platform.

[0138] The object storage service cache path of the service data of the credit product is published to the middleware.

[0139] After obtaining the service data of the credit product, the oss path of the service data is published to the middleware, and the node that needs to obtain the service data can read from the middleware.

[0140] It should be understood that, although Figures 1-2The steps in the flowchart are shown in sequence according to the arrows, but the steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, the steps are not strictly limited in sequence, and the steps can be executed in other sequences. Moreover, Figures 1-2 At least one part of the steps in the flowchart can include multiple sub-steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of the sub-steps or stages is not necessarily sequential, but can be executed alternately or alternately with at least one part of other steps or sub-steps or stages of other steps.

[0141] Embodiment three:

[0142] Referring to Figure 4 As shown in the figure, Figure 4 is a system structure diagram of the credit platform data acquisition system of the present application.

[0143] The credit platform data acquisition system of the present embodiment comprises:

[0144] The permission verification module is configured to verify the permission of the business request of the credit product.

[0145] The process of obtaining credit data according to specific credit products by credit personnel is a series of data acquisition processes completed internally by the credit platform. When the credit personnel starts the credit data acquisition process, the credit product selected by the credit personnel will be received first, and then the credit platform will verify the permission of the credit product through the permission verification module. If the permission verification of the credit product is passed, the selection of the supplier will be further performed to determine the corresponding supplier interface; if the permission verification of the credit product is not passed, the business request of the credit product will be rejected, thereby improving the security of credit product data acquisition.

[0146] The supplier strategy module is configured to select a corresponding supplier according to a supplier selection strategy between the credit product and the supplier, and to determine a corresponding supplier interface according to the credit product and the selected supplier.

[0147] After receiving the business request of the credit product, the permission of the credit product is verified first, and after the permission verification of the credit product is passed, a corresponding supplier is selected by the supplier strategy module according to a supplier selection strategy between the credit product and the supplier, and then a corresponding supplier interface is determined according to the credit product and the supplier. The supplier strategy module is also configured to establish a default supplier strategy, a priority supplier strategy, a decision flow supplier strategy and a business flow supplier strategy.

[0148] The fuse module is configured to perform multi-dimensional fusing on the supplier interface.

[0149] After the supplier interface is determined, multi-dimensional fusing can be further performed through the fusing module to prevent excessive business requests and reduce the cost of data acquisition.

[0150] The data processing module is configured to acquire an input parameter configuration of the supplier interface, define a supplier interface parameter name and a corresponding data acquisition input item in the input parameter configuration, and input the supplier interface parameter name and the data acquisition input item into a data acquisition platform to return a business parameter value through the data acquisition platform.

[0151] After the supplier interface of the credit product is acquired, the input parameter configuration of the supplier interface is acquired through the data processing module. The input parameter configuration includes a supplier interface parameter name and a corresponding data acquisition input item. The data acquisition input item is a corresponding field in the data acquisition platform for executing data acquisition. After the supplier interface parameter name and the data acquisition input item are input into the data acquisition platform, the data acquisition platform identifies the supplier interface parameter name and the data acquisition input item. The data acquisition platform executes a related data processing procedure according to the data acquisition input item. The data acquisition platform finally returns a business parameter value. According to the business parameter value, the source of data acquisition of the credit product can be further determined to reduce the cost of data acquisition.

[0152] The business data module is configured to determine a corresponding data source according to a credit product validity period and a business parameter value, acquire business data from the data source, and publish the business data to a middleware.

[0153] In order to reduce the cost of data acquisition, for example, vehicle information, real estate information and the like, as long as the corresponding data of the credit product is within the validity period, real-time data does not need to be acquired. Therefore, the data source is divided into two categories, one is data in the cache, and the other is real-time data acquired from the supplier. Through the business data module, it is determined whether data needs to be acquired from the cache or real-time data needs to be acquired from the supplier according to the credit product validity period and the business parameter value to reduce the cost of data acquisition. After the data source is determined, the business data is acquired through the data source, and the business data is published to the middleware.

[0154] The data source judgment module is configured to determine whether an MD5 value of a current business of a credit product is consistent with an MD5 value of a last business of the credit product, and whether a request time of the current business of the credit product minus a request time of the last business of the credit product is less than or equal to a validity period of the credit product.

[0155] If the MD5 value of the current business of the credit product is consistent with the MD5 value of the last business of the credit product, and the request time of the current business of the credit product minus the request time of the last business of the credit product is less than or equal to the validity period of the credit product, the data source of the credit product is obtained from the oss cache; if the MD5 value of the current business of the credit product is inconsistent with the MD5 value of the last business of the credit product, or the request time of the current business of the credit product minus the request time of the last business of the credit product is greater than the validity period of the credit product, the data source of the credit product is obtained from the supplier.

[0156] The specific limitations of the credit platform data acquisition system can be referred to the limitations of the method in the above, which will not be repeated here. Each module in the above credit platform data acquisition system can be realized by software, hardware and their combinations in whole or in part. The above each module can be embedded in or independent of the processor in the computer device in hardware form, or can be stored in the memory in the computer device in software form, so as to be called and executed by the processor to perform the operations corresponding to the above each module.

[0157] Embodiment four:

[0158] The embodiment provides a computer device, which comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and characterized in that the processor implements the steps of the credit platform data acquisition method when executing the computer program.

[0159] The computer device can be a terminal, and its internal structure diagram can be as shown in Figure 5 The computer device comprises a processor, a memory, a network interface, a display screen and an input device connected through a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device comprises a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operating system and the computer program in the non-volatile storage medium to run. The network interface of the computer device is used to communicate with external terminals through network connection. The computer program is executed by the processor to implement the credit platform data acquisition method. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer overlaid on the display screen, or can be a key, trackball or touchpad arranged on the shell of the computer device, or can be an external keyboard, touchpad or mouse, etc.

[0160] Those skilled in the art should understand that Figure 5The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0161] In one of the embodiments, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the following steps when executing the computer program:

[0162] receiving a service request of a credit product, and performing permission verification on the service request of the credit product;

[0163] After the permission verification is passed, selecting a corresponding supplier according to a supplier selection strategy between the credit product and the supplier, determining a corresponding supplier interface according to the credit product and the selected supplier, and performing multi-dimensional fusing on the supplier interface;

[0164] obtaining an input parameter configuration of the supplier interface, defining a supplier interface parameter name and a corresponding data acquisition input item in the input parameter configuration, and inputting the supplier interface parameter name and the data acquisition input item into a data acquisition platform, and returning a service parameter value through the data acquisition platform;

[0165] determining a corresponding data source according to the validity period of the credit product and the service parameter value, obtaining service data from the data source, and publishing the service data to a middleware.

[0166] In one of the embodiments, the processor further implements the following steps when executing the computer program:

[0167] authenticating the credit product and its corresponding scene identifier;

[0168] limiting the service request of the credit product.

[0169] In one of the embodiments, the processor further implements the following steps when executing the computer program:

[0170] establishing a default supplier strategy;

[0171] establishing different priority supplier strategies according to different service factors of the supplier interface;

[0172] establishing a decision flow supplier strategy according to a decision logic;

[0173] establishing a business flow supplier strategy according to business content

[0174] In one of the embodiments, the processor further implements the following steps when executing the computer program:

[0175] Based on the non-relational database counting, at least two dimensions of the supplier interface and the supplier interface+scene identification are fused.

[0176] In one of the embodiments, the processor, when executing the computer program, also implements the following steps:

[0177] The supplier interface parameter name and the data acquisition input item are input into the data acquisition platform;

[0178] The data acquisition platform returns the business parameter value of the current business of the credit product and the request time of the current business of the credit product through calculation;

[0179] The business parameter value of the last business of the credit product and the request time of the last business of the credit product are obtained.

[0180] In one of the embodiments, the processor, when executing the computer program, also implements the following steps:

[0181] It is judged whether the business parameter value of the current business of the credit product is consistent with the business parameter value of the last business of the credit product, and whether the request time of the current business of the credit product minus the request time of the last business of the credit product is less than or equal to the validity period of the credit product;

[0182] If the business parameter value of the current business of the credit product is consistent with the business parameter value of the last business of the credit product, and the request time of the current business of the credit product minus the request time of the last business of the credit product is less than or equal to the validity period of the credit product, the data source of the credit product is obtained from the object storage service cache;

[0183] If the business parameter value of the current business of the credit product is inconsistent with the business parameter value of the last business of the credit product, or the request time of the current business of the credit product minus the request time of the last business of the credit product is greater than the validity period of the credit product, the data source of the credit product is obtained from the supplier.

[0184] In one of the embodiments, the processor, when executing the computer program, also implements the following steps:

[0185] The object storage service cache path of the business data of the credit product is determined;

[0186] The object storage service cache path of the business data of the credit product is published to the middleware.

[0187] Embodiment five:

[0188] The embodiment provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the following steps:

[0189] receive a service request of a credit product, and perform permission verification on the service request of the credit product;

[0190] after the permission verification is passed, select a corresponding supplier according to a supplier selection strategy between the credit product and the supplier, determine a corresponding supplier interface according to the credit product and the selected supplier, and perform multi-dimensional fusing on the supplier interface;

[0191] obtain an input parameter configuration of the supplier interface, define a supplier interface parameter name and a corresponding data acquisition input item in the input parameter configuration, and input the supplier interface parameter name and the data acquisition input item into a data acquisition platform, and return a service parameter value through the data acquisition platform;

[0192] determine a corresponding data source according to the credit product validity period and the service parameter value, obtain service data from the data source, and publish the service data to middleware.

[0193] In one embodiment, the processor executing the computer program further implements the following steps:

[0194] authenticating the credit product and its corresponding scene identifier;

[0195] limiting the service request of the credit product.

[0196] In one embodiment, the processor executing the computer program further implements the following steps:

[0197] establishing a default supplier strategy;

[0198] establishing different priority supplier strategies according to different service factors of the supplier interface;

[0199] establishing a decision flow supplier strategy according to a decision logic;

[0200] establishing a business flow supplier strategy according to business content

[0201] In one embodiment, the processor executing the computer program further implements the following steps:

[0202] based on a non-relational database count, at least two dimensions of the supplier interface and the supplier interface+scene identifier are fused.

[0203] In one embodiment, the processor executing the computer program further implements the following steps:

[0204] inputting the supplier interface parameter name and the data acquisition input item into the data acquisition platform;

[0205] The data acquisition platform calculates a service parameter value of the current business of the credit product and a request time of the current business of the credit product.

[0206] The data acquisition platform calculates a service parameter value of the current business of the credit product and a request time of the current business of the credit product.

[0207] In one of the embodiments, the processor, when executing the computer program, further implements the following steps:

[0208] determining whether the service parameter value of the current business of the credit product is consistent with the service parameter value of the previous business of the credit product, and whether the request time of the current business of the credit product minus the request time of the previous business of the credit product is less than or equal to the validity period of the credit product;

[0209] if the service parameter value of the current business of the credit product is consistent with the service parameter value of the previous business of the credit product, and the request time of the current business of the credit product minus the request time of the previous business of the credit product is less than or equal to the validity period of the credit product, the data source of the credit product is obtained from the object storage service cache;

[0210] if the service parameter value of the current business of the credit product is inconsistent with the service parameter value of the previous business of the credit product, or the request time of the current business of the credit product minus the request time of the previous business of the credit product is greater than the validity period of the credit product, the data source of the credit product is obtained from the supplier.

[0211] In one of the embodiments, the processor, when executing the computer program, further implements the following steps:

[0212] determining an object storage service cache path of the service data of the credit product;

[0213] publishing the object storage service cache path of the service data of the credit product to the middleware.

[0214] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. Any reference to memory, storage, databases, or other media in the embodiments provided by the present application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration but not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0215] The technical features of the above embodiments can be combined in any way. In order to make the description simple, not all possible combinations of the technical features in the above embodiments are described, but as long as the combinations of the technical features do not exist, they should be considered as the scope of the present application.

[0216] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent. It should be pointed out that for ordinary skilled in the art, without departing from the concept of the present application, some modifications and improvements can be made, which are all within the scope of the present application. Therefore, the scope of the patent of the present application should be subject to the appended claims.

Claims

1. A credit platform data collection method, characterized in that, The credit platform data collection method comprises: receiving a service request of a credit product, and performing permission verification on the service request of the credit product; after the permission verification is passed, selecting a corresponding supplier according to a supplier selection strategy between the credit product and the supplier, determining a corresponding supplier interface according to the credit product and the selected supplier, and performing multi-dimensional fusing on the supplier interface; obtaining an input parameter configuration of the supplier interface, defining a supplier interface parameter name and a corresponding data acquisition input item in the input parameter configuration, and inputting the supplier interface parameter name and the data acquisition input item into a data acquisition platform, and returning a service parameter value through the data acquisition platform; determining a corresponding data source according to a valid period of the credit product and the service parameter value, obtaining service data from the data source, and publishing the service data to middleware; wherein the supplier selection strategy comprises a default supplier strategy, a priority supplier strategy, a decision flow supplier strategy and a business flow supplier strategy; the multi-dimensional fusing on the supplier interface comprises: based on a non-relational database count, at least two dimensions of the supplier interface and the supplier interface + scene identification are fused; the inputting of the supplier interface parameter name and the data acquisition input item into the data acquisition platform and the returning of the service parameter value through the data acquisition platform comprises: inputting the supplier interface parameter name and the data acquisition input item into the data acquisition platform; the data acquisition platform returns the service parameter value of the credit product this time and the request time of the credit product this time by calculation; obtaining the service parameter value of the credit product last time and the request time of the credit product last time; the determination of the corresponding data source according to the valid period of the credit product and the service parameter value comprises: judging whether the service parameter value of the credit product this time is consistent with the service parameter value of the credit product last time, and whether the request time of the credit product this time minus the request time of the credit product last time is less than or equal to the valid period of the credit product; if the service parameter value of the credit product this time is consistent with the service parameter value of the credit product last time, and the request time of the credit product this time minus the request time of the credit product last time is less than or equal to the valid period of the credit product, the data source of the credit product is obtained from the object storage service cache; if the service parameter value of the credit product this time is inconsistent with the service parameter value of the credit product last time, or the request time of the credit product this time minus the request time of the credit product last time is greater than the valid period of the credit product, the data source of the credit product is obtained from the supplier.

2. The credit platform data collection method of claim 1, wherein, the permission verification on the service request of the credit product comprises: authenticating the credit product and its corresponding scene identification; throttling the service request of the credit product.

3. The credit platform data collection method of claim 1, wherein, before the corresponding supplier is selected according to the supplier selection strategy between the credit product and the supplier, further comprising: establishing a default supplier strategy; establishing different priority supplier strategies according to different service factors of the supplier interface; establishing a decision flow supplier strategy according to a decision logic; A service flow provider strategy is established according to a service content.

4. The credit platform data collection method of claim 1, wherein, The publishing of the service data to the middleware comprises: determining an object storage service cache path of the service data of the credit product; publishing the object storage service cache path of the service data of the credit product to the middleware.

5. A credit platform data collection system implementing the credit platform data collection method of any one of claims 1-4, characterized by, The credit platform data collection system comprises: a permission verification module configured to perform permission verification on the service request of the credit product; a provider strategy module configured to select a corresponding provider according to a provider selection strategy between the credit product and the provider, and to determine a corresponding provider interface according to the credit product and the selected provider; a fuse module configured to perform multi-dimensional fusing on the provider interface; a data processing module configured to acquire an input parameter configuration of the provider interface, define a provider interface parameter name and a corresponding data acquisition input item in the input parameter configuration, and input the provider interface parameter name and the data acquisition input item into a data acquisition platform, and return a service parameter value through the data acquisition platform; a service data module configured to determine a corresponding data source according to a validity period of the credit product and the service parameter value, acquire service data from the data source, and publish the service data to the middleware.

6. A computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor implements the steps of the method in any one of claims 1-4 when executing the computer program.

7. A computer-readable storage medium, characterized in that: The computer readable storage medium stores a program, and when the program is executed by the processor, the processor executes the steps of the method in any one of claims 1-4.

Images