Capability measurement evaluation method used in financial service scene
Through a multi-level evaluation system combining network connectivity, metadata consistency and user feedback, the biased problem of interface capability evaluation in financial business scenarios is solved, comprehensive and accurate evaluation and continuous improvement of interface capability are achieved, and the stability of the system is improved. and user experience.
Patent Information
- Application Number
- CN202411248385.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-06
- Publication Date
- 2024-11-29
AI Technical Summary
It is difficult for the existing technology to comprehensively evaluate the comprehensive capabilities of the interface in financial business scenarios, resulting in biased measurement scores and inability to accurately reflect the actual situation of the interface.
Adopt a multi-level evaluation system, combining network connectivity monitoring, metadata consistency comparison, statistical analysis of capability use and user feedback, and through the combination of automation and manual review, a full life cycle management evaluation plan is built, multi-dimensional data is deeply explored, and detailed generation is generated. quality inspection report.
It realizes accurate evaluation of interface capabilities, improves the accuracy and comprehensiveness of evaluation, promotes continuous improvement of services and user experience, and ensures efficient coordination and maintainability of the system.
Smart Images

Figure CN119046119A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of capability measurement and evaluation, and in particular to a capability measurement and evaluation method for use in a financial business scenario. Background Art
[0002] In today's rapidly changing digital age, the financial industry is at a critical juncture full of challenges and opportunities. In the financial business scenario, facing the fragmentation problem and comprehensive scheduling challenges that are particularly prominent in banking business, it is necessary to conduct quantitative evaluations of the stability, availability, reusability and other aspects of the capabilities that are continuously developed and put into use to ensure efficient collaborative work of the system, provide convenience for development docking, ensure smooth docking, secure interaction and stable operation between various capabilities, significantly enhance the maintainability and flexibility of the system, and provide a certain data basis for optimization, troubleshooting and decision support.
[0003] Interface capability measurement and unified evaluation are direct responses to the demand for efficient, secure, and reliable interaction between systems in the context of the rapid development of information technology, involving all-round considerations from technology implementation to management systems. Building a unified evaluation system that integrates the above multi-dimensional indicators to form comparable and traceable measurement results is the key to improving the overall IT governance level. Clear evaluation standards, measurement methods, and reporting mechanisms need to be established.
[0004] The capability measurement and evaluation in financial business scenarios is mainly based on interface performance, including response time, throughput, concurrent processing capability, and resource utilization. At the same time, by simulating high-load scenarios, it is ensured that the interface can provide stable services in actual deployment to avoid becoming a system bottleneck. On the other hand, it is to measure the performance of the interface under abnormal conditions, such as error rate, fault recovery speed, and service level agreement (SLA) compliance. A sound monitoring and logging mechanism is required to quickly locate and solve problems.
[0005] The current technical solution has certain limitations, focusing only on the three independent dimensions of performance evaluation, system stability and reliability, and the improvement suggestions and feedback provided are therefore relatively one-sided. Because a systematic and unified evaluation framework has not yet been formed, the final measurement score is inevitably biased and cannot fully reflect the comprehensive capabilities of the interface.
[0006] When choosing a suitable interface measurement and evaluation mechanism, it is necessary to comprehensively consider factors such as the specific capability situation. Each capability has its applicable scenarios and limitations. Therefore, it is crucial to design a capability life cycle management evaluation plan from capability design, capability assessment quality inspection to capability reuse evaluation and make appropriate selections and evaluations. Summary of the invention
[0007] The purpose of the present invention is to provide a capability measurement and evaluation method for financial business scenarios, which can comprehensively consider the three core indicators of capability quality, capability inspection effectiveness and user feedback, build a multi-level evaluation system, and deeply mine multi-dimensional data such as service availability, call volume, user feedback content and special surveys.
[0008] In order to achieve the above object, the technical solution adopted by the present invention is: a capability measurement and evaluation method for a financial business scenario, comprising the following steps:
[0009] Step 1: Monitor network connectivity in real time, use network diagnostic tools to evaluate the responsiveness of the interface IP and port, ensure the availability and stability of the interface, continuously verify the accessibility and response speed of the service, and ensure unimpeded information flow;
[0010] Step 2: Perform intelligent metadata consistency comparison, develop automated scripts, periodically review metadata, compare the consistency of program API parameters and document registration API parameters, promptly discover and correct data inconsistencies, maintain the accuracy and integrity of data structures, and ensure the accuracy and consistency of parameter information;
[0011] Step 3: Conduct capability usage statistics and analysis by deploying sophisticated data collection and analysis application services, monitoring and statistical API access trends, analyzing user behavior and needs, and deeply mining usage patterns to provide a basis for capability optimization, optimize resource allocation, and improve service efficiency;
[0012] Step 4: Customized quality inspection reports are automatically generated, summarizing the test results to generate detailed quality inspection reports, providing intuitive basis for decision-making and accelerating the problem identification and resolution process.
[0013] Preferably, the evaluation method further includes step 5, combining manual review with an automated scheduled inspection mechanism to achieve all-round monitoring of deployed capabilities.
[0014] Preferably, the evaluation method further includes step 6, designing and implementing an intelligent questionnaire survey program to promote effective participation of capability users, and accurately capturing users' actual feelings and needs through a refined scoring mechanism.
[0015] Preferably, the real-time monitoring of network connectivity in step 1 includes the following steps:
[0016] Step 11: Data collection: Through the monitoring agent deployed on the network node, network traffic, packet loss rate, and delay data can be collected periodically or manually in real time;
[0017] Step 12: Perform network diagnosis and use network diagnostic tools to continuously monitor the responsiveness of the IP and port of the target interface;
[0018] Step 13: When an anomaly is detected, a fault recovery strategy is automatically triggered;
[0019] Step 14: Perform visual display and provide a graphical interface to display the network health status in real time.
[0020] Preferably, the fault recovery strategy in step 13 includes switching a backup path or restarting the network service.
[0021] Preferably, performing intelligent comparison of metadata consistency in step 2 includes the following steps:
[0022] Step 21: Perform data collection and periodically capture metadata in the system through automated scripts;
[0023] Step 22: Perform consistency comparison to compare metadata from different sources and identify parameter differences;
[0024] Step 23: Perform difference analysis and use a deep learning model to analyze the cause of the difference to determine whether it is a real error or an acceptable version difference;
[0025] Step 24: Perform intelligent correction, and automatically trigger the correction process for the identified errors to fix the metadata inconsistency problem;
[0026] Step 25: Provide feedback on the results and generate a detailed comparison report for the administrator to review.
[0027] Preferably, in step 21, metadata in the system including program API parameters and document registration API parameters are periodically captured by an automated script.
[0028] Preferably, in step 22, a hash algorithm is used to compare metadata from different sources.
[0029] Preferably, the comparison report in step 25 includes a difference list, analysis results and processing suggestions.
[0030] Preferably, the step 4 includes the following steps:
[0031] Step 41: Collect data by performing capability quality inspection, metadata comparison and statistical access information to collect various test result data;
[0032] Step 42: Perform data analysis, using data mining techniques to clean, integrate and analyze the collected data to identify trends, anomalies and potential problems;
[0033] Step 43: Customize the report. The user selects the specific indicators, time range, and analysis dimensions to be included in the report through the interface. The system generates a customized report based on the user's needs.
[0034] Step 44: Generate a report. The system uses natural language generation (NLG) technology to convert data analysis results into human-readable text descriptions, combined with charts and key indicators to form a complete quality inspection report.
[0035] Step 45: Distribute the report. The automatically generated quality inspection report is automatically sent to the relevant person in charge via email, corporate intranet or other designated channels.
[0036] The beneficial effects of the present invention are:
[0037] In order to solve the limitation of the current single capability measurement and evaluation method, this solution comprehensively considers the three core indicators of capability quality, capability inspection effectiveness and user feedback, and constructs a multi-level evaluation system with specific evaluation criteria to deeply mine multi-dimensional data such as service availability, call volume, user feedback content and special surveys. Using this system to drive continuous improvement will not only promote the dual improvement of evaluation accuracy and technological cutting-edge, but also help the high-quality development of products and application scenario services, and achieve close coordination and efficiency leaps in scientific and technological businesses. The present invention strives to establish a closed-loop capability assessment ecosystem, provide comprehensive visual analysis and strategy guidance, and ensure the continuous iteration and forward-looking development of services.
[0038] This invention aims to systematically build a set of all-round, three-dimensional capability interaction and unified quantitative evaluation models, realize the comprehensiveness and three-dimensionality of capability interaction, and promote efficient collaboration and sharing of internal resources. By establishing a rigorous and forward-looking capability value scoring system, we can ensure that core capabilities are accurately quantified and follow high-level management guidelines, fundamentally enhancing overall effectiveness and team collaboration efficiency.
[0039] This solution builds an intelligent quality inspection platform that integrates manual and automatic inspection capabilities, and implements in-depth control of capability quality through means such as network connectivity verification, metadata consistency check, and usage analysis. A user-participated questionnaire and scoring mechanism is established to directly collect docking and usage experience feedback, and combined with data analysis technology, a direct linkage from user feedback to product optimization is formed to accelerate service upgrades and iterations. By continuously collecting and analyzing user feedback, the present invention promotes the self-evolution of capabilities, ensuring that it can quickly respond to changes in the market and user needs, and maintain the foresight and competitiveness of services. An original and multi-faceted evaluation system covering capability quality, docking efficiency, user experience, etc. is designed to achieve a comprehensive and accurate evaluation of capability performance and guide the direction of continuous improvement.
[0040] Through this technical solution, the present invention not only realizes multi-angle and multi-level evaluation of capabilities, but also promotes closed-loop interaction between user feedback and product iteration, ensuring the continuous evolution of the capabilities provided and accurately matching the ever-changing needs of the market and users, thereby maintaining a leading position in a highly competitive environment. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0042] Figure 1 The figure is an overall flow chart of capability measurement evaluation of the present invention.
[0043] Figure 2 A real-time viewing schematic diagram is provided for visualizing the capability availability of the present invention.
[0044] Figure 3 This is a metadata comparison and verification flow chart of the present invention.
[0045] Figure 4 It is a schematic diagram of the capability statistics interaction process of the present invention.
[0046] Figure 5 A schematic diagram is generated for the capability report of the present invention.
[0047] Figure 6 It is a schematic diagram of capability feedback evaluation of the present invention. DETAILED DESCRIPTION
[0048] The present invention is further described in detail below in conjunction with embodiments and with reference to the accompanying drawings.
[0049] The present invention discloses a capability measurement and evaluation method for a financial business scenario. The capability measurement and evaluation method aims to comprehensively evaluate the quality of capabilities through a series of detection methods. The detection methods include interface availability, metadata consistency, statistics and measurability. The technical solution of the present invention is implemented on the bank capability middle platform system. In the early stage, the middle platform is relied on to connect capabilities with various systems. By regularly evaluating the capabilities that have been put on the capability middle platform, potential problems are discovered, capability improvements are guided, the overall capability quality is improved, and the pace of innovation of the bank is accelerated.
[0050] like Figure 1 As shown, the embodiment includes the following steps:
[0051] Step 1: Monitor network connectivity in real time, use network diagnostic tools to evaluate the responsiveness of the interface IP and port, ensure the availability and stability of the interface, continuously verify the accessibility and response speed of the service, and ensure unimpeded information flow;
[0052] Step 2: Perform intelligent metadata consistency comparison, develop automated scripts, periodically review metadata, compare the consistency of program API parameters and document registration API parameters, promptly discover and correct data inconsistencies, maintain the accuracy and integrity of data structures, and ensure the accuracy and consistency of parameter information;
[0053] Step 3: Conduct capability usage statistics and analysis by deploying sophisticated data collection and analysis application services, monitoring and statistical API access trends, analyzing user behavior and needs, and deeply mining usage patterns to provide a basis for capability optimization, optimize resource allocation, and improve service efficiency;
[0054] Step 4: Customized quality inspection reports are automatically generated, summarizing various test results to generate detailed quality inspection reports, providing intuitive basis for decision-making and accelerating the problem identification and resolution process;
[0055] Step 5: Combine manual review with automated scheduled inspection mechanisms to achieve full monitoring of deployed capabilities.
[0056] Step 6: Design and implement an intelligent questionnaire survey program to promote the effective participation of capability users and accurately capture users’ actual feelings and needs through a refined scoring mechanism.
[0057] like Figure 2 As shown, the real-time monitoring of network connectivity in step 1 includes the following steps:
[0058] Step 11: Data collection: Through the monitoring agent deployed on the network node, network traffic, packet loss rate, and delay data can be collected periodically or manually in real time;
[0059] Step 12: Perform network diagnosis and use network diagnostic tools such as ping and traceroute to continuously monitor the responsiveness of the target interface's IP and port;
[0060] Step 13: When an anomaly is detected, a fault recovery strategy is automatically triggered, including switching to an alternate path or restarting the network service;
[0061] Step 14: Perform visual display and provide a graphical interface to display the network health status in real time for easy monitoring.
[0062] like Figure 3 As shown, the metadata consistency intelligent comparison in step 2 includes the following steps:
[0063] Step 21: Perform data collection, and periodically capture metadata in the system through automated scripts, including but not limited to program API parameters, document registration API parameters, etc.;
[0064] Step 22: Perform consistency comparison, using a hash algorithm or other data comparison algorithm to compare metadata from different sources and identify parameter differences;
[0065] Step 23: Perform difference analysis and use a deep learning model to analyze the cause of the difference to determine whether it is a real error or an acceptable version difference;
[0066] Step 24: Perform intelligent correction, and automatically trigger the correction process for the identified errors to fix the metadata inconsistency problem;
[0067] Step 25: Provide feedback on the results and generate a detailed comparison report, including a list of differences, analysis results, and processing suggestions for the administrator to review.
[0068] like Figure 4 As shown, pull the capabilities to be counted to obtain a list of capabilities to be counted. Figure 4 1.1; Whether the acceptance capability can be statistically verified, the acceptance capability can be statistically verified, see Figure 4 2.1; Accept the ability to count the number of visits, accept the ability to count the number of visits, see Figure 4 Chinese 4.1.
[0069] like Figure 5 As shown, step 4 includes the following steps:
[0070] Step 41: Collect data by performing capability quality inspection, metadata comparison and statistical access information to collect various test result data;
[0071] Step 42: Perform data analysis, using data mining techniques to clean, integrate and analyze the collected data to identify trends, anomalies and potential problems;
[0072] Step 43: Customize the report. The user selects the specific indicators, time range, and analysis dimensions to be included in the report through the interface. The system generates a customized report based on the user's needs.
[0073] Step 44: Generate a report. The system uses natural language generation (NLG) technology to convert data analysis results into human-readable text descriptions, combined with charts and key indicators to form a complete quality inspection report.
[0074] Step 45: Distribute the report. The automatically generated quality inspection report is automatically sent to the relevant person in charge via email, corporate intranet or other designated channels.
[0075] like Figure 6As shown, in step 5, manual review and automated scheduled inspection mechanisms are combined to achieve all-round monitoring of deployed capabilities, ensuring that each service reaches the industry's top level in terms of stability, reliability and user experience, creating a trustworthy service environment for users. The weight of capabilities is calculated through multi-dimensional data such as capability usage docking steps, usage scenarios, interface availability, metadata consistency, access statistics, and the number of capability users, guiding the platform to improve capability quality.
[0076] In order to ensure a comprehensive and in-depth assessment of capabilities in step 6, the present invention adopts an innovative comprehensive feedback technology solution in the capability evaluation stage. The solution aims to accurately measure and optimize capability performance through three key dimensions: the "capability search index", "connection experience" and "usage experience" put into use.
[0077] Specifically, by designing and implementing an intelligent questionnaire survey program, the program not only promotes the effective participation of capability users, but also accurately captures the actual feelings and needs of each user through a refined scoring mechanism. The questionnaire has been carefully constructed to cover a wide range of topics from the convenience of technical docking to the fluency of actual operations, ensuring that the collected data is comprehensive and representative.
[0078] In addition, this solution also integrates data analysis technology to conduct in-depth mining of collected feedback to identify performance bottlenecks and room for improvement in user experience. This data-driven approach can intuitively identify trends, quantify improvement effects, and formulate optimization strategies that better meet user expectations.
[0079] It should be noted that the parts not described in detail in the above embodiments are all prior art.
[0080] The above description is only a preferred embodiment of the present invention and does not constitute any form of limitation to the present invention. Although the present invention has been disclosed as a preferred embodiment as above, it is not intended to limit the present invention. Any technician familiar with the profession can make some changes or modifications to equivalent embodiments of equivalent changes using the technical contents disclosed above without departing from the scope of the technical solution of the present invention. However, any simple modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention without departing from the content of the technical solution of the present invention should be covered within the protection scope of the present invention.
Claims
1. A capability measurement and evaluation method for financial business scenarios, characterized by: The following steps are involved: Step 1: Monitor network connectivity in real time, use network diagnostic tools to evaluate the responsiveness of the interface IP and port, ensure the availability and stability of the interface, continuously verify the accessibility and response speed of the service, and ensure unimpeded information flow; Step 2: Perform intelligent metadata consistency comparison, develop automated scripts, periodically review metadata, compare the consistency of program API parameters and document registration API parameters, promptly discover and correct data inconsistencies, maintain the accuracy and integrity of data structures, and ensure the accuracy and consistency of parameter information; Step 3: Conduct capability usage statistics and analysis by deploying sophisticated data collection and analysis application services, monitoring and statistical API access trends, analyzing user behavior and needs, and deeply mining usage patterns to provide a basis for capability optimization, optimize resource allocation, and improve service efficiency; Step 4: Customized quality inspection reports are automatically generated, summarizing the test results to generate detailed quality inspection reports, providing intuitive basis for decision-making and accelerating the problem identification and resolution process.
2. The capability measurement and evaluation method for a financial business scenario according to claim 1, characterized in that: It also includes step 5, combining manual review with an automated scheduled inspection mechanism to achieve all-round monitoring of deployed capabilities.
3. The capability measurement and evaluation method for a financial business scenario according to claim 2 is characterized in that: It also includes step 6, designing and implementing intelligent questionnaire survey programs to promote the effective participation of capability users and accurately capture users' actual feelings and needs through a refined scoring mechanism.
4. The capability measurement and evaluation method for a financial business scenario according to claim 1, characterized in that: The real-time monitoring of network connectivity in step 1 includes the following steps: Step 11: Data collection: Through the monitoring agent deployed on the network node, network traffic, packet loss rate, and delay data can be collected periodically or manually in real time; Step 12: Perform network diagnosis and use network diagnostic tools to continuously monitor the responsiveness of the IP and port of the target interface; Step 13: When an anomaly is detected, a fault recovery strategy is automatically triggered; Step 14: Perform visual display and provide a graphical interface to display the network health status in real time.
5. The capability measurement and evaluation method for a financial business scenario according to claim 4, characterized in that: The fault recovery strategy in step 13 includes switching a backup path or restarting the network service.
6. The capability measurement and evaluation method for a financial business scenario according to claim 1, characterized in that: The metadata consistency intelligent comparison in step 2 includes the following steps: Step 21: Perform data collection and periodically capture metadata in the system through automated scripts; Step 22: Perform consistency comparison to compare metadata from different sources and identify parameter differences; Step 23: Perform difference analysis and use a deep learning model to analyze the cause of the difference to determine whether it is a real error or an acceptable version difference; Step 24: Perform intelligent correction, and automatically trigger the correction process for the identified errors to fix the metadata inconsistency problem; Step 25: Provide feedback on the results and generate a detailed comparison report for the administrator to review.
7. The capability measurement and evaluation method for a financial business scenario according to claim 6, characterized in that: In step 21, metadata in the system including program API parameters and document registration API parameters are periodically captured through an automated script.
8. The capability measurement and evaluation method for a financial business scenario according to claim 6, characterized in that: In step 22, a hash algorithm is used to compare metadata from different sources.
9. The capability measurement and evaluation method for a financial business scenario according to claim 6, characterized in that: The comparison report in step 25 includes a difference list, analysis results and processing suggestions.
10. The capability measurement and evaluation method for a financial business scenario according to claim 1, characterized in that: The step 4 includes the following steps: Step 41: Collect data by performing capability quality inspection, metadata comparison and statistical access information to collect various test result data; Step 42: Perform data analysis, using data mining techniques to clean, integrate and analyze the collected data to identify trends, anomalies and potential problems; Step 43: Customize the report. The user selects the specific indicators, time range, and analysis dimensions to be included in the report through the interface. The system generates a customized report based on the user's needs. Step 44: Generate a report. The system uses natural language generation (NLG) technology to convert data analysis results into human-readable text descriptions, combined with charts and key indicators to form a complete quality inspection report. Step 45: Distribute the report. The automatically generated quality inspection report is automatically sent to the relevant person in charge via email, corporate intranet or other designated channels.
