Construction method and device of development capability map, equipment, medium and product

Abstract

The invention discloses a construction method and device of a development capability map, equipment, a medium and a product. The construction method comprises the following steps: collecting plug-in tools related to target capability, and packaging to generate a development capability package; a matched language environment is loaded, the development capability package is operated in the language environment, and the development capability package which passes operation is obtained; performing quality scoring on the development capability package by adopting a pre-constructed quality evaluation model to obtain a quality score of the development capability package; when the quality score is greater than a preset score threshold value, issuing the development capability package to a development capability map; wherein the development capability map is used for providing storage and downloading of a development capability package. According to the method, convenient and expansible function selection can be provided for a demander of a personalized operation and maintenance scene, and the personalized customization requirement of a user is met.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to a method, apparatus, device, medium, and product for constructing a capability map. Background Technology

[0002] With the rapid development of current business, the use of technologies such as containers and microservices under cloud-native architecture has made the software architecture more refined and flexible, which can improve the response speed and iteration speed of business needs. However, the complexity of the software architecture has increased significantly, personalized operation and maintenance needs have continued to increase, and new risks and failures have become more and more common.

[0003] Operations and maintenance scenarios refer to specific business scenarios formed around specific operations and maintenance objectives and combined with specific technical environments during the process of IT infrastructure and business support, which need to be implemented through development capability packages. Current solutions typically only build corresponding development capability packages for specific operations and maintenance scenarios, resulting in low utilization rates of development capability packages and difficulty in supporting in-depth customer customization needs. Summary of the Invention

[0004] The purpose of this invention is to provide a method, apparatus, device, medium, and product for constructing a development capability map, which can provide convenient and scalable functional options for users with personalized operation and maintenance scenarios, and meet users' personalized customization needs.

[0005] To achieve the above objectives, embodiments of the present invention provide a method for constructing a development capability map, comprising: Collect plugin tools related to the target capabilities and package them into a development capability package; Load the matching language environment, run the development capability package in the language environment, and obtain the successfully run development capability package; The development capability package is scored using a pre-built quality evaluation model to obtain its quality score. When the quality score is greater than a preset score threshold, the development capability package is published to the development capability map; wherein, the development capability map is used to provide storage and download of the development capability package.

[0006] As an improvement to the above solution, the step of using a pre-built quality evaluation model to score the development capability package and obtain a quality score for the development capability package includes: Determine several quality evaluation indicators for the development capability package; Based on the test results of the multi-scenario test of the development capability package, calculate the quantitative value of each of the quality evaluation indicators of the development capability package; The quantitative values ​​of the quality evaluation indicators are standardized using a preset data standardization method to obtain the standardized values ​​of the quality evaluation indicators. Calculate the weighting coefficient for each of the aforementioned quality evaluation indicators; The quality score of the development capability package is calculated using a weighted summation method based on the standardized value and the weighting coefficient.

[0007] As an improvement to the above scheme, the calculation of the weighting coefficient for each of the quality evaluation indicators includes: Using the consistent matrix method, based on a preset importance scaling rule, all the quality evaluation indicators are compared pairwise to generate an indicator comparison matrix; wherein, the importance scaling rule is used to quantify the importance comparison result between two elements; The index comparison matrix is ​​normalized to obtain the feature vector of each quality evaluation index. Based on the feature vector of each quality evaluation indicator, a weight coefficient for each quality evaluation indicator is generated.

[0008] As an improvement to the above solution, the quality evaluation indicators include compatibility, functionality, stability, ease of use, and security.

[0009] As an improvement to the above solution, the step of publishing the development capability package to the development capability map includes: Obtain the description information of the development capability package; The development capability package and the description information are presented in a visual form and published to the development capability map.

[0010] As an improvement to the above solution, after publishing the development capability package to the development capability map, the method further includes: Using preset usage evaluation rules, the usage score of the development capability package is obtained by scoring the user's use of the development capability package. Compare the differences between the usage score and the quality score; Based on the aforementioned differences, the quality evaluation model is optimized.

[0011] As an improvement to the above solution, the step of adopting preset usage evaluation rules to score the user's use of the development capability package and obtain a usage score for the development capability package includes: Determine several usage evaluation indicators for the development capability package; Based on the user's usage of the development capability package, calculate the score for each of the usage evaluation metrics of the development capability package; The usage score of the development capability package is calculated based on the score of each of the aforementioned usage evaluation indicators.

[0012] This invention also provides an apparatus for constructing a development capability map, comprising: The development capability package generation module is used to collect plug-in tools related to the target capability and encapsulate them to generate a development capability package. The language environment execution module is used to load the matching language environment, run the development capability package in the language environment, and obtain the successfully executed development capability package; The quality scoring module is used to score the development capability package using a pre-built quality evaluation model to obtain the quality score of the development capability package. A development capability map construction module is used to publish the development capability package to the development capability map when the quality score is greater than a preset score threshold; wherein, the development capability map is used to provide storage and download of the development capability package.

[0013] This invention also provides a development capability map construction device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, it implements the development capability map construction method as described in any of the above embodiments.

[0014] This invention also provides a computer-readable storage medium, which includes a stored computer program, wherein the computer program, when running, controls the device where the computer-readable storage medium is located to execute the development capability map construction method as described in any of the above embodiments.

[0015] This invention also provides a computer program product, which includes a computer program or computer instructions. When the computer program or computer instructions are executed by a processor, they implement the method for constructing a development capability map as described in any of the above embodiments.

[0016] Compared with existing technologies, the development capability map construction method, apparatus, equipment, medium, and product disclosed in this invention conduct preliminary experimental testing and pre-set quality evaluation model reviews on rapidly constructed development capability packages. Successfully executed and reviewed development capability packages are published to the development capability map for capability reference, allowing users to download or call the required development capability packages within the map, thus enabling customization of personalized operation and maintenance scenarios. This invention provides convenient and scalable functional options for users requiring personalized operation and maintenance scenarios, offering query and call functionality in a map mode to meet users' ordering and capability output needs. It satisfies users' personalized self-service needs and out-of-the-box time-saving requirements, while enabling capability reuse, reducing developer investment, effectively achieving cost reduction and efficiency improvement, and quickly meeting personalized operation and maintenance needs. Attached Figure Description

[0017] Figure 1 This is a schematic diagram illustrating the steps of a method for constructing a development capability map according to an embodiment of the present invention; Figure 2 This is a schematic diagram of the development capability map construction process in an embodiment of the present invention; Figure 3 This is a schematic diagram illustrating the process of generating the capability package and running the environment in an embodiment of the present invention; Figure 4 This is a schematic diagram of a development capability map construction device provided in an embodiment of the present invention. Detailed Implementation

[0018] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0019] In the description of this application, it should be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this application.

[0020] The terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0021] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection between two components. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0022] See Figure 1 This is a schematic diagram illustrating the steps of a method for constructing a development capability map according to an embodiment of the present invention. The embodiment of the present invention provides a method for constructing a development capability map, including steps S11 to S14: S11. Collect plug-in tools related to the target capabilities and encapsulate them to generate a development capability package; S12. Load the matching language environment, run the development capability package in the language environment, and obtain the successfully run development capability package; S13. Use a pre-built quality evaluation model to score the development capability package and obtain the quality score of the development capability package; S14. When the quality score is greater than a preset score threshold, the development capability package is published to the development capability map; wherein, the development capability map is used to provide storage and download of the development capability package.

[0023] See Figure 2 This is a schematic diagram of the construction process of the development capability map in an embodiment of the present invention. In this embodiment of the present invention, through the review and registration of development capability packages, the rapidly constructed development capability packages undergo strict review through online review, experimental testing, etc. Only after passing the review can they be provided to the agile platform for capability reference. The referenced capabilities are stored in the development capability map, and the various capabilities in the development capability map are displayed in a visual way, so that capability users can download or call the relevant capabilities in the development capability map for use.

[0024] See Figure 3This is a flowchart illustrating the generation and operation of the development capability package in this embodiment of the invention. Enterprises or developers receive various external operation and maintenance plugins, identify and categorize them, and then package them into development capability packages. The packaged capability development package has not yet been reviewed and approved by the development capability map. Therefore, an online environment is needed to test and run the capability development package to verify that the capabilities to be listed comply with the supermarket rules and are ready for immediate use by users. Therefore, before submitting the development capability package for review, an online development environment compatible with mainstream technologies is assembled for its operation and acceptance.

[0025] As illustrated in the diagram, the development environment testing area supports the selection of language environments, including built-in Java, Python, Shell, and JavaScript front-end language stacks. At the initial stage, various types of capabilities are uploaded. Capability uploads identify their respective language environments and match the capability's runtime environment through a self-service language mode download. After downloading, the language environment is loaded to ensure that the uploaded capabilities can run in the loaded language environment and reflect the capability's current status. Running the uploaded capabilities in the development environment testing area provides a clear demonstration of the capability's current shortcomings and strengths. This provides a basis for subsequent capability review and registration, and offers proof of capability expansion performance and practical test cases.

[0026] Taking database performance monitoring capabilities as an example, we encapsulate scattered operation and maintenance plugins into a standardized capability package and verify its feasibility through environmental testing. First, technical personnel collect scattered plugins related to database performance monitoring, including CPU usage monitoring scripts and memory usage analysis tools, and encapsulate them into a "database performance monitoring capability package." Next, in the development environment testing area, a suitable language environment is selected. Since this capability package depends on Python, a Python language environment is downloaded and loaded. After loading, the capability package is run in this environment to simulate high database load scenarios, testing its ability to accurately collect metrics such as CPU, memory, and disk I / O. Simultaneously, it checks for runtime errors, data latency, and other issues, ultimately generating a test report proving that the capability package runs normally and meets performance standards.

[0027] Furthermore, development capability packages based on the test area of ​​the development environment need to be reviewed. Once approved, they are officially released on the development capability map marketplace. The review process utilizes an algorithmic model, or evaluation model, to quantitatively score the development capability packages to be deployed, obtaining a quality score to assess their suitability for deployment. When the quality score of a development capability package exceeds a preset threshold, it is considered to have passed the review and is ready for deployment. Finally, the approved development capability packages are officially released on the development capability map, allowing users to easily search for and download the required capabilities, enabling customization for personalized operation and maintenance scenarios.

[0028] Using the technical means of this invention, rapidly built development capability packages need to undergo preliminary experimental testing and review by a preset quality evaluation model. Successfully running and approved development capability packages are then published to a development capability map for reference, allowing users to download or call the required packages from the map, thus enabling customization of personalized operation and maintenance scenarios. This invention provides convenient and scalable functional options for users with personalized operation and maintenance needs, offering query and call functionality in a map mode. It satisfies users' ordering and capability output needs, meets their personalized self-service requirements and out-of-the-box time-saving requirements, and enables capability reuse, reducing developer investment and effectively achieving cost reduction, efficiency improvement, and rapid fulfillment of personalized operation and maintenance needs.

[0029] As a preferred embodiment, the present invention further implements the above embodiments. Step S13, namely, using a pre-built quality evaluation model to score the quality of the development capability package and obtain the quality score of the development capability package, includes steps S131 to S135: S131. Determine several quality evaluation indicators for the development capability package; S132. Based on the test results of the multi-scenario test of the development capability package, calculate the quantitative value of each of the quality evaluation indicators of the development capability package; S133. The quantitative values ​​of the quality evaluation indicators are standardized using a preset data standardization method to obtain the standardized values ​​of the quality evaluation indicators. S134. Calculate the weight coefficient for each of the quality evaluation indicators. S135. The quality score of the development capability package is calculated by weighted summation based on the standardized value and the weighting coefficient.

[0030] In this embodiment of the invention, N quality evaluation indicators for the development capability package are determined based on actual application scenarios. The development capability package is then tested under various operation and maintenance scenarios. Based on the test results, the quantitative value of each of the quality evaluation indicators for the development capability package is determined. Furthermore, the quantitative values ​​of each quality evaluation indicator are standardized to obtain standardized values. Simultaneously, based on the importance of each quality evaluation indicator, a weighting coefficient for each indicator is determined. Finally, based on the standardized value and weighting coefficient of each quality evaluation indicator, a weighted summation method is used to calculate the quality score of the development capability package. .

[0031] Preferably, based on the software functional quality evaluation system, the quality evaluation indicators include compatibility, functionality, stability, ease of use, and security.

[0032] It should be noted that the quantitative value of each of the aforementioned quality evaluation indicators... It is necessary to combine the needs of operation and maintenance scenarios and collect and determine the data through objective methods such as scenario-based testing and verification, functional test statistics, and user operation feedback.

[0033] The compatibility of the development capability package can be characterized by the number of systems, languages, and device types it supports, such as the types of mainstream databases, programming languages, and target devices. Functionality can be characterized by the number of core operational functions implemented, such as the coverage of key functions like monitoring, automated operation, alarms, and data export. Stability can be characterized by continuous fault-free operation time and fault recovery time. Usability can be characterized by the time required for user setup and the number of operation steps. Security can be characterized by the number of security protection measures and the data encryption level, such as whether it supports access control, transmission encryption, and vulnerability detection.

[0034] As an example, the quantitative value of each of the aforementioned quality evaluation indicators is determined as follows: The compatibility metrics are based on actual measurements within the adaptation range to determine the original data (i.e., quantified values). The core of the compatibility metrics is to measure the adaptability of the capability package to mainstream systems, languages, and devices in the operation and maintenance scenario. The original data is obtained through statistical analysis of actual adaptation tests. Specifically, the core adaptation objects in the operation and maintenance scenario are identified: including mainstream programming languages ​​(such as Java, Python, Shell, and JS front-end languages), target devices / systems (such as hosts, databases, storage, and network devices), and underlying architecture (such as containerized environments). Adaptation tests are performed on each capability package: the capability package is deployed and run in the real environments of the above-mentioned objects to verify whether it can be normally compatible (e.g., the database monitoring capability package is tested to adapt to databases such as MySQL and Oracle, and the programming language capability package is tested to adapt to environments such as Python and Shell). The number of successfully adapted objects is counted as the original data: for example, if a capability package successfully adapts to 3 programming languages, 2 types of databases, and 1 type of network device, then the original compatibility data x is calculated. j =6 (total number of compatible objects).

[0035] The functional metrics are based on actual measurements of core function coverage to determine the raw data. These metrics focus on whether the capability package meets core operational needs. The raw data is determined through functional point testing and statistics. Specifically: First, clarify the core functional requirements of the operational scenario: Combined with the operational capability reuse goals, determine the key functions that this type of capability package must cover (e.g., monitoring capabilities must include "real-time data collection, anomaly alarms, and historical data queries," while automation capabilities must include "one-click deployment and automatic fault recovery"). Test and verify the functionality of each capability package: By simulating real operational scenarios (e.g., high load, fault-triggered scenarios), test whether the capability package can fully implement each core function (e.g., test whether the monitoring capability package can accurately trigger alarms and export historical data). Count the number of successfully implemented core functions as the raw data: For example, if a monitoring capability package needs to cover 4 core functions, and 3 are successfully implemented after testing, then the functional raw data is x. j =3.

[0036] The stability metrics are based on raw data determined through long-term operational testing. These metrics measure the ability of a capability package to operate continuously without failure. The raw data is collected through long-term, uninterrupted testing, specifically: A simulated operational stress environment is built: simulating high-concurrency, high-load scenarios in actual use (e.g., a database monitoring capability package simulating a data collection pressure of 1000 records / second); uninterrupted operation testing is conducted: the capability package runs continuously in this environment, recording whether any failures occur during operation (e.g., crashes, data loss, excessive response latency); the duration of continuous, fault-free operation is used as the raw data: for example, if a capability package runs continuously without failure for 72 hours, then the stability raw data x... j=72 (unit: hours); If one fault occurs during operation, and the fault-free period before the fault is 48 hours, then the original data x j =48.

[0037] The usability metrics are based on raw data determined through real-world user operation tests. These metrics focus on the user's learning curve, and the raw data is collected through actual user operation tests. Specifically, the following steps are taken: Selecting a typical user group: choosing users with basic operational skills (simulating actual users); Setting standardized operation tasks: such as completing the installation and deployment of a capability package, configuring one core function (e.g., monitoring indicator thresholds), and exporting one operational report; Recording user operation data: calculating the average time and number of steps required for users to complete the above standardized tasks, using the average time or number of steps as the raw data. For example, if the average time for 10 users to complete the configuration task is 10 minutes, then the usability raw data x j =10 (unit: minutes).

[0038] The security metrics are based on raw data determined by security protection testing. These metrics measure the risk control capabilities of the capability package. The raw data is determined through security vulnerability detection and protection measure verification. Specifically, the following methods are used: Define security testing dimensions: including data transmission encryption (e.g., whether SSL protocol is used), access control (e.g., whether role-based authorization is supported), and vulnerability protection (e.g., whether it can resist SQL injection and unauthorized access); conduct specialized security testing: using professional security tools (e.g., vulnerability scanning tools) or manual penetration testing to verify whether the capability package possesses the above security protection measures and whether high-risk vulnerabilities exist; count the number of effective security protection measures or the duration without high-risk vulnerabilities as raw data: for example, if a capability package possesses two effective protection measures—data encryption and access control—and no high-risk vulnerabilities are detected, then the raw security data is x. j =2 (number of protective measures).

[0039] Understandably, the quantitative values ​​of the above quality evaluation indicators are only examples. In actual application, they can be calculated according to the actual operation and maintenance scenario requirements, and no specific limitations are made here.

[0040] Furthermore, the evaluation model principle for the development capability package is as follows: based on the characteristics and operational requirements of the development capability package, an indicator evaluation system is first established, and then the evaluation indicators are standardized using the 0-1 standardization method. Finally, a method combining multiple weight coefficients is used to calculate the weight of each evaluation indicator for scoring, and the decision on whether to launch the development capability package is based on the score level.

[0041] Preferably, the step of standardizing the quantified values ​​of the quality evaluation indicators using a preset data standardization method to obtain standardized values ​​of the quality evaluation indicators includes: Determine the type of the quality evaluation index; wherein the index type includes positive indicators and negative indicators; When the quality evaluation indicator is a positive indicator, the quantitative value of the quality evaluation indicator is standardized using the first standardization formula to obtain the standardized value of the quality evaluation indicator:

[0042] When the quality evaluation indicator is a reverse indicator, the quantified value of the quality evaluation indicator is standardized using the second standardization formula to obtain the standardized value of the quality evaluation indicator:

[0043] It should be noted that positive indicators refer to those with larger quantitative values, which represent better indicator quality, while negative indicators refer to those with smaller quantitative values, which represent better indicator quality.

[0044] In a preferred embodiment, step S134, namely calculating the weighting coefficient of each of the quality evaluation indicators, includes: Using the consistent matrix method, based on a preset importance scaling rule, all the quality evaluation indicators are compared pairwise to generate an indicator comparison matrix; wherein, the importance scaling rule is used to quantify the importance comparison result between two elements; The index comparison matrix is ​​normalized to obtain the feature vector of each quality evaluation index. Based on the feature vector of each quality evaluation indicator, a weight coefficient for each quality evaluation indicator is generated.

[0045] In this embodiment of the invention, a consistent matrix method is employed, meaning that instead of comparing all quality evaluation indicators together, they are compared pairwise. A relative scale is used in this process to minimize the difficulty of comparing factors with different characteristics, thereby improving accuracy. The quality evaluation indicators are compared pairwise and ranked according to their importance. To illustrate the importance comparison results between element i and element j, Table 1 lists nine importance levels and their assigned values. The matrix formed by the pairwise comparison results is called the judgment matrix. The judgment matrix has the following properties:

[0046] Determine matrix elements The scaling method is as follows: Table 1 Scale Table

[0047] As an example, five quality evaluation indicators—compatibility, functionality, stability, ease of use, and security—are selected to evaluate the development capability package. These indicators can be expanded later based on actual needs. The pairwise comparison judgment matrix is ​​shown in Table 2. Table 2

[0048] Normalize the above matrix:

[0049] in, This is the sum of all columns.

[0050] The feature vectors of each indicator are shown in Table 3: Table 3

[0051] The weighting coefficients for each indicator are further obtained as shown in Table 4: Table 4

[0052] Assuming the standardized values ​​of each quality evaluation indicator are 0.91, 0.86, 0.8, 0.82, and 0.9 respectively, and the standardized scores of each quality evaluation indicator are 91, 86, 80, 82, and 90 respectively, when scored on a percentage scale.

[0053] Based on the standardized scores and weighting coefficients of each indicator, a weighted score is calculated to obtain the quality score of the development capability package. The decision on whether to launch the package is then made according to the review rules, as shown in Table 5. Table 5

[0054] By employing the technical means of this invention, by determining various quality evaluation indicators of the development capability package, and calculating the standardized values ​​and weight coefficients of the quality evaluation indicators based on multi-scenario test results, the development capability package is scored in terms of quality. This enables an objective and accurate determination of whether the development capability package supports online release, thereby reducing the risk of using the development capability package.

[0055] As a preferred embodiment, the present invention is further implemented based on any of the above embodiments. Step S14, namely, publishing the development capability package to the development capability map, includes steps S141 and S142: S141. Obtain the description information of the development capability package; S142. Present the development capability package and the description information in a visual form and publish them to the development capability map.

[0056] In this embodiment of the invention, the approved development capability packages are uploaded and stored in the development capability map. The various capabilities in the development capability map are displayed in a visual way. At the same time, the uploaded capability requires the capability developer to provide a detailed description of the capability, as well as related icon logos and other identification information, so that capability users can clearly view the specific details of the capability in the development capability map and download or call the development capability package as needed.

[0057] In addition, the development capability map allows users to upload capability-related SDKs, Swagger API documentation, and tool installation packages. Capability uploads can be categorized, with at least monitoring, automation, DevOps, and intelligent operations and maintenance categories, and operations and maintenance targets including hosts, databases, storage, and network devices. During queries, the development capability map centrally displays all capabilities, along with their descriptions, allowing users to quickly determine if a capability suits their needs. Users can search for capabilities by category and operations and maintenance target for quick identification of required capabilities. The development capability map prioritizes capabilities with high popularity or positive reviews, with popularity corresponding to download volume and positive reviews to the number of likes. It also displays capability comments, helping users understand the capabilities' strengths and weaknesses to determine suitability. During downloads, users can select the capabilities they need. Different capability types can be downloaded using different implementations, including SDKs, API documentation, and tool installation packages, ensuring immediate usability. Users can integrate downloaded capability implementations (SDKs, APIs, etc.) with their own system capabilities to quickly expand their system's capabilities. Users can take uploaded capabilities offline, but this requires administrator approval. Users must also receive at least one month's advance notice to allow sufficient time for adjustments, as capabilities will become unusable after the expiration date. Users can rate and like capabilities in the capability marketplace. The system uses this data to comprehensively rate capabilities, selecting high-quality and trending capabilities to recommend to new users. Furthermore, artificial intelligence technology automatically categorizes capability reviews to help users find the capabilities they need.

[0058] Furthermore, the development capability map supports multiple supply models for external sharing. Specifically, based on the evaluation of the reviewed and launched feature sets, and under the background of intensive operation and maintenance, all feature sets need to output operation and maintenance capabilities to achieve external sharing. Multiple rapid supply models need to be provided; the more all models are supported, the greater the external reference coverage of the feature. These mainly cover two types: rapid sharing of open capabilities and a capability marketplace. Given the urgent need for rapid sharing of operation and maintenance capabilities, an overall framework for rapid sharing of operation and maintenance capabilities needs to be built. Services need to support containerized deployment or one-click installation, deployment, and upgrades to ensure rapid service deployment and updates. It needs to support rapid API user access and authorization, facilitating users to quickly use API sharing capabilities. It should support mainstream programming languages ​​and provide good download channels for easy user downloads. The SDK should provide a unified download site, such as the cloud platform portal, the cloud platform developer service page, or even the cloud platform's own package management tool. It should provide good documentation for easy user use. The SDK needs to provide good user manuals, preferably in standard HTML format, explaining classes and methods and providing sample code.

[0059] It provides basic atomic capabilities and their combination and encapsulation capabilities in the form of interfaces, software packages, and files. Capability formats include APIs, SDKs, and H5. Backend services and data are encapsulated through API interfaces to provide services. Users need to call the API interfaces within their own environment to utilize these capabilities.

[0060] When a service receives information about an external request to call, it will send the request for verification and approval. The approval process verifies the type of the external call. Once the verification is successful, the corresponding reference method will be returned based on the request mode. The verification part will return authorization information based on the characteristics, which will facilitate the applicant to quickly introduce and implement the service.

[0061] As an example, the application references and rules for supply model are shown in Table 6: Table 6

[0062] For example, when a company needs to utilize database performance monitoring capabilities, it submits an application, selecting "Monitoring" as the request category and providing essential information such as the company name, business license code, and legal representative. The supply mode is set to "API." After verifying the application information, the system returns an API address (e.g., http: / / xxx.xxx.xxx / api / monitor) and an authorization token (e.g., abc123456). The company's technical staff can then use the token to call the API interface, enabling them to integrate database performance monitoring capabilities into their own system and achieve rapid reuse.

[0063] By employing the technical means of this invention, development capability packages and descriptive information are presented visually on a development capability map, allowing users to select them intuitively. The development process involves application and authorization to complete the output of operational capabilities, which helps meet users' personalized needs and facilitates self-management. Furthermore, capability control is managed throughout the entire process from development application to the development capability map, ensuring orderly management of applied and referenced development capabilities and avoiding chaotic development management issues.

[0064] As a preferred embodiment, the present invention further implements the above embodiments. In step S14, that is, after publishing the development capability package to the development capability map, the method further includes steps S15 to S17: S15. Using preset usage evaluation rules, score the user's use of the development capability package to obtain a usage score for the development capability package. S16. Compare the differences between the usage score and the quality score; S17. Optimize the quality evaluation model based on the differences.

[0065] In this embodiment of the invention, after the development capability package is launched, a usage score is obtained by evaluating the development capability package based on user feedback and usage records. The quality score from the pre-launch quality review is compared with the post-launch usage score, and the quality evaluation model is optimized based on the differences between the two scores, thereby improving the robustness of the quality evaluation model.

[0066] In a preferred embodiment, the step of employing preset usage evaluation rules to score the development capability package based on user feedback is as follows: Determine several usage evaluation indicators for the development capability package; Based on the user's usage of the development capability package, calculate the score for each of the usage evaluation metrics of the development capability package; The usage score of the development capability package is calculated based on the score of each of the aforementioned usage evaluation indicators.

[0067] Preferably, the usage evaluation indicators include download volume, user satisfaction, resource utilization rate, and complaint status.

[0068] In a preferred embodiment, comparing the differences between the usage score and the quality score includes: A one-way ANOVA method was used to determine the p-value between the usage score and the quality score; wherein the p-value was used to characterize the difference between the usage score and the quality score. The optimization of the quality evaluation model based on the differences includes: When the P-value is less than a preset deviation threshold, the quality evaluation model is optimized.

[0069] As an example, based on the comprehensive rating and capability hotspot screening mechanism of the development capability map, different screening criteria and review rules are formulated for different capabilities. Furthermore, the capabilities and popularity of the current development package are adapted based on real user feedback and evaluations. The review is conducted according to the usage of the development capability package, focusing on four aspects: download volume (call volume), user satisfaction, resource utilization, and complaint status. The scoring rules are shown in Table 7: Table 7

[0070] The usage score is the sum of the individual scores for each usage indicator.

[0071] To further improve the accuracy and reliability of the development capability package evaluation, multiple samples were taken from the scores before and after the development capability package went live. An algorithm was used for analysis, and a deviation adaptive optimization mechanism was established to adjust the pre-launch review model. The principle is as follows: a one-way ANOVA method is used to determine the difference between the two sets of scores. If the deviation value P > 0.05, it is considered that there is no significant difference in scores before and after launch, and no optimization is needed. If P < 0.05, a pre-launch review is initiated again for scoring, and post-launch scoring is conducted through a capability marketplace, thereby improving the adaptability of the development capability package.

[0072] For ease of understanding, let's take the pre-launch rating as X and the post-launch rating as Y. After 5 ratings, we get the following rating array as shown in Table 8 example: Table 8

[0073] The rating fluctuation is S:

[0074]

[0075] Assume the overall average value before and after the launch is W:

[0076] Further calculation of overall score fluctuation ST:

[0077] Similarly, using the average values ​​and arrays before and after the implementation, the sources of difference between and within groups before and after the implementation are shown in Table 9: Table 9

[0078] Since P=0.09>0.05, the pre- and post-launch scores are considered within the acceptable range and no further review or optimization is required. Similarly, if P<0.05, adaptive optimization will be performed, and a pre-launch review will be initiated again for scoring. The post-launch scores will be compared with those obtained from the capability map, and the quality evaluation model will be optimized based on the differences. For example, the weights of indicators may be adjusted, and the scoring rules may be improved. This will enhance the adaptability of the development capability package.

[0079] By employing the technical means of this invention, the quality score of the development capability package before its launch is compared with the usage score after its launch. Based on the differences between the two, the quality evaluation model is optimized, which helps to improve the evaluation accuracy of the quality evaluation model and ensure the quality and security of the released development capability package.

[0080] See Figure 4 This is a schematic diagram of a development capability map construction device provided in an embodiment of the present invention. The embodiment of the present invention provides a development capability map construction device 10, comprising: The development capability package generation module 11 is used to collect plug-in tools related to the target capability and encapsulate them to generate a development capability package. The language environment running module 12 is used to load the matching language environment, run the development capability package in the language environment, and obtain the successfully run development capability package; Quality scoring module 13 is used to score the development capability package using a pre-built quality evaluation model to obtain the quality score of the development capability package; The development capability map construction module 14 is used to publish the development capability package to the development capability map when the quality score is greater than a preset score threshold; wherein, the development capability map is used to provide storage and download of the development capability package.

[0081] Using the technical means of this invention, rapidly built development capability packages need to undergo preliminary experimental testing and review by a preset quality evaluation model. Successfully running and approved development capability packages are then published to a development capability map for reference, allowing users to download or call the required packages from the map, thus enabling customization of personalized operation and maintenance scenarios. This invention provides convenient and scalable functional options for users with personalized operation and maintenance needs, offering query and call functionality in a map mode. It satisfies users' ordering and capability output needs, meets their personalized self-service requirements and out-of-the-box time-saving requirements, and enables capability reuse, reducing developer investment and effectively achieving cost reduction, efficiency improvement, and rapid fulfillment of personalized operation and maintenance needs.

[0082] It should be noted that the development capability map construction device provided in this embodiment of the invention is used to execute all the process steps of the development capability map construction method of the above embodiment. The working principle and beneficial effect of the two are one-to-one, so they will not be described again.

[0083] This invention also provides a development capability map construction device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, it implements the development capability map construction method as described in any of the above embodiments.

[0084] This invention also provides a computer-readable storage medium, which includes a stored computer program, wherein the computer program, when running, controls the device where the computer-readable storage medium is located to execute the development capability map construction method as described in any of the above embodiments.

[0085] This invention also provides a computer program product, which includes a computer program or computer instructions. When the computer program or computer instructions are executed by a processor, they implement the method for constructing a development capability map as described in any of the above embodiments.

[0086] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0087] The above description represents the preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of the present invention, and these improvements and modifications are also considered to be within the scope of protection of the present invention.

Claims

1. A method for constructing a development capability map, characterized in that, include: Collect plugin tools related to the target capabilities and package them into a development capability package; Load the matching language environment, run the development capability package in the language environment, and obtain the successfully run development capability package; The development capability package is scored using a pre-built quality evaluation model to obtain its quality score. When the quality score is greater than a preset score threshold, the development capability package is published to the development capability map; wherein, the development capability map is used to provide storage and download of the development capability package.

2. The method for constructing a development capability map as described in claim 1, characterized in that, The quality score of the development capability package is obtained by using a pre-built quality evaluation model to score the development capability package, including: Determine several quality evaluation indicators for the development capability package; Based on the test results of the multi-scenario test of the development capability package, calculate the quantitative value of each of the quality evaluation indicators of the development capability package; The quantitative values ​​of the quality evaluation indicators are standardized using a preset data standardization method to obtain the standardized values ​​of the quality evaluation indicators. Calculate the weighting coefficient for each of the aforementioned quality evaluation indicators; The quality score of the development capability package is calculated using a weighted summation method based on the standardized value and the weighting coefficient.

3. The method for constructing a development capability map as described in claim 2, characterized in that, The calculation of the weighting coefficient for each of the quality evaluation indicators includes: Using the consistent matrix method, based on a preset importance scaling rule, all the quality evaluation indicators are compared pairwise to generate an indicator comparison matrix; wherein, the importance scaling rule is used to quantify the importance comparison result between two elements; The index comparison matrix is ​​normalized to obtain the feature vector of each quality evaluation index. Based on the feature vector of each quality evaluation indicator, a weight coefficient for each quality evaluation indicator is generated.

4. The method for constructing a development capability map as described in claim 2 or 3, characterized in that, The quality evaluation indicators include compatibility, functionality, stability, ease of use, and security.

5. The method for constructing a development capability map as described in claim 1, characterized in that, Publishing the development capability package to the development capability map includes: Obtain the description information of the development capability package; The development capability package and the description information are presented in a visual form and published to the development capability map.

6. The method for constructing a development capability map as described in claim 1, characterized in that, After publishing the development capability package to the development capability map, the method further includes: Using preset usage evaluation rules, the usage score of the development capability package is obtained by scoring the user's use of the development capability package. Compare the differences between the usage score and the quality score; Based on the aforementioned differences, the quality evaluation model is optimized.

7. The method for constructing a development capability map as described in claim 6, characterized in that, The process employs preset usage evaluation rules to score users' performance on the development capability package, resulting in a usage score for the development capability package, including: Determine several usage evaluation indicators for the development capability package; Based on the user's usage of the development capability package, calculate the score for each of the usage evaluation metrics of the development capability package; The usage score of the development capability package is calculated based on the score of each of the aforementioned usage evaluation indicators.

8. A device for constructing a development capability map, characterized in that, include: The development capability package generation module is used to collect plug-in tools related to the target capability and encapsulate them to generate a development capability package. The language environment execution module is used to load the matching language environment, run the development capability package in the language environment, and obtain the successfully executed development capability package; The quality scoring module is used to score the development capability package using a pre-built quality evaluation model to obtain the quality score of the development capability package. A development capability map construction module is used to publish the development capability package to the development capability map when the quality score is greater than a preset score threshold; wherein, the development capability map is used to provide storage and download of the development capability package.

9. A device for constructing a development capability map, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor executes the computer program to implement the method for constructing a development capability map as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored computer program, wherein, when the computer program is executed, it controls the device on which the computer-readable storage medium is located to perform the method for constructing a development capability map as described in any one of claims 1 to 7.

11. A computer program product, characterized in that, The computer program product includes a computer program or computer instructions, which, when executed by a processor, implement the method for constructing a development capability map as described in any one of claims 1 to 7.

Images