A performance evaluation method, system, device, medium and program product

Abstract

The application provides an effectiveness evaluation method, system, device, medium and program product, relates to the technical field of blockchains, and the method comprises the following steps: a prophet module broadcasts first performance data of a marketing channel to a consortium chain; an intelligent contract module determines a performance index according to second performance data and benchmark performance data corresponding to the second performance data when it is monitored that the second performance data reaches a preset quantity and / or a preset time; an SLO judgment module determines a first SLO judgment result according to the performance index obtained from the intelligent contract module and a preset SLO threshold, and broadcasts the first SLO judgment result to the consortium chain; and the intelligent contract module determines the first SLO judgment result as an effectiveness evaluation result of the marketing channel when a verification result of the first SLO judgment result indicates that a consensus support rate of nodes of the consortium chain to the first SLO judgment result meets a standard. The credibility of the effectiveness evaluation of the marketing channel is improved.

Description

Technical Field

[0001] This application relates to the field of blockchain technology, and in particular to a performance evaluation method, system, device, medium, and program product. Background Technology

[0002] With the advancement of digital transformation in marketing channels, the evaluation of their effectiveness has become crucial. Currently, marketing channel effectiveness evaluation primarily includes centralized monitoring and analysis solutions and document-based evaluation solutions. Centralized monitoring and analysis solutions typically collect performance data from marketing channels through a centralized monitoring platform or distributed link tracing system, import this data into local tools to calculate performance indicators, and then compare the data before and after the transformation to calculate the transformation effectiveness evaluation result. Document-based evaluation solutions typically first collect transformation summary reports from each channel, then use text recognition and other technologies to read the reports, generate corresponding indicators, and then input them into evaluation tools to calculate the transformation effectiveness evaluation result.

[0003] However, in existing technologies, centralized monitoring and analysis solutions rely on a single platform for data storage and analysis, lacking authentication of data immutability and the credibility of results; while document-based evaluation solutions output summary reports from multiple channels, they also suffer from data authenticity issues, as evaluation data is susceptible to human intervention, leading to a discrepancy between the final evaluation results and the actual effects.

[0004] It is evident that existing performance evaluation methods suffer from low reliability. Summary of the Invention

[0005] This application provides a performance evaluation method, system, device, medium, and program product to address the problem of low reliability in existing performance evaluation methods.

[0006] In a first aspect, embodiments of this application provide a performance evaluation method applied to a performance evaluation system, the performance evaluation system including an oracle module, a smart contract module, and a service level target (SLO) determination module, the method comprising:

[0007] The oracle module broadcasts the first performance data of the acquired marketing channel to the consortium blockchain. The first performance data is used for the quantitative evaluation of the effectiveness of the marketing channel.

[0008] When the smart contract module detects that the second performance data has reached a preset quantity and / or a preset time, it determines the performance index based on the second performance data and the benchmark performance data corresponding to the second performance data. The second performance data is the performance data written into the consortium blockchain distributed ledger after the nodes of the consortium blockchain perform a first verification on the identity and legitimacy of the oracle module and the integrity of the first performance data. The benchmark performance data is the benchmark data pre-stored in the consortium blockchain distributed ledger.

[0009] The SLO determination module determines a first SLO determination result based on the performance indicators obtained from the smart contract module and a preset SLO threshold, and broadcasts the first SLO determination result to the consortium blockchain. The preset SLO threshold is a preset value stored in the smart contract module. The nodes of the consortium blockchain are used to perform a second verification on the first SLO determination result to generate a verification result of the first SLO determination result.

[0010] If the verification result of the first SLO determination result indicates that the consensus support rate of the nodes of the consortium blockchain for the first SLO determination result meets the standard, the smart contract module determines the first SLO determination result as the effectiveness evaluation result of the marketing channel.

[0011] Optionally, the performance evaluation system further includes a consortium blockchain construction module, and before the oracle module broadcasts the first performance data of the acquired marketing channels to the consortium blockchain, the method further includes:

[0012] The consortium blockchain construction module configures the marketing channel's operation team as a participating node of the consortium blockchain and the marketing channel's review committee as a supervisory node of the consortium blockchain. The operation team includes an online e-commerce channel operation team and an offline self-operated hall operation team.

[0013] The consortium blockchain construction module stores the benchmark performance data, after consensus among the participating nodes and the supervisory node, into the consortium blockchain distributed ledger. The benchmark performance data serves as the comparison benchmark for the calculation of the performance indicators.

[0014] The consortium blockchain construction module stores the preset SLO threshold, which is agreed upon by the participating nodes and the regulatory node, into the smart contract module. The preset SLO threshold serves as the comparison benchmark for the first SLO determination result.

[0015] The consortium blockchain construction module establishes a data connection channel between the oracle module and the marketing channel.

[0016] Optionally, the oracle module broadcasts the first performance data of the acquired marketing channels to the consortium blockchain, including:

[0017] The oracle module acquires raw performance data of the marketing channel, which includes at least one of the following: average response time, transactions per second (TPS), number of failures, failure recovery time, and number of complaints.

[0018] The oracle module verifies the validity of the original performance data to obtain first performance data that meets the validity verification requirements.

[0019] The oracle module encapsulates the first performance data into an on-chain transaction, and the on-chain transaction carries the digital signature of the oracle module. The digital signature is used by the nodes of the consortium blockchain to verify the identity and legitimacy of the oracle module.

[0020] The oracle module broadcasts the on-chain transactions to the nodes of the consortium blockchain.

[0021] Optionally, when the smart contract module detects that the second performance data has reached a preset quantity and / or a preset time, it determines performance indicators based on the second performance data and the corresponding benchmark performance data, including:

[0022] The smart contract module monitors the amount of second performance data written into the consortium blockchain distributed ledger and the cumulative time interval since the completion of the previous round of indicator calculation;

[0023] When the quantity of the second performance data reaches the preset quantity, and / or the time interval reaches the preset time, the smart contract module acquires the second performance data and the baseline performance data;

[0024] The smart contract module uses a pre-configured metric calculation strategy to calculate the metric based on the second performance data and the benchmark performance data, thereby obtaining the performance metric.

[0025] Optionally, before the smart contract module determines the first SLO determination result as the performance evaluation result of the marketing channel, the method further includes:

[0026] The smart contract module broadcasts the first SLO determination result and the SLO determination strategy to the participating nodes and the supervisory nodes of the consortium blockchain. The nodes of the consortium blockchain include the participating nodes and the supervisory nodes. The SLO determination strategy is used by the SLO determination module to determine the first SLO determination result based on the performance indicators and the preset SLO threshold.

[0027] The smart contract module determines the verification result of the first SLO judgment result based on the number of approving nodes and the number of dissenting nodes in the consortium blockchain.

[0028] Wherein, the recognized node is the node in the consortium blockchain whose second SLO determination result, determined according to the SLO determination strategy and the first performance data, is consistent with the first SLO determination result; the objecting node is the node in the consortium blockchain whose third SLO determination result, determined according to the SLO determination strategy and the first performance data, is inconsistent with the first SLO determination result.

[0029] Wherein, if the proportion of the number of recognized nodes in the total number of nodes is greater than or equal to a preset consensus threshold, the verification result of the first SLO determination result indicates that the consensus support rate of the participating nodes and the regulatory nodes for the first SLO determination result meets the standard, and the total number of nodes includes the number of recognized nodes and the number of dissenting nodes.

[0030] Optionally, the smart contract module determines the verification result of the first SLO judgment result based on the number of approving nodes and the number of dissenting nodes in the consortium blockchain, including:

[0031] The smart contract module determines a first node and a second node among the participating nodes, and a third node and a fourth node among the supervisory nodes. The first node and the third node are the approval nodes, and the second node and the fourth node are the objection nodes.

[0032] The smart contract module obtains the first weight corresponding to the participating node and the second weight corresponding to the supervisory node;

[0033] The smart contract module determines the weighted number of the approval nodes based on the number of the first nodes, the number of the third nodes, the first weight, and the second weight.

[0034] The smart contract module determines the weighted number of participating nodes based on the number of the first nodes, the number of the second nodes, and the first weight.

[0035] The smart contract module determines the weighted number of the supervisory nodes based on the number of the third nodes, the number of the fourth nodes, and the second weight.

[0036] The smart contract module determines the verification result of the first SLO determination result based on the weighted number of the accrediting nodes, the weighted number of the participating nodes, and the weighted number of the regulatory nodes. If the weighted number of the accrediting nodes accounts for a proportion greater than or equal to the sum of the weighted numbers of the participating nodes and the regulatory nodes, the verification result of the first SLO determination result indicates that the consensus support rate of the participating nodes and the regulatory nodes for the first SLO determination result meets the standard.

[0037] Secondly, embodiments of this application provide a performance evaluation system, which includes an oracle module, a smart contract module, and a service level target (SLO) determination module; wherein...

[0038] The oracle module is used to broadcast the first performance data of the acquired marketing channel to the consortium blockchain, and the first performance data is used for the quantitative evaluation of the effectiveness of the marketing channel.

[0039] The smart contract module is used to determine performance indicators based on the second performance data and the corresponding benchmark performance data when the second performance data is detected to reach a preset quantity and / or a preset time. The second performance data is the performance data written into the consortium blockchain distributed ledger after the nodes of the consortium blockchain perform a first verification on the identity and legitimacy of the oracle module and the integrity of the first performance data. The benchmark performance data is the benchmark data pre-stored in the consortium blockchain distributed ledger.

[0040] The SLO determination module is used to determine a first SLO determination result based on the performance indicators obtained from the smart contract module and a preset SLO threshold, and broadcast the first SLO determination result to the consortium blockchain. The preset SLO threshold is a preset value stored in the smart contract module. The nodes of the consortium blockchain are used to perform a second verification on the first SLO determination result to generate a verification result of the first SLO determination result.

[0041] The smart contract module is used to determine the first SLO determination result as the effectiveness evaluation result of the marketing channel when the verification result of the first SLO determination result indicates that the consensus support rate of the nodes of the consortium chain for the first SLO determination result meets the standard.

[0042] Thirdly, embodiments of this application provide an electronic device, including: a processor, a memory, and a program stored in the memory and executable on the processor, wherein when the program is executed by the processor, it implements the steps of the performance evaluation method as described in the first aspect.

[0043] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the performance evaluation method as described in the first aspect.

[0044] Fifthly, embodiments of this application provide a computer program product including computer instructions that, when executed by a processor, implement the steps of the performance evaluation method as described in the first aspect.

[0045] In this embodiment, an oracle module enables reliable collection of marketing channel performance data. Combined with verification of data source and integrity by consortium blockchain nodes, the authenticity of the data is enhanced. A smart contract module automatically triggers performance indicator calculations based on the performance data verified by consortium blockchain nodes and the corresponding benchmark performance data. Then, a SLO (Solution to Loss) determination module judges the performance indicators according to a preset SLO threshold, obtaining a first SLO determination result, which is then publicly disclosed across the entire blockchain, allowing consortium blockchain nodes to verify it. Finally, if the consensus support rate meets the standard, the smart contract module confirms the first SLO determination result as the marketing channel's performance evaluation result. By utilizing blockchain and smart contract technologies, the credibility of marketing channel performance evaluation is improved. Attached Figure Description

[0046] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0047] Figure 1 This is a flowchart of a performance evaluation method provided in an embodiment of this application;

[0048] Figure 2 This is one of the structural schematic diagrams of a performance evaluation system provided in the embodiments of this application;

[0049] Figure 3 This is a second schematic diagram of the structure of a performance evaluation system provided in the embodiments of this application;

[0050] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0051] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0052] See Figure 1 , Figure 1 This is a flowchart of a performance evaluation method provided in an embodiment of this application, applied to a performance evaluation system. The performance evaluation system includes an oracle module, a smart contract module, and a Service Level Objective (SLO) determination module, such as... Figure 1 As shown, the method includes the following steps:

[0053] Step 101: The oracle module broadcasts the first performance data of the acquired marketing channel to the consortium blockchain. The first performance data is used for the quantitative evaluation of the effectiveness of the marketing channel.

[0054] In this step, the oracle module can be a dedicated oracle for marketing channels, used for collecting real-time data from these channels. After verifying and cleaning the collected raw performance data, the oracle module obtains the first performance data and broadcasts it to the consortium blockchain. Through nodes in the consortium blockchain, such as pre-built participating nodes and supervisory nodes, the legitimacy of the oracle module and the integrity of the first performance data are verified before being written into the consortium blockchain's distributed ledger, ensuring the data's legitimacy and lack of tampering. See the following description for details:

[0055] Optionally, step 101, whereby the oracle module broadcasts the acquired first performance data of the marketing channel to the consortium blockchain, includes:

[0056] The oracle module acquires raw performance data of the marketing channel, which includes at least one of the following: average response time, transactions per second (TPS), number of failures, failure recovery time, and number of complaints.

[0057] The oracle module verifies the validity of the original performance data to obtain first performance data that meets the validity verification requirements.

[0058] The oracle module encapsulates the first performance data into an on-chain transaction, and the on-chain transaction carries the digital signature of the oracle module. The digital signature is used by the nodes of the consortium blockchain to verify the identity and legitimacy of the oracle module.

[0059] The oracle module broadcasts the on-chain transactions to the nodes of the consortium blockchain.

[0060] In this embodiment, the oracle module can collect raw performance data from the operator's internal distributed link tracing system (e.g., SkyWalking, Zipkin) and marketing channel monitoring system (e.g., Prometheus, Zabbix) at a preset frequency, improving the reliability and real-time performance of the raw data source. The average response time of the marketing channel can include the average latency of each stage in the online channel's order placement process: user access, channel reach, and order processing. The TPS of the marketing channel can include the number of orders processed per second in the online channel. The number of failures can be the number of marketing channel failure events. The failure recovery time can be the time taken from the occurrence of a marketing channel failure to its restoration. The number of complaints can include complaint records from online and offline partner halls.

[0061] After collecting the raw performance data, the oracle module further performs dual validity verification on the raw performance data: For example, it compares the raw performance data from multiple sources within the same source, such as comparing the latency data of the same marketing channel from SkyWalking and Zipkin, to verify data consistency; simultaneously, it performs logical rationality verification on the raw performance data, for example, verifying whether the TPS value of marketing order processing exceeds the hardware limit of the marketing channel system, to verify the logical rationality of the data. If the error value of any validity verification of a certain raw data exceeds a preset threshold (e.g., 5%) or is abnormal, the raw data is considered not to meet the validity verification requirements and must be discarded. Only the performance data that meets the validity verification requirements is retained, thus obtaining the first performance data that meets the validity verification requirements. Then, the oracle module encapsulates the first performance data that meets the validity verification requirements into an on-chain transaction, attaches its own digital signature, and broadcasts it to the nodes of the consortium blockchain.

[0062] In this process, nodes in the consortium blockchain can verify the identity and legitimacy of the oracle module based on digital signatures. After the identity and legitimacy verification is successful, the nodes in the consortium blockchain further verify the integrity of the first performance data. The nodes in the consortium blockchain then determine the performance data that has passed the identity and legitimacy verification and data integrity verification from the first performance data as the second performance data. Finally, through consensus rules, such as confirmation by 2 / 3 of the nodes in the consortium blockchain, the second performance data is written into the consortium blockchain distributed ledger to ensure that the data is immutable.

[0063] Furthermore, to ensure the reliable collection of marketing channel performance data by the oracle module, and the subsequent verification of the oracle's identity legitimacy and the integrity of the performance data by consortium blockchain nodes, a consortium blockchain construction module can also be included in the performance evaluation system, such as... Figure 2As shown, the consortium blockchain construction module completes the underlying setup, evaluation benchmark configuration, and data path initialization of the entire consortium blockchain before data collection and broadcasting. See the following description for details:

[0064] Optionally, the performance evaluation system further includes a consortium blockchain construction module. Before step 101, when the oracle module broadcasts the first performance data of the acquired marketing channels to the consortium blockchain, the method further includes:

[0065] The consortium blockchain construction module configures the marketing channel's operation team as a participating node of the consortium blockchain and the marketing channel's review committee as a supervisory node of the consortium blockchain. The operation team includes an online e-commerce channel operation team and an offline self-operated hall operation team.

[0066] The consortium blockchain construction module stores the benchmark performance data, after consensus among the participating nodes and the supervisory node, into the consortium blockchain distributed ledger. The benchmark performance data serves as the comparison benchmark for the calculation of the performance indicators.

[0067] The consortium blockchain construction module stores the preset SLO threshold, which is agreed upon by the participating nodes and the regulatory node, into the smart contract module. The preset SLO threshold serves as the comparison benchmark for the first SLO determination result.

[0068] The consortium blockchain construction module establishes a data connection channel between the oracle module and the marketing channel.

[0069] In this embodiment, the marketing channel's operations team is configured as a participating node in the consortium blockchain through the consortium blockchain construction module, and the marketing channel's review committee is configured as a supervisory node, thus forming a blockchain with participation from the operators and supervision from the supervisors. The consortium blockchain construction module assigns a unique node identity (ID) to each node in the consortium blockchain; and generates a public-private key pair for the node using an asymmetric encryption algorithm (Rivest Shamir Adleman, RSA). The public key is published on the blockchain, while the private key is kept by the node itself, thus completing the foundation for identity authentication and trust.

[0070] In addition, the consortium blockchain construction module establishes a data connection channel between the oracle module and the marketing channel, enabling the oracle module to interface with the marketing channel monitoring system and the distributed tracing system. This provides a transmission foundation for the oracle module to collect raw performance data regularly and stably, and also provides a prerequisite for consortium blockchain nodes to verify the source and integrity of the data.

[0071] After establishing a data connection between the oracle module and the marketing channels, the marketing channel review committee can extract benchmark performance data of traditional marketing channels before their digital transformation from historical monitoring data using the oracle module. This includes average response times for key marketing channel links, such as latency in traditional offline channel business processing, peak TPS for marketing order processing, and channel failure recovery time. After participating nodes and regulatory nodes reach on-chain consensus, this data is stored in a distributed ledger. In this way, benchmark performance data can serve as a unified comparison reference for subsequent performance indicator calculations, and its consensus-based storage prevents arbitrary tampering, thus improving the fairness and uniformity of the benchmark data.

[0072] Simultaneously, the Marketing Channel Review Committee can collaborate with each channel's operations team to discuss and pre-determine SLO thresholds, such as an average channel response time improvement of ≥20%, channel collaboration failures ≤1 per quarter, and channel complaint triggers ≤5 per month. These pre-determined SLO thresholds, agreed upon by all parties, are then written into the smart contract module after reaching a consensus among participating and regulatory nodes. In this way, the pre-determined SLO thresholds serve as the legally binding benchmark for subsequent SLO assessments. Furthermore, once deployed, these thresholds are transparent, tamper-proof, and prevent human intervention in the assessment process, thus enhancing the objectivity of the judgment rules.

[0073] Step 102: When the smart contract module detects that the second performance data has reached a preset quantity and / or a preset time, it determines the performance index based on the second performance data and the benchmark performance data corresponding to the second performance data. The second performance data is the performance data written into the consortium blockchain distributed ledger after the nodes of the consortium blockchain perform a first verification on the identity and legitimacy of the oracle module and the integrity of the first performance data. The benchmark performance data is the benchmark data pre-stored in the consortium blockchain distributed ledger.

[0074] In this step, the smart contract module can automatically determine performance metrics according to preset rules, without any manual intervention, thus improving the credibility of the evaluation. The smart contract module continuously monitors the second performance data already written into the consortium blockchain's distributed ledger, and / or monitors the accumulated time interval since the last round of metric calculation. When the second performance data reaches a preset quantity (e.g., 100 records), or the accumulated time interval reaches a preset time (e.g., 24 hours), the smart contract module automatically triggers its metric calculation process, determining the performance metrics based on the second performance data and the corresponding baseline performance data. The second performance data is the performance data written into the consortium blockchain's distributed ledger after the nodes on the consortium blockchain have performed a first verification of the oracle module's identity and the completeness of the first performance data. This combination of node joint verification and on-chain notarization enhances the reliability of the second performance data. The process of determining performance metrics is detailed below:

[0075] Optionally, in step 102, when the smart contract module detects that the second performance data has reached a preset quantity and / or a preset time, it determines the performance indicators based on the second performance data and the corresponding benchmark performance data, including:

[0076] The smart contract module monitors the amount of second performance data written into the consortium blockchain distributed ledger and the cumulative time interval since the completion of the previous round of indicator calculation;

[0077] When the quantity of the second performance data reaches the preset quantity, and / or the time interval reaches the preset time, the smart contract module acquires the second performance data and the baseline performance data;

[0078] The smart contract module uses a pre-configured metric calculation strategy to calculate the metric based on the second performance data and the benchmark performance data, thereby obtaining the performance metric.

[0079] In this embodiment, when the second performance data stored in the consortium blockchain's distributed ledger reaches a preset quantity and / or a preset time, the data receiving contract in the smart contract module is automatically triggered to import the on-chain data into the metric calculation contract. The metric calculation contract is pre-configured with a metric calculation strategy.

[0080] In one example, performance metrics could include the percentage improvement in average channel response time. The metric calculation contract extracts the real-time average latency of the digitized marketing channel from the consortium blockchain's distributed ledger. For example, the latency of the online e-commerce channel's user order placement microservice is 600ms, and the baseline latency corresponding to the average latency is 800ms. Based on the metric calculation strategy, the response time improvement percentage can be determined to be 25%, specifically calculated as: (800-600) / 800×100%=25%.

[0081] In one example, the performance metric could include the total number of channel collaboration failures. The metric calculation contract iterates through the marketing channel failure event data stored on-chain, filters for events where a single marketing channel failure causes two or more related downstream marketing channels to become unavailable, such as an online payment channel failure causing the order channel and refund channel to become unavailable, and calculates the total number of failures within the statistical period (e.g., quarter) according to the metric calculation strategy.

[0082] In one example, the performance metric may include the total number of channel complaints. The metric calculation contract summarizes the complaint trigger records of each marketing channel within the period according to the metric calculation strategy, and obtains the total number of channel complaints after deduplication.

[0083] It should be understood that performance metrics can also include other types. Smart contract modules can also use corresponding metric calculation strategies to calculate metrics based on the second performance data and the benchmark performance data, which will not be elaborated here.

[0084] Step 103: The SLO determination module determines a first SLO determination result based on the performance indicators obtained from the smart contract module and a preset SLO threshold, and broadcasts the first SLO determination result to the consortium blockchain. The preset SLO threshold is a preset value stored in the smart contract module. The nodes of the consortium blockchain are used to perform a second verification on the first SLO determination result to generate a verification result of the first SLO determination result.

[0085] In this step, the SLO determination module obtains performance metrics and corresponding preset SLO thresholds from the smart contract module. For example, performance metrics may include the percentage improvement in response time, the total number of channel collaboration failures, and the total number of channel complaints. The preset SLO threshold for the percentage improvement in response time could be 20%, the preset SLO threshold for the total number of channel collaboration failures could be 1 failure per quarter, and the preset SLO threshold for the total number of channel complaints could be 5 complaints per month. These preset SLO thresholds can be jointly determined by the marketing channel review committee and each channel operations team. The SLO determination module then compares each performance metric with its corresponding preset SLO threshold. If the collected data shows an average channel response time improvement of 25%, 0 channel collaboration failures per quarter, and 3 complaints per month, then the first SLO determination result is deemed satisfactory (25% ≥ 20%, 0 complaints per quarter ≤ 1 complaint per quarter, and 3 complaints per month ≤ 5 complaints per month). If any metric fails to meet the standard, such as a total number of channel complaints of 6 complaints per month, then the first SLO determination result is deemed unsatisfactory.

[0086] To verify the correctness of the first SLO determination result, the result and the SLO determination strategy can be broadcast to nodes on the consortium blockchain, ensuring full transparency of the determination result across the entire chain, allowing all on-chain nodes to independently verify it. See the following description for details:

[0087] Optionally, before step 104, when the smart contract module determines the first SLO determination result as the effectiveness evaluation result of the marketing channel, the method further includes:

[0088] The smart contract module broadcasts the first SLO determination result and the SLO determination strategy to the participating nodes and the supervisory nodes of the consortium blockchain. The nodes of the consortium blockchain include the participating nodes and the supervisory nodes. The SLO determination strategy is used by the SLO determination module to determine the first SLO determination result based on the performance indicators and the preset SLO threshold.

[0089] The smart contract module determines the verification result of the first SLO judgment result based on the number of approving nodes and the number of dissenting nodes in the consortium blockchain.

[0090] Wherein, the recognized node is the node in the consortium blockchain whose second SLO determination result, determined according to the SLO determination strategy and the first performance data, is consistent with the first SLO determination result; the objecting node is the node in the consortium blockchain whose third SLO determination result, determined according to the SLO determination strategy and the first performance data, is inconsistent with the first SLO determination result.

[0091] Wherein, if the proportion of the number of recognized nodes in the total number of nodes is greater than or equal to a preset consensus threshold, the verification result of the first SLO determination result indicates that the consensus support rate of the participating nodes and the regulatory nodes for the first SLO determination result meets the standard, and the total number of nodes includes the number of recognized nodes and the number of dissenting nodes.

[0092] In this embodiment, the smart contract module broadcasts the first SLO determination result and the SLO determination strategy to the participating nodes and supervisory nodes of the consortium blockchain. Each node in the consortium blockchain independently recalculates the SLO determination result based on the publicly available SLO determination strategy and the trusted first performance data on the chain; one node corresponds to one SLO determination result.

[0093] In one example, if a node in the consortium blockchain recalculates a second SLO decision based on the SLO decision strategy and the first performance data, and the result matches the first SLO decision, then that node is defined as an approving node. Conversely, if a node in the consortium blockchain recalculates a third SLO decision based on the SLO decision strategy and the first performance data, and the result does not match the first SLO decision, then that node is defined as a dissenting node. Cross-validation of the decision results is achieved through independent verification by multiple nodes on the consortium blockchain.

[0094] Then, the smart contract module determines the verification result of the first SLO (Solution to Default) judgment based on the number of approving nodes and the number of dissenting nodes in the consortium blockchain. If the proportion of approving nodes to the total number of nodes is greater than or equal to a preset consensus threshold, the consensus support rate between participating nodes and regulatory nodes for the first SLO judgment is considered satisfactory, and the first SLO judgment result serves as the final performance evaluation result. Conversely, if the proportion of approving nodes is less than or equal to a preset consensus threshold, the reasons for dissent must be investigated, such as data collection errors or disputes over computational logic. The first SLO judgment result is then re-determined after correction.

[0095] Furthermore, considering that the total number of nodes includes not only the number of approving nodes and dissenting nodes, but may also include the number of invalid nodes (which can be offline, have not responded, or have failed authentication), the total number of nodes can be expressed as:

[0096] N total = N agree + N disagree + N invalid ;

[0097] Where, N total N represents the total number of nodes. agree N represents the number of nodes that receive approval. disagree N represents the number of dissenting nodes. invalid This represents the number of invalid nodes.

[0098] The percentage of recognized nodes in the total number of nodes can be optimized using the following formula:

[0099] P agree = N agree / (N agree + N disagree );

[0100] P agree This could be the percentage of the number of approved nodes in the total number of nodes after optimization. If P agree If the consensus threshold is greater than or equal to the preset consensus threshold, then the consensus support rate of the participating nodes and the regulatory nodes for the first SLO determination result is determined to be up to standard, and the first SLO determination result is used as the final performance evaluation result. In this way, the denominator only counts valid nodes, avoiding invalid nodes from lowering the support rate and ensuring that the consensus reflects the true intentions of the nodes.

[0101] Optionally, the smart contract module determines the verification result of the first SLO judgment result based on the number of approving nodes and the number of dissenting nodes in the consortium blockchain, including:

[0102] The smart contract module determines a first node and a second node among the participating nodes, and a third node and a fourth node among the supervisory nodes. The first node and the third node are the approval nodes, and the second node and the fourth node are the objection nodes.

[0103] The smart contract module obtains the first weight corresponding to the participating node and the second weight corresponding to the supervisory node;

[0104] The smart contract module determines the weighted number of the approval nodes based on the number of the first nodes, the number of the third nodes, the first weight, and the second weight.

[0105] The smart contract module determines the weighted number of participating nodes based on the number of the first nodes, the number of the second nodes, and the first weight.

[0106] The smart contract module determines the weighted number of the supervisory nodes based on the number of the third nodes, the number of the fourth nodes, and the second weight.

[0107] The smart contract module determines the verification result of the first SLO determination result based on the weighted number of the accrediting nodes, the weighted number of the participating nodes, and the weighted number of the regulatory nodes. If the weighted number of the accrediting nodes accounts for a proportion greater than or equal to the sum of the weighted numbers of the participating nodes and the regulatory nodes, the verification result of the first SLO determination result indicates that the consensus support rate of the participating nodes and the regulatory nodes for the first SLO determination result meets the standard.

[0108] In this embodiment, different types of nodes have different levels of credibility. Therefore, the first weight corresponding to the participating nodes and the second weight corresponding to the supervisory nodes can be pre-configured. For example, the first weight can be 0.4 and the second weight can be 0.6. In this way, the support rate can be adjusted by weighting to avoid the impact of objections from low-credibility nodes on the results.

[0109] The proportion of the weighted number of accredited nodes in the sum of the weighted number of participating nodes and the weighted number of regulatory nodes can be expressed by the following formula:

[0110] P agree,weighed =(W reg *N agree,reg +W par *N agree,par ) / (W reg *(N agree,reg +N disagree,reg )+W par *(N agree,par +Ndisagree,par ));

[0111] P agree,weighed The percentage of the weighted number of recognized nodes in the sum of the weighted number of participating nodes and the weighted number of regulatory nodes;

[0112] W par It is the first weight;

[0113] W reg As the second weight;

[0114] N agree,par The number of participating nodes that are recognized, i.e., the number of first nodes;

[0115] N agree,reg The number of approved regulatory nodes, i.e., the number of third-party nodes;

[0116] N agree,par This refers to the number of dissenting nodes, i.e., the number of second nodes.

[0117] N agree,reg The number of dissenting regulatory nodes, i.e., the number of fourth nodes;

[0118] If P agree Greater than or equal to the preset weighted consensus threshold (denoted as P) th When the consensus rate of participating nodes and regulatory nodes reaches 66.7%, it is determined that the consensus rate of the first SLO determination result meets the standard, and the first SLO determination result serves as the final performance evaluation result. This further enhances the credibility of the performance evaluation result.

[0119] Step 104: If the verification result of the first SLO determination result indicates that the consensus support rate of the nodes of the consortium blockchain for the first SLO determination result meets the standard, the smart contract module determines the first SLO determination result as the effectiveness evaluation result of the marketing channel.

[0120] In this step, if the verification result of the first SLO determination indicates that the consensus support rate of the nodes of the consortium blockchain for the first SLO determination result meets the standard, the smart contract module automatically executes the result confirmation operation, reducing the manual intervention of operators and regulators. By utilizing the distributed evidence storage and full node consensus characteristics of the consortium blockchain, the objectivity and fairness of the final performance evaluation result are improved.

[0121] In this embodiment, an oracle module enables reliable collection of marketing channel performance data. Combined with verification of data source and integrity by consortium blockchain nodes, the authenticity of the data is enhanced. A smart contract module automatically triggers performance indicator calculations based on the performance data verified by consortium blockchain nodes and the corresponding benchmark performance data. Then, a SLO (Solution to Loss) determination module judges the performance indicators according to a preset SLO threshold, obtaining a first SLO determination result, which is then publicly disclosed across the entire blockchain, allowing consortium blockchain nodes to verify it. Finally, if the consensus support rate meets the standard, the smart contract module confirms the first SLO determination result as the marketing channel's performance evaluation result. By utilizing blockchain and smart contract technologies, the credibility of marketing channel performance evaluation is improved.

[0122] In addition, the performance evaluation system can also include modules for digital signatures and evaluation report generation.

[0123] In one example, the evaluation report generation module generates a structured marketing channel effectiveness evaluation report based on the effective SLO determination results, on-chain raw data, and performance indicator calculation process. The core content may include at least one of the following:

[0124] Basic information: including the evaluation period and the marketing channels involved (such as online orders placed by users and offline self-operated hall business processing);

[0125] Quantitative metrics include the percentage improvement in average channel response time (e.g., 25%), the number of channel collaboration failures (e.g., 0 times), and the number of channel complaints triggered (e.g., 3 times).

[0126] SLO determination conclusion: including meeting the preset SLO, and the marketing channel digital transformation has achieved significant results in response time optimization and fault control;

[0127] Quantitative contributions include a 200ms reduction in response time and an 80% reduction in the scope of impact of failures compared to traditional marketing channels.

[0128] In one example, the digital signature module calls the private keys of each consortium blockchain node to generate a digital signature for the evaluation report. Participating nodes sign to confirm the authenticity of their team's marketing channel data, while the supervisory node signs to confirm the compliance of the evaluation process.

[0129] Furthermore, the evaluation report with signatures from all nodes is synchronized to the local storage of each node and can be downloaded for marketing channel decisions, such as adjusting the marketing channel layout and optimizing the SLO threshold based on the report's conclusions. At the same time, the report's hash value is uploaded to the blockchain to ensure that the report is not tampered with and its integrity can be verified at any time through the hash value.

[0130] Furthermore, the system can automatically conduct performance evaluations at preset intervals (such as once a month); after each evaluation, new baseline data (such as marketing channel latency for this month) will be updated to the on-chain ledger as a basis for comparison in the next month's evaluation.

[0131] The preset SLO threshold can also be dynamically adjusted. For example, if marketing business needs change, such as a surge in marketing orders during holidays, or if the marketing channel's technical architecture is upgraded, such as by introducing a marketing service mesh, the marketing channel review committee can initiate an SLO threshold adjustment proposal. After consensus is reached among all nodes, the threshold parameters in the smart contract are updated, such as increasing the marketing order processing TPS threshold from 500 to 800.

[0132] The functionality of the oracle module can be optimized. For example, the data collection frequency of the oracle can be adjusted based on actual usage feedback, such as collecting channel reach response latency data every 5 seconds during peak marketing periods, or the verification rules can be improved, such as adding a verification dimension for comparison with marketing business log data, to improve the accuracy and real-time performance of data collection.

[0133] See Figure 3 , Figure 3 This is a second schematic diagram of the structure of a performance evaluation system provided in the embodiments of this application, as shown below. Figure 3 As shown, the performance evaluation system 300 includes: an oracle module 301, a smart contract module 302, and a service level target (SLO) determination module 303; wherein,

[0134] Oracle module 301 is used to broadcast the first performance data of the acquired marketing channel to the consortium blockchain, and the first performance data is used for the quantitative evaluation of the effectiveness of the marketing channel.

[0135] The smart contract module 302 is used to determine performance indicators based on the second performance data and the corresponding benchmark performance data when the second performance data is detected to reach a preset quantity and / or a preset time. The second performance data is the performance data written into the consortium blockchain distributed ledger after the nodes of the consortium blockchain perform a first verification on the identity and legitimacy of the oracle module and the integrity of the first performance data. The benchmark performance data is the benchmark data pre-stored in the consortium blockchain distributed ledger.

[0136] SLO determination module 303 is used to determine a first SLO determination result based on the performance indicators obtained from the smart contract module and a preset SLO threshold, and broadcast the first SLO determination result to the consortium blockchain. The preset SLO threshold is a preset value stored in the smart contract module. The nodes of the consortium blockchain are used to perform a second verification on the first SLO determination result to generate a verification result of the first SLO determination result.

[0137] The smart contract module 302 is used to determine the first SLO determination result as the performance evaluation result of the marketing channel when the verification result of the first SLO determination result indicates that the consensus support rate of the nodes of the consortium chain for the first SLO determination result meets the standard.

[0138] Optionally, the evaluation system further includes a consortium blockchain construction module;

[0139] The consortium blockchain construction module is used to configure the marketing channel's operation team as a participating node of the consortium blockchain and the marketing channel's review committee as a supervisory node of the consortium blockchain. The operation team includes an online e-commerce channel operation team and an offline self-operated hall operation team.

[0140] The benchmark performance data, after consensus among the participating nodes and the supervisory node, is stored in the consortium blockchain distributed ledger. The benchmark performance data serves as the comparison benchmark for calculating the performance indicators.

[0141] The preset SLO threshold, after consensus among the participating nodes and the regulatory node, is stored in the smart contract module. The preset SLO threshold serves as the comparison benchmark for the first SLO determination result.

[0142] Establish a data connection channel between the oracle module and the marketing channel.

[0143] Optionally, the oracle module is further configured to:

[0144] Obtain raw performance data of the marketing channel, wherein the raw performance data includes at least one of the following: average response time, transactions per second (TPS), number of failures, failure recovery time, and number of complaints.

[0145] The original performance data is validated to obtain first performance data that meets the validity validation requirements;

[0146] The first performance data is encapsulated into an on-chain transaction, which carries the digital signature of the oracle module. The digital signature is used by the nodes of the consortium blockchain to verify the identity and legitimacy of the oracle module.

[0147] The on-chain transaction is broadcast to the nodes of the consortium blockchain.

[0148] Optionally, the smart contract module is further used for:

[0149] Monitor the amount of second performance data written into the consortium blockchain distributed ledger and the cumulative time interval since the last round of metric calculation;

[0150] When the quantity of the second performance data reaches the preset quantity, and / or the time interval reaches the preset time, the second performance data and the baseline performance data are acquired.

[0151] The performance index is obtained by using a pre-configured index calculation strategy based on the second performance data and the benchmark performance data.

[0152] Optionally, the smart contract module is also used for:

[0153] The first SLO determination result and the SLO determination strategy are broadcast to the participating nodes and the supervisory nodes of the consortium blockchain. The nodes of the consortium blockchain include the participating nodes and the supervisory nodes. The SLO determination strategy is used by the SLO determination module to determine the first SLO determination result based on the performance indicators and the preset SLO threshold.

[0154] The verification result of the first SLO judgment result is determined based on the number of approving nodes and the number of dissenting nodes in the consortium blockchain.

[0155] Wherein, the recognized node is the node in the consortium blockchain whose second SLO determination result, determined according to the SLO determination strategy and the first performance data, is consistent with the first SLO determination result; the objecting node is the node in the consortium blockchain whose third SLO determination result, determined according to the SLO determination strategy and the first performance data, is inconsistent with the first SLO determination result.

[0156] Wherein, if the proportion of the number of recognized nodes in the total number of nodes is greater than or equal to a preset consensus threshold, the verification result of the first SLO determination result indicates that the consensus support rate of the participating nodes and the regulatory nodes for the first SLO determination result meets the standard, and the total number of nodes includes the number of recognized nodes and the number of dissenting nodes.

[0157] Optionally, the smart contract module is further used for:

[0158] A first node and a second node are determined among the participating nodes, and a third node and a fourth node are determined among the monitoring nodes. The first node and the third node are the approval nodes, and the second node and the fourth node are the objection nodes.

[0159] Obtain the first weight corresponding to the participating node and the second weight corresponding to the regulatory node;

[0160] The weighted number of the approved nodes is determined based on the number of the first nodes, the number of the third nodes, the first weight, and the second weight.

[0161] The weighted number of participating nodes is determined based on the number of the first nodes, the number of the second nodes, and the first weight.

[0162] The weighted number of regulatory nodes is determined based on the number of the third node, the number of the fourth node, and the second weight.

[0163] The verification result of the first SLO determination result is determined based on the weighted number of the accrediting nodes, the weighted number of the participating nodes, and the weighted number of the regulatory nodes. If the weighted number of the accrediting nodes accounts for a proportion greater than or equal to the sum of the weighted numbers of the participating nodes and the regulatory nodes, the verification result of the first SLO determination result indicates that the consensus support rate of the participating nodes and the regulatory nodes for the first SLO determination result meets the standard.

[0164] The performance evaluation system 300 is designed to implement the various processes of the above-described embodiments of the performance evaluation method. The technical features are one-to-one and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0165] This application also provides an electronic device, including: a processor, a memory, and a program stored in the memory and executable on the processor. When the program is executed by the processor, it implements the various processes of the above-described performance evaluation method embodiments and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0166] For details, see Figure 4 This application also provides an electronic device, including a bus 401, a transceiver 402, an antenna 403, a bus interface 404, a processor 405, and a memory 406.

[0167] exist Figure 4 In this context, a bus architecture (represented by bus 401) is used. Bus 401 can include any number of interconnected buses and bridges, linking various circuits including one or more processors represented by processor 405 and memory represented by memory 406. Bus 401 can also link various other circuits such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and therefore will not be described further herein. Bus interface 404 provides an interface between bus 401 and transceiver 402. Transceiver 402 can be a single element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices over a transmission medium. Data processed by processor 405 is transmitted over a wireless medium via antenna 403, which further receives data and transmits data to processor 405.

[0168] Processor 405 is responsible for managing bus 401 and general processing, and can also provide various functions, including timing, peripheral interface, voltage regulation, power management, and other control functions. Memory 406 can be used to store data used by processor 405 during operation.

[0169] Optionally, the processor 405 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a complex programmable logic device (CPLD).

[0170] This application also provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the various processes of the above-described performance evaluation method embodiments and achieves the same technical effects. To avoid repetition, it will not be described again here. The computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.

[0171] This application also provides a computer program product, including computer instructions. When executed by a processor, these computer instructions implement the various processes of the above-described performance evaluation method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0172] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0173] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0174] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A performance evaluation method, characterized in that, The method is applied to a performance evaluation system, which includes an oracle module, a smart contract module, and a service level target (SLO) determination module. The oracle module broadcasts the first performance data of the acquired marketing channel to the consortium blockchain. The first performance data is used for the quantitative evaluation of the effectiveness of the marketing channel. When the smart contract module detects that the second performance data has reached a preset quantity and / or a preset time, it determines the performance index based on the second performance data and the benchmark performance data corresponding to the second performance data. The second performance data is the performance data written into the consortium blockchain distributed ledger after the nodes of the consortium blockchain perform a first verification on the identity and legitimacy of the oracle module and the integrity of the first performance data. The benchmark performance data is the benchmark data pre-stored in the consortium blockchain distributed ledger. The SLO determination module determines a first SLO determination result based on the performance indicators obtained from the smart contract module and a preset SLO threshold, and broadcasts the first SLO determination result to the consortium blockchain. The preset SLO threshold is a preset value stored in the smart contract module. The nodes of the consortium blockchain are used to perform a second verification on the first SLO determination result to generate a verification result of the first SLO determination result. If the verification result of the first SLO determination result indicates that the consensus support rate of the nodes of the consortium blockchain for the first SLO determination result meets the standard, the smart contract module determines the first SLO determination result as the effectiveness evaluation result of the marketing channel.

2. The method according to claim 1, characterized in that, The performance evaluation system also includes a consortium blockchain construction module. Before the oracle module broadcasts the first performance data of the acquired marketing channels to the consortium blockchain, the method further includes: The consortium blockchain construction module configures the marketing channel's operation team as a participating node of the consortium blockchain and the marketing channel's review committee as a supervisory node of the consortium blockchain. The operation team includes an online e-commerce channel operation team and an offline self-operated hall operation team. The consortium blockchain construction module stores the benchmark performance data, after consensus among the participating nodes and the supervisory node, into the consortium blockchain distributed ledger. The benchmark performance data serves as the comparison benchmark for the calculation of the performance indicators. The consortium blockchain construction module stores the preset SLO threshold, which is agreed upon by the participating nodes and the regulatory node, into the smart contract module. The preset SLO threshold serves as the comparison benchmark for the first SLO determination result. The consortium blockchain construction module establishes a data connection channel between the oracle module and the marketing channel.

3. The method according to claim 1, characterized in that, The oracle module broadcasts the first performance data of the acquired marketing channels to the consortium blockchain, including: The oracle module acquires raw performance data of the marketing channel, which includes at least one of the following: average response time, transactions per second (TPS), number of failures, failure recovery time, and number of complaints. The oracle module verifies the validity of the original performance data to obtain first performance data that meets the validity verification requirements. The oracle module encapsulates the first performance data into an on-chain transaction, and the on-chain transaction carries the digital signature of the oracle module. The digital signature is used by the nodes of the consortium blockchain to verify the identity and legitimacy of the oracle module. The oracle module broadcasts the on-chain transactions to the nodes of the consortium blockchain.

4. The method according to claim 1, characterized in that, When the smart contract module detects that the second performance data has reached a preset quantity and / or a preset time, it determines performance indicators based on the second performance data and the corresponding benchmark performance data, including: The smart contract module monitors the amount of second performance data written into the consortium blockchain distributed ledger and the cumulative time interval since the completion of the previous round of indicator calculation; When the quantity of the second performance data reaches the preset quantity, and / or the time interval reaches the preset time, the smart contract module acquires the second performance data and the baseline performance data; The smart contract module uses a pre-configured metric calculation strategy to calculate the metric based on the second performance data and the benchmark performance data, thereby obtaining the performance metric.

5. The method according to any one of claims 1 to 4, characterized in that, Before the smart contract module determines the first SLO determination result as the effectiveness evaluation result of the marketing channel, the method further includes: The smart contract module broadcasts the first SLO determination result and the SLO determination strategy to the participating nodes and the supervisory nodes of the consortium blockchain. The nodes of the consortium blockchain include the participating nodes and the supervisory nodes. The SLO determination strategy is used by the SLO determination module to determine the first SLO determination result based on the performance indicators and the preset SLO threshold. The smart contract module determines the verification result of the first SLO judgment result based on the number of approving nodes and the number of dissenting nodes in the consortium blockchain. Wherein, the recognized node is the node in the consortium blockchain whose second SLO determination result, determined according to the SLO determination strategy and the first performance data, is consistent with the first SLO determination result; the objecting node is the node in the consortium blockchain whose third SLO determination result, determined according to the SLO determination strategy and the first performance data, is inconsistent with the first SLO determination result. Wherein, if the proportion of the number of recognized nodes in the total number of nodes is greater than or equal to a preset consensus threshold, the verification result of the first SLO determination result indicates that the consensus support rate of the participating nodes and the regulatory nodes for the first SLO determination result meets the standard, and the total number of nodes includes the number of recognized nodes and the number of dissenting nodes.

6. The method according to claim 5, characterized in that, The smart contract module determines the verification result of the first SLO judgment result based on the number of approving nodes and the number of dissenting nodes in the consortium blockchain, including: The smart contract module determines a first node and a second node among the participating nodes, and a third node and a fourth node among the supervisory nodes. The first node and the third node are the approval nodes, and the second node and the fourth node are the objection nodes. The smart contract module obtains the first weight corresponding to the participating node and the second weight corresponding to the supervisory node; The smart contract module determines the weighted number of the approval nodes based on the number of the first nodes, the number of the third nodes, the first weight, and the second weight. The smart contract module determines the weighted number of participating nodes based on the number of the first nodes, the number of the second nodes, and the first weight. The smart contract module determines the weighted number of the supervisory nodes based on the number of the third nodes, the number of the fourth nodes, and the second weight. The smart contract module determines the verification result of the first SLO determination result based on the weighted number of the accrediting nodes, the weighted number of the participating nodes, and the weighted number of the regulatory nodes. If the weighted number of the accrediting nodes accounts for a proportion greater than or equal to the sum of the weighted numbers of the participating nodes and the regulatory nodes, the verification result of the first SLO determination result indicates that the consensus support rate of the participating nodes and the regulatory nodes for the first SLO determination result meets the standard.

7. A performance evaluation system, characterized in that, The performance evaluation system includes an oracle module, a smart contract module, and a service level target (SLO) determination module; wherein... The oracle module is used to broadcast the first performance data of the acquired marketing channel to the consortium blockchain, and the first performance data is used for the quantitative evaluation of the effectiveness of the marketing channel. The smart contract module is used to determine performance indicators based on the second performance data and the corresponding benchmark performance data when the second performance data is detected to reach a preset quantity and / or a preset time. The second performance data is the performance data written into the consortium blockchain distributed ledger after the nodes of the consortium blockchain perform a first verification on the identity and legitimacy of the oracle module and the integrity of the first performance data. The benchmark performance data is the benchmark data pre-stored in the consortium blockchain distributed ledger. The SLO determination module is used to determine a first SLO determination result based on the performance indicators obtained from the smart contract module and a preset SLO threshold, and broadcast the first SLO determination result to the consortium blockchain. The preset SLO threshold is a preset value stored in the smart contract module. The nodes of the consortium blockchain are used to perform a second verification on the first SLO determination result to generate a verification result of the first SLO determination result. The smart contract module is used to determine the first SLO determination result as the effectiveness evaluation result of the marketing channel when the verification result of the first SLO determination result indicates that the consensus support rate of the nodes of the consortium chain for the first SLO determination result meets the standard.

8. An electronic device, characterized in that, include: A processor, a memory, and a program stored in the memory and executable on the processor, wherein the program, when executed by the processor, implements the steps of the method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the method as described in any one of claims 1 to 6.

10. A computer program product, characterized in that, Includes computer instructions that, when executed by a processor, implement the steps of the method as described in any one of claims 1 to 6.

Images