Information supply quality evaluation method and device, computer device and storage medium

Abstract

The application relates to the technical field of artificial intelligence, and specifically discloses a quality evaluation method and device for information supply, computer equipment and a storage medium. The method comprises the following steps: acquiring information data provided by each information supplier; detecting information elements of each information content in the information data to obtain corresponding completeness evaluation results; obtaining corresponding stability evaluation results according to the number of updated information labels in each first detection period; obtaining corresponding safety evaluation results according to the number of information that does not pass the audit in each second detection period; acquiring interaction data of each information content in the information data, obtaining feedback conditions of each information content according to the interaction data, and obtaining corresponding application degree evaluation results according to the feedback conditions; and determining a quality evaluation result of the information supply according to the completeness evaluation results, the stability evaluation results, the safety evaluation results and the application degree evaluation results. The method can improve the accuracy of information evaluation.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence technology, and in particular to a method, apparatus, computer equipment, and storage medium for assessing the quality of information supply. Background Technology

[0002] With rapid economic and technological development, users are exposed to an ever-increasing amount of information. However, this information is often provided by multiple providers, not just a single one. The quality of information from different providers varies greatly, necessitating quality assessment of the information offered by each provider to ensure overall quality.

[0003] In related technologies, incomplete information evaluation can easily lead to inaccurate information evaluation. Therefore, how to improve the accuracy of information evaluation has become a technical problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0004] Therefore, it is necessary to provide a method, apparatus, computer equipment, and storage medium for assessing the quality of information supply that can improve the accuracy of information assessment, in order to address the aforementioned technical problems.

[0005] Firstly, this application provides a method for assessing the quality of information supply. The method includes:

[0006] Obtain information data provided by various information providers; the information data carries information tags used to identify the provider to which the information data belongs;

[0007] The information elements of each information content in the information data are detected to obtain the completeness evaluation result corresponding to the information tag;

[0008] Based on the number of updated information for each information tag within each first detection period, the stability evaluation result corresponding to the information tag is obtained;

[0009] The security assessment result corresponding to each information tag is obtained based on the number of information tags that fail the review within each second detection cycle;

[0010] The interaction data of each piece of information in the information data is obtained, and the feedback on each piece of information is obtained based on the interaction data. The application degree evaluation result corresponding to the information tag is obtained based on the feedback.

[0011] Based on the completeness assessment results, the stability assessment results, the security assessment results, and the usability assessment results, the quality assessment results of the information supply are determined.

[0012] In one embodiment, the method further includes:

[0013] Based on the quality assessment results, improvement dimensions are determined; the improvement dimensions are at least one of completeness, stability, security, and applicability.

[0014] Based on the evaluation results corresponding to the improvement dimensions, improvement suggestions are output.

[0015] In one embodiment, the information elements include basic information and supplementary information of the declaration;

[0016] The step of detecting information elements of each information content in the information data to obtain the completeness assessment result corresponding to the information tag includes:

[0017] The basic information of each piece of information in the information data is evaluated based on the inspection frequency to obtain the completeness of the basic information corresponding to the information tag;

[0018] The content of the information is evaluated based on the inspection frequency and the supplementary information of the statement to obtain the completeness of the supplementary information of the statement;

[0019] Based on the completeness of the basic information and the completeness of the supplementary information in the statement, the completeness assessment result corresponding to the information tag is calculated.

[0020] In one embodiment, calculating the completeness assessment result corresponding to the information tag based on the completeness of the basic information and the completeness of the declared supplementary information includes:

[0021] Based on the completeness of the basic information and the completeness of the supplementary information in the statement, the current completeness assessment result corresponding to the inspection frequency is calculated;

[0022] Obtain the historical completeness assessment result based on the information tags;

[0023] Based on the current completeness assessment result and the historical completeness assessment result, the completeness assessment result corresponding to the information tag is calculated.

[0024] In one embodiment, obtaining the stability assessment result corresponding to the information tag based on the number of updated information for each information tag within each first detection period includes:

[0025] Based on the update status of the information content in the information data corresponding to each information tag within each first detection period, the update time evaluation result corresponding to the information tag is determined;

[0026] Obtain the number of updated information corresponding to each information tag within each of the first detection periods;

[0027] The current quantity variance is calculated based on the number of updated information.

[0028] Obtain the historical variance of the information tags within the first time period;

[0029] Based on the current quantity variance, the historical quantity variance, the update time evaluation result, and the mapping relationship, the stability evaluation result corresponding to the information tag is calculated.

[0030] In one embodiment, obtaining the security assessment result corresponding to each information tag based on the number of information tags that failed review within each second detection cycle includes:

[0031] Within each of the second detection cycles, keyword review is performed on the information content in the information data corresponding to the information tags to obtain keyword review results;

[0032] Within each of the second detection cycles, the information content in the information data corresponding to the information tags is subject to public opinion review to obtain the public opinion review results.

[0033] Obtain the number of information items that passed the review within each second detection cycle;

[0034] Based on the keyword review results and the public opinion review results, the number of information items that failed the review is determined;

[0035] The security assessment result corresponding to the information tag is obtained based on the number of information that failed the review and the number of information that passed the review.

[0036] In one embodiment, the interaction data includes positive feedback data and negative feedback data;

[0037] The step of obtaining feedback on each piece of information based on the interaction data, and obtaining the application evaluation result corresponding to the information tag based on the feedback, includes:

[0038] The positive feedback status for each piece of information is determined based on the positive feedback data; the positive feedback data is used to characterize the user's satisfaction with the information content.

[0039] The negative feedback data is used to determine the negative feedback status of each piece of information; the negative feedback data is used to characterize the user's degree of dissatisfaction with the information content.

[0040] Based on the positive and negative feedback conditions, the application degree evaluation result corresponding to the information tag is obtained.

[0041] Secondly, this application also provides an information supply quality assessment device. The device includes:

[0042] The information data acquisition module is used to acquire information data provided by various information providers; the information data carries information tags to identify the provider to which the information data belongs;

[0043] The information element detection module is used to detect the information elements of each information content in the information data and obtain the completeness evaluation result corresponding to the information tag;

[0044] The stability assessment module is used to obtain the stability assessment result corresponding to the information tag based on the number of updated information for each information tag in each first detection period;

[0045] The security assessment module is used to obtain the security assessment result corresponding to the information tag based on the number of information tags that fail the review in each second detection cycle.

[0046] The application evaluation module is used to obtain the interaction data of each piece of information in the information data, obtain the feedback on each piece of information based on the interaction data, and obtain the application evaluation result corresponding to the information tag based on the feedback.

[0047] The quality assessment determination module is used to determine the quality assessment result of the information supply based on the integrity assessment result, the stability assessment result, the security assessment result, and the usability assessment result.

[0048] In one embodiment, the device further includes:

[0049] The improvement dimension determination module is used to determine the improvement dimensions based on the quality assessment results; the improvement dimension is at least one of completeness, stability, security, and applicability.

[0050] The improvement suggestion output module is used to output improvement suggestions based on the evaluation results corresponding to the improvement dimensions.

[0051] In one embodiment, the information elements include basic information and supplementary information of the declaration;

[0052] The information element detection module includes:

[0053] The basic information evaluation unit is used to evaluate the basic information of each piece of information in the information data according to the inspection frequency, and to obtain the completeness of the basic information corresponding to the information tag.

[0054] A content evaluation unit is used to evaluate the information content based on the inspection frequency and the supplementary information of the statement, and to obtain the completeness of the supplementary information of the statement.

[0055] The completeness calculation unit is used to calculate the completeness assessment result corresponding to the information tag based on the completeness of the basic information and the completeness of the supplementary information of the declaration.

[0056] In one embodiment, the completeness calculation unit includes:

[0057] The current completeness calculation subunit is used to calculate the current completeness evaluation result corresponding to the inspection frequency based on the completeness of the basic information and the completeness of the supplementary information declared.

[0058] The historical integrity acquisition subunit is used to obtain the historical integrity assessment result based on the information tags;

[0059] The completeness assessment subunit is used to calculate the completeness assessment result corresponding to the information tag based on the current completeness assessment result and the historical completeness assessment result.

[0060] In one embodiment, the stability assessment module includes:

[0061] The update time evaluation unit is used to determine the update time evaluation result corresponding to the information tag based on the update status of the information content in the information data corresponding to each information tag in each first detection period.

[0062] The update information quantity acquisition unit is used to acquire the corresponding update information quantity of each information tag in each of the first detection periods;

[0063] The current quantity variance calculation unit is used to calculate the current quantity variance based on the quantity of the updated information.

[0064] The historical quantity variance acquisition unit is used to acquire the historical quantity variance of the information tag within a first time period;

[0065] The stability assessment unit is used to calculate the stability assessment result corresponding to the information tag based on the current quantity variance, the historical quantity variance, the update time assessment result, and the mapping relationship.

[0066] In one embodiment, the security assessment module includes:

[0067] The keyword review unit is used to review the information content in the information data corresponding to the information tag within each of the second detection cycles and obtain the keyword review result.

[0068] The public opinion review unit is used to review the information content in the information data corresponding to the information tag within each of the second detection cycles and obtain the public opinion review result.

[0069] The information quantity acquisition unit is used to acquire the number of information items that have passed the review within each of the second detection cycles;

[0070] The information quantity determination unit is used to determine the number of information items that failed the review based on the keyword review results and the public opinion review results;

[0071] The security assessment unit is used to obtain the security assessment result corresponding to the information tag based on the number of information that failed the review and the number of information that passed the review.

[0072] In one embodiment, the interaction data includes positive feedback data and negative feedback data; the application evaluation module includes:

[0073] A positive feedback determination unit is used to determine the positive feedback status of each piece of information based on the positive feedback data; the positive feedback data is used to characterize the user's satisfaction with the information content.

[0074] A negative feedback determination unit is used to determine the negative feedback status of each piece of information based on the negative feedback data; the negative feedback data is used to characterize the user's degree of dissatisfaction with the information content.

[0075] The application evaluation unit is used to obtain the application evaluation result corresponding to the information tag based on the positive feedback and the negative feedback.

[0076] Thirdly, this application also provides a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps of the above-described information supply quality assessment method.

[0077] Fourthly, this application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements the steps of the above-described information supply quality assessment method.

[0078] Fifthly, this application also provides a computer program product. The computer program product includes a computer program that, when executed by a processor, implements the steps of the above-described information supply quality assessment method.

[0079] The aforementioned information supply quality assessment method, apparatus, computer equipment, and storage medium acquire information data from various information providers through information provider interfaces. Then, it detects the information elements of each information content within the information data to obtain a completeness assessment result. It obtains a stability assessment result based on the number of updated information tags within each first detection period, a security assessment result based on the number of information items that failed review, and an application assessment result based on interactive data. This achieves information data assessment from the dimensions of completeness, stability, security, and application, improving the coverage of information data assessment and thus enhancing the accuracy of information data quality assessment. Furthermore, by assessing information data from the application dimension, the assessment results are more closely aligned with specific application scenarios, further improving the accuracy of information data quality assessment. This facilitates and improves the accuracy of information provider quality assessment. Attached Figure Description

[0080] Figure 1 This is a diagram illustrating the application environment of an information supply quality assessment method in one embodiment.

[0081] Figure 2 This is a flowchart illustrating a method for assessing the quality of information provision in one embodiment;

[0082] Figure 3 This is a flowchart illustrating the steps for determining the integrity assessment result in one embodiment;

[0083] Figure 4 This is a flowchart illustrating the steps for determining the stability assessment result in one embodiment;

[0084] Figure 5 This is a flowchart illustrating the steps for determining the security assessment result in one embodiment;

[0085] Figure 6 This is a flowchart illustrating the steps for determining the application degree evaluation result in one embodiment;

[0086] Figure 7 This is a flowchart illustrating a method for assessing the quality of information supply in another embodiment;

[0087] Figure 8 A structural block diagram of an information supply quality assessment device in one embodiment;

[0088] Figure 9 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0089] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0090] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data shall comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0091] The information supply quality assessment method provided in this application embodiment can be applied to, for example, Figure 1 In the application environment shown, the quality assessment method for information supply can be executed by server 106. Supplier terminal 102 and user terminal 104 have a data interface, and user terminal 104 communicates with server 106 via a network. The data storage system can store the data that server 106 needs to process, such as storing mapping relationships, information data, and interactive data. The data storage system can be integrated on server 106 or located in the cloud or on another network server. User terminal 104, through its interface with supplier terminal 102, obtains information data provided by various information suppliers in real time and sends the obtained information data to server 106. The information data carries information tags used to identify the information data suppliers. Server 106 detects the information elements of each information content in the information data and obtains the completeness assessment result corresponding to the information tag. Server 106 obtains the stability assessment result corresponding to the information tag based on the number of updated information for each information tag in each first detection period. Server 106 obtains the security assessment result corresponding to each information tag based on the number of information items that failed review within the second detection period, acquires the interaction data of each information content in the information data, and obtains the feedback on each information content based on the interaction data. Based on the feedback, it obtains the application assessment result corresponding to each information tag. Server 106 determines the quality assessment result of the information supply based on the completeness assessment result, stability assessment result, security assessment result, and application assessment result. The supplier terminal 102 or user terminal 104 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, etc. Server 106 can be implemented using a standalone server or a server cluster composed of multiple servers.

[0092] In one embodiment, such as Figure 2 As shown, a method for quality assessment of information supply is provided, which can be applied to... Figure 1Taking server 106 as an example, the explanation includes the following steps:

[0093] Step 202: Obtain information data provided by each information provider; the information data carries information tags used to identify the provider to which the information data belongs.

[0094] In this context, "information" can refer to valuable information that can be delivered to users in a relatively short period of time. Information includes, but is not limited to, news, research reports, knowledge, commentary, and opinions.

[0095] Information providers can refer to businesses or individuals that offer various types of information to information users. When information users need a large amount of data but cannot obtain it themselves, they can obtain it through an information provider. Different information providers may offer information of varying quality.

[0096] Information data can refer to data acquired within a unit of time. This information data includes information tags that identify the information provider to which the information data belongs. When information data includes both information content and information tags, it indicates that information has been updated within that unit of time; when information data only carries information tags and does not include information content, it indicates that the information has not been updated within that unit of time. Information data may or may not include multiple pieces of information content. For example, if information data is acquired through information provider A's interface within one hour (a unit of time), and this information data includes 4 pieces of information, it means that information provider A updated the information within one hour, with 4 pieces of information content and the information tag being A.

[0097] The content of the information can refer to the specific content of each piece of information.

[0098] For example, the data interface of the user terminal 104 can be connected to the interface of the supplier terminal 102. The information data provided by each information supplier can be obtained in real time through the interface of the supplier terminal 102. After obtaining the information data, the information data can be sent to the server 106, and the server 106 can store the information data in the data storage system.

[0099] Step 204: Detect the information elements of each information content in the information data to obtain the completeness assessment results corresponding to the information tags.

[0100] Information elements can refer to the basic components of information. These information elements may include, but are not limited to, the title, author, publication time, information category, information body, body format, and title image.

[0101] The completeness assessment result can refer to whether the information elements of the information content provided by the information provider corresponding to the information tag are complete. This completeness assessment result can be a specific completeness assessment score or other non-score results. For example, it can be a first completeness assessment result indicating a successful completeness assessment, or a second completeness assessment result indicating a failed completeness assessment. When the completeness assessment result is a specific completeness assessment score, it represents the overall score of all information content provided by the information provider corresponding to the information tag.

[0102] For example, the information elements of each piece of information content in the information data provided by each information provider are detected to determine whether the information elements of the information content are complete, and the completeness assessment result corresponding to the information tag is obtained.

[0103] Step 206: Based on the number of updated information for each information tag in each first detection period, obtain the stability evaluation result corresponding to the information tag.

[0104] The first testing period can refer to the testing period used to assess the stability of information data. This first testing period can be daily, hourly, etc.

[0105] The number of updated information items refers to the number of information items updated by the information provider within the first detection period. For example, the number of information items updated by the information provider within one hour. This number of updated information items can be one, multiple, or zero. When the number of updated information items is zero, it means that the information provider corresponding to the information tag did not update any information within the first detection period.

[0106] Stability assessment results can refer to the results used to characterize the stability of information updates by an information provider. These stability assessment results can be expressed using specific stability scores.

[0107] For example, the number of updated information for each information tag in each first detection period can be obtained, and then the stability evaluation result corresponding to the information tag can be calculated based on the number of updated information in each first detection period.

[0108] For example, a scheduled task can be configured every hour (the first detection cycle) to calculate the number of information items received within that hour, thus determining the number of updated information items. Server 106 then obtains the number of updated information items by acquiring the output of this scheduled task.

[0109] Step 208: Based on the number of information items that failed the review for each information tag within each second detection cycle, obtain the security assessment result corresponding to the information tag.

[0110] The second detection cycle can refer to the detection cycle used to assess the security of information content. This second detection cycle can be daily, hourly, etc.

[0111] The number of posts that failed the review can refer to the total number of posts that failed the security review during the second testing cycle. The security review may include, but is not limited to, checks for sensitive words and whether the posts are likely to cause negative public opinion.

[0112] A security assessment result refers to the outcome used to characterize the security level of information content. This security assessment result can be expressed as a specific security score.

[0113] For example, the number of information items that failed the review for each information tag in each second detection period can be obtained, and then the security assessment result corresponding to the information tag can be calculated based on the number of information items that failed the review.

[0114] Step 210: Obtain the interaction data of each piece of information in the information data, and obtain the feedback on each piece of information based on the interaction data, and obtain the application evaluation result corresponding to the information tag based on the feedback.

[0115] Interaction data refers to the data generated by users interacting with news content after reading it. This interaction data can be positive feedback (such as likes) or negative feedback (such as dislikes). It characterizes the application of news content in specific application scenarios. Application scenarios can refer to the scenarios in which news content is published and used across different channels, targeting different customer groups, and adhering to different business rules.

[0116] Feedback can refer to how users respond to information content. This feedback could include sharing, saving, disliking, or reporting.

[0117] Application evaluation results refer to the assessment results used to characterize the application of information content in application scenarios. These application evaluation results can be expressed as specific application scores.

[0118] For example, user interaction data on information content can be read from server 106, and then the user's feedback on each piece of information content can be determined based on the interaction data. Then, the application degree evaluation result corresponding to the information tag can be calculated based on the feedback.

[0119] Step 212: Determine the quality assessment results of information supply based on the results of the integrity assessment, stability assessment, security assessment, and applicability assessment.

[0120] The quality assessment result can refer to the result used to characterize the overall quality of the information provided by the information provider. This quality assessment result can be expressed as a specific score.

[0121] For example, the integrity assessment results, stability assessment results, security assessment results, and applicability assessment results can be added together to obtain the corresponding quality assessment results.

[0122] For example, based on pre-set weights, the weights corresponding to each evaluation result can be multiplied by the evaluation result, and then the multiplied results can be added together to obtain the quality evaluation result.

[0123] For example, the quality assessment result can be calculated using the following formula (1), which is as follows:

[0124]

[0125] In formula (1), score i bscore represents the quality assessment result of the information provider corresponding to a certain information tag. i This indicates the specific evaluation results of the information tag across various target dimensions, including completeness, stability, security, and applicability. ω i These are the weight values ​​corresponding to the target dimension.

[0126] The quality assessment results for each information provider can be calculated using formula (1).

[0127] The information supply quality assessment method of this application embodiment obtains information data from each information provider through an information provider interface, then detects the information elements of each information content in the information data to obtain a completeness assessment result, obtains a stability assessment result based on the number of updated information for each information tag in each first detection period, obtains a security assessment result based on the number of information that failed the review, and determines an application assessment result based on interactive data. This achieves information data assessment from the dimensions of completeness, stability, security, and application, improving the coverage of information data assessment and thus improving the accuracy of information data quality assessment. Furthermore, by assessing information data from the application dimension, the assessment results are more closely aligned with specific application scenarios, further improving the accuracy of information data quality assessment. This facilitates the quality assessment of information providers and enhances the accuracy of information provider quality assessment.

[0128] In some embodiments, the information supply quality assessment method further includes, but is not limited to, the following steps: determining improvement dimensions based on the quality assessment results; the improvement dimensions are at least one of completeness, stability, security, and applicability; and outputting improvement suggestions based on the assessment results corresponding to the improvement dimensions.

[0129] In this context, "improvement dimension" refers to the dimension in which an information provider needs to improve. When an information provider has a dimension that needs improvement, it indicates that the information provided by that provider has a deficiency in that dimension.

[0130] Improvement suggestions can refer to recommendations stored in user terminal 104 or server 106 for improving deficiencies in the information provided by the information provider. These improvement suggestions can be pre-stored in user terminal 104 or server 106. For example, users or administrators can pre-store multiple improvement suggestions corresponding to various improvement dimensions in the data storage system of server 106. Then, server 106 matches and obtains improvement suggestions based on the specific circumstances of each improvement dimension and outputs the improvement suggestions.

[0131] For example, information providers can be ranked according to their quality assessment results, and a supplier quality score ranking list can be constructed. Detailed score radar charts can be built based on the specific assessment results for each dimension. For information providers with lower rankings, their specific assessment results for each dimension can be obtained to determine the dimensions requiring improvement. Then, improvement suggestions can be generated based on the assessment results for those improvement dimensions and output.

[0132] The technical solution of this application embodiment determines the improvement dimensions corresponding to each information provider, thereby identifying the dimensions where each information provider has quality problems. Based on the evaluation results of the improvement dimensions, improvement suggestions are output, which facilitates information providers to make improvements according to the improvement suggestions, thereby improving the quality of the information provided by information providers and enhancing the user experience of reading information.

[0133] like Figure 3 As shown, in some embodiments, information elements include basic information and supplementary information of the declaration. The step "detecting the information elements of each information content in the information data to obtain the completeness assessment result corresponding to the information tag" includes, but is not limited to, the following steps:

[0134] Step 302: Evaluate the basic information of each piece of information in the information data according to the inspection frequency to obtain the completeness of the basic information corresponding to the information tag.

[0135] The inspection frequency refers to how frequently the basic information of each piece of information is evaluated. This inspection frequency can be once per hour, once per day, once per week, etc.

[0136] Basic information refers to the information used to characterize the fundamental elements of a news article. This basic information includes, but is not limited to, the article's title, author, publication date, category, and text.

[0137] The completeness of basic information can refer to the completeness of the basic information used to characterize the information content. This completeness of basic information may or may not conform to the completeness specifications.

[0138] If all the basic information in the information content is present, then the information content meets the completeness standard; if any of the basic information in the information content is missing, then the information content does not meet the completeness standard.

[0139] For example, the basic information of each piece of information in the information data can be evaluated at a frequency of once a day to obtain the completeness of the basic information corresponding to the information tags, thereby achieving a standardized evaluation of the completeness of the basic information of the information.

[0140] Step 304: Evaluate the content of the information based on the inspection frequency and the supplementary information in the statement to obtain the completeness of the supplementary information in the statement.

[0141] The supplementary information in the statement can refer to additional information that corresponds to the content in the title or body of the statement. For example, the supplementary information could include whether the statement contains a title image, whether it does not contain a title image, whether it contains an image in the body of the statement, or whether it does not contain an image in the body of the statement.

[0142] The completeness of supplementary information in a statement refers to the degree of matching between the supplementary information and the corresponding statement content. When the supplementary information matches the corresponding statement content, the completeness of the supplementary information conforms to the completeness specification; otherwise, it violates the completeness specification.

[0143] For example, the information content can be evaluated based on the specific content of the supplementary information of the statement to determine whether there is any statement content in the information content that matches the supplementary information of the statement, thereby obtaining the completeness of the supplementary information of the statement.

[0144] For example, if the supplementary information of a statement is that the statement has a title image, then the information content will be searched for a statement that matches the supplementary information of the statement. If the information content contains a title image, then the completeness of the supplementary information of the corresponding statement meets the completeness specification.

[0145] Specifically, when the supplementary information declared does not contain a title image, it needs to be corrected based on historical data. This includes the following steps: obtaining the average number of untitled images within a preset time period; obtaining the number of untitled images provided by the information provider corresponding to the information tag on that day; and determining the completeness of the declared supplementary information based on the average number of untitled images within the preset time period and the number of untitled images provided on that day.

[0146] The preset time period can refer to a pre-defined time period, such as a week or a month.

[0147] The average number of untitled images within a preset time period can be determined by the following formula (2), which is as follows:

[0148]

[0149] Where δ can refer to the average number of untitled images within a preset time period, and n can refer to the duration to be counted, such as the number of days, with a default of 7 days. x i This can refer to the number of untitled images provided by a news provider prior to the current day.

[0150] Formula (2) can be used to calculate the average number of untitled images within a preset time period. If the number of untitled images provided on a given day exceeds the number of corrections, the completeness of the supplementary information in the statement corresponding to the excess information is considered to violate the completeness specification. The completeness of the supplementary information in the statement corresponding to the information that does not exceed the limit is considered to comply with the completeness specification. That is, if y is greater than δ, then z = y - δ; if y is less than or equal to δ, then z = 0. Where z is the number of supplementary information in the statement that violates the completeness specification when there is no title image.

[0151] When the supplementary information in the statement indicates that the statement contains an image or that the statement does not contain an image, the handling method is similar to that for statements containing a title image or statements not containing a title image, and will not be repeated here.

[0152] Step 306: Calculate the completeness assessment result corresponding to the information tag based on the completeness of the basic information and the completeness of the supplementary information declared.

[0153] For example, the total number of violations of the completeness specification can be counted in the completeness of basic information and the completeness of supplementary information declared, and then the completeness assessment result corresponding to the information tag can be calculated.

[0154] The technical solution of this application embodiment determines the completeness assessment result by evaluating the basic information and the supplementary information declared in the information content, thereby realizing the completeness assessment of the information provided by the information provider, which facilitates the subsequent overall quality assessment of the information provider.

[0155] In some embodiments, the step "calculate the completeness assessment result corresponding to the information tag based on the completeness of the basic information and the completeness of the declared supplementary information" includes, but is not limited to, the following steps: calculating the current completeness assessment result corresponding to the inspection frequency based on the completeness of the basic information and the completeness of the declared supplementary information; obtaining the historical completeness assessment result based on the information tag; and calculating the completeness assessment result corresponding to the information tag based on the current completeness assessment result and the historical completeness assessment result.

[0156] Specifically, the integrity assessment result can be calculated in the following way.

[0157] t-score = current completeness assessment result * current weight + historical completeness assessment result * historical weight.

[0158] Here, t-score represents the completeness assessment result corresponding to the information tag, with a current weight of 70% and a historical weight of 30% by default. The current completeness assessment result and the historical completeness assessment result can be calculated in the following way:

[0159] Current completeness assessment result = (1 - number of information content completeness assessments that failed within the inspection frequency / total number of information contents obtained within the inspection frequency);

[0160] Historical completeness assessment result = (1 - number of information content completeness assessment failures within the historical period / total number of information contents obtained within the historical period).

[0161] Specifically, if either the completeness of the basic information or the completeness of the supplementary information declared violates the completeness specification, the corresponding information content completeness assessment will fail, and the historical time period will be within the past six months by default.

[0162] The technical solution of this application embodiment obtains a completeness assessment result by combining the current completeness assessment result and the historical completeness assessment result. It can comprehensively consider the current situation and the historical situation, thereby improving the accuracy of the completeness assessment and thus improving the accuracy of the quality assessment of information supply.

[0163] Please see Figure 4 In some embodiments, the step "obtaining the stability evaluation result corresponding to the information tag based on the number of updated information for each information tag in each first detection period" includes, but is not limited to, the following steps:

[0164] Step 402: Determine the update time evaluation result corresponding to the information tag based on the update status of the information content in the information data corresponding to each information tag within each first detection period.

[0165] The update status refers to whether there have been any updates to the information content during the first detection period. This update status includes both updates and no updates.

[0166] The update time assessment result can refer to the evaluation result used to characterize multiple update scenarios. This update time assessment result can be represented by a specific update time score.

[0167] For example, a scheduled task can be configured in each first detection cycle to record the update status of each information tag, that is, to record whether the information provider corresponding to each information tag has updated the information content, and then determine the corresponding update time evaluation result based on the update status.

[0168] For example, with the first detection cycle being one hour, a scheduled task is configured in each hour. If information content is updated within the scheduled task, the result (update status) is recorded as Y; otherwise, it is recorded as N. The corresponding update time evaluation result can be calculated using the following formula (3):

[0169]

[0170] Where α represents the update time evaluation result, count(Y) represents the number of information content updates in n first detection periods, and n represents the number of scheduled tasks, i.e., the number of first detection periods. For example, when count(Y) represents the number of information content updates from information providers corresponding to each information tag each day, n can be 24, or it can be a value less than 24 (scheduled tasks can be not configured during certain time periods, such as the time period from 10 pm to 6 am).

[0171] Step 404: Obtain the number of updated information corresponding to each information tag within each first detection period.

[0172] The number of updated information items can refer to the number of information items updated by the information provider corresponding to each information tag within the first detection period.

[0173] For example, a data statistics module can be set up to count the number of news items from the news providers corresponding to each news tag during the first detection period, thereby obtaining the number of updated news items.

[0174] When the first detection period is one hour, the number of updated information in each hour can be counted, and then the total number of information updates per day for each information provider corresponding to each information tag can be counted.

[0175] Step 406: Calculate the current quantity variance based on the number of updated information.

[0176] Among them, the current quantity variance can refer to the stability of the supplier's current information content quantity update in each first detection period corresponding to the information tag.

[0177] The formula for calculating the current quantity variance is shown in formula (4):

[0178]

[0179] in, Let x represent the current variance. i Let avg represent the number of updated information in each first detection period, where n is the number of first detection periods.

[0180] For example, the current quantity variance can be calculated according to formula (4).

[0181] Step 408: Obtain the historical quantity variance of information tags within the first time period.

[0182] The first time period is a pre-set time period that occurs before the current time, and this first time period can be one week from the current time.

[0183] For example, one can obtain the historical variance of information tags from a week ago.

[0184] Step 410: Calculate the stability assessment result corresponding to the information tag based on the current quantity variance, historical quantity variance, update time assessment result, and mapping relationship.

[0185] The mapping relationship refers to a pre-defined relationship between the mapping scores used to characterize the variance and stability assessment results. This mapping relationship can be stored in a data storage system. The mapping relationship can be shown in Table 1.

[0186] Table 1

[0187] variance Mapping score ≤50 100 [50,100) 90 [100,150) 80 And so on. And so on.

[0188] For example, based on the mapping relationship shown in Table 1, the mapping score corresponding to the current quantity variance can be obtained, the mapping score corresponding to the historical quantity variance can be obtained, and then the mapping score corresponding to the current quantity variance and the mapping score corresponding to the historical quantity variance can be weighted and averaged to obtain the corresponding updated quantity evaluation result. Then, the stability evaluation result can be calculated by weighting and averaging the updated quantity evaluation result and the updated time evaluation result.

[0189] For example, the stability assessment result can be calculated in the following way:

[0190] Updated quantity assessment result = Mapped score corresponding to historical quantity variance * Historical variance weight + Mapped score corresponding to current quantity variance * Current variance weight

[0191] The historical variance weight is set to 0.7 by default, and the current variance weight is set to 0.3 by default. These can be modified for more specific situations.

[0192] Stability assessment result = Update quantity assessment result * weight 1 + Update time assessment result * weight 2

[0193] The default values ​​for weight 1 and weight 2 are 0.5, which can be modified according to the actual situation.

[0194] The technical solution of this application embodiment, by combining the historical quantity variance, the current quantity variance, and the update time evaluation results, can accurately calculate the stability evaluation results, thereby improving the accuracy of stability evaluation and thus improving the accuracy of information content evaluation by information providers.

[0195] Please see Figure 5 In some embodiments, the step "obtaining the security assessment result corresponding to the information tag based on the number of information tags that failed review in each second detection cycle" includes, but is not limited to, the following steps:

[0196] Step 502: In each second detection cycle, the information content in the information data corresponding to the information tag is subject to keyword review to obtain the keyword review results.

[0197] The second detection period can refer to the period used to detect sensitive words in information content. This second detection period can be either a day or an hour.

[0198] Keyword review can refer to the process of checking whether there are sensitive words in information content.

[0199] Keyword review results can include keyword approval and keyword rejection.

[0200] For example, sensitive word detection can be performed on the information content during each second detection period to achieve keyword review. When sensitive words are present in the information content, the corresponding keyword review result is "keyword review failed." When no sensitive words are present in the information content, the corresponding keyword review result is "keyword review passed."

[0201] Step 504: In each second detection cycle, conduct public opinion review on the information content in the information data corresponding to the information tags to obtain the public opinion review results.

[0202] Among them, public opinion review can refer to the review of whether there is any negative public opinion content in the information content.

[0203] The results of public opinion review can include public opinion review failure and public opinion review success.

[0204] For example, the information content can be reviewed for negative public opinion in each second detection cycle. When there is negative public opinion in the information content, the corresponding review result is "public opinion review fails"; when there is no negative public opinion in the information content, the corresponding review result is "public opinion review passes".

[0205] Step 506: Obtain the number of information items that passed the review within each second testing cycle.

[0206] Among them, review can refer to the manual re-review of the information content when it fails the public opinion review or keyword review.

[0207] For example, the number of information items that have been manually re-approved in each second detection cycle can be obtained through server 106.

[0208] Step 508: Determine the number of information items that failed the review based on the keyword review results and public opinion review results.

[0209] The number of information items that failed the review can refer to the total number of information items that failed the keyword review or public opinion review. The number of information items that failed the review is not counted repeatedly; that is, if a piece of information fails both the keyword review and the public opinion review, the number is only counted as 1.

[0210] For example, the number of news items that failed the keyword review and the number of news items that failed the public opinion review are obtained. Then, the sum of the two is taken, and the number of duplicates is subtracted to obtain the corresponding number of news items that failed the review.

[0211] Step 510: Based on the number of information items that failed the review and the number of information items that passed the review, obtain the security assessment results corresponding to the information tags.

[0212] The security assessment results can include current security assessment results and historical security assessment results. The security assessment result can be obtained by weighting the current security assessment results and historical security assessment results.

[0213] For example, it can be calculated in the following way:

[0214] Security assessment result = Current security assessment result * Current security weight + Historical security assessment result * Historical security weight

[0215] The current security weight can be set to 0.7 by default, and the historical security weight can be set to 0.3 by default. These can be modified to suit specific circumstances.

[0216] The current security assessment result can be calculated using the following formula (5), and the historical security assessment result can be calculated using the following formula (6):

[0217]

[0218]

[0219] Here, cscore represents the current security assessment result, and hscore represents the historical security assessment result.

[0220] count(csw) and count(hsw) represent the number of information items that failed the sensitive word check in the second detection period and the historical detection period (e.g., one week), respectively.

[0221] count(cps) and count(hps) represent the number of pieces of information that failed the public opinion check of the data source in the second detection period and the historical detection period (e.g., one week);

[0222] count(cm) and count(hps) represent the number of pieces of information that have passed manual review in the second testing cycle and the historical testing cycle (e.g., one week).

[0223] The technical solution of this application embodiment calculates the security assessment result by combining historical security assessment results and current security assessment results, thereby improving the accuracy of security assessment.

[0224] Please see Figure 6 In some embodiments, the interaction data includes positive feedback data and negative feedback data. The step of "obtaining feedback on each piece of information based on the interaction data, and obtaining the application evaluation result corresponding to the information tag based on the feedback" includes, but is not limited to, the following steps:

[0225] Step 602: Determine the positive feedback status for each piece of information based on the positive feedback data.

[0226] Positive feedback data refers to data that provides positive feedback and represents user satisfaction with the information content. This positive feedback data can include actions such as browsing, liking, saving, and sharing.

[0227] Positive feedback can refer to the positive feedback that users give to information content.

[0228] For example, the positive feedback of information content can be determined by obtaining the number of views, likes, favorites, and shares of each piece of information, thus obtaining the positive feedback situation.

[0229] Step 604: Determine the negative feedback status of each piece of information based on the negative feedback data.

[0230] Negative feedback data refers to negative feedback data that characterizes user dissatisfaction with information content. This negative feedback data can include dislikes, reports, etc.

[0231] Negative feedback can refer to situations that characterize negative feedback from users towards information content.

[0232] For example, the amount of negative feedback on each piece of information can be determined by obtaining the number of dislikes and reports, and negative feedback can be purchased.

[0233] Step 606: Based on the positive and negative feedback, obtain the application evaluation results corresponding to the information tags.

[0234] For example, the application evaluation can include the current application evaluation result (such as the application evaluation result for the day) and the historical application evaluation results (the default is one week). The application evaluation result can be obtained by weighted averaging of the current application evaluation result and the historical application evaluation result.

[0235] For example, the application evaluation result = current application evaluation result * current application weight + historical application evaluation result * historical application weight.

[0236] The technical solution of this application embodiment obtains positive and negative feedback data for each piece of information to evaluate the applicability of the information content, making the evaluation results of the information content closer to the specific application scenario. Furthermore, by combining historical applicability evaluation results with current applicability evaluation results, the accuracy of the applicability evaluation results is improved, thereby improving the accuracy of the evaluation of the information content.

[0237] Please see Figure 7 This application provides a method for assessing the quality of information supply, including but not limited to the following steps:

[0238] Step 702: Obtain information data provided by each information provider; the information data carries an information tag used to identify the provider to which the information data belongs.

[0239] Step 704: Evaluate the basic information of each piece of information in the information data according to the inspection frequency to obtain the completeness of the basic information corresponding to the information tag.

[0240] Step 706: Evaluate the content of the information based on the inspection frequency and the supplementary information in the statement to obtain the completeness of the supplementary information in the statement.

[0241] Step 708: Calculate the current completeness assessment result corresponding to the inspection frequency based on the completeness of the basic information and the completeness of the declared supplementary information.

[0242] Step 710: Obtain the historical completeness assessment results based on the information tags.

[0243] Step 712: Calculate the completeness assessment result corresponding to the information tag based on the current completeness assessment result and the historical completeness assessment result.

[0244] Step 714: Determine the update time evaluation result corresponding to the information tag based on the update status of the information content in the information data corresponding to each information tag within each first detection period.

[0245] Step 716: Obtain the number of updated information corresponding to each information tag in each first detection period, and calculate the current quantity variance based on the number of updated information.

[0246] Step 718: Obtain the historical quantity variance of the information tag within the first time period. Based on the current quantity variance, historical quantity variance, update time evaluation results, and mapping relationship, calculate the stability evaluation result corresponding to the information tag.

[0247] Step 720: In each second detection cycle, the information content in the information data corresponding to the information tag is subject to keyword review to obtain the keyword review results.

[0248] Step 722: In each second detection cycle, conduct public opinion review on the information content in the information data corresponding to the information tags to obtain the public opinion review results.

[0249] Step 724: Determine the number of information items that failed the review based on the keyword review results and the public opinion review results.

[0250] Step 726: Obtain the number of information items that passed the review in each second testing cycle, and obtain the security assessment result corresponding to the information label based on the number of information items that failed the review and the number of information items that passed the review.

[0251] Step 728: Determine the positive feedback status for each piece of information based on the positive feedback data, and determine the negative feedback status for each piece of information based on the negative feedback data.

[0252] Step 730: Based on the positive and negative feedback, obtain the application evaluation results corresponding to the information tags.

[0253] Step 732: Based on the quality assessment results, determine the improvement dimensions; the improvement dimensions are at least one of completeness, stability, safety, and applicability; based on the assessment results corresponding to the improvement dimensions, output improvement suggestions.

[0254] For specific implementation details of steps 702 to 732, please refer to [link / reference]. Figures 2 to 6 The implementation examples are not described in detail here.

[0255] The technical solution of this application embodiment obtains information data from various information providers through information provider interfaces, then detects the information elements of each information content in the information data to obtain a completeness assessment result, obtains a stability assessment result based on the number of updated information for each information tag in each first detection period, obtains a security assessment result based on the number of information that failed the review, and determines an application assessment result based on interactive data. This achieves information data evaluation from the dimensions of completeness, stability, security, and application, improving the coverage of information data evaluation and thus improving the accuracy of information data quality assessment. Furthermore, by evaluating information data from the application dimension, the evaluation results are closer to specific application scenarios, further improving the accuracy of information data quality assessment. This facilitates the quality assessment of information providers and improves the accuracy of information provider quality assessment. By setting different detection periods or frequencies, the timeliness of information provider quality assessment is improved, and improvement suggestions are output through the quality assessment results, enabling information providers to improve based on these suggestions, thereby improving the quality of the information provided by information providers and enhancing the user experience of reading information.

[0256] It should be understood that although the steps in the flowcharts of the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0257] Based on the same inventive concept, this application also provides an information supply quality assessment apparatus for implementing the information supply quality assessment method described above. The solution provided by this apparatus is similar to the solution described in the above method.

[0258] In one embodiment, such as Figure 8 As shown, an information supply quality assessment device is provided, comprising: an information data acquisition module 802, an information element detection module 804, a stability assessment module 806, a security assessment module 808, an applicability assessment module 810, and a quality assessment determination module 812, wherein:

[0259] The information data acquisition module 802 is used to acquire information data provided by various information providers; the information data carries information tags used to identify the provider to which the information data belongs.

[0260] The information element detection module 804 is used to detect the information elements of each information content in the information data and obtain the completeness assessment results corresponding to the information tags.

[0261] The stability assessment module 806 is used to obtain the stability assessment result corresponding to each information tag based on the number of updated information for each information tag in each first detection period.

[0262] The security assessment module 808 is used to obtain the security assessment result of each information tag based on the number of information tags that fail the review within each second detection cycle.

[0263] The application evaluation module 810 is used to obtain the interaction data of each piece of information in the information data, obtain the feedback on each piece of information based on the interaction data, and obtain the application evaluation result corresponding to the information tag based on the feedback.

[0264] The quality assessment determination module 812 is used to determine the quality assessment results of information supply based on the results of integrity assessment, stability assessment, security assessment, and usability assessment.

[0265] In some embodiments, the information supply quality assessment device further includes:

[0266] The improvement dimension determination module is used to determine the improvement dimensions based on the quality assessment results; the improvement dimension is at least one of completeness, stability, safety, and applicability.

[0267] The improvement suggestion output module is used to output improvement suggestions based on the evaluation results corresponding to the improvement dimensions.

[0268] In some embodiments, the information elements include basic information and supplementary information of the declaration; the information element detection module includes: a basic information evaluation unit, used to evaluate the basic information of each information content in the information data according to the inspection frequency, and obtain the completeness of the basic information corresponding to the information tag; a content evaluation unit, used to evaluate the content of the information content according to the inspection frequency and the supplementary information of the declaration, and obtain the completeness of the supplementary information of the declaration; and a completeness calculation unit, used to calculate the completeness evaluation result corresponding to the information tag according to the completeness of the basic information and the completeness of the supplementary information of the declaration.

[0269] In some embodiments, the completeness calculation unit includes: a current completeness calculation subunit, configured to calculate the current completeness assessment result corresponding to the inspection frequency based on the completeness of the basic information and the completeness of the declared supplementary information; a historical completeness acquisition subunit, configured to acquire historical completeness assessment results based on the information tag; and a completeness assessment subunit, configured to calculate the completeness assessment result corresponding to the information tag based on the current completeness assessment result and the historical completeness assessment result.

[0270] In some embodiments, the stability assessment module includes: an update time assessment unit, configured to determine the update time assessment result corresponding to the information tag based on the update status of the information content in the information data corresponding to each information tag within each first detection period; an update information quantity acquisition unit, configured to acquire the update information quantity corresponding to each information tag within each first detection period; a current quantity variance calculation unit, configured to calculate the current quantity variance based on the update information quantity; a historical quantity variance acquisition unit, configured to acquire the historical quantity variance of the information tag within a first time period; and a stability assessment unit, configured to calculate the stability assessment result corresponding to the information tag based on the current quantity variance, the historical quantity variance, the update time assessment result, and the mapping relationship.

[0271] In some embodiments, the security assessment module includes: a keyword review unit, configured to review the information content in the information data corresponding to the information tag with keywords within each second detection period, and obtain a keyword review result; a public opinion review unit, configured to review the information content in the information data corresponding to the information tag with public opinion within each second detection period, and obtain a public opinion review result; an information quantity acquisition unit, configured to acquire the number of information items that passed the review within each second detection period; an information quantity determination unit, configured to determine the number of information items that failed the review based on the keyword review result and the public opinion review result; and a security assessment unit, configured to obtain a security assessment result corresponding to the information tag based on the number of information items that failed the review and the number of information items that passed the review.

[0272] In some embodiments, the interaction data includes positive feedback data and negative feedback data; the application evaluation module includes: a positive feedback determination unit, configured to determine the positive feedback status of each piece of information based on the positive feedback data; the positive feedback data is used to characterize the user's satisfaction with the information content; a negative feedback determination unit, configured to determine the negative feedback status of each piece of information based on the negative feedback data; the negative feedback data is used to characterize the user's dissatisfaction with the information content; and an application evaluation unit, configured to obtain the application evaluation result corresponding to the information tag based on the positive feedback status and the negative feedback status.

[0273] Each module in the aforementioned information supply quality assessment device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the corresponding operations of each module.

[0274] In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 9As shown, the computer device includes a processor, memory, input / output interface, communication interface, display unit, and input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interface. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The input / output interface is used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When executed by the processor, the computer program implements a method for evaluating the quality of information provision. The display unit is used to form a visually visible image and can be a display screen, projection device, or virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.

[0275] Those skilled in the art will understand that Figure 9 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0276] In one embodiment, a computer device is provided, including a memory and a processor. The memory stores a computer program, and the processor executes the computer program to perform the following steps: acquiring information data provided by various information providers; the information data carrying information tags for identifying the providers to which the information data belongs; detecting information elements of each information content in the information data to obtain a completeness assessment result corresponding to the information tag; obtaining a stability assessment result corresponding to the information tag based on the number of updated information for each information tag in each first detection period; obtaining a security assessment result corresponding to the information tag based on the number of information that failed review for each information tag in each second detection period; acquiring interaction data of each information content in the information data, obtaining feedback on each information content based on the interaction data, and obtaining an applicability assessment result corresponding to the information tag based on the feedback; and determining a quality assessment result of the information supply based on the completeness assessment result, stability assessment result, security assessment result, and applicability assessment result.

[0277] In one embodiment, when the processor executes the computer program, it further performs the following steps: determining improvement dimensions based on the quality assessment results; the improvement dimension is at least one of completeness, stability, security, and applicability; and outputting improvement suggestions based on the assessment results corresponding to the improvement dimensions.

[0278] In one embodiment, when the processor executes the computer program, it further performs the following steps: evaluating the basic information of each piece of information in the information data according to the inspection frequency to obtain the completeness of the basic information corresponding to the information tag; evaluating the content of the information content according to the inspection frequency and the declared supplementary information to obtain the completeness of the declared supplementary information; and calculating the completeness evaluation result corresponding to the information tag based on the completeness of the basic information and the completeness of the declared supplementary information.

[0279] In one embodiment, when the processor executes the computer program, it further performs the following steps: calculating the current completeness assessment result corresponding to the inspection frequency based on the completeness of the basic information and the completeness of the declared supplementary information; obtaining the historical completeness assessment result based on the information tag; and calculating the completeness assessment result corresponding to the information tag based on the current completeness assessment result and the historical completeness assessment result.

[0280] In one embodiment, when the processor executes the computer program, it further implements the following steps: determining the update time evaluation result corresponding to the information tag based on the update status of the information content in the information data corresponding to each information tag in each first detection period; obtaining the number of updated information corresponding to each information tag in each first detection period; calculating the current quantity variance based on the number of updated information; obtaining the historical quantity variance of the information tag in the first time period; and calculating the stability evaluation result corresponding to the information tag based on the current quantity variance, historical quantity variance, update time evaluation result, and mapping relationship.

[0281] In one embodiment, when the processor executes the computer program, it further performs the following steps: performing keyword review on the information content in the information data corresponding to the information tag within each second detection period, and obtaining keyword review results; performing public opinion review on the information content in the information data corresponding to the information tag within each second detection period, and obtaining public opinion review results; obtaining the number of information items that passed the review within each second detection period; determining the number of information items that failed the review based on the keyword review results and the public opinion review results; and obtaining the security assessment result corresponding to the information tag based on the number of information items that failed the review and the number of information items that passed the review.

[0282] In one embodiment, when the processor executes the computer program, it further performs the following steps: determining the positive feedback status of each piece of information based on positive feedback data; the positive feedback data is used to characterize the user's satisfaction with the information content; determining the negative feedback status of each piece of information based on negative feedback data; the negative feedback data is used to characterize the user's dissatisfaction with the information content; and obtaining the application evaluation result corresponding to the information tag based on the positive and negative feedback status.

[0283] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When executed by a processor, the computer program performs the following steps: acquiring information data provided by various information providers; the information data carrying information tags for identifying the providers to which the information data belongs; detecting information elements of each information content in the information data to obtain a completeness assessment result corresponding to the information tag; obtaining a stability assessment result corresponding to the information tag based on the number of updated information for each information tag in each first detection period; obtaining a security assessment result corresponding to the information tag based on the number of information that failed review for each information tag in each second detection period; acquiring interaction data of each information content in the information data, and obtaining feedback on each information content based on the interaction data, and obtaining an applicability assessment result corresponding to the information tag based on the feedback; and determining a quality assessment result of the information supply based on the completeness assessment result, stability assessment result, security assessment result, and applicability assessment result.

[0284] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: determining improvement dimensions based on the quality assessment results; the improvement dimension is at least one of completeness, stability, security, and applicability; and outputting improvement suggestions based on the assessment results corresponding to the improvement dimensions.

[0285] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: evaluating the basic information of each piece of information in the information data according to the inspection frequency to obtain the completeness of the basic information corresponding to the information tag; evaluating the content of the information content according to the inspection frequency and the declared supplementary information to obtain the completeness of the declared supplementary information; and calculating the completeness evaluation result corresponding to the information tag based on the completeness of the basic information and the completeness of the declared supplementary information.

[0286] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: calculating the current completeness assessment result corresponding to the inspection frequency based on the completeness of the basic information and the completeness of the declared supplementary information; obtaining the historical completeness assessment result based on the information tag; and calculating the completeness assessment result corresponding to the information tag based on the current completeness assessment result and the historical completeness assessment result.

[0287] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: determining the update time evaluation result corresponding to the information tag based on the update status of the information content in the information data corresponding to each information tag in each first detection period; obtaining the number of updated information corresponding to each information tag in each first detection period; calculating the current quantity variance based on the number of updated information; obtaining the historical quantity variance of the information tag in the first time period; and calculating the stability evaluation result corresponding to the information tag based on the current quantity variance, historical quantity variance, update time evaluation result, and mapping relationship.

[0288] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: performing keyword review on the information content in the information data corresponding to the information tag within each second detection period, and obtaining keyword review results; performing public opinion review on the information content in the information data corresponding to the information tag within each second detection period, and obtaining public opinion review results; obtaining the number of information items that passed the review within each second detection period; determining the number of information items that failed the review based on the keyword review results and the public opinion review results; and obtaining the security assessment result corresponding to the information tag based on the number of information items that failed the review and the number of information items that passed the review.

[0289] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: determining the positive feedback status of each piece of information based on positive feedback data; the positive feedback data is used to characterize the user's satisfaction with the information content; determining the negative feedback status of each piece of information based on negative feedback data; the negative feedback data is used to characterize the user's dissatisfaction with the information content; and obtaining the application evaluation result corresponding to the information tag based on the positive and negative feedback status.

[0290] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, acquires information data provided by various information providers; the information data carries information tags for identifying the providers to which the information data belongs; detects information elements of each information content in the information data to obtain a completeness assessment result corresponding to the information tag; obtains a stability assessment result corresponding to the information tag based on the number of updated information for each information tag in each first detection period; obtains a security assessment result corresponding to the information tag based on the number of information that fails review for each information tag in each second detection period; acquires interaction data of each information content in the information data, and obtains feedback on each information content based on the interaction data, and obtains an applicability assessment result corresponding to the information tag based on the feedback; and determines a quality assessment result of the information supply based on the completeness assessment result, stability assessment result, security assessment result, and applicability assessment result.

[0291] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: determining improvement dimensions based on the quality assessment results; the improvement dimension is at least one of completeness, stability, security, and applicability; and outputting improvement suggestions based on the assessment results corresponding to the improvement dimensions.

[0292] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: evaluating the basic information of each piece of information in the information data according to the inspection frequency to obtain the completeness of the basic information corresponding to the information tag; evaluating the content of the information content according to the inspection frequency and the declared supplementary information to obtain the completeness of the declared supplementary information; and calculating the completeness evaluation result corresponding to the information tag based on the completeness of the basic information and the completeness of the declared supplementary information.

[0293] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: calculating the current completeness assessment result corresponding to the inspection frequency based on the completeness of the basic information and the completeness of the declared supplementary information; obtaining the historical completeness assessment result based on the information tag; and calculating the completeness assessment result corresponding to the information tag based on the current completeness assessment result and the historical completeness assessment result.

[0294] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: determining the update time evaluation result corresponding to the information tag based on the update status of the information content in the information data corresponding to each information tag in each first detection period; obtaining the number of updated information corresponding to each information tag in each first detection period; calculating the current quantity variance based on the number of updated information; obtaining the historical quantity variance of the information tag in the first time period; and calculating the stability evaluation result corresponding to the information tag based on the current quantity variance, historical quantity variance, update time evaluation result, and mapping relationship.

[0295] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: performing keyword review on the information content in the information data corresponding to the information tag within each second detection period, and obtaining keyword review results; performing public opinion review on the information content in the information data corresponding to the information tag within each second detection period, and obtaining public opinion review results; obtaining the number of information items that passed the review within each second detection period; determining the number of information items that failed the review based on the keyword review results and the public opinion review results; and obtaining the security assessment result corresponding to the information tag based on the number of information items that failed the review and the number of information items that passed the review.

[0296] In one embodiment, when the computer program is executed by the processor, it further performs the following steps: determining the positive feedback status of each piece of information based on positive feedback data; the positive feedback data is used to characterize the user's satisfaction with the information content; determining the negative feedback status of each piece of information based on negative feedback data; the negative feedback data is used to characterize the user's dissatisfaction with the information content; and obtaining the application evaluation result corresponding to the information tag based on the positive and negative feedback status.

[0297] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0298] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0299] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method of evaluating the quality of information provision, characterized by, The method comprises: acquiring information data provided by each information provider; the information data carries an information label for identifying the provider to which the information data belongs; according to the inspection frequency, performing completeness evaluation on information base information of each information content in the information data, and performing matching degree evaluation on the information content according to declared supplementary information information, to obtain the number of information contents that fail in the information content completeness evaluation, so as to determine the completeness evaluation result corresponding to the information label; according to the update situation and the number of updated information of the information content in the information data corresponding to each information label in each first detection period, performing information update time evaluation and information update number evaluation, to obtain the update time evaluation result and the update number evaluation result, so as to determine the stability evaluation result corresponding to the information label; according to the number of information that fails in keyword review, the number of information that fails in public opinion review and the number of information that passes in review of each information label in each second detection period, performing proportion calculation, to obtain the safety evaluation result corresponding to the information label; acquiring positive feedback data and negative feedback data of each information content in the information data, and determining the positive feedback situation and the negative feedback situation of each information content according to the positive feedback data and the negative feedback data, to obtain the application degree evaluation result corresponding to the information label; wherein the positive feedback data is used to represent the satisfaction degree of the user to the information content, and the negative feedback data is used to represent the dissatisfaction degree of the user to the information content; determining the quality evaluation result of the information supply according to the completeness evaluation result, the stability evaluation result, the safety evaluation result and the application degree evaluation result.

2. The method of claim 1, wherein, The method further comprises: determining an improvement dimension according to the quality evaluation result; the improvement dimension is at least one of completeness, stability, safety and application degree; outputting an improvement suggestion according to the evaluation result corresponding to the improvement dimension.

3. The method of claim 1, wherein, The declared supplementary information information comprises declaration of existence of title picture, declaration of non-existence of title picture, declaration of existence of picture in the text and declaration of non-existence of picture in the text; performing matching degree evaluation on the information content according to the declared supplementary information information comprises: when the declared supplementary information information is declaration of existence of title picture or declaration of existence of picture in the text, and the declared content matching the declared supplementary information information is found in the information content, it is determined that the information content completeness evaluation passes; when the declared supplementary information information is declaration of existence of title picture or declaration of existence of picture in the text, and the declared content matching the declared supplementary information information cannot be found in the information content, it is determined that the information content completeness evaluation fails; when the declared supplementary information information is declaration of non-existence of title picture or declaration of non-existence of picture in the text, the information content exceeding the average number of title pictures in a preset time period or the information content exceeding the average number of text pictures in a preset time period is determined as the information content that fails in the information content completeness evaluation.

4. The method of claim 3, wherein, According to the number of information contents that fail in the information content completeness evaluation, a completeness evaluation result corresponding to the information label is determined, including: According to the number of information contents that fail in the information content completeness evaluation and the total number of information contents obtained within the inspection frequency, a current completeness evaluation result corresponding to the inspection frequency is calculated; According to the history completeness evaluation result of the information label, a completeness evaluation result corresponding to the information label is calculated. According to the current completeness evaluation result and the current weight, the history completeness evaluation result and the history weight, a completeness evaluation result corresponding to the information label is calculated.

5. The method of claim 1, wherein, According to the number of updated information contents in the information data corresponding to each information label within each first detection period, an information update quantity evaluation is performed to obtain an update quantity evaluation result, including: Obtain the number of updated information contents corresponding to each information label within each first detection period; According to the update quantity, a current quantity variance is calculated; Obtain the history quantity variance of the information label within a first time period; Through a mapping relationship, a mapping score corresponding to the current quantity variance and a mapping score corresponding to the history quantity variance are obtained; The mapping score corresponding to the current quantity variance and the mapping score corresponding to the history quantity variance are weighted and averaged to obtain the update quantity evaluation result.

6. The method according to any one of claims 1 to 5, characterized in that, According to the number of information contents that fail in keyword review, the number of information contents that fail in public opinion review, and the number of information contents that pass in review of each information label within each second detection period, a proportion calculation is performed to obtain a safety degree evaluation result corresponding to the information label, including: According to the number of information contents that fail in keyword review, the number of information contents that fail in public opinion review, and the number of information contents that pass in review of each information label within a current second detection period, a proportion calculation is performed to obtain a current safety degree evaluation result; According to the number of information contents that fail in keyword review, the number of information contents that fail in public opinion review, and the number of information contents that pass in review of each information label within a history detection period, a proportion calculation is performed to obtain a history safety degree evaluation result; The current safety degree evaluation result and the history safety degree evaluation result are weighted and averaged to obtain a safety degree evaluation result corresponding to the information label.

7. The method according to any one of claims 1 to 5, characterized in that, According to the completeness evaluation result, the stability evaluation result, the safety degree evaluation result, and the application degree evaluation result, a quality evaluation result of the information supply is determined, including: According to a pre-set weight, the completeness evaluation result, the stability evaluation result, the safety degree evaluation result, and the application degree evaluation result are weighted and calculated to determine the quality evaluation result of the information supply.

8. An information supply quality evaluation device characterized by comprising: The device includes: An information data acquisition module for acquiring information data provided by each information supplier; the information data carries an information label for identifying the supplier to which the information data belongs; The information element detection module is configured to perform completeness evaluation on information base information of each information content in the information data according to a check frequency, perform matching degree evaluation on the information content according to declared supplementary information, and obtain an information quantity of which the information content completeness evaluation fails, so as to determine a completeness evaluation result corresponding to the information label; The stability evaluation module is configured to perform information update time evaluation and information update quantity evaluation according to an update condition and an update information quantity of the information content in the information data corresponding to each information label in each first detection period, and obtain an update time evaluation result and an update quantity evaluation result, so as to determine a stability evaluation result corresponding to the information label; The security evaluation module is configured to perform proportion calculation according to an information quantity that fails keyword review, an information quantity that fails public opinion review, and an information quantity that passes recheck of each information label in each second detection period, and obtain a security evaluation result corresponding to the information label; The application degree evaluation module is configured to obtain positive feedback data and negative feedback data of each information content in the information data, and determine positive feedback conditions and negative feedback conditions of each information content according to the positive feedback data and the negative feedback data, so as to obtain an application degree evaluation result corresponding to the information label; the positive feedback data is used to represent a satisfaction degree of a user to the information content, and the negative feedback data is used to represent an unsatisfaction degree of the user to the information content; The quality evaluation determination module is configured to determine a quality evaluation result of the information supply according to the completeness evaluation result, the stability evaluation result, the security evaluation result, and the application degree evaluation result.

9. The apparatus of claim 8, wherein, The device further includes: The improvement dimension determination module is configured to determine an improvement dimension according to the quality evaluation result; the improvement dimension is at least one of completeness, stability, security, and application degree; The improvement suggestion output module is configured to output an improvement suggestion according to an evaluation result corresponding to the improvement dimension. 10.A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer device is configured to perform the method according to any one of claims 1-9. The processor executes the computer program to implement the steps of the method in any one of claims 1 to 7.

11. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method in any one of claims 1 to 7.

12. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method in any one of claims 1 to 7.

Images