Document quality evaluation method and device, equipment and storage medium

Abstract

The invention belongs to the technical field of computers, and particularly relates to a document quality evaluation method and device, equipment and a storage medium. To-be-evaluated document information is obtained, the to-be-evaluated document information comprises a target document type and target document content, the target document rule configuration condition is determined according to the target document type and a rule configuration library, and the rule configuration library is used for indicating the incidence relation between the document type and the document rule configuration condition; determining a target document quality evaluation range according to the target document content and the target document rule configuration condition, and performing evaluation processing on the target document content according to the target document quality evaluation range to obtain a target document quality evaluation result; according to the method, the document rule configuration condition and the document quality evaluation range are dynamically matched for the to-be-evaluated document, and the diversity, reusability and accuracy of document quality evaluation are improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular, to a method, apparatus, device, and storage medium for document quality assessment. Background Art

[0002] Document quality assessment is a comprehensive assessment and analysis of the quality of archives. Through document quality assessment, archival information can be better protected and utilized, and the scientific nature and accuracy of enterprise decision-making can be improved.

[0003] In the prior art, a quality evaluation model is constructed through historical document information, and the quality of a document to be evaluated is scored through the quality evaluation model. Among them, the specific implementation method for the quality evaluation model to score the quality of a document to be evaluated is as follows: by splitting the text of the document to be evaluated, the structural features and text features of the document to be evaluated are obtained, so as to determine the document quality evaluation result and obtain a document quality evaluation report.

[0004] However, in the above method, the quality of documents of the same type cannot be dynamically evaluated, and there are problems such as low diversity, poor reusability, and low accuracy in document quality assessment. Summary of the Invention

[0005] This application provides a method, apparatus, device, and storage medium for document quality assessment to solve the problems of low diversity, poor reusability, and low accuracy in document quality assessment.

[0006] In a first aspect, this application provides a method for document quality assessment, including:

[0007] Obtain document information to be evaluated, where the document information to be evaluated includes: a target document type and target document content;

[0008] According to the target document type and the rule configuration library, determine the target document rule configuration situation, where the rule configuration library is used to indicate the association relationship between the document type and the document rule configuration situation;

[0009] According to the target document content and the target document rule configuration situation, determine the target document quality assessment range, and perform an assessment process on the target document content according to the target document quality assessment range to obtain a target document quality assessment result.

[0010] Optionally, determining the target document rule configuration situation as a first rule configuration situation according to the requirement document type and the rule configuration library, where the first rule configuration situation includes: a keyword matching rule, a format verification rule, a resource library retrieval rule, and a semantic matching model verification rule;

[0011] Determine the quality assessment scope of the target document according to the content of the target document and the configuration of the target document rules, and evaluate and process the content of the target document according to the quality assessment scope of the target document to obtain the quality assessment result of the target document, including:

[0012] Determine the first quality assessment scope corresponding to the content of the target document according to the content of the target document and the configuration of the first rule. The first quality assessment scope includes: keyword matching scope, format verification standard, resource library retrieval scope, and semantic matching model verification standard;

[0013] Evaluate and process the content of the target document according to the keyword matching scope, the format verification standard, the resource library retrieval scope, and the semantic matching model verification standard to obtain the quality assessment result of the target document.

[0014] Optionally, perform word segmentation processing on the content of the target document according to the keyword matching scope to obtain at least one target keyword;

[0015] Evaluate and process the target document according to the target keyword and the bidirectional maximum matching algorithm to obtain the forward matching word segmentation result and the reverse matching word segmentation result;

[0016] Judge whether the forward matching word segmentation result and the reverse matching word segmentation result are equal;

[0017] If the forward matching word segmentation result and the reverse matching word segmentation result are equal, the keyword matching result is any one of the forward matching word segmentation result and the reverse matching word segmentation result;

[0018] If the forward matching word segmentation result and the reverse matching word segmentation result are not equal, select the one that meets the preset conditions from the forward matching word segmentation result and the reverse matching word segmentation result as the keyword matching result;

[0019] Obtain the first quality assessment result according to the keyword matching result.

[0020] Optionally, the quality assessment result of the target document includes: a second quality assessment result. Evaluate and process the content of the target document according to the format verification standard to obtain the second quality assessment result, including:

[0021] Perform format parsing on the content of the target document according to the format verification standard to obtain the format parsing result of the target document;

[0022] Obtain the second quality assessment result according to the format parsing result of the target document.

[0023] Optionally, the target document quality assessment result includes: a third quality assessment result, and the process of assessing the target document content according to the resource library retrieval scope to obtain the third quality assessment result includes:

[0024] Performing a similarity and / or duplicate check rate retrieval on the target document content according to the resource library retrieval scope to obtain a target document retrieval result;

[0025] Obtaining the third quality assessment result according to the target document retrieval result.

[0026] Optionally, the target document quality assessment result includes: a fourth quality assessment result, and the process of assessing the target document content according to the semantic matching model inspection standard to obtain the fourth quality assessment result includes:

[0027] Performing a semantic similarity match on the target document content according to the semantic matching model inspection standard to obtain a target document semantic matching result;

[0028] Obtaining the fourth quality assessment result according to the target document semantic matching result.

[0029] In a second aspect, the present application provides a document quality assessment device, including:

[0030] An acquisition module, configured to acquire information of a document to be evaluated, where the information of the document to be evaluated includes: a target document type and target document content;

[0031] A determination module, configured to determine the target document rule configuration according to the target document type and a rule configuration library, where the rule configuration library is used to indicate the association relationship between the document type and the document rule configuration;

[0032] The determination module is further configured to determine the target document quality assessment scope according to the target document content and the target document rule configuration;

[0033] A processing module, configured to perform an assessment process on the target document content according to the target document quality assessment scope to obtain a target document quality assessment result.

[0034] Optionally, the determination module is further configured to determine that the target document rule configuration is a first rule configuration according to the requirement document type and the rule configuration library, where the first rule configuration includes: a keyword matching rule, a format verification rule, a resource library retrieval rule, and a semantic matching model inspection rule;

[0035] The determining module is further configured to determine a first quality evaluation range corresponding to the target document content according to the target document content and the first rule configuration, where the first quality evaluation range includes: a keyword matching range, a format verification standard, a resource library retrieval range, and a semantic matching model verification standard;

[0036] The processing module is further configured to perform an evaluation process on the target document content according to the keyword matching range, the format verification standard, the resource library retrieval range, and the semantic matching model verification standard to obtain the target document quality evaluation result.

[0037] Optionally, the document quality evaluation device further includes: a judgment module;

[0038] The processing module is further configured to perform word segmentation on the target document content according to the keyword matching range to obtain at least one target keyword;

[0039] The processing module is further configured to perform an evaluation process on the target document according to the target keyword and the bidirectional maximum matching algorithm to obtain a forward matching word segmentation result and a reverse matching word segmentation result;

[0040] The judgment module is further configured to judge whether the forward matching word segmentation result and the reverse matching word segmentation result are equal;

[0041] The determining module is further configured to, when the forward matching word segmentation result and the reverse matching word segmentation result are equal, the keyword matching result is any one of the forward matching word segmentation result and the reverse matching word segmentation result;

[0042] The determining module is further configured to, when the forward matching word segmentation result and the reverse matching word segmentation result are not equal, take the one that meets the preset conditions among the forward matching word segmentation result and the reverse matching word segmentation result as the keyword matching result.

[0043] The determining module is further configured to obtain the first quality evaluation result according to the keyword matching result.

[0044] Optionally, the determining module is further configured to perform format parsing on the target document content according to the format verification standard to obtain a target document format parsing result;

[0045] The determining module is further configured to obtain the second quality evaluation result according to the target document format parsing result.

[0046] Optionally, the determining module is further configured to perform a similarity and / or duplicate check rate retrieval on the target document content according to the resource library retrieval range to obtain a target document retrieval result;

[0047] The determining module is further configured to obtain the third quality evaluation result according to the target document retrieval result.

[0048] Optionally, the determining module is further configured to perform semantic similarity matching on the content of the target document according to the semantic matching model inspection criteria to obtain a target document semantic matching result;

[0049] The determining module is further configured to obtain the fourth quality evaluation result according to the target document semantic matching result.

[0050] In a third aspect, the present application provides a document quality evaluation device, including:

[0051] A memory;

[0052] A processor;

[0053] Wherein, the memory stores computer execution instructions;

[0054] The processor executes the computer execution instructions stored in the memory to implement the document quality evaluation method as described in the first aspect and all possible implementations of the first aspect.

[0055] In a fourth aspect, the present application provides a computer storage medium, characterized in that computer execution instructions are stored in the computer storage medium, and when the computer execution instructions are executed by a processor, they are used to implement the document quality evaluation method as described in the first aspect and all possible implementations of the first aspect.

[0056] The document quality evaluation method provided by the present application obtains information of a document to be evaluated, where the information of the document to be evaluated includes: a target document type and target document content, determines a target document rule configuration situation according to the target document type and a rule configuration library, where the rule configuration library is used to indicate the association relationship between the document type and the document rule configuration situation, determines a target document quality evaluation range according to the target document content and the target document rule configuration situation, and performs an evaluation process on the target document content according to the target document quality evaluation range to obtain a target document quality evaluation result; this method dynamically matches a document rule configuration situation and a document quality evaluation range for the document to be evaluated, improving the diversity, reusability, and accuracy of document quality evaluation. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application and used together with the specification to explain the principles of the present application.

[0058] Figure 1 is a flowchart of the document quality evaluation method provided by the present application Figure 1 ;

[0059] Figure 2 The flow of the document quality evaluation method provided for this application Figure 2 ;

[0060] Figure 3 The flow of the document quality evaluation method provided for this application Figure 3 ;

[0061] Figure 4 The structural schematic diagram of the document quality evaluation device provided for this application;

[0062] Figure 5 The structural schematic diagram of the document quality evaluation equipment provided for this application.

[0063] Through the above-mentioned drawings, the specific embodiments of this application have been shown, and there will be more detailed descriptions hereinafter. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. Specific embodiments

[0064] Here, the exemplary embodiments will be described in detail, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. On the contrary, they are merely examples of devices and methods consistent with some aspects of this application as detailed in the appended claims.

[0065] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant laws, regulations, and standards, and corresponding operation entrances are provided for the user to choose to authorize or refuse.

[0066] Document quality evaluation is to comprehensively evaluate and analyze the quality of archives. Through document quality evaluation, the archival information can be better protected and utilized, and the scientificity and accuracy of enterprise decision-making can be improved.

[0067] In the prior art, a quality evaluation model is constructed through historical document information, and the quality of the document to be evaluated is scored through the quality evaluation model. Among them, the specific implementation method for the quality evaluation model to score the quality of the document to be evaluated is: by splitting the text of the document to be evaluated, the structural features and text features of the document to be evaluated are obtained, so as to determine the document quality evaluation result and obtain a document quality evaluation report.

[0068] However, in the above method, it is impossible to dynamically evaluate the quality of documents of the same type, and there are problems such as low diversity, poor reusability, and low accuracy in document quality evaluation.

[0069] In view of the above problems, the present application proposes a document quality evaluation method. By obtaining the document information to be evaluated corresponding to the target document type and the target document content, determining the target document rule configuration according to the target document type and the rule configuration library, determining the target document quality evaluation range according to the target document content and the target document rule configuration, and evaluating the target document content according to the target document quality evaluation range to obtain the target document quality evaluation result; this method dynamically matches the document rule configuration and the document quality evaluation range for the document to be evaluated, improving the diversity, reusability, and accuracy of document quality evaluation.

[0070] The technical solution of the present application and how the technical solution of the present application solves the above technical problems will be described in detail below with specific embodiments. These specific embodiments below can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below with reference to the drawings.

[0071] Figure 1 The flow of the document quality evaluation method provided by the present application Figure 1 . As Figure 1 shown, the document quality evaluation method shown in this embodiment includes:

[0072] S101: Obtain the document information to be evaluated, where the document information to be evaluated includes: the target document type and the target document content.

[0073] First, it is necessary to obtain historical evaluation documents, and then according to the uses and characteristics of the documents, the documents can be divided into different types, such as: requirement documents, design documents, test documents, delivery feedback documents, product description documents, etc.

[0074] After determining the document type, it is necessary to extract the document content through reading or document parsing tools. The document content includes: the title, text, paragraphs, and format of the document, etc. For the extracted document content, some formatting processing needs to be performed to ensure the accuracy and reliability of the document content. For example: removing irrelevant format tags, handling garbled characters, etc.

[0075] Classify and organize the formatted document content according to different document types, so as to associate the document types in the historical document information with the document content. Each document type will correspond to at least one document content, and each document content has a corresponding document type.

[0076] After obtaining the document to be evaluated, the features of the document to be evaluated can be extracted and processed to determine the information of the document to be evaluated. In this step, obtaining accurate information of the document to be evaluated is the basis for obtaining an accurate document quality evaluation result.

[0077] S102: Determine the target document rule configuration according to the target document type and the rule configuration library, where the rule configuration library is used to indicate the association relationship between the document type and the document rule configuration.

[0078] Among them, the rule configuration library is a database or data structure that stores the corresponding rule configurations for different document types. By analyzing the rule configuration library, the corresponding rule configurations for different document types can be determined.

[0079] According to the target document type, by comparing the target document type with the document types in the rule configuration library, the corresponding rule configuration for the target document type can be found and matched. The rule configuration can include: keyword matching rules, format verification rules, semantic matching model verification rules, etc.

[0080] The extracted rule configuration information can be sorted and organized to form a rule configuration list applicable to the document to be evaluated, so that the target document rule configuration can be clearly reflected in the configuration list. It includes: information such as the name, description, and parameters of each rule.

[0081] According to the target document rule configuration, the corresponding evaluation and inspection methods can be applied to the document to be evaluated. By executing the target document rules, the quality and content of the document to be evaluated can be comprehensively and accurately evaluated to determine whether the document to be evaluated meets the preset standards and requirements.

[0082] S103: Determine the target document quality evaluation scope according to the target document content and the target document rule configuration, and perform evaluation processing on the target document content according to the target document quality evaluation scope to obtain the target document quality evaluation result.

[0083] Among them, the target document quality evaluation scope can be determined according to the main body, structure, language use of the target document content, as well as the key concepts, technologies, and domain knowledge involved in the content. This can include: the integrity, accuracy, clarity, format standardization of the document, and the relationship between the target document and other relevant documents, such as: consistency and coherence in context, etc.

[0084] Evaluate and process the content of the target document according to the scope of the target document quality assessment. For example, conduct item-by-item inspection, analysis, comparison, and judgment on the inner cylinder of the target document for comprehensive evaluation. The purpose of the target document quality assessment is to give evaluations and improvement suggestions on aspects such as the content, structure, and format of the document. And the results of the target document quality assessment should be clear, accurate, easy to understand, and easy to use.

[0085] The document quality assessment method provided in this embodiment obtains information of the document to be evaluated. The information of the document to be evaluated includes: the type of the target document and the content of the target document. According to the type of the target document and the rule configuration library, determine the rule configuration situation of the target document. The rule configuration library is used to indicate the association relationship between the document type and the document rule configuration situation. According to the content of the target document and the rule configuration situation of the target document, determine the scope of the target document quality assessment, and evaluate and process the content of the target document according to the scope of the target document quality assessment to obtain the target document quality assessment result; this method dynamically matches the document rule configuration situation and the document quality assessment scope for the document to be evaluated, improving the diversity, reusability, and accuracy of the document quality assessment.

[0086] Figure 2 is the flow of the document quality assessment method provided in this application Figure 2 As Figure 2 shown, this embodiment details the document quality assessment method on the basis of Figure 1 the embodiment. The document quality assessment method shown in this embodiment includes:

[0087] S201: Obtain information of the document to be evaluated. The information of the document to be evaluated includes: the type of requirement document and the content of the target document.

[0088] Among them, the requirement document, as a type of document to be evaluated, usually describes the requirements in aspects such as the functional requirements, performance requirements, and user interface design of a product or project.

[0089] When the type of the document to be evaluated is the type of requirement document, in order to ensure that the extracted content of the target document is complete, accurate, and closely related to the theme of the requirement document, it is necessary to deeply analyze the extracted content of the target document and determine the information of the document to be evaluated according to the characteristics and evaluation purpose of the requirement document.

[0090] S202: According to the type of the requirement document and the rule configuration library, determine that the rule configuration situation of the target document is the first rule configuration situation.

[0091] According to the type of requirement document, search for and match the corresponding rule configuration in the rule configuration library. Among them, the first rule configuration corresponding to the type of requirement document includes: keyword matching rule, format verification rule, resource library retrieval rule, and semantic matching model verification rule.

[0092] Optionally, the document types include: requirement document types, design document types, test document types, delivery feedback document types, and product description document types.

[0093] Requirement documents include: requirement specification documents and technical requirement specification documents; design documents include: general design documents and detailed design documents; test document types include: test plan types, test plan documents, test case documents, and test report documents; delivery feedback types include: emergency handling plan types and interview questionnaire types; product description types include: user guide types, maintenance operation instruction types, and precautions types.

[0094] The rule configuration corresponding to the design document type is: keyword matching rule, format verification rule, semantic matching model verification rule;

[0095] The rule configuration corresponding to the test document type is: keyword matching rule, format verification rule, and semantic matching model verification rule;

[0096] The rule configuration corresponding to the delivery feedback document type is: format verification rule and semantic matching model verification rule;

[0097] The rule configuration corresponding to the product description document type is: keyword matching, format verification rule, and semantic matching model verification rule.

[0098] S203: Determine the first quality evaluation range corresponding to the target document content according to the target document content and the first rule configuration. The first quality evaluation range includes: keyword matching range, format verification standard, resource library retrieval range, and semantic matching model verification standard.

[0099] Among them, according to the requirement document content, keyword matching rule, format verification rule, resource library retrieval rule, and semantic matching model verification rule, determine the keyword matching range, format verification standard, resource library retrieval range, and semantic matching model verification standard corresponding to the target document content.

[0100] Determine the keyword matching range according to the characteristics of the requirement document. Keywords may involve the core content of the requirement, function points, performance indicators, etc.

[0101] The format verification standards for requirement - type document types include: specifications in aspects such as document layout, paragraph format, title style, citation format, etc. Through format verification, the standardization and consistency of the document are ensured.

[0102] The scope of the resource library search is used to verify the reliability and accuracy of the content of the requirement document. The resource library can include: documents, data, reference materials, etc. By comparing the information in the resource library, the feasibility and rationality of the requirements are evaluated.

[0103] The semantic - matching model verification standard is used to deeply evaluate the content of requirement - type documents. Through natural language processing technology, semantic analysis is performed on the document to evaluate the clarity, logic, and consistency of the requirement description.

[0104] S204: Evaluate and process the target document content according to the keyword matching scope, the format verification standard, the resource library search scope, and the semantic - matching model verification standard to obtain the quality evaluation result of the target document.

[0105] Among them, according to the determined keyword matching scope, keyword matching checks are performed on the target document content. Evaluate whether each keyword appears in the document, the frequency and position of its appearance, as well as the accuracy and integrity of keyword matching.

[0106] According to the format verification standard, evaluate the format of the target document. Check whether the document layout, paragraph format, title style, citation format, etc. meet the specifications, and evaluate the overall appearance and consistency of the document.

[0107] According to the resource library search scope, search for information related to the target document content in the relevant resource library. Compare the differences between the information in the resource library and the document content, and evaluate the reliability and accuracy of the requirement description.

[0108] Using the semantic - matching model verification standard, perform semantic analysis on the target document content. Through natural language processing technology, evaluate the clarity, logic, and consistency of the requirement description, and detect potential semantic errors or ambiguities.

[0109] Combining the evaluation results of the above - mentioned aspects, conduct comprehensive analysis and processing. Weigh the scores and evaluations of different aspects to obtain the comprehensive quality evaluation result of the target document content.

[0110] According to the result of the comprehensive evaluation and processing, generate a quality evaluation report for the target document. The report should include: evaluation results of each aspect, overall quality evaluation, improvement suggestions, etc., to facilitate subsequent improvement and optimization work.

[0111] The document quality evaluation method provided in this embodiment obtains information of the document to be evaluated, where the information of the document to be evaluated includes: the type of requirement document and the content of the target document. According to the type of requirement document and the rule configuration library, it is determined that the rule configuration of the target document is the first rule configuration. According to the content of the target document and the first rule configuration, the first quality evaluation range corresponding to the content of the target document is determined. The first quality evaluation range includes: the keyword matching range, the format verification standard, the resource library retrieval range, and the semantic matching model verification standard. The content of the target document is evaluated and processed according to the keyword matching range, the format verification standard, the resource library retrieval range, and the semantic matching model verification standard to obtain the quality evaluation result of the target document. This method improves the diversity, reusability, and accuracy of document quality evaluation by dynamically matching the document rule configuration and the document quality evaluation range for the document to be evaluated.

[0112] Figure 3 is the flow of the document quality evaluation method provided in this application Figure 3 As Figure 3 shown, this embodiment is based on the Figure 2 embodiment, and details the quality evaluation method for requirement documents. The document quality evaluation method shown in this embodiment includes:

[0113] S301: Perform word segmentation on the content of the target document according to the keyword matching range to obtain the keyword matching result of the target document.

[0114] Among them, a suitable word segmentation tool is selected, for example: a Chinese word segmentation tool, to perform word segmentation on the content of the target document. The word segmentation tool can divide the content of the target document into individual words or phrases according to language characteristics and rules.

[0115] Use the word segmentation tool to perform word segmentation on the content of the target document. The document content is segmented according to language rules and word segmentation algorithms to obtain individual words or phrases. Ensure the accuracy and integrity of word segmentation for subsequent keyword matching.

[0116] Compare the word segmentation result with the loaded keyword matching range. Through a matching algorithm, check whether each word segmentation result is within the keyword matching range and record the matching situation. Matching thresholds or rules can be set as needed to determine the accuracy and importance of the matching.

[0117] Generate the keyword matching result of the target document according to the matching situation. The keyword matching result can be, for example, a result in the form of a list containing matching keywords, a matching quantity statistic, a matching degree score, etc. Ensure that the result is clear and accurate and can be provided for subsequent evaluation and analysis.

[0118] Optionally, the specific implementation of this step is as follows: perform word segmentation on the target document content according to the keyword matching range to obtain at least one target keyword;

[0119] Perform evaluation processing on the target document according to the target keyword and the bidirectional maximum matching algorithm to obtain a forward matching word segmentation result and a reverse matching word segmentation result;

[0120] Determine whether the forward matching word segmentation result is equal to the reverse matching word segmentation result;

[0121] If the forward matching word segmentation result is equal to the reverse matching word segmentation result, the keyword matching result is any one of the forward matching word segmentation result and the reverse matching word segmentation result;

[0122] If the forward matching word segmentation result is not equal to the reverse matching word segmentation result, take the one that meets the preset conditions among the forward matching word segmentation result and the reverse matching word segmentation result as the keyword matching result;

[0123] S302: Obtain the first quality evaluation result according to the keyword matching result of the target document.

[0124] Analyze the keyword matching result of the target document, and determine the first quality evaluation result according to the keyword matching result. If the keyword matching degree is high, it can be considered that the first quality evaluation result is high; if the keyword matching degree is low, it can be considered that the first quality evaluation result is low.

[0125] Provide corresponding improvement suggestions according to the first quality evaluation result. If the document quality is low, it may be necessary to re - examine the requirement description, optimize the document structure, strengthen semantic expression, etc.; if the document quality is high, it can be fine - tuned according to the actual situation.

[0126] Organize the first quality evaluation result and improvement suggestions into a report form. The report should include content such as keyword matching result analysis, comprehensive quality evaluation, improvement measures, etc., for the reference and improvement of the document writer or relevant personnel.

[0127] S303: Perform format parsing on the target document content according to the format verification standard to obtain the target document format parsing result.

[0128] Perform format parsing processing on the target document content according to the determined format verification standard. These standards can include: specification requirements for document layout, paragraph format, title style, citation format, etc.

[0129] The parsing tool will check the format of the document one by one according to the loaded format verification standard, and identify and record the places that do not meet the standard.

[0130] Analyze the format parsing results to identify formatting issues in the target document. Formatting issues may include: irregular layout, incorrect paragraph formatting, inconsistent heading styles, and incorrect citation formats.

[0131] Record the identified formatting issues to form the format parsing results of the target document. The results should include a detailed description, location, and possible solutions or suggestions for each issue.

[0132] Organize the format parsing results into a report. The report should include an overview of the formatting issues, specific descriptions, impacts, and solutions, etc., to facilitate modification and optimization by the document writer or relevant personnel.

[0133] S304: Obtain the second quality assessment result based on the format parsing results of the target document.

[0134] Analyze the format parsing results of the target document to determine the formatting issues in the document. Analyze the nature, severity, and scope of the issues for a comprehensive assessment.

[0135] Determine the second quality assessment result based on the number and severity of the formatting issues. If the formatting issues are few and not severe, the second quality assessment result is considered high; if there are many or severe formatting issues, the second quality assessment result is considered low.

[0136] Provide corresponding improvement suggestions based on the second quality assessment result. If the document quality is low, it may be necessary to re - examine aspects such as the layout, paragraph formatting, heading styles, and citation formats of the document and make corrections and improvements; if the document quality is high, fine - tuning can be carried out according to the actual situation.

[0137] Organize the second quality assessment result and improvement suggestions into a report. The report should include format issue analysis, comprehensive quality assessment, improvement measures, etc., to facilitate reference and improvement by the document writer or relevant personnel.

[0138] S305: Conduct a similarity and / or duplication rate search on the content of the target document according to the resource library search scope to obtain the target document search result.

[0139] Select a suitable resource library, such as: document library, knowledge base, or Internet resources, etc., for retrieving information related to the content of the target document. Ensure that the resource library content is rich, accurate, and reliable.

[0140] Conduct a similarity and / or duplication rate search on the content of the target document according to the determined resource library search scope. The resource library search scope will be matched and compared with the content of the target document to calculate the similarity and duplication rate.

[0141] Analyze the retrieval results of the target document. Check the specific values and ratios of similarity and duplication rates to determine the similarity and duplication of the document content with other content in the resource library.

[0142] Record the analyzed retrieval results to form the retrieval results of the target document. The results should include the specific values of similarity and / or duplication rate, the matching resource library entries, and relevant information.

[0143] Organize the retrieval results into a report form. The report should include an overview of similarity and / or duplication rate, specific values, matching resource library entries, etc., for the reference and evaluation of the document writer or relevant personnel.

[0144] S306: Obtain the third quality assessment result based on the retrieval results of the target document.

[0145] Analyze the retrieval results of the target document to determine the similarity and duplication of the document content with other content in the resource library. Consider the specific values and ratios of similarity and duplication rate, as well as the matching resource library entries and relevant information.

[0146] Based on the similarity and duplication rate of the retrieval results, combined with the originality, uniqueness of the document content, and other relevant evaluation criteria (such as keyword matching, format verification, etc.), determine the third quality assessment result. If the similarity and duplication rate are high, the third quality assessment result is high; if the similarity and duplication rate are low, the third quality assessment result is low.

[0147] Provide corresponding improvement suggestions based on the third quality assessment result. If the document quality is low, it may be necessary to re-examine the originality and uniqueness of the document to avoid duplication with existing content; if the document quality is high, it can be fine-tuned according to the actual situation.

[0148] Organize the third quality assessment result and improvement suggestions into a report form. The report should include analysis of retrieval results, comprehensive quality assessment, improvement measures, etc., for the reference and improvement of the document writer or relevant personnel.

[0149] S307: Perform semantic similarity matching on the content of the target document according to the semantic matching model test criteria to obtain the semantic matching result of the target document.

[0150] Select a suitable semantic matching model, such as: a semantic matching model based on deep learning or a semantic matching model based on rules. Ensure that the model can accurately and effectively perform semantic similarity matching on the document content.

[0151] Perform semantic similarity matching on the content of the target document according to the determined semantic matching model inspection criteria. Evaluate the semantic similarity of statements, paragraphs, or concepts in the document according to the loaded inspection criteria, and record the matching results.

[0152] Analyze the semantic matching results of the target document. Check the specific numerical values and ratios of the semantic similarity matching to understand the similarities and differences in the semantic level of the document content.

[0153] Record the analyzed semantic matching results to form the semantic matching results of the target document. The results should include specific numerical values of semantic similarity, matching statements or paragraphs, etc.

[0154] Organize the semantic matching results into a report form. The report should include an overview of semantic similarity, specific numerical values, matching statements or paragraphs, etc., for the reference and evaluation of the document writer or relevant personnel.

[0155] S308: Obtain the fourth quality assessment result according to the semantic matching results of the target document.

[0156] Analyze the semantic matching results of the target document to understand the similarities and differences in the semantic level of the document content. Consider the specific numerical values and ratios of semantic similarity, as well as the matching statements or paragraphs, etc.

[0157] Based on the similarity and difference of the semantic matching results, combined with the semantic consistency, accuracy, and other relevant evaluation criteria of the document content (such as keyword matching, format verification, etc.). If the semantic similarity is low or there are obvious semantic differences, the document quality may be low; if the semantic similarity is high and the differences are small, the document quality may be high.

[0158] Provide corresponding improvement suggestions according to the fourth quality assessment result. If the document quality is low, it may be necessary to re-examine the semantic expression and consistency of the document and make corrections and improvements; if the document quality is high, the existing level can be maintained and fine-tuned according to the actual situation.

[0159] Organize the fourth quality assessment result and improvement suggestions into a report form. The report should include the analysis of semantic matching results, comprehensive quality assessment, improvement measures, etc., for the reference and improvement of the document writer or relevant personnel.

[0160] S309: Determine the quality assessment result of the target document according to the first quality assessment result, the second quality assessment result, the third quality assessment result, and the fourth quality assessment result.

[0161] Comprehensively analyze the first quality assessment result, the second quality assessment result, the third quality assessment result, and the fourth quality assessment result. Consider the specific circumstances and weights of each assessment result, analyze the mutual relationships among each assessment result, and analyze the quality assessment result of the target document. If all four quality assessment results are relatively high, it can be considered that the document quality is high; if there is a situation where one or more quality assessment results are low, the document quality may be affected.

[0162] Provide overall improvement suggestions based on the determined quality assessment result of the target document. These suggestions may include improvement measures for keyword matching, format verification, repository retrieval, and semantic matching, etc., to improve the overall quality and satisfaction of the document.

[0163] Organize the quality assessment result of the target document and the overall improvement suggestions into a final quality assessment report. The report should include an overview of the quality assessment result, specific analysis, improvement measures, and overall suggestions, etc., for the reference and improvement of the document writer or relevant personnel.

[0164] The document quality assessment method provided in this embodiment tokenizes the content of the target document according to the keyword matching range to obtain the keyword matching result of the target document. According to the keyword matching result of the target document, the first quality assessment result is obtained. Parse the format of the target document content according to the format verification standard to obtain the format parsing result of the target document. According to the format parsing result of the target document, the second quality assessment result is obtained. Retrieve the similarity and / or duplicate rate of the target document content according to the repository retrieval range to obtain the retrieval result of the target document. According to the retrieval result of the target document, the third quality assessment result is obtained. Perform semantic similarity matching on the content of the target document according to the semantic matching model test standard to obtain the semantic matching result of the target document. According to the semantic matching result of the target document, the fourth quality assessment result is obtained. Determine the quality assessment result of the target document according to the first quality assessment result, the second quality assessment result, the third quality assessment result, and the fourth quality assessment result. This method sequentially evaluates the rule configuration of the document, improving the accuracy of the document quality assessment.

[0165] Figure 4 It is a schematic structural diagram of the document quality assessment device provided in this application. As Figure 4 shown, the document quality assessment device 400 provided in this embodiment includes:

[0166] An acquisition module 401, configured to acquire the document information to be evaluated, where the document information to be evaluated includes: the type of the target document and the content of the target document;

[0167] A determination module 402, configured to determine a target document rule configuration according to the target document type and a rule configuration library, where the rule configuration library is used to indicate an association relationship between a document type and a document rule configuration;

[0168] The determination module 402 is further configured to determine a target document quality evaluation range according to the target document content and the target document rule configuration;

[0169] A processing module 403, configured to perform an evaluation process on the target document content according to the target document quality evaluation range to obtain a target document quality evaluation result.

[0170] Optionally, the determination module 402 is further configured to determine that the target document rule configuration is a first rule configuration according to the requirements document type and the rule configuration library, where the first rule configuration includes: a keyword matching rule, a format verification rule, a resource library retrieval rule, and a semantic matching model verification rule;

[0171] The determination module 402 is further configured to determine a first quality evaluation range corresponding to the target document content according to the target document content and the first rule configuration, where the first quality evaluation range includes: a keyword matching range, a format verification standard, a resource library retrieval range, and a semantic matching model verification standard;

[0172] The processing module 403 is further configured to perform an evaluation process on the target document content according to the keyword matching range, the format verification standard, the resource library retrieval range, and the semantic matching model verification standard to obtain the target document quality evaluation result.

[0173] Optionally, the document quality evaluation device further includes: a judgment module 404;

[0174] The processing module 403 is further configured to perform word segmentation on the target document content according to the keyword matching range to obtain at least one target keyword;

[0175] The processing module 403 is further configured to perform an evaluation process on the target document according to the target keyword and a bidirectional maximum matching algorithm to obtain a forward matching word segmentation result and a reverse matching word segmentation result;

[0176] The judgment module 404 is further configured to judge whether the forward matching word segmentation result and the reverse matching word segmentation result are equal;

[0177] The determination module 402 is further configured to, when the forward matching word segmentation result and the reverse matching word segmentation result are equal, the keyword matching result is any one of the forward matching word segmentation result and the reverse matching word segmentation result;

[0178] When the forward matching word segmentation result and the reverse matching word segmentation result are not equal, the determining module 402 is further configured to select, as the keyword matching result, those that meet the preset conditions from the forward matching word segmentation result and the reverse matching word segmentation result.

[0179] The determining module 402 is further configured to obtain the first quality evaluation result according to the keyword matching result.

[0180] Optionally, the determining module 402 is further configured to perform format parsing on the target document content according to the format verification standard to obtain a target document format parsing result;

[0181] The determining module 402 is further configured to obtain the second quality evaluation result according to the target document format parsing result.

[0182] Optionally, the determining module 402 is further configured to perform similarity and / or duplicate rate retrieval on the target document content according to the resource library retrieval range to obtain a target document retrieval result;

[0183] The determining module 402 is further configured to obtain the third quality evaluation result according to the target document retrieval result.

[0184] Optionally, the determining module 402 is further configured to perform semantic similarity matching on the target document content according to the semantic matching model verification standard to obtain a target document semantic matching result;

[0185] The determining module 402 is further configured to obtain the fourth quality evaluation result according to the target document semantic matching result.

[0186] Figure 5 It is a schematic structural diagram of the document quality evaluation device provided by this application. As Figure 5 shown, this application provides a document quality evaluation device. The document quality evaluation device 500 includes: a receiver 501, a transmitter 502, a processor 503, and a memory 504.

[0187] The receiver 501 is configured to receive instructions and data;

[0188] The transmitter 502 is configured to transmit instructions and data;

[0189] The memory 504 is configured to store computer execution instructions;

[0190] The processor 503 is configured to execute the computer execution instructions stored in the memory 504 to implement the various steps performed by the document quality evaluation method in the above embodiments. For details, reference may be made to the relevant descriptions in the foregoing embodiments of the document quality evaluation method.

[0191] Optionally, the above-mentioned memory 504 can be either independent or integrated with the processor 503.

[0192] When the memory 504 is independently provided, the electronic device further includes a bus for connecting the memory 504 and the processor 503.

[0193] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the document quality assessment method performed by the above-mentioned document quality assessment device.

[0194] It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that this application is not limited by the described action sequence, because according to this application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to this application.

[0195] Furthermore, it should be noted that although the steps in the flowchart are sequentially shown according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowchart may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same moment, but can be executed at different moments. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or sub-steps or stages of other steps.

[0196] It should be understood that the above-mentioned device embodiments are illustrative only, and the devices of this application can also be implemented in other ways. For example, the division of units / modules in the above embodiments is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units, modules or components can be combined, or can be integrated into another system, or some features can be ignored or not executed.

[0197] In addition, without special description, in each embodiment of this application, the functional units / modules can be integrated into one unit / module, or each unit / module can exist physically alone, or two or more units / modules can be integrated together. The above-mentioned integrated unit / module can be implemented in the form of hardware or in the form of a software program module.

[0198] When the integrated unit / module is implemented in the form of hardware, the hardware can be a digital circuit, an analog circuit, etc. The physical implementation of the hardware structure includes but is not limited to transistors, memristors, etc. Unless otherwise specified, the processor can be any suitable hardware processor, such as CPU, GPU, FPGA, DSP, and ASIC, etc. Unless otherwise specified, the storage unit can be any suitable magnetic storage medium or magneto-optical storage medium, such as resistive random access memory (RRAM), dynamic random access memory (DRAM), static random access memory (SRAM), enhanced dynamic random access memory (EDRAM), high-bandwidth memory (HBM), hybrid memory cube (HMC), etc.

[0199] If the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in various embodiments of this application. And the aforementioned memory includes: USB flash drive, read-only memory (ROM), random access memory (RAM), mobile hard disk, magnetic disk, or optical disc, etc., all kinds of media that can store program codes.

[0200] In the above embodiments, the descriptions of each embodiment have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments. The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as the combinations of these technical features do not conflict, they should all be considered as the scope described in this specification.

[0201] Other embodiments of the present application will be readily apparent to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. The present application is intended to cover any variations, uses, or adaptations of the present application, which follow the general principles of the present application and include known common general knowledge or conventional technical means in the technical field not disclosed in the present application. The specification and examples are only illustrative, and the true scope and spirit of the present application are pointed out by the following claims.

[0202] It should be understood that the present application is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present application is only limited by the appended claims.

Claims

1. A method for document quality assessment, characterized in that, The method includes: Obtaining the document information to be evaluated, where the document information to be evaluated includes: the target document type and the target document content; Determining the target document rule configuration according to the target document type and the rule configuration library, where the rule configuration library is used to indicate the association relationship between the document type and the document rule configuration; Determining the target document quality evaluation range according to the target document content and the target document rule configuration, and performing an evaluation process on the target document content according to the target document quality evaluation range to obtain the target document quality evaluation result.

2. The method according to claim 1, wherein If the target document type is a requirements document type, then determining the target document rule configuration according to the target document type and the rule configuration library includes: Determining that the target document rule configuration is the first rule configuration according to the requirements document type and the rule configuration library, where the first rule configuration includes: a keyword matching rule, a format verification rule, a resource library retrieval rule, and a semantic matching model verification rule; Determining the target document quality evaluation range according to the target document content and the target document rule configuration, and performing an evaluation process on the target document content according to the target document quality evaluation range to obtain the target document quality evaluation result, including: Determining a first quality evaluation range corresponding to the target document content according to the target document content and the first rule configuration, where the first quality evaluation range includes: a keyword matching range, a format verification standard, a resource library retrieval range, and a semantic matching model verification standard; Performing an evaluation process on the target document content according to the keyword matching range, the format verification standard, the resource library retrieval range, and the semantic matching model verification standard to obtain the target document quality evaluation result.

3. The method according to claim 2, wherein The target document quality evaluation result includes: a first quality evaluation result, and performing an evaluation process on the target document content according to the keyword matching range to obtain the first quality evaluation result, including: Performing word segmentation on the target document content according to the keyword matching range to obtain at least one target keyword; Performing an evaluation process on the target document according to the target keyword and the bidirectional maximum matching algorithm to obtain a forward matching word segmentation result and a backward matching word segmentation result; Judging whether the forward matching word segmentation result and the backward matching word segmentation result are equal; If the forward matching word segmentation result and the backward matching word segmentation result are equal, the keyword matching result is any one of the forward matching word segmentation result and the backward matching word segmentation result; If the forward matching word segmentation result and the backward matching word segmentation result are not equal, taking the one that meets the preset conditions among the forward matching word segmentation result and the backward matching word segmentation result as the keyword matching result; Obtaining the first quality evaluation result according to the keyword matching result.

4. The method according to claim 2, wherein The target document quality evaluation result includes: a second quality evaluation result, and performing an evaluation process on the target document content according to the format verification standard to obtain the second quality evaluation result, including: Perform format parsing on the target document content according to the format verification standard to obtain a target document format parsing result; Obtain the second quality assessment result according to the target document format parsing result.

5. The method according to claim 2, characterized in that, The target document quality assessment result includes: a third quality assessment result. Performing an assessment process on the target document content according to the resource library retrieval scope to obtain the third quality assessment result includes: Perform a similarity and / or duplicate check rate retrieval on the target document content according to the resource library retrieval scope to obtain a target document retrieval result; Obtain the third quality assessment result according to the target document retrieval result.

6. The method according to claim 2, wherein The target document quality assessment result includes: a fourth quality assessment result. Performing an assessment process on the target document content according to the semantic matching model verification standard to obtain the fourth quality assessment result includes: Perform a semantic similarity match on the target document content according to the semantic matching model verification standard to obtain a target document semantic matching result; Obtain the fourth quality assessment result according to the target document semantic matching result.

7. A document quality evaluation device, characterized in that, Includes: An acquisition module, configured to acquire information of a document to be evaluated, where the information of the document to be evaluated includes: a target document type and target document content; A determination module, configured to determine the target document rule configuration according to the target document type and a rule configuration library, where the rule configuration library is used to indicate the association relationship between the document type and the document rule configuration; The determination module is further configured to determine the target document quality assessment scope according to the target document content and the target document rule configuration; A processing module, configured to perform an assessment process on the target document content according to the target document quality assessment scope to obtain a target document quality assessment result.

8. The device according to claim 7, characterized in that, Includes: The determination module is further configured to determine that the target document rule configuration is a first rule configuration according to the requirement document type and the rule configuration library, where the first rule configuration includes: a keyword matching rule, a format verification rule, a resource library retrieval rule, and a semantic matching model verification rule.

9. A document quality assessment device, characterized in that, Includes: A processor and a memory communicatively connected to the processor; The memory stores computer execution instructions; The processor executes the computer execution instructions stored in the memory to implement the method according to any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that, Computer execution instructions are stored in the computer-readable storage medium, and when the computer execution instructions are executed by a processor, they are used to implement the method according to any one of claims 1 to 6.

Images