Operation and maintenance document quality determination method

Abstract

The application discloses a kind of operation and maintenance document quality determination methods, comprising: determining reference data of operation and maintenance document in different quality evaluation dimensions;According to the reference data of different quality evaluation dimensions, determine the result information for measuring the quality of operation and maintenance document;Wherein, the different quality evaluation dimensions include one or more of structural integrity dimension, easy to execute dimension, specification dimension, effective dimension, easy-to-read dimension and basic quality dimension;The operation and maintenance document is the document indicating the operation and maintenance strategy for solving the fault when the computing system fails.It can automatically quantify the quality of operation and maintenance document, fill the gap of operation and maintenance document quantitative evaluation standard, and is conducive to urging the improvement of operation and maintenance document quality, indirectly improving operation and maintenance efficiency, so as to form a virtuous circle.

Description

Technical Field

[0001] This invention relates to the field of automated document quality assessment, and more particularly to a method for determining the quality of operation and maintenance documents. Background Technology

[0002] With the widespread adoption of high-performance scientific computing applications, the number of high-performance computing users is growing rapidly, and the expansion speed and scale of high-performance computer clusters are also increasing exponentially. Therefore, in the face of increasingly large and complex cluster operation and maintenance needs, the updating and inheritance of operation and maintenance knowledge also need to follow a "standardized, high-speed, and intelligent" approach, and can no longer be limited to the rigid and slow development of operation and maintenance manuals or traditional structured knowledge bases.

[0003] Therefore, it is necessary to ensure the quality of operations and maintenance documentation. However, current quality assessments of operations and maintenance documentation mainly rely on subjective evaluation based on human experience, lacking quantifiable evaluation standards.

[0004] In view of this, the present invention is hereby proposed. Summary of the Invention

[0005] To address the aforementioned technical issues, this invention provides a method for determining the quality of operation and maintenance (O&M) documents. This method can automatically quantify the quality of O&M documents, filling the gap in quantitative evaluation standards for O&M documents. It is beneficial for promoting the improvement of O&M document quality, indirectly improving O&M efficiency, and thus forming a virtuous cycle.

[0006] In a first aspect, embodiments of the present invention provide a method for determining the quality of operation and maintenance documents, the method comprising:

[0007] Determine the reference data for operation and maintenance documentation across different quality assessment dimensions;

[0008] The results information used to measure the quality of operation and maintenance documents are determined based on reference data from different quality assessment dimensions.

[0009] The different quality assessment dimensions include one or more of the following: structural integrity, ease of execution, standardization, effectiveness, readability, and basic quality. Operation and maintenance documents are documents that indicate the operation and maintenance strategies for resolving faults when a computing system fails.

[0010] In a second aspect, embodiments of the present invention provide an electronic device, the electronic device comprising:

[0011] Processor and memory;

[0012] The processor executes the steps of the operation and maintenance document quality determination method of any embodiment by calling programs or instructions stored in memory.

[0013] Thirdly, embodiments of the present invention provide a computer-readable storage medium storing a program or instructions that cause a computer to perform the steps of the operation and maintenance document quality determination method of any embodiment.

[0014] The embodiments of the present invention have the following technical effects:

[0015] By identifying reference data for operation and maintenance (O&M) documents across different quality assessment dimensions, and then determining the resulting information for measuring O&M document quality based on this reference data, the quality of O&M documents is automatically quantified. This fills the gap in quantitative assessment standards for O&M documents, which helps to encourage improvements in O&M document quality and indirectly improves O&M efficiency, thus forming a virtuous cycle. Attached Figure Description

[0016] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0017] Figure 1 This is a flowchart of a method for determining the quality of operation and maintenance documents provided in an embodiment of the present invention. Figure 1 ;

[0018] Figure 2 This is a flowchart of a method for determining the quality of operation and maintenance documents provided in an embodiment of the present invention. Figure 2 ;

[0019] Figure 3 This is a flowchart of a method for determining the quality of operation and maintenance documents provided in an embodiment of the present invention. Figure 3 ;

[0020] Figure 4 This is a flowchart of a method for determining the quality of operation and maintenance documents provided in an embodiment of the present invention. Figure 4 ;

[0021] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0022] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below. Obviously, the described embodiments are only a part of the embodiments of this invention, and not all of them. Based on the embodiments of this invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this invention.

[0023] Example 1

[0024] Figure 1 This is a flowchart of a method for determining the quality of operation and maintenance documents provided in an embodiment of the present invention. See also... Figure 1 The method for determining the quality of this operations and maintenance documentation specifically includes the following steps:

[0025] S110. Determine the reference data for operation and maintenance documents in different quality assessment dimensions.

[0026] Different quality assessment dimensions include one or more of the following: structural integrity, ease of execution, standardization, effectiveness, readability, and basic quality. Operation and maintenance documents are documents that indicate the operation and maintenance strategies for resolving faults when a computing system fails.

[0027] S120. Determine the result information used to measure the quality of operation and maintenance documents based on reference data from different quality assessment dimensions.

[0028] For example, reference data from different quality assessment dimensions can be summed to obtain result information used to measure the quality of operations and maintenance documentation.

[0029] By evaluating the quality of operations and maintenance documentation from multiple different quality assessment dimensions, the accuracy of the assessment results has been improved.

[0030] Example 2

[0031] Based on the above embodiments, this embodiment provides a specific evaluation process for each specific quality assessment dimension.

[0032] For example, the evaluation dimensions include structural integrity, and the corresponding reference data includes structural integrity reference data. Determining the structural integrity reference data for the operations and maintenance documentation in the structural integrity dimension includes:

[0033] The content of the operation and maintenance document is parsed to determine whether it includes a preset module; based on whether the operation and maintenance document includes a preset module, reference data for the structural integrity of the operation and maintenance document is determined.

[0034] High-quality operations and maintenance (O&M) documentation should include modules for fault symptoms, fault cause analysis, troubleshooting steps, and methods for verifying fault recovery. Therefore, if an O&M document includes all of these pre-defined modules, its structure is considered relatively complete.

[0035] For example, the structural integrity of an operations and maintenance document can be determined by using keyword matching to identify which preset modules are included in the document.

[0036] Furthermore, based on whether the operation and maintenance documentation includes preset modules, the structural integrity reference data for the operation and maintenance documentation is determined, including:

[0037] The following formula is used to determine the structural integrity reference data for operations and maintenance documents:

[0038]

[0039] in, Represents structural integrity reference data. This represents the tag for the i-th preset module. If the maintenance documentation includes the i-th preset module, then... The value is 1; if the maintenance documentation does not include the i-th preset module, then... The value is 0. This represents the weight of the i-th preset module; where the weight can be set to 0.2 for the fault phenomenon module, 0.3 for the fault cause analysis module, 0.4 for the fault resolution operation steps module, and 0.1 for the fault recovery verification method module. The 20% in the above formula represents the weight of the structural integrity dimension; this value is a set value and is not limited to 20%.

[0040] For example, the quality assessment dimension includes an ease-to-execute dimension, and the corresponding reference data includes ease-to-execute reference data. Determining the ease-to-execute reference data for the operations and maintenance (O&M) documentation includes: obtaining feedback results from users simulating O&M operations according to the O&M strategies indicated in the O&M documentation, and the step-by-step decomposition granularity information of the O&M strategies indicated in the O&M documentation; and determining the ease-to-execute reference data for the O&M documentation based on the feedback results and the step-by-step decomposition granularity information.

[0041] The granularity of the steps in the operation and maintenance strategy indicated in the operation and maintenance document can be determined in the following way:

[0042] Semantic analysis is performed on the text belonging to the operation and maintenance strategy in the operation and maintenance documents to determine the operation items involved and the number of decomposed steps associated with the operation items. At the same time, the total number of standardized steps of the operation items is determined through a large model, and the ratio of the number of decomposed steps to the total number of standardized steps is determined as the step decomposition granularity information.

[0043] For example, if the operation is "configure a yum repository", and the operation and maintenance policy indicates that "configuring a yum repository" includes steps 1, 2, and 3, and the large model determines that "configuring a yum repository" includes 5 standardized steps, then the step decomposition granularity information is determined to be 3 / 5 = 0.6. The larger the value of the step decomposition granularity information, the finer the step decomposition granularity, the lower the understanding cost when performing operation and maintenance according to the operation and maintenance documentation, and the higher the operation and maintenance efficiency.

[0044] The feedback results include the error rate of simulated operation and maintenance operations according to the operation and maintenance strategies indicated in the operation and maintenance documentation.

[0045] Based on the feedback results and the granularity of the steps, we determine the executability reference data for the operation and maintenance documentation, including:

[0046] The executability reference data is determined using the following formula:

[0047]

[0048] in, This indicates reference data on ease of execution. Indicates the error rate. This indicates the granularity information of the decomposition steps. Indicates the number of steps that have been decomposed. Indicates the total number of steps.

[0049] For example, quality assessment dimensions include standardization dimensions, and reference data includes normative reference data. The reference data for operations and maintenance documents across different quality assessment dimensions is determined, including:

[0050] Determine the number of valid hierarchical headings, the total number of headings, and the code standardization rate in the operation and maintenance documents, and determine the standardization reference data based on the number of valid hierarchical headings, the total number of headings, and the code standardization rate.

[0051] Among these methods, format validation tools can be used to determine the number of valid hierarchical headings and the total number of headings in the operations and maintenance documents. For example, Figure 2 The heading 210 shown is a valid heading, with a quantity of 5; the heading indicated by the label 220 is an invalid heading.

[0052] The standardized reference data for operation and maintenance documents is determined using the following formula:

[0053]

[0054] in, Indicates normative reference data, This represents the heading level score, which is the ratio of the number of valid hierarchical headings to the total number of headings. This indicates the code standardization rate. If code exists in the operations and maintenance documentation, the code standardization rate can be determined through analysis using script syntax verification tools such as Shell / Python. If no code exists in the operations and maintenance documentation, then... Set it to 0.5.

[0055] For example, the quality assessment dimensions include a validity dimension, and the reference data includes validity reference data; the reference data for operation and maintenance documents in different quality assessment dimensions is determined, including:

[0056] The total number of times faults were handled according to the operation and maintenance documents within a set time period, and the number of times the faults were successfully resolved after being handled according to the operation and maintenance documents within the set time period, are used to determine the validity reference data based on the total number of faults handled and the number of faults successfully resolved.

[0057] For example, the validity reference data for operation and maintenance documents is determined by the following calculation formula:

[0058]

[0059] in, Indicates the validity reference data. This indicates the total number of times faults were handled according to the maintenance documentation within the set time period. This indicates the number of times a fault was successfully resolved within a set time period after being handled according to the maintenance documentation.

[0060] Through design This can help suppress the long-tail effect. The logarithmic function grows slowly for large values ​​and grows faster for small values, which can compress the range of extreme values, make the data distribution more uniform, and suppress the long-tail effect caused by extreme values.

[0061] Optionally, each time a related fault occurs, the maintenance documentation is associated with and recommended as a reference document, displayed once in the pop-up window. This is considered as one reference, meaning the fault was handled based on the maintenance documentation once. After a fault is successfully handled, a questionnaire pop-up window similar to "Is this maintenance documentation valid?" will appear. If the maintenance personnel select "Yes," it will be counted as a successful handling.

[0062] For example, the quality assessment dimensions include readability, and the reference data includes readability reference data; the reference data for operation and maintenance documents in different quality assessment dimensions includes:

[0063] Determine the reading difficulty index, the number of paragraphs reaching the word count threshold, the total number of paragraphs, and the number of charts for the operation and maintenance documents; determine the readability reference data based on the reading difficulty index, the number of paragraphs reaching the word count threshold, the total number of paragraphs, and the number of charts.

[0064] The reading difficulty index is an internationally recognized indicator, usually denoted as Flesch, which is calculated by a relevant plugin and has a value range of 0-100. In this embodiment, if it is below 60, it is treated as 0.

[0065] To ensure readability, ideally, each line of text should have 65 characters. A paragraph exceeding 5 lines is considered excessively long and will negatively impact readability.

[0066] Using illustrations instead of long paragraphs of text can effectively reduce the reader's comprehension cost. Therefore, the ratio of text to illustrations is also an important indicator of document readability. The golden ratio of text to illustrations is at least one illustration or table for every five paragraphs of text. More than one illustration will not increase readability.

[0067] For example, the readability reference data for operations and maintenance documents is determined by the following calculation formula:

[0068]

[0069]

[0070]

[0071] in, Indicates readability reference data. As a reading difficulty indicator, This represents the paragraph score, where d represents the number of paragraphs that reached the word count threshold, and D represents the total number of paragraphs. This indicates the score for the combination of text and images, where 't' represents the number of charts. This represents a function that takes the maximum value. This represents a function that takes the minimum value.

[0072] For example, the quality assessment dimensions include basic quality dimensions, and the reference data includes basic quality reference data. The reference data for operations and maintenance documents across different quality assessment dimensions is determined, including:

[0073] Determine the word count, number of likes, and age of the operation and maintenance documents. Based on the age of the operation and maintenance documents, determine the timeliness decay information of the operation and maintenance documents. Based on the word count, number of likes, and timeliness decay information of the operation and maintenance documents, determine the basic quality reference data.

[0074] Optionally, the basic quality reference data for operation and maintenance documents can be determined using the following formula:

[0075]

[0076]

[0077]

[0078]

[0079] in, This represents the basic quality reference data. The score is based on the number of words. This indicates the word count of the operations and maintenance documentation. This indicates the score for liking. This indicates the number of likes on the operations and maintenance documentation. This indicates the score for time-related decay. This represents the age of the maintenance documentation, and `max()` is a function that takes the maximum value. The documentation's validity score decreases by 20% annually, and after 5 years, it retains a stable 20% base score to prevent historical maintenance documentation from becoming completely invalid.

[0080] The method for determining the quality of operation and maintenance documents provided in this embodiment is the first of its kind to establish an evaluation dimension system for operation and maintenance documents. The evaluation indicators are closely aligned with the key requirements of the operation and maintenance field of large-scale high-performance clusters, filling the gap in the industry for quantitative evaluation of the quality of operation and maintenance knowledge, and significantly improving the relevance compared to general document evaluation tools.

[0081] Example 3

[0082] like Figure 3 As shown, the method for determining the quality of operation and maintenance documentation provided in this embodiment includes the following steps:

[0083] S310. Determine the reference data for operation and maintenance documents in different quality assessment dimensions.

[0084] S320. Determine the result information used to measure the quality of operation and maintenance documents based on reference data from different quality assessment dimensions.

[0085] S330. Determine productivity reference data for different productivity evaluation dimensions based on the result information used to measure the quality of operation and maintenance documents and the associated information of all operation and maintenance documents produced by the authors of the operation and maintenance documents.

[0086] The productivity reference data for different productivity assessment dimensions includes production volume reference data, production quality reference data, and activity reference data. The associated information of all operation and maintenance documents produced by the production author includes, but is not limited to: the total number of operation and maintenance documents produced by the author, the total number of times each operation and maintenance document has been updated, the duration of the author's production account, and the total number of times each operation and maintenance document has been updated in the past six months.

[0087] Specifically, the production volume reference data is determined based on the total number of operation and maintenance documents produced by the author, the total number of times each operation and maintenance document is updated, and the duration of the author's production account.

[0088] For example, production volume reference data can be determined using the following calculation formula:

[0089]

[0090] in, This represents reference data for production volume. This represents the total number of all operation and maintenance documents produced by the author. This indicates the duration of the author's production account, which is used by the author to create operation and maintenance documents. This indicates the total number of times each maintenance document has been updated.

[0091] Production quality reference data is determined based on the result information used to measure the quality of each operation and maintenance document, the total number of all operation and maintenance documents produced by the author, and the number of operation and maintenance documents whose result information meets the set conditions.

[0092] For example, production quality reference data can be determined using the following calculation formula:

[0093]

[0094] in, This represents reference data for production quality. This represents the results information used to measure the quality of a single operations and maintenance document produced by the author. This indicates that the result information of all operation and maintenance documents produced by the author is summed. This result information is usually a specific score value. The higher the score value, the higher the quality of the operation and maintenance document. This indicates the number of operation and maintenance documents whose results meet the set conditions (referring to the number of high-quality documents with high quality scores).

[0095] The activity level reference data is determined using the following formula:

[0096] in, This represents activity level reference data. This indicates the total number of times various operation and maintenance documents have been updated in the past six months.

[0097] S340. Determine the indicator data used to measure the author's productivity based on productivity reference data from different productivity assessment dimensions.

[0098] The productivity reference data from different productivity assessment dimensions are summed to obtain the indicator data used to measure the author's productivity.

[0099] S350 presents reference data for operation and maintenance documents in chart form across different quality assessment dimensions, and presents author productivity data in chart form across different dimensions.

[0100] General overview, for reference, etc. Figure 4 The flowchart shown illustrates a process for determining the quality of operations and maintenance documentation, including the following steps:

[0101] S410, Production and Maintenance Documents for Operations and Maintenance Personnel.

[0102] S420. Quantitatively evaluate the quality of operation and maintenance documents.

[0103] S430. Recommend the operation and maintenance documents to operation and maintenance personnel for application and provide feedback on the application effect.

[0104] S440, Author's Production Capacity Assessment.

[0105] S450, visual dashboard rating view.

[0106] The method for determining the quality of operation and maintenance documents provided in this application includes 6 (document quality assessment indicators) + 3 (operation and maintenance knowledge production capabilities) exclusive indicators, such as structural integrity, ease of execution of operation steps, readability, and standardization. It breaks through the limitations of traditional dimensions, conducts simultaneous evaluation of operation and maintenance documents and document producers, and creates a multi-dimensional evaluation system, providing an accurate and reliable theoretical basis for the evaluation of operation and maintenance documents and the evaluation of the knowledge production capabilities of operation and maintenance knowledge producers.

[0107] Dynamic penalties are imposed on invalid documents that have not been updated for a long time and knowledge producers whose activity level has declined, forming a positive cycle of "evaluation-feedback-optimization".

[0108] By decoupling document quality scores (0-100) from producer points (0-1000), a five-level capability assessment system is constructed. Operations and maintenance personnel can earn bonus points for high-scoring documents. Capability levels are assigned to different point ranges, and these levels serve as a reference for evaluating work efficiency, forming a closed-loop ecosystem of "quality creating value - value exchanging for benefits - benefits incentivizing quality." Specifically, production authors receive bonus points based on their operations and maintenance document quality scores. The total points earned by the production author determine their capability level; the higher the operations and maintenance document quality score, the more bonus points are awarded, and the higher the total points earned, the higher the production author's capability level.

[0109] It fills the gap in quantitative evaluation standards for operation and maintenance documents, is specifically designed for operation and maintenance knowledge bases, is highly targeted, and can effectively evaluate the quality of operation and maintenance documents and the knowledge mastery and output level of operation and maintenance personnel. It can serve as an effective reference for performance evaluation. It is engineering-friendly and easy to implement quickly: all algorithms in this invention provide clear data sources and calculation methods, have low model complexity, and are easy to implement quickly into existing operation and maintenance knowledge bases.

[0110] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. For example... Figure 5 As shown, the electronic device 200 includes one or more processors 201 and memory 202.

[0111] The processor 201 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 200 to perform desired functions.

[0112] The memory 202 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 201 may execute the program instructions to implement the operation and maintenance document quality determination method of any embodiment of the present invention described above, and / or other desired functions. Various contents such as initial external parameters and thresholds may also be stored in the computer-readable storage medium.

[0113] In one example, the electronic device 200 may further include an input device 203 and an output device 204, these components being interconnected via a bus system and / or other forms of connection mechanisms (not shown). The input device 203 may include, for example, a keyboard, a mouse, etc. The output device 204 may output various information to the outside, including warning messages, braking force, etc. The output device 204 may include, for example, a display, a speaker, a printer, and a communication network and its connected remote output devices, etc.

[0114] Of course, for the sake of simplicity, Figure 5 Only some of the components of the electronic device 200 relevant to the present invention are shown, omitting components such as buses, input / output interfaces, etc. In addition, the electronic device 200 may include any other suitable components depending on the specific application.

[0115] In addition to the methods and devices described above, embodiments of the present invention may also be computer program products, which include computer program instructions that, when executed by a processor, cause the processor to perform the steps of the operation and maintenance document quality determination method provided in any embodiment of the present invention.

[0116] The computer program product can be written in any combination of one or more programming languages ​​to perform the operations of the embodiments of the present invention. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0117] Furthermore, embodiments of the present invention may also be computer-readable storage media storing computer program instructions thereon, which, when executed by a processor, cause the processor to perform the steps of the operation and maintenance document quality determination method provided in any embodiment of the present invention.

[0118] The computer-readable storage medium may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.

[0119] It should be noted that the terminology used in this invention is for describing specific embodiments only and is not intended to limit the scope of this application. As shown in this specification, unless the context clearly indicates otherwise, words such as "a," "an," "an," and / or "the" do not specifically refer to the singular and may include the plural. The terms "comprising," "including," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, or apparatus. Without further limitations, an element defined by the phrase "comprising an..." does not exclude the presence of other identical elements in the process, method, or apparatus that includes said element.

[0120] It should also be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the present invention. Unless otherwise expressly specified and limited, the terms "installed," "connected," "linked," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components. For those skilled in the art, the specific meaning of the above terms in the present invention can be understood according to the specific circumstances.

[0121] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the technical solutions of the embodiments of the present invention.

Claims

1. An operation and maintenance document quality determination method, characterized by, The method comprises: determining reference data of the operation and maintenance document in different quality evaluation dimensions; determining result information for measuring the quality of the operation and maintenance document according to the reference data in different quality evaluation dimensions; the operation and maintenance document is a document indicating an operation and maintenance strategy for solving a fault of a computing system; the quality evaluation dimensions comprise an easy-to-execute dimension, and the reference data comprises easy-to-execute reference data; the determining of the reference data of the operation and maintenance document in different quality evaluation dimensions comprises: obtaining feedback result information of simulating an operation and maintenance operation according to an operation and maintenance strategy indicated by the operation and maintenance document and step decomposition granularity information of the operation and maintenance strategy indicated by the operation and maintenance document; determining easy-to-execute reference data of the operation and maintenance document according to the feedback result information and the step decomposition granularity information; the feedback result information comprises an error rate of simulating the operation and maintenance operation according to the operation and maintenance strategy indicated by the operation and maintenance document; the greater the value of the step decomposition granularity information, the finer the step decomposition granularity.

2. The method of claim 1, wherein, the quality evaluation dimensions further comprise a structural integrity dimension, and the corresponding reference data comprises structural integrity reference data; the determining of the reference data of the operation and maintenance document in different quality evaluation dimensions comprises: analyzing the content of the operation and maintenance document to determine whether a preset module is included in the operation and maintenance document; determining structural integrity reference data of the operation and maintenance document according to whether the preset module is included in the operation and maintenance document.

3. The method of claim 2, wherein, the determining of the structural integrity reference data of the operation and maintenance document according to whether the preset module is included in the operation and maintenance document comprises: determining the structural integrity reference data by using the following calculation formula: ; wherein, represents the structure integrity reference data, represents a label of the i-th preset module, if the operation and maintenance document includes the i-th preset module, is valued at 1 if the operation and maintenance document does not include the i-th preset module, is valued at 0, represents a weight of the i-th preset module; the preset module comprises a fault phenomenon module, a fault cause analysis module, an operation step module for solving the fault, and a method module for verifying fault recovery.

4. The method of claim 1, wherein the determining of the easy-to-execute reference data of the operation and maintenance document according to the feedback result information and the step decomposition granularity information comprises: determining the easy-to-execute reference data by using the following calculation formula: ; wherein, represents the ease of execution reference data, represents the error rate, represents the step breakdown granularity information, represents the number of broken down steps, represents the total number of steps.

5. The method of claim 1, wherein, the quality evaluation dimensions further comprise a specification dimension, and the corresponding reference data comprises specification reference data; the determining of the reference data of the operation and maintenance document in different quality evaluation dimensions comprises: determining the specification reference data of the operation and maintenance document by using the following calculation formula: ; wherein, represents the normative reference data, represents the title hierarchy score, which is the ratio of the number of valid hierarchical titles to the total number of titles, represents the code specification rate; the quality evaluation dimensions comprise an easy-to-read dimension, and the reference data comprises easy-to-read reference data; the determining of the reference data of the operation and maintenance document in different quality evaluation dimensions comprises: determining the easy-to-read reference data of the operation and maintenance document by using the following calculation formula: ; ; ; wherein, represents the legibility reference data, is a reading difficulty indicator, represents the paragraph score, d represents the number of paragraphs with a word count reaching a threshold value, D represents the total number of paragraphs, represents the figure-text combination score, t represents the number of figures, represents a function that takes the maximum value, represents a function that takes the minimum value.

6. The method of claim 1, wherein, the quality evaluation dimensions further comprise an effectiveness dimension, and the corresponding reference data comprises effectiveness reference data; the determining of the reference data of the operation and maintenance document in different quality evaluation dimensions comprises: determining the effectiveness reference data of the operation and maintenance document by using the following calculation formula: ; wherein, represents the effectiveness reference data, represents the total number of times of handling faults according to the operation and maintenance document within a set time period, represents the number of times of successfully solving faults after handling faults according to the operation and maintenance document within a set time period.

7. The method of claim 1, wherein, the quality evaluation dimensions further comprise a basic quality dimension, and the corresponding reference data comprises basic quality reference data; the determining of the reference data of the operation and maintenance document in different quality evaluation dimensions comprises: determining the basic quality reference data of the operation and maintenance document by using the following calculation formula: ; ; ; ; wherein, denotes the base quality reference data, denotes the word count score, denotes the word count of the operation and maintenance document, denotes the like score, denotes the number of likes of the operation and maintenance document, denotes the timeliness decay score, denotes the age of the operation and maintenance document, and max() denotes a function that takes the maximum value.

8. The method of claim 1, wherein, further comprising According to the result information for measuring the quality of the operation and maintenance document and the associated information of all operation and maintenance documents produced by a production author of the operation and maintenance document, production reference data of different productivity evaluation dimensions is determined; According to the production reference data of the different productivity evaluation dimensions, index data for measuring the productivity of the author is determined; The reference data of the operation and maintenance document in different quality evaluation dimensions is displayed in a chart form, and the productivity data of the author in different dimensions is displayed in a chart form.

9. The method of claim 8, wherein, The production reference data of the different productivity evaluation dimensions includes production quantity reference data, production quality reference data and activity reference data; The production reference data of the different productivity evaluation dimensions is determined according to the result information for measuring the quality of the operation and maintenance document and the associated information of all operation and maintenance documents produced by a production author of the operation and maintenance document, and includes: The production quantity reference data is determined by the following calculation formula: ; wherein, represents the production quantity reference data, represents the total number of all operation and maintenance documents produced by the author, represents the time length of the production account of the author, the author producing operation and maintenance documents through the production account, represents the total number of times each operation and maintenance document is updated; The production quality reference data is determined by the following calculation formula: ; wherein, represents the production quality reference data, represents the result information for measuring the operation and maintenance document quality of the single operation and maintenance document produced by the author, represents the number of operation and maintenance documents for which the result information satisfies a set condition; The activity reference data is determined by the following calculation formula: ; wherein, represents the activity reference data, represents the total number of times each operation and maintenance document is updated in the last half year.

Images