Job assessment methods, job assessment equipment, and job assessment systems

Abstract

This disclosure relates to a work evaluation method, work evaluation equipment, and work evaluation system. The work evaluation method includes: acquiring network element operation logs; establishing a log database based on the network element operation logs; and determining and outputting work evaluation data of maintenance personnel within a preset time period based on the log database.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and more specifically, to a work evaluation method, work evaluation equipment, and work evaluation system. Background Technology

[0002] With the updating and development of communication technologies, especially in the context of the coexistence of multiple generations of communication networks, the difficulty and cost of operation and maintenance for operators have increased accordingly. Therefore, in order to more easily evaluate the work of operation and maintenance personnel, and thus help to more rationally allocate operation and maintenance tasks and improve operation and maintenance efficiency, it is necessary to propose a new work evaluation method. Summary of the Invention

[0003] One of the purposes of this disclosure is to provide a job evaluation method, job evaluation equipment, and job evaluation system.

[0004] According to the first aspect of this disclosure, a work evaluation method is proposed, comprising:

[0005] Obtain network element operation logs;

[0006] Based on the network element operation logs, a log database is established. Each log entry in the log database includes at least the following data fields: operation time information, operation and maintenance personnel information corresponding to the operation and maintenance personnel, network element information corresponding to the network element, and maintenance work parameters.

[0007] Based on the log database, the work evaluation data of the operation and maintenance personnel within a preset time period is determined and output.

[0008] In some embodiments, the job evaluation method further includes:

[0009] Obtain a query request, wherein the query request indicates at least one of the following: the maintenance personnel to be evaluated, a preset time period, and a description of the work evaluation data to be queried.

[0010] In some embodiments, the maintenance parameters in the log data are determined based on the human-machine command instructions in the log data and a command database.

[0011] In some embodiments, the instruction database is established by the following operations:

[0012] Obtain the human-machine command operation manual;

[0013] Identify the text in the human-machine command operation manual to determine at least one of the function description keywords and instruction header keywords of the human-machine command instructions in the manual; and

[0014] Based on at least one of the identified functional description keywords and instruction header keywords, at least a portion of the maintenance parameters corresponding to each human-machine command are marked to establish the instruction database.

[0015] In some embodiments, maintenance work parameters include maintenance work type, and the work evaluation data of the operation and maintenance personnel includes the total number of network elements maintained by the operation and maintenance personnel;

[0016] Based on the log database, the work evaluation data of the operations and maintenance personnel within the preset time period is determined as follows:

[0017] For each of all network elements, perform the following operations:

[0018] Based on the network element information and operation time information in the log data in the log database, determine the maintenance work type corresponding to the network element within the preset time period;

[0019] Determine the total number of maintenance operations for each maintenance task type corresponding to the network element within a preset time period;

[0020] Based on the operation time information, maintenance personnel information, and maintenance work type of the log data in the log database, the specific time period for each maintenance personnel to perform their duties is determined.

[0021] The number of maintenance operations performed by each type of maintenance task by the network element;

[0022] Based on the total number of maintenance tasks for each maintenance task type, the number of maintenance tasks for each maintenance worker for each maintenance task type, and the participation weight for each maintenance task type, the following categories are defined:

[0023] Do not determine the level of involvement of each operations and maintenance personnel in the work related to that network element; and

[0024] Based on each maintenance worker's level of involvement with that network element, determine the number of network elements associated with that network element for each maintenance worker; and

[0025] The total number of network elements maintained by each maintenance personnel is determined by summing up the equivalent number of network elements associated with all network elements for each maintenance personnel.

[0026] In some embodiments, within a preset time period, if the total number of maintenance tasks of the i-th maintenance type corresponding to the m-th network element is SAmi, the number of maintenance tasks of the i-th maintenance type performed by the j-th maintenance personnel on the m-th network element is SBmij, the participation weight of the i-th maintenance type is Ki, and the total number of maintenance task types is I, then the work participation Wmj of the j-th maintenance personnel on the m-th network element satisfies:

[0027]

[0028] in,

[0029] In some embodiments, when the work participation of the operation and maintenance personnel in relation to a network element is greater than or equal to a first participation threshold, the number of network elements associated with that network element by the operation and maintenance personnel is determined to be a first preset number.

[0030] When an operations and maintenance (O&M) personnel's engagement level with a network element is less than a first engagement threshold but greater than or equal to a second engagement threshold, the number of network elements associated with that O&M personnel is determined to be a second preset number; and

[0031] When the work participation of the operation and maintenance personnel in relation to the network element is less than the second participation threshold but greater than zero, the number of network elements associated with that network element by the operation and maintenance personnel is determined to be the third preset number.

[0032] Among them, the first participation threshold is greater than the second participation threshold, the first preset number is greater than the second preset number, and the second preset number is greater than the third preset number.

[0033] In some embodiments, determining the work evaluation data of maintenance personnel within a preset time period based on the log database includes:

[0034] Filter log data with preset maintenance parameters from the log database; and

[0035] Based on the operation time information and maintenance personnel information of the filtered log data, the workload of each maintenance personnel in performing work with preset maintenance parameters within a preset time period is determined.

[0036] In some embodiments, the preset maintenance parameters include multiple preset maintenance types;

[0037] Based on the operation time information and maintenance personnel information of the filtered log data, the workload of each maintenance personnel within a preset time period, including the work with preset maintenance parameters, is determined as follows:

[0038] Determine the number of maintenance tasks of each type performed by each maintenance personnel within a preset time period; and

[0039] Based on the number of maintenance operations performed by each maintenance personnel for each type of work within a preset time period, and the workload weight of each type of work, the workload of each maintenance personnel for each type of work within a preset time period is determined.

[0040] In some embodiments, within a preset time period, if the workload weight of the r-th type of work with preset maintenance parameters is Pr, and the number of times the s-th maintenance personnel performs the r-th type of work with preset maintenance parameters is LBrs, then the workload Wcs of the work with preset maintenance parameters performed by the s-th maintenance personnel satisfies:

[0041]

[0042] According to a second aspect of this disclosure, a work evaluation apparatus is provided, comprising a processor and a memory, wherein the memory stores instructions that, when executed by the processor, implement the steps of the work evaluation method as described above.

[0043] According to a third aspect of this disclosure, a work evaluation system is proposed, comprising:

[0044] The data acquisition module is configured to acquire network element operation logs;

[0045] The database processing module is configured to establish a log database based on the network element operation logs. Each log entry in the log database includes at least the following data fields: operation time information, operation and maintenance personnel information corresponding to the operation and maintenance personnel, network element information corresponding to the network element, and maintenance work parameters.

[0046] A performance evaluation module is configured to determine the performance evaluation data of maintenance personnel within a preset time period based on the log database; and

[0047] The storage and output module is configured to store and output the work evaluation data of the operation and maintenance personnel within a preset time period.

[0048] According to a fourth aspect of this disclosure, a computer-readable storage medium is provided, wherein instructions are stored on the computer-readable storage medium, and when the instructions are executed, implement the steps of the work evaluation method as described above.

[0049] According to a fifth aspect of this disclosure, a computer program product is provided, the computer program product comprising instructions that, when executed by the processor, implement the steps of the performance evaluation method as described above.

[0050] Other features and advantages of this disclosure will become clearer from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0051] The accompanying drawings, which form part of this specification, illustrate embodiments of this disclosure and, together with the specification, serve to explain the principles of this disclosure.

[0052] This disclosure will become clearer with reference to the accompanying drawings and the following detailed description, wherein:

[0053] Figure 1 A flowchart illustrating a performance evaluation method according to an exemplary embodiment of the present disclosure is shown;

[0054] Figure 2 A flowchart illustrating the process of establishing an instruction database in a job evaluation method according to an exemplary embodiment of the present disclosure is shown;

[0055] Figure 3 A partial flowchart of step S300 in a work evaluation method according to a specific example of the present disclosure is shown;

[0056] Figure 4 A partial flowchart of step S300 in a work evaluation method according to another specific example of this disclosure is shown;

[0057] Figure 5 A block diagram of a performance evaluation apparatus according to an exemplary embodiment of the present disclosure is shown;

[0058] Figure 6 A block diagram of a performance evaluation system according to an exemplary embodiment of the present disclosure is shown.

[0059] Note that in the embodiments described below, the same reference numerals are sometimes used across different figures to denote the same parts or parts with the same function, and repeated descriptions are omitted. In some cases, similar reference numerals and letters are used to denote similar items, so once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0060] For ease of understanding, the positions, dimensions, and extents of the structures shown in the accompanying drawings and other materials may not represent actual positions, dimensions, and extents. Therefore, this disclosure is not limited to the positions, dimensions, and extents disclosed in the accompanying drawings and other materials. Detailed Implementation

[0061] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the present disclosure.

[0062] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the scope of this disclosure or its application or use. That is, the structures and methods herein are shown in an exemplary manner to illustrate different embodiments of the structures and methods in this disclosure. However, those skilled in the art will understand that they merely illustrate exemplary ways that can be used to implement this disclosure, and not exhaustive ways. Furthermore, the drawings are not necessarily drawn to scale, and some features may be enlarged to show details of specific components.

[0063] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0064] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0065] With the advancement and development of communication technologies, 5G standalone networks are being commercially deployed on a large scale. However, existing 2G / 3G networks have not yet been decommissioned, resulting in a multi-network overlay of 2G / 3G / 4G / 5G, which increases the difficulty and cost of operation and maintenance for operators. Therefore, the problem of excessively high operation and maintenance costs must be addressed during the digital transformation of operators to provide high-quality mobile network operation and maintenance services as economically and cost-effectively as possible. However, network operation and maintenance departments, as technical support departments, often lack effective monitoring and tracking of operation and maintenance work. This makes it difficult for managers to reliably evaluate the work of frontline operation and maintenance personnel, leading to chaotic work allocation—often handled by whoever is available—and wasting human resources. Based on the above, it is necessary to establish a traceable and automated method for evaluating the work of operation and maintenance personnel, based on objective data, to achieve effective monitoring and tracking of their work.

[0066] In response, this disclosure proposes a performance evaluation method that accurately assesses the work of network maintenance personnel based on network element operation logs. This evaluation allows for a simple and reasonable allocation of maintenance personnel's workload, thereby reducing maintenance costs and improving efficiency. Figure 1 As shown, in an exemplary embodiment of this disclosure, the work evaluation method may include:

[0067] Step S100: Obtain network element operation logs.

[0068] A network element is an element within a network; it can be the smallest unit that can be monitored and managed in network management, capable of independently performing certain transmission functions. Network element operation logs can be collected in real-time during the operation of the network element. To comprehensively evaluate the work of all maintenance personnel, network element operation logs for all network elements can be obtained; alternatively, to reduce the amount of data to be processed, only the network element operation logs for a subset of network elements can be obtained as needed.

[0069] like Figure 1 As shown, job evaluation methods may also include:

[0070] Step S200: Establish a log database based on the network element operation logs.

[0071] The data fields of each log entry in the log database can include at least the operation time information, the operation and maintenance personnel information corresponding to each operation and maintenance personnel, the network element information corresponding to each network element, and the maintenance work parameters.

[0072] Specifically, the operation time information may include the maintenance start time, maintenance end time, and maintenance period for the corresponding network element.

[0073] The personnel information corresponding one-to-one with maintenance personnel can include their account information to uniquely identify the corresponding maintenance personnel. Furthermore, the association between all maintenance personnel and their account information can be stored, for example, in an account management system. In addition, during network element maintenance, maintenance personnel need to log in to their accounts to perform corresponding operations; thus, the account information of the maintenance personnel associated with the maintenance work can be recorded in the network element operation log. Based on the maintenance personnel information recorded in the network element operation log, the work of the maintenance personnel can be evaluated accordingly. It is understood that, as needed, maintenance personnel information can also be other information that can uniquely identify the maintenance personnel; this is not limited here.

[0074] Network element information, corresponding one-to-one with each network element, may include network element identifiers or network element names to uniquely identify the corresponding network element. Furthermore, the relationships between all network elements and their information can be stored, for example, in a network element management system. Additionally, network element information can also be recorded in the network element operation log. Thus, based on the network element information recorded in the network element operation log, corresponding tasks can be mapped to the corresponding network elements for evaluation. It is understood that, as needed, network element information can also be other information that can uniquely identify the network element; this is not limited here.

[0075] Maintenance parameters can include parameters such as maintenance job type. In a specific example, maintenance job type can include four categories, such as "Business Activation Guarantee Maintenance," "Major Risk Operation Maintenance," "Fault Handling Maintenance," and "Basic Inspection Maintenance." However, it is understood that other maintenance parameters or maintenance job types can be set as needed, and this is not limited here.

[0076] In some embodiments, maintenance work parameters in the log data can be determined based on an instruction database and human-machine command instructions in the log data. The instruction database can record the association between instructions and maintenance work parameters such as maintenance work type.

[0077] like Figure 2 As shown, in some embodiments, the instruction database can be established through the following operations:

[0078] Step S510: Obtain the human-machine command operation manual;

[0079] Step S520: Identify the text in the human-machine command operation manual to determine at least one of the function description keywords and instruction header keywords of the human-machine command instructions in the human-machine command operation manual; and

[0080] Step S530: Based on at least one of the identified function description keywords and instruction header keywords, mark at least some maintenance operation parameters corresponding to each human-machine command instruction to establish an instruction database.

[0081] Specifically, the instruction database can include a mapping relationship between all human-machine commands and instructions and at least some maintenance work parameters. For example, it can include a mapping relationship between human-machine commands and instructions and maintenance work types to achieve analysis and classification of human-machine commands and instructions for all network elements. In some embodiments, the human-machine command operation manual can be digitized based on web crawling technology, that is, an instruction database can be built based on the human-machine command operation manual. Here, a web crawler is a program or script that can automatically crawl network information according to certain rules. The text in the human-machine command operation manual can be identified based on big data text semantic recognition algorithms to determine at least one of the functional description keywords and instruction header keywords of the human-machine commands and instructions. For example, the identification of semantics can be assisted by inputting human-machine command tagged samples, sample classification model samples, etc. Here, functional description keywords can include keywords such as business, interface, configuration, management, etc., while instruction header keywords can include keywords such as ADD, RMV, RM, MOD, MD, RESET, etc. By identifying at least one of the function description keywords and instruction header keywords, at least some of the maintenance work parameters corresponding to each human-machine command can be marked. For example, human-machine commands can be associated with the four maintenance work types mentioned above: "service activation guarantee maintenance", "major risk operation maintenance", "fault handling maintenance" and "basic inspection maintenance".

[0082] Based on the acquired network element operation logs, combined with, for example, maintenance personnel information in the account management system and network element information in the network element management system, as well as at least some maintenance work parameters determined based on the instruction database, a log database containing data fields such as operation time information, maintenance personnel information, network element information, and maintenance work parameters can be established to structurally record various information from network element operation logs obtained from the corresponding network elements, making it easier to filter the required log data in subsequent steps to evaluate the work of maintenance personnel.

[0083] return Figure 1 Job evaluation methods may also include:

[0084] Step S300: Based on the log database, determine and output the work evaluation data of the operation and maintenance personnel within a preset time period.

[0085] Work evaluation data can include workload and work efficiency. However, there is currently a lack of standard definitions for the workload or work efficiency of operations and maintenance personnel. In this disclosure, at least one of the following can be used to characterize the work evaluation data of operations and maintenance personnel within a preset time period: the total number of network elements maintained by operations and maintenance personnel within the preset time period and the workload of work with preset maintenance work parameters (e.g., the number of high-difficulty maintenance tasks determined according to preset maintenance work parameters). Defining work evaluation data in this narrow way helps to objectively and traceably determine the workload or work efficiency of operations and maintenance personnel. However, it is understood that work evaluation data can also be defined in other ways and the corresponding work evaluation data can be determined based on relevant information in the log database.

[0086] In some embodiments, prior to step S300, the work evaluation method may further include obtaining a query request, wherein the query request may indicate at least one of the following: the maintenance personnel to be evaluated, a preset time period, and a description of the work evaluation data to be queried (e.g., querying the workload of high-difficulty tasks), so as to evaluate the work of relevant maintenance personnel in a targeted manner. However, it is understood that in some other embodiments, the above-mentioned query parameters may also be preset, and the corresponding work evaluation data may be automatically determined and output based on the preset query parameters, for example, periodically (e.g., weekly, monthly, quarterly, or annually).

[0087] In some embodiments, maintenance work parameters may include the maintenance work type, and the performance evaluation data of the operations and maintenance personnel may include the total number of network elements maintained by the personnel. For example... Figure 3 As shown, based on the log database, the performance evaluation data of operations and maintenance personnel within a preset time period can include:

[0088] For each of all network elements, perform the following operations:

[0089] Step S311: Based on the network element information and operation time information in the log data in the log database, determine the maintenance work type corresponding to the network element within the preset time period.

[0090] Step S312: Determine each type of maintenance corresponding to the network element within a preset time period.

[0091] Total number of maintenance visits for each job type;

[0092] Step S313: Based on the operation time information, maintenance personnel information, and maintenance work type of the log data in the log database, determine the time period for each maintenance personnel.

[0093] The number of maintenance operations performed on each type of maintenance task for this network element;

[0094] Step S314: Based on the total number of maintenance tasks for each maintenance task type, the number of maintenance tasks for each maintenance task type for each maintenance personnel, and the participation weight for each maintenance task type, determine the work participation level of each maintenance personnel for that network element; and

[0095] Step 315: Based on each maintenance worker's participation level in the work related to that network element, determine the number of network elements associated with that network element for each maintenance worker; and

[0096] Step S316: Accumulate the converted number of network elements associated with all network elements for each maintenance personnel to determine the total number of network elements maintained by each maintenance personnel.

[0097] The number of network elements associated with a specific network element by an operations and maintenance (O&M) personnel reflects the extent to which that O&M personnel participate in the maintenance of that network element. In calculating the number of network elements, network element information can be used as the primary index dimension, and data tables corresponding to one or more preset time periods can be obtained based on operation time information to calculate the total number of network elements maintained by each O&M personnel within each preset time period.

[0098] Within a preset time period, if the total number of maintenance visits for the i-th maintenance type corresponding to the m-th network element is SAmi, the number of maintenance visits for the i-th maintenance type performed by the j-th maintenance personnel on the m-th network element is SBmij, the participation weight for the i-th maintenance type is Ki, and the total number of maintenance types is I, then the participation degree Wmj of the j-th maintenance personnel for the m-th network element can be determined according to... To determine, among which,

[0099] Furthermore, when the work participation of the operation and maintenance personnel in relation to a network element is greater than or equal to the first participation threshold, the number of network elements associated with that network element can be determined as the first preset number; when the work participation of the operation and maintenance personnel in relation to a network element is less than the first participation threshold but greater than or equal to the second participation threshold, the number of network elements associated with that network element can be determined as the second preset number; and when the work participation of the operation and maintenance personnel in relation to a network element is less than the second participation threshold but greater than zero, the number of network elements associated with that network element can be determined as the third preset number; wherein, the first participation threshold is greater than the second participation threshold, the first preset number is greater than the second preset number, and the second preset number is greater than the third preset number.

[0100] In a specific example, for the m-th network element, the total number of maintenance visits for each maintenance work type can be calculated cumulatively based on the maintenance work type. The total number of visits for "Service Activation Guarantee Maintenance" is denoted as SAm1, for "Major Risk Operation Maintenance" as SAm2, for "Fault Handling Maintenance" as SAm3, and for "Basic Inspection Maintenance" as SAm4. Alternatively, the number of visits for each maintenance worker for each maintenance work type can be calculated cumulatively based on the maintenance personnel information and the maintenance work type. Taking the j-th maintenance worker as an example, the number of visits for "Service Activation Guarantee Maintenance" is denoted as SBm1j, for "Major Risk Operation Maintenance" as SBm2j, for "Fault Handling Maintenance" as SBm3j, and for "Basic Inspection Maintenance" as SBm4j. Therefore, the work participation rate of this maintenance worker can be represented as:

[0101]

[0102] K1, K2, K3, and K4 represent the participation weights for "Business Activation Guarantee Maintenance," "Major Risk Operation Maintenance," "Fault Handling Maintenance," and "Basic Inspection Maintenance," respectively, and can be adjusted as needed. In some embodiments, K1+K2+K3+K4=1.

[0103] Further, in the specific example above, the first participation threshold can be set to 50%, the second participation threshold to 20%, the first preset number to 1, the second preset number to 0.5, and the third preset number to 0.2. That is, when an operator's participation in a network element is greater than or equal to 50%, the number of network elements associated with that operator can be 1, or the number of network elements under their primary maintenance (Qa) can be increased accordingly. When an operator's participation in a network element is less than 50% but greater than or equal to 20%, the number of network elements associated with that operator can be 0.5, or the number of network elements under their secondary maintenance (Qb) can be increased accordingly. When an operator's participation in a network element is less than 20% but greater than 0, the number of network elements associated with that operator can be 0.2, or the number of network elements under their participation in maintenance (Qc) can be increased accordingly.

[0104] Then, for each operations and maintenance (O&M) personnel, the total number of network elements maintained by that personnel within the preset time period is calculated by summing the converted number of network elements for all network elements. Alternatively, the total number of network elements maintained by a particular O&M personnel can be expressed as Qa + Qb / 2 + Qc / 5, where Qa is the number of network elements primarily maintained by the O&M personnel, Qb is the number of network elements secondarily maintained by the O&M personnel, and Qc is the number of network elements maintained in conjunction with the O&M personnel. It is understood that within the same preset time period, O&M personnel with a higher total number of network elements maintained have a higher workload or higher efficiency, and can be rewarded accordingly or have their workload reduced to balance the distribution of work.

[0105] In some embodiments, the workload or efficiency of maintenance personnel performing a specific task can be determined based on preset maintenance work parameters. For example, the workload or efficiency of maintenance personnel performing high-difficulty tasks can be determined.

[0106] Specifically, such as Figure 4 As shown, based on the log database, the performance evaluation data of operations and maintenance personnel within a preset time period can include:

[0107] Step S321: Filter log data with preset maintenance parameters from the log database; and

[0108] Step S322: Based on the operation time information and maintenance personnel information of the filtered log data, determine the workload of each maintenance personnel for the work with preset maintenance parameters within the preset time period.

[0109] The preset maintenance work parameters can be determined based on requirements. For example, preset maintenance work parameters may include one or more preset maintenance work types. Furthermore, based on the operation time information and maintenance personnel information of the filtered log data, the workload of each maintenance personnel performing tasks with preset maintenance work parameters within a preset time period can be determined as follows:

[0110] Determine the number of maintenance tasks of each type performed by each maintenance personnel within a preset time period; and

[0111] Based on the number of maintenance operations performed by each maintenance personnel for each type of work within a preset time period, and the workload weight of each type of work, the workload of each maintenance personnel for each type of work within a preset time period is determined.

[0112] In some embodiments, within a preset time period, if the workload weight of the r-th type of work with preset maintenance parameters is Pr, and the number of times the s-th maintenance personnel perform the r-th type of work with preset maintenance parameters is LBrs, then according to... Let Wcs be the workload of the s-th maintenance personnel performing the work with preset maintenance parameters.

[0113] In a specific example, if we want to obtain the work evaluation data of high-difficulty tasks performed by operations and maintenance personnel within a preset time period, where high-difficulty tasks include maintenance work types such as "service activation guarantee maintenance" and "major risk operation maintenance," then we can define the maintenance work types of "service activation guarantee maintenance" and "major risk operation maintenance" as preset maintenance work parameters, and filter the number of logs with such preset maintenance work parameters from the log database. We can obtain data tables corresponding to one or more preset time periods based on operation time information to calculate the workload of each operations and maintenance personnel for tasks with preset maintenance work types within each preset time period.

[0114] For the s-th maintenance personnel, the number of times they perform "service activation and maintenance" within a preset time period is denoted as LB1s, and the number of times they perform "major risk operation maintenance" within the preset time period is denoted as LB2s. Then, the performance evaluation data Wcs of the maintenance personnel's work with preset maintenance parameters can be represented as:

[0115] Wcs = LB1s * P1 + LB2s * P2

[0116] Here, P1 and P2 represent the workload weights for "Business Activation Guarantee Maintenance" and "Major Risk Operation Maintenance," respectively. The workload weights can be adjusted as needed; for example, in a specific example, P1 can be set to 0.5, and K2 can be set to 1.

[0117] The performance evaluation data of operation and maintenance personnel can also include provincial rankings, group rankings, etc. After the performance evaluation data is determined, the operation and maintenance personnel information, the total number of network elements maintained, the workload of the work performed with preset maintenance parameters, provincial rankings, group rankings, etc. can be output to external systems for queryers to view.

[0118] The work evaluation method disclosed herein allows for a comprehensive analysis of the operation logs of all maintained network elements to accurately assess the workload or efficiency of maintenance personnel. As needed, relevant data can be acquired periodically (e.g., weekly, monthly, quarterly, annually) within preset time periods to enable periodic evaluation of maintenance personnel's work. This helps to adjust work allocation in a timely manner, allowing operators to promptly grasp and objectively evaluate the current work status of maintenance personnel, thereby reducing maintenance costs and improving maintenance efficiency.

[0119] This disclosure also proposes a performance evaluation device, such as Figure 5 As shown, the work evaluation device may include a processor 610 and a memory 620. The memory 620 stores instructions, and when the instructions are executed by the processor 610, the steps of the work evaluation method described above are implemented.

[0120] The processor 610 can perform various actions and processes according to instructions stored in the memory 620. Specifically, the processor 610 can be an integrated circuit chip with signal processing capabilities. The processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of this disclosure. The general-purpose processor can be a microprocessor or any conventional processor, and can be an x86 architecture or an ARM architecture, etc.

[0121] Memory 620 stores executable instructions that are executed by processor 610 using the work evaluation method described above. Memory 620 may be volatile memory or non-volatile memory, or may include both. Non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory may be random access memory (RAM) used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct memory bus random access memory (DR RAM). It should be noted that the memory used in the methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0122] This disclosure also proposes a job evaluation system, such as Figure 6 As shown, the work evaluation system may include a data acquisition module 710 configured to, for example, obtain network element operation logs from network elements, a database processing module 720 configured to establish a log database based on the network element operation logs, a work evaluation module configured to determine the work evaluation data of maintenance personnel within a preset time period based on the log database, and a storage and output module 740 configured to store and output the work evaluation data of maintenance personnel within a preset time period.

[0123] The data fields of each log entry in the log database can include at least the operation time information, the operation and maintenance personnel information corresponding to each operation and maintenance personnel, the network element information corresponding to each network element, and the maintenance work parameters.

[0124] In addition, the data acquisition module 710 can also be configured to obtain operation and maintenance personnel information from the account management system, obtain network element information from the network element management system, and import human-machine command operation manuals from various manufacturers from other external interfaces.

[0125] In some embodiments, the database processing module 720 may include an instruction processing unit for establishing an instruction database that includes human-machine command instructions and corresponding maintenance operation parameters.

[0126] In some embodiments, the work evaluation module may include at least one of a maintenance network element number unit 731 and a parameter work evaluation unit 732, for determining the total number of network elements maintained by maintenance personnel within a preset time period and the workload of work performed with preset maintenance work parameters, respectively.

[0127] The storage and output module 740 may include a display unit to display the calculated performance evaluation data.

[0128] In addition, the job evaluation system may also include interfaces and scheduling modules 750 for receiving query requests from users and for scheduling the various internal modules of the job evaluation system.

[0129] According to another aspect of this disclosure, a computer-readable storage medium is proposed, on which instructions are stored, which, when executed, can implement the steps in the work evaluation method described above.

[0130] Similarly, the computer-readable storage medium in the embodiments of this disclosure may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. It should be noted that the computer-readable storage medium described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0131] This disclosure also proposes a computer program product that may include instructions that, when executed by a processor, can implement the steps of the performance evaluation method described above.

[0132] Instructions can be any set of instructions that will be executed directly by one or more processors, such as machine code, or any set of instructions that will be executed indirectly, such as a script. The terms “instruction,” “application,” “process,” “step,” and “program” used herein are interchangeable. Instructions can be stored in object code format for direct processing by one or more processors, or stored in any other computer language, including scripts or sets of independent source code modules that are interpreted on demand or compiled ahead of time. Instructions can include instructions that cause one or more processors to act as the various neural networks described herein. The function, methods, and routines of instructions are explained in more detail in other parts of this document.

[0133] It should be noted that the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0134] In general, the various exemplary embodiments of this disclosure can be implemented in hardware or dedicated circuitry, software, firmware, logic, or any combination thereof. Some aspects can be implemented in hardware, while others can be implemented in firmware or software that can be executed by a controller, microprocessor, or other computing device. When aspects of embodiments of this disclosure are illustrated or described as block diagrams, flowcharts, or using some other graphical representation, it will be understood that the blocks, apparatuses, systems, techniques, or methods described herein can be implemented as non-limiting examples in hardware, software, firmware, dedicated circuitry or logic, general-purpose hardware or controllers or other computing devices, or some combination thereof.

[0135] The terms “front,” “back,” “top,” “bottom,” “above,” “below,” etc., used in the specification and claims, if present, are for descriptive purposes and are not necessarily used to describe unchanging relative positions. It should be understood that such terms are interchangeable where appropriate, so that embodiments of this disclosure described herein can, for example, operate on orientations different from those shown or otherwise described herein.

[0136] As used herein, the term "exemplary" means "serving as an example, instance, or illustration," and not as a "model" to be precisely copied. Any implementation described herein by example is not necessarily to be construed as preferred or advantageous over other implementations. Furthermore, this disclosure is not limited to any theory expressed or implied as given in the foregoing technical field, background, summary of invention, or detailed description.

[0137] As used herein, the term "substantially" means any minor variation resulting from design or manufacturing defects, device or component tolerances, environmental influences, and / or other factors. The term "substantially" also allows for differences from the perfect or ideal situation due to parasitic effects, noise, and other practical considerations that may exist in the actual implementation.

[0138] Additionally, the foregoing description may refer to elements, nodes, or features that are “connected” or “coupled” together. As used herein, unless otherwise expressly stated, “connected” means that one element / node / feature is electrically, mechanically, logically, or otherwise directly connected (or directly communicating) with another element / node / feature. Similarly, unless otherwise expressly stated, “coupled” means that one element / node / feature can be directly or indirectly connected to another element / node / feature mechanically, electrically, logically, or otherwise to allow interaction, even if the two features may not be directly connected. That is, “coupled” is intended to include both direct and indirect connections of elements or other features, including connections using one or more intermediate elements.

[0139] Additionally, terms such as “first,” “second,” etc., may be used in this document for reference purposes only and are not intended to be limiting. For example, unless the context clearly indicates otherwise, the words “first,” “second,” and other such numerical terms relating to structures or elements do not imply order or sequence.

[0140] It should also be understood that when the term “including / contains” is used herein, it indicates the presence of the indicated feature, whole, step, operation, unit and / or component, but does not preclude the presence or addition of one or more other features, wholes, steps, operations, units and / or components and / or combinations thereof.

[0141] In this disclosure, the term “provide” is used broadly to cover all ways of obtaining an object, and therefore “provide an object” includes, but is not limited to, “purchasing,” “preparing / manufacturing,” “arranging / setting up,” “installing / assembling,” and / or “ordering” an object.

[0142] While specific embodiments of this disclosure have been described in detail by way of example, those skilled in the art should understand that the examples are for illustrative purposes only and not intended to limit the scope of this disclosure. The various embodiments disclosed herein can be combined in any way without departing from the spirit and scope of this disclosure. Those skilled in the art should also understand that various modifications can be made to the embodiments without departing from the scope and spirit of this disclosure. The scope of this disclosure is defined by the appended claims.

Claims

1. A job evaluation method, characterized in that, The work evaluation methods include: Obtain network element operation logs; Based on the network element operation logs, a log database is established. Each log entry in the log database includes at least the following data fields: operation time information, operation and maintenance personnel information corresponding to the operation and maintenance personnel, network element information corresponding to the network element, and maintenance work parameters, including the maintenance work type. Based on the log database, the work evaluation data of the operation and maintenance personnel within a preset time period is determined and output. The work evaluation data of the operation and maintenance personnel includes the total number of network elements maintained by the operation and maintenance personnel. The work evaluation data of maintenance personnel within a preset time period, based on the log database, includes: For each network element, perform the following operations: Based on the network element information and operation time information in the log data of the log database, determine the corresponding maintenance work type for the network element within a preset time period; determine the total number of maintenance visits for each maintenance work type for the network element within the preset time period; based on the operation time information, maintenance personnel information, and maintenance work type in the log data of the log database, determine the number of maintenance visits for each maintenance personnel for the network element within the preset time period for each maintenance work type; based on the total number of maintenance visits for each maintenance work type, the number of maintenance visits for each maintenance personnel for each maintenance work type, and the participation weight for each maintenance work type, determine the work participation level of each maintenance personnel for the network element; and based on the work participation level of each maintenance personnel for the network element, determine the number of converted network elements associated with that network element for each maintenance personnel; and... The total number of network elements maintained by each maintenance personnel is determined by summing up the equivalent number of network elements associated with all network elements for each maintenance personnel.

2. The work evaluation method according to claim 1, characterized in that, The work evaluation method also includes: Obtain a query request, wherein the query request indicates at least one of the following: the maintenance personnel to be evaluated, a preset time period, and a description of the work evaluation data to be queried.

3. The work evaluation method according to claim 1, characterized in that, The maintenance parameters in the log data are determined based on the human-machine command instructions in the log data and the instruction database.

4. The work evaluation method according to claim 3, characterized in that, The instruction database is established through the following operations: Obtain the human-machine command operation manual; Identify the text in the human-machine command operation manual to determine at least one of the function description keywords and instruction header keywords of the human-machine command instructions in the human-machine command operation manual. as well as Based on at least one of the identified functional description keywords and instruction header keywords, at least a portion of the maintenance parameters corresponding to each human-machine command are marked to establish the instruction database.

5. The work evaluation method according to claim 1, characterized in that, Within a preset time period, if the total number of maintenance tasks of the i-th maintenance type corresponding to the m-th network element is SAmi, the number of maintenance tasks of the i-th maintenance type performed by the j-th maintenance personnel on the m-th network element is SBmij, the participation weight of the i-th maintenance type is Ki, and the total number of maintenance task types is I, then the work participation Wmj of the j-th maintenance personnel on the m-th network element satisfies: ， in, .

6. The work evaluation method according to claim 1, characterized in that, When the work participation of the operation and maintenance personnel in relation to a network element is greater than or equal to the first participation threshold, the number of network elements associated with that network element by the operation and maintenance personnel is determined to be the first preset number. When the work participation of the operation and maintenance personnel in relation to the network element is less than the first participation threshold but greater than or equal to the second participation threshold, the number of network elements associated with the network element for that operation and maintenance personnel is determined to be the second preset number. as well as When the work participation of the operation and maintenance personnel in relation to the network element is less than the second participation threshold but greater than zero, the number of network elements associated with that network element by the operation and maintenance personnel is determined to be the third preset number. Among them, the first participation threshold is greater than the second participation threshold, the first preset number is greater than the second preset number, and the second preset number is greater than the third preset number.

7. The work evaluation method according to claim 1, characterized in that, Based on the log database, the work evaluation data of the operations and maintenance personnel within the preset time period is determined as follows: Filter log data with preset maintenance parameters from the log database; and Based on the operation time information and maintenance personnel information of the filtered log data, the workload of each maintenance personnel in performing work with preset maintenance parameters within a preset time period is determined.

8. The work evaluation method according to claim 7, characterized in that, The preset maintenance parameters include multiple preset maintenance task types; Based on the operation time information and maintenance personnel information of the filtered log data, the workload of each maintenance personnel within a preset time period, including the work with preset maintenance parameters, is determined as follows: Determine the number of maintenance tasks of each type performed by each maintenance personnel within a preset time period; and Based on the number of maintenance operations performed by each maintenance personnel for each type of work within a preset time period, and the workload weight of each type of work, the workload of each maintenance personnel for each type of work within a preset time period is determined.

9. The work evaluation method according to claim 8, characterized in that, Within a preset time period, if the workload weight of the r-th type of work with preset maintenance parameters is Pr, and the number of times the s-th maintenance personnel performs the r-th type of work with preset maintenance parameters is LBrs, then the workload Wcs of the work with preset maintenance parameters performed by the s-th maintenance personnel satisfies: 。 10. A work evaluation device, characterized in that, The work evaluation device includes a processor and a memory, the memory storing instructions that, when executed by the processor, implement the steps of the work evaluation method as described in any one of claims 1 to 9.

11. A job evaluation system, characterized in that, The performance evaluation system includes: The data acquisition module is configured to acquire network element operation logs; The database processing module is configured to establish a log database based on the network element operation log. Each log entry in the log database includes at least the following data fields: operation time information, operation and maintenance personnel information corresponding to the operation and maintenance personnel, network element information corresponding to the network element, and maintenance work parameters, including the maintenance work type. The work evaluation module is configured to determine the work evaluation data of maintenance personnel within a preset time period based on the log database. The work evaluation data of the maintenance personnel includes the total number of network elements maintained by the personnel. The storage and output module is configured to store and output the work evaluation data of maintenance personnel within a preset time period. The work evaluation data of maintenance personnel within a preset time period, based on the log database, includes: For each network element, perform the following operations: Based on the network element information and operation time information in the log data of the log database, determine the corresponding maintenance work type for the network element within a preset time period; determine the total number of maintenance visits for each maintenance work type for the network element within the preset time period; based on the operation time information, maintenance personnel information, and maintenance work type in the log data of the log database, determine the number of maintenance visits for each maintenance personnel for the network element within the preset time period for each maintenance work type; based on the total number of maintenance visits for each maintenance work type, the number of maintenance visits for each maintenance personnel for each maintenance work type, and the participation weight for each maintenance work type, determine the work participation level of each maintenance personnel for the network element; and based on the work participation level of each maintenance personnel for the network element, determine the number of converted network elements associated with that network element for each maintenance personnel; and... The total number of network elements maintained by each maintenance personnel is determined by summing up the equivalent number of network elements associated with all network elements for each maintenance personnel.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed, implement the steps of the performance evaluation method as described in any one of claims 1 to 9.

13. A computer program product, characterized in that, The computer program product includes instructions that, when executed by a processor, implement the steps of the performance evaluation method as described in any one of claims 1 to 9.

Images