Assessment method and device for robot operation and electronic equipment

By extracting robot operation data to calculate quality and efficiency scores, the problem of inaccurate evaluation results in the existing technology is solved, quantitative evaluation and real-time monitoring of robot operation are realized, and the objectivity and accuracy of evaluation are improved.

CN118941164AActive Publication Date: 2024-11-12STATEGRID RUIJIA (TIANJIN) INTELLIGENT ROBOT CO LTD
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
CN202411351973.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-26
Publication Date
2024-11-12
Estimated Expiration
2044-09-26

AI Technical Summary

Technical Problem

The existing technology is difficult to conduct quantitative evaluation of robot operations, and the lack of real-time monitoring and timely feedback leads to a lack of objectivity and accuracy in the evaluation results.

Method used

By obtaining relevant data during the robot operation process, selecting characteristic data such as task completion rate, error rate and energy consumption rate, calculating quality and efficiency scores, and providing evaluation reports to achieve quality and efficiency evaluation of robot operation.

Benefits of technology

It realizes quantitative evaluation of robot operations, is objective and accurate, supports real-time monitoring and feedback, and improves the uniformity and accuracy of evaluation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118941164A_ABST
    Figure CN118941164A_ABST
Patent Text Reader

Abstract

The invention provides a robot operation evaluation method and device and electronic equipment, and relates to the technical field of robotics.The method comprises the steps that operation related data generated in the operation process of a robot is obtained, and feature data related to robot performance are extracted from the operation related data; calculating a scoring index of the robot according to the feature data; and calculating a quality-effect score of the operation of the robot based on the scoring index so as to evaluate the operation of the robot. According to the robot operation assessment method and device and the electronic equipment, the quality-effect score of the robot operation can be calculated based on the scoring index so as to assess the robot operation, and in the assessment process, due to the fact that the adopted feature data are extracted from the operation related data of the robot, the assessment efficiency is greatly improved. According to the method, characteristics such as quality and efficiency of robot operation can be evaluated, and meanwhile, the evaluation process does not need to depend on manual observation and experience judgment, so that the method has certain objectivity and accuracy.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of robots, and in particular to a method, device and electronic equipment for evaluating robot operations. Background Art

[0002] The live-line operation robot for distribution network (hereinafter referred to as the robot) is used to replace manual operation. It generally has one or more robotic arms. At the ends of the robotic arms, different clamps can be fixed through quick-connect devices to complete the corresponding operations. The clamps include wire breakers, wiring connectors, clamping tools, etc., which can be used to cut leads, connect leads, replace bird repellers and lightning arresters, etc. In addition, when the robot is working, it needs to obtain external information through depth cameras, laser radars, etc. The controller can generate coordinates after processing to determine the disconnection position, wiring position, etc., so that the clamps carried by the robotic arms can perform corresponding operations.

[0003] In the existing technology, many companies have produced robots for live-working, but it is currently difficult to quantify the performance of the robots and how to evaluate their operations. Therefore, it is also difficult to achieve real-time monitoring and timely feedback of the robots' operations. Summary of the invention

[0004] In view of this, an object of the present invention is to provide a method, device and electronic equipment for evaluating robot operations to alleviate the above technical problems.

[0005] In a first aspect, an embodiment of the present invention provides a method for evaluating robot operations, the method comprising: acquiring operation-related data generated by the robot during an operation, and extracting characteristic data related to the robot performance from the operation-related data; wherein the characteristic data comprises task data and energy data completed by the robot during the operation; the task data comprises data on tasks completed by the robot within a specified time, and data on errors occurring during the operation of the robot; calculating scoring indicators of the robot based on the characteristic data; the scoring indicators comprise task completion rate, error rate and energy consumption rate; the task completion rate is used to measure the proportion of the robot completing a predetermined operation task within a specified time; the error rate is used to measure the frequency of errors occurring during the operation of the robot; the energy consumption rate is used to measure the ratio of the energy consumed by the robot in completing the operation to the energy required to complete a unit task; and the quality and efficiency score of the robot operation is calculated based on the scoring indicators to evaluate the robot operation.

[0006] In combination with the first aspect, an embodiment of the present invention provides a first possible implementation scheme of the first aspect, wherein the step of calculating the scoring index of the robot based on the characteristic data includes: calculating the task completion rate of the robot based on the data of the robot completing the task within the specified time; calculating the error rate of the robot based on the data of errors occurring during the operation of the robot; and calculating the energy consumption rate of the robot during the operation based on the energy data.

[0007] In combination with the first possible implementation manner of the first aspect, an embodiment of the present invention provides a second possible implementation manner of the first aspect, wherein the data of the above-mentioned robot completing tasks within the specified time includes: the number of completed tasks, the total number of tasks in the operation process, and the total number of operations of the robot during the operation process; the calculation formula of the task completion rate is as follows: n=(N / N0)×100%, wherein N represents the number of completed tasks, and N0 represents the total number of tasks; the data of errors occurring in the operation process of the robot includes the number of errors occurring in the operation process of the robot; the calculation formula of the error rate is as follows: F=(F / F0)×100%, wherein F represents the number of errors occurring, and F0 represents the total number of operations; the energy consumption rate of the robot during the operation process includes the total energy consumption of the robot during the operation process; the calculation formula of the energy consumption rate is as follows: w=(W / N)×100%, wherein W represents the total energy consumption, and N represents the number of completed tasks.

[0008] In combination with the first aspect, an embodiment of the present invention provides a third possible implementation scheme of the first aspect, wherein the step of calculating the quality and efficiency score of the robot operation based on the scoring indicators includes: obtaining a pre-configured weight parameter for each of the scoring indicators; performing weighted calculation on each of the scoring indicators based on the weight parameters to obtain the quality and efficiency score of the robot operation.

[0009] In combination with the first aspect, an embodiment of the present invention provides a fourth possible implementation of the first aspect, wherein the above method also includes: extracting the automated operation data of the robot during the operation process based on the operation-related data; wherein the automated operation data includes each operation step, and the degree of automation corresponding to each of the operation steps; calculating the operation automation rate of the robot based on the automated operation data, and graphically presenting the operation automation rate.

[0010] In combination with the fourth possible implementation of the first aspect, an embodiment of the present invention provides a fifth possible implementation of the first aspect, wherein the above-mentioned degree of automation is used to characterize whether the actual operation of each of the operation steps is an automatic process or a manually intervened process; the step of calculating the operation automation rate of the robot based on the automated operation data comprises: counting the total number of the operation steps, as well as the number of the operation steps whose actual operation is an automatic process and the number of the operation steps whose actual operation is a manually intervened process; calculating the proportion of the operation steps whose actual operation is an automatic process to the total number of the operation steps; and determining the proportion as the operation automation rate of the robot.

[0011] In combination with the fourth possible implementation of the first aspect, an embodiment of the present invention provides a sixth possible implementation of the first aspect, wherein the above method also includes: extracting job information of the robot operation from the job-related data, wherein the job information at least includes: basic job information, job conclusion data, job process analysis data, job deduction data, and job record data; generating a job scoring report including the quality and efficiency score and the job automation rate based on the job information.

[0012] In a second aspect, an embodiment of the present invention further provides an evaluation device for robot operations, the device comprising: an acquisition module, used to acquire operation-related data generated by the robot during the operation process, and extract characteristic data related to the robot performance from the operation-related data; wherein the characteristic data includes task data and energy data completed by the robot during the operation process; the task data includes data on the robot completing the task within a specified time, and data on errors occurring during the operation process; a first calculation module, used to calculate scoring indicators of the robot based on the characteristic data; the scoring indicators include task completion rate, error rate and energy consumption rate; the task completion rate is used to measure the proportion of the robot completing the predetermined operation tasks within the specified time; the error rate is used to measure the frequency of errors occurring during the operation of the robot; the energy consumption rate is used to measure the ratio of the energy consumed by the robot in completing the operation process to the energy required to complete a unit task; a second calculation module, used to calculate the quality and efficiency score of the robot operation based on the scoring indicators to evaluate the robot operation.

[0013] In a third aspect, an embodiment of the present invention further provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in the first aspect when executing the computer program.

[0014] In a fourth aspect, an embodiment of the present invention further provides a machine-readable storage medium, wherein the machine-readable storage medium stores machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions prompt the processor to implement the method described in the first aspect.

[0015] The embodiments of the present invention bring the following beneficial effects:

[0016] The robot operation evaluation method, device and electronic device provided in the embodiments of the present invention can obtain the operation-related data generated by the robot during the operation process, extract feature data related to the robot performance from the operation-related data; then calculate the robot's scoring index based on the feature data; and then calculate the quality and efficiency score of the robot's operation based on the scoring index to evaluate the robot's operation. During the evaluation process, since the feature data used is extracted from the robot's operation-related data, the characteristics such as the quality and efficiency of the robot's operation can be evaluated. At the same time, the evaluation process does not need to rely on manual observation and experience judgment, and therefore has a certain degree of objectivity and accuracy.

[0017] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention are realized and obtained by the structures particularly pointed out in the description, claims and drawings.

[0018] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0020] Figure 1 A flowchart of a method for evaluating a robot operation provided by an embodiment of the present invention;

[0021] Figure 2 A flowchart of another robot operation evaluation method provided by an embodiment of the present invention;

[0022] Figure 3 A schematic diagram of the structure of a robot operation evaluation device provided by an embodiment of the present invention;

[0023] Figure 4A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0025] At present, the evaluation of the operation of live-line operation robots (hereinafter referred to as robots) in distribution networks mainly relies on manual observation and empirical judgment, which lacks objectivity and accuracy, and lacks unified standards. This is because different evaluators may use different evaluation standards and indicators, resulting in inconsistent evaluation results. In addition, existing evaluation methods can often only provide qualitative evaluation results, but cannot quantitatively evaluate the quality and efficiency of robot operations. Moreover, existing evaluation methods are usually performed offline, and cannot achieve real-time monitoring and timely feedback of robot operations.

[0026] Based on this, an embodiment of the present invention provides a robot operation evaluation method, device and electronic equipment, which can effectively alleviate the above technical problems.

[0027] To facilitate understanding of this embodiment, a robot operation evaluation method disclosed in an embodiment of the present invention is first introduced in detail.

[0028] In a possible implementation, the present invention provides a method for evaluating a robot operation, such as Figure 1 A flowchart of a method for evaluating a robot operation is shown, the method comprising the following steps:

[0029] Step S102, acquiring operation-related data generated by the robot during the operation process, and extracting characteristic data related to the robot performance from the operation-related data;

[0030] Among them, the robot in the embodiment of the present invention refers to a distribution network live operation robot. Usually, in order to realize the automated operation of the robot, the robot is equipped with sensors such as depth cameras, lasers, radars, etc. to obtain external information, and these sensors can obtain external information in real time during the operation of the robot.

[0031] Therefore, in the above step S102, the process of obtaining the job-related data generated by the robot during the operation is actually a real-time data collection process, that is, the job-related data during the robot's operation can be collected in real time through the data generated by the sensors of the robot's body, the robot's job log files, etc., and the job-related data in the embodiment of the present invention generally includes job information, task completion time, task accuracy, energy consumption, as well as various indicators, system information, error information, etc. during the robot's operation, and then feature data related to the robot's performance are extracted from the above job-related data.

[0032] Furthermore, considering the influence of external environmental factors, the data collected by the robot during the operation process often includes some useless data. Therefore, in the process of data collection, the collected data can be further pre-processed, such as data cleaning, sorting and standardization, to remove outliers, fill in missing values, etc., so as to ensure the accuracy and consistency of the data.

[0033] The specific preprocessing process can be set according to actual usage conditions, and the embodiment of the present invention does not limit this.

[0034] Further, the characteristic data in the embodiment of the present invention includes the task data and energy data completed by the robot during the operation; the task data includes the data of the robot completing the task within the specified time, and the data of the robot making errors during the operation; and the process of extracting the characteristic data related to the robot performance in the above step S102 is actually the process of in-depth analysis of the operation-related data. Specifically, the operation-related data obtained after preprocessing can usually be analyzed in depth using statistics and machine learning algorithms to extract the characteristic data related to the robot performance. For example, the Pearson correlation coefficient, Spearman rank correlation coefficient and other methods can be used to analyze the correlation between the characteristic data, so as to screen out the characteristics that are highly related to the robot performance. In addition, the influence of different factors (such as different operation tasks, environmental conditions, etc.) on the robot performance can be tested by the analysis of variance (ANOVA) statistical method, and then the significant characteristics can be identified.

[0035] The specific algorithm used in the feature data extraction process can be set according to actual usage, and the embodiment of the present invention does not limit this.

[0036] Step S104, calculating the scoring index of the robot according to the feature data;

[0037] Step S106, calculating the quality and efficiency score of the robot's operation based on the scoring index to evaluate the robot's operation.

[0038] In actual use, the above-mentioned scoring indicators are defined according to the characteristics and quality requirements of the robot's operation. Therefore, the above-mentioned scoring indicators can also be called quality scoring indicators and efficiency scoring indicators. In addition, since the robot's operation process is actually a complex process, there are usually multiple scoring indicators in the above-mentioned step S104, such as task completion rate, error rate, energy consumption rate, etc. Among them, the task completion rate is used to measure the proportion of the robot completing the scheduled task within the specified time; the error rate is used to measure the frequency of errors made by the robot during the operation; the energy consumption rate is used to measure the ratio of the energy consumed by the robot in the process of completing the operation to the energy required to complete the unit task.

[0039] Then in step S106, these scoring indicators are further comprehensively processed to obtain a final quality and efficiency score to evaluate the robot's operation process.

[0040] For example, for the robot's operation process, the final quality and efficiency score is a score, and if the score is greater than the preset score threshold, it means that the robot's operation process meets the quality and efficiency requirements. Otherwise, it does not meet the quality and efficiency requirements, and the robot's operation process needs to be further improved.

[0041] Therefore, the robot operation evaluation method provided in the embodiment of the present invention can obtain the operation-related data generated by the robot during the operation process, and extract feature data related to the robot performance from the operation-related data; then calculate the scoring index of the robot based on the feature data; and then calculate the quality and efficiency score of the robot operation based on the scoring index to evaluate the robot's operation. During the evaluation process, since the feature data used is extracted from the robot's operation-related data, the characteristics such as the quality and efficiency of the robot's operation can be evaluated. At the same time, the evaluation process does not need to rely on manual observation and experience judgment, and therefore has a certain objectivity and accuracy.

[0042] In actual use, for the above-mentioned scoring indicators such as task completion rate, error rate and energy consumption rate, corresponding weights can usually be assigned to each scoring indicator according to actual job requirements and priorities. Therefore, when calculating the quality and efficiency score, weighted calculation is also required based on the weight of each scoring indicator.

[0043] For ease of understanding, in the above Figure 1 On the basis of Figure 2 A flowchart of another method for evaluating robot operations is also shown, which further explains the calculation process of scoring indicators and quality and efficiency scores.

[0044] like Figure 2 As shown, the following steps are included:

[0045] Step S202, obtaining operation-related data generated by the robot during the operation process, and extracting characteristic data related to the robot performance from the operation-related data;

[0046] Among them, the characteristic data includes the task data and energy data completed by the robot during the operation process; the task data includes the data of the robot completing the task within the specified time, as well as the data of errors occurring during the robot's operation process.

[0047] Step S204, calculating the robot's task completion rate based on the data of the robot completing tasks within a specified time;

[0048] Specifically, the task completion rate in the embodiment of the present invention is used to measure the proportion of the robot completing the predetermined task within the specified time;

[0049] Step S206, calculating the error rate of the robot according to the data of errors that occurred during the operation of the robot;

[0050] The error rate in the embodiment of the present invention is used to measure the frequency of errors that occur during the operation of the robot;

[0051] Step S208, calculating the energy consumption rate of the robot during operation according to the energy data;

[0052] The energy consumption rate in the embodiment of the present invention is used to measure the ratio of the energy consumed by the robot in the process of completing the operation to the energy required to complete the unit task.

[0053] In a specific implementation, the data of the tasks completed by the robot in the embodiment of the present invention within a specified time includes: the number of completed tasks, the total number of tasks in the operation process, and the total number of operations of the robot in the operation process;

[0054] Therefore, the calculation formula for the above task completion rate is as follows:

[0055] n = (N / N0) × 100%, where N represents the number of completed tasks and N0 represents the total number of tasks;

[0056] Furthermore, the data of errors that occur during the operation of the robot includes the number of errors that occur during the operation of the robot;

[0057] The above error rate is calculated as follows:

[0058] F = (F / F0) × 100%, where F represents the number of errors that occurred and F0 represents the total number of operations;

[0059] Furthermore, the energy consumption rate of the robot during operation includes the total energy consumption of the robot during operation;

[0060] The calculation formula for the above energy consumption rate is as follows:

[0061] w = (W / N) × 100%, where W represents the total energy consumption and N represents the number of completed tasks.

[0062] Step S210, calculating the quality and efficiency score of the robot's operation based on the scoring index to evaluate the robot's operation.

[0063] Specifically, when calculating the quality and efficiency score of the robot operation based on the scoring indicators, it is necessary to obtain the pre-configured weight parameters of each scoring indicator; then, each scoring indicator is weightedly calculated based on the weight parameters to obtain the quality and efficiency score of the robot operation.

[0064] In specific implementation, since the scoring indicators in the embodiment of the present invention include task completion rate, error rate and energy consumption rate, in step S210, it is necessary to obtain the weights of the task completion rate, error rate and energy consumption rate respectively, and then perform weighted calculation on the task completion rate, error rate and energy consumption rate to obtain the quality and efficiency score.

[0065] In actual use, the above weights are allocated according to the actual needs and priorities of each scoring indicator in the operation process to reflect its importance. At the same time, they can also be determined based on actual experience values. The specific weight allocation method can be set according to actual usage, and the embodiment of the present invention is not limited to this.

[0066] Furthermore, in the above process of weighted calculation of each scoring index based on the weight parameter to obtain the quality and efficiency score of the robot operation, a scoring model can be constructed with the help of statistical or machine learning methods, and training and optimization can be performed. For example, the scoring model can adopt a regression model, a decision tree model or a neural network model, etc., and for the established scoring model, the robot can also continuously optimize its operating steps, force control and recognition system parameters, etc. according to the scoring index or quality and efficiency score during the continuous operation process, that is, the scoring model can adopt an iterative optimization cycle, aiming to gradually improve the robot's operation score, and finally find the most suitable relevant parameters for the robot to perform the operation. At the same time, the scoring model can also be gradually improved according to the massive amount of operation-related data generated during the robot operation process. The specific scoring model can be set according to the actual usage situation, and the embodiment of the present invention does not limit this.

[0067] Furthermore, for the robot operation evaluation method in the embodiment of the present invention, the robot's degree of automation can be further evaluated. Specifically, the robot's automated operation data during the operation process can be extracted from the operation-related data; wherein the automated operation data includes each operation step, and the degree of automation corresponding to each operation step; then, the robot's operation automation rate is calculated based on the automated operation data, and the operation automation rate is graphically presented.

[0068] In specific implementation, for the robot, since it replaces manual operation, its normal operation process is theoretically 100% automated operation. However, the robot's operation process needs to collect and analyze information, and then control the movement of the robotic arm through its own control logic based on this information. Therefore, during the operation process, due to information limitations, the robotic arm often does not work as expected. Therefore, manual intervention is required for certain operation steps. For example, when wiring, manual intervention is required to identify leads, strip wires, or thread wires, etc., and if there is too much manual intervention, the robot's operation efficiency will be reduced. Therefore, when evaluating the quality and efficiency of the robot, in addition to quality and efficiency, it is often necessary to consider the degree of automation, that is, the operation automation rate in the embodiment of the present invention.

[0069] Generally, the operation automation rate can be calculated based on the degree of automation of each operation step, that is, whether the actual operation of each operation step is an automatic process or a manual intervention process. That is, the above-mentioned degree of automation in the embodiment of the present invention is actually used to characterize whether the actual operation of each operation step is an automatic process or a manual intervention process. When calculating the operation automation rate of the robot, the total number of operation steps, as well as the number of operation steps whose actual operation is an automatic process and the number of operation steps whose actual operation is a manual intervention process can be counted; then the proportion of operation steps whose actual operation is an automatic process to the total number of operation steps is calculated; and then the proportion is determined as the operation automation rate of the robot.

[0070] For example, for wiring operations, which include 12 operation steps, 5 of which are completed under manual intervention, and the rest are completed by automatic processes. At this time, the operation automation rate can be expressed as the proportion of the number of operation steps completed by the automatic process to the total operation steps. Usually, it is expressed as a percentage, which can be expressed as the operation automation rate in the embodiment of the present invention.

[0071] In specific implementation, the analysis process of the job automation rate and the quality and efficiency score obtained above can also be formed into a job scoring report for visual presentation. For example, the job automation rate, scoring indicators, and quality and efficiency score results are displayed to users through visual tools, and corresponding feedback and improvement suggestions are provided to help users optimize the execution quality and efficiency of robot jobs.

[0072] Specifically, the job information of the robot operation can be extracted from the job-related data, wherein the job information includes at least: basic job information, job conclusion data, job process analysis data, job deduction data, and job record data; and then a job scoring report including a quality and efficiency score and a job automation rate is generated based on the job information.

[0073] For example, taking the flow line connection operation as an example, the basic information of the operation may include the operation start time, operation end time, operation location, operation number, operation equipment, as well as line type, operation type, operation result (such as whether the operation is successful), as well as the above-mentioned evaluation indicators and quality and efficiency scores, etc.

[0074] Furthermore, the above operation conclusion data may include the actual operation time and theoretical operation time of the operation process, as well as the above operation automation rate, such as the expected operation automation rate is 100%, the actual operation automation rate is A%, which is (100-A)% lower than expected, etc. At the same time, for the operation automation rate, image display content can be generated, such as using a ring or bar chart to indicate the automation degree of a specific operation step, etc.

[0075] In addition, the operation process analysis data can include each step in the operation process and the operation process of each step, such as the degree of automation of each step, whether there is manual intervention, and the target duration, actual duration, whether it is timed out for each operation step, whether an error occurs, and the level of the error, etc., which can all be displayed to the user.

[0076] Furthermore, the operation deduction data can also be displayed. If, in which operation step, the robot has an error operation, the corresponding execution implementation of the operation step, the type of error operation, a simple error description, as well as the error classification, error level, etc. can be recorded. And for the general matters that need to be paid attention to during the operation, or some key records of the operation site, they can be extracted in the operation record data.

[0077] In this way, based on the above content, the job scoring report in the embodiment of the present invention can be generated and displayed to the user through a visual tool. Moreover, based on the above job scoring report, the robot's operation process can also be monitored. For example, the operation-related data generated by the robot during the operation process can be obtained in real time, and the scoring indicators and quality and efficiency scores can be updated in time, and displayed through a visual interface. At the same time, according to the set rules and thresholds, such as setting the number of tasks, the number of operations, the number of errors, etc. in the operation process, and monitoring the changes in the scoring indicators in real time, so as to send warnings and reminders when abnormal or beyond the expected range, and then provide corresponding feedback and improvement suggestions to help users optimize the execution quality and efficiency of robot operations.

[0078] Further, based on the above embodiment, the embodiment of the present invention also provides a robot operation evaluation device, such as Figure 3 A schematic diagram of a structure of a robot operation evaluation device is shown, the device comprising:

[0079] The acquisition module 30 is used to acquire the operation-related data generated by the robot during the operation process, and extract characteristic data related to the performance of the robot from the operation-related data; wherein the characteristic data includes the task data and energy data completed by the robot during the operation process; the task data includes the data of the robot completing the task within a specified time, and the data of the error occurred in the robot during the operation process;

[0080] The first calculation module 32 is used to calculate the scoring index of the robot according to the characteristic data; the scoring index includes task completion rate, error rate and energy consumption rate; the task completion rate is used to measure the proportion of the robot completing the predetermined task within the specified time; the error rate is used to measure the frequency of errors made by the robot during the operation; the energy consumption rate is used to measure the ratio of the energy consumed by the robot during the operation to the energy required to complete the unit task;

[0081] The second calculation module 34 is used to calculate the quality and efficiency score of the robot's operation based on the scoring index to evaluate the robot's operation.

[0082] The robot operation evaluation device provided in the embodiment of the present invention has the same technical features as the robot operation evaluation method provided in the above embodiment, so it can also solve the same technical problems and achieve the same technical effects.

[0083] Furthermore, an embodiment of the present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above method when executing the computer program.

[0084] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above method are executed.

[0085] Furthermore, an embodiment of the present invention also provides a schematic diagram of the structure of an electronic device, such as Figure 4 As shown, it is a schematic diagram of the structure of the electronic device, wherein the electronic device includes a processor 41 and a memory 40, the memory 40 stores computer executable instructions that can be executed by the processor 41, and the processor 41 executes the computer executable instructions to implement the above method.

[0086] exist Figure 4 In the illustrated embodiment, the electronic device further includes a bus 42 and a communication interface 43 , wherein the processor 41 , the communication interface 43 and the memory 40 are connected via the bus 42 .

[0087] Among them, the memory 40 may include a high-speed random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 43 (which can be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. can be used. The bus 42 can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The bus 42 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0088] The processor 41 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 41 or the instruction in the form of software. The above processor 41 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in the embodiment of the present invention can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor 41 reads the information in the memory and completes the above method in combination with its hardware.

[0089] The computer program product of the robot operation evaluation method, device and electronic device provided in the embodiments of the present invention includes a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the methods described in the previous method embodiments. The specific implementation can be found in the method embodiments, which will not be repeated here.

[0090] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0091] In addition, in the description of the embodiments of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, and it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0092] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program codes.

[0093] In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0094] Finally, it should be noted that the above embodiments are only specific implementations of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The protection scope of the present invention is not limited thereto. Although the present invention is described in detail with reference to the above embodiments, those skilled in the art should understand that any person skilled in the art can still modify the technical solutions recorded in the above embodiments within the technical scope disclosed by the present invention, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A method for evaluating robot operation, characterized in that: The method comprises: Acquire operation-related data generated by the robot during the operation process, and extract characteristic data related to the robot performance from the operation-related data; wherein the characteristic data includes task data and energy data completed by the robot during the operation process; the task data includes data on the robot completing the task within a specified time, and data on errors occurring during the operation process of the robot; Calculate the scoring index of the robot according to the characteristic data; the scoring index includes task completion rate, error rate and energy consumption rate; the task completion rate is used to measure the proportion of the robot completing the scheduled task within the specified time; the error rate is used to measure the frequency of errors made by the robot during the operation; the energy consumption rate is used to measure the proportion of energy consumed by the robot during the operation to the energy required to complete the unit task; The quality and efficiency score of the robot's operation is calculated based on the scoring index to evaluate the robot's operation.

2. The method according to claim 1, characterized in that The step of calculating the scoring index of the robot according to the feature data comprises: Calculating the task completion rate of the robot according to the data of the robot completing the task within the specified time; Calculating the error rate of the robot based on the data of errors that occur during the operation of the robot; and, The energy consumption rate of the robot during operation is calculated according to the energy data.

3. The method according to claim 2, characterized in that The data of tasks completed by the robot within the specified time includes: the number of completed tasks, the total number of tasks in the operation process, and the total number of operations of the robot in the operation process; The calculation formula of the task completion rate is as follows: n = (N / N0) × 100%, where N represents the number of completed tasks and N0 represents the total number of tasks; The data of errors occurring during the operation of the robot includes the number of errors occurring during the operation of the robot; The error rate is calculated as follows: F = (F / F0) × 100%, where F represents the number of errors that occurred and F0 represents the total number of operations; The energy consumption rate of the robot during operation includes the total energy consumption of the robot during operation; The energy consumption rate is calculated as follows: w = (W / N) × 100%, where W represents the total energy consumption and N represents the number of completed tasks.

4. The method according to claim 1, characterized in that: The step of calculating the quality and efficiency score of the robot operation based on the scoring index includes: Obtaining a pre-configured weight parameter for each of the scoring indicators; A weighted calculation is performed on each of the scoring indicators based on the weight parameters to obtain a quality and efficiency score for the robot operation.

5. The method according to claim 1, characterized in that The method further comprises: Extracting automated operation data of the robot during the operation according to the operation-related data; wherein the automated operation data includes each operation step and the automation degree corresponding to each operation step; The operation automation rate of the robot is calculated based on the automated operation data, and the operation automation rate is graphically presented.

6. The method according to claim 5, characterized in that The automation degree is used to characterize whether the actual operation of each of the operation steps is an automatic process or a manual intervention process; The step of calculating the operation automation rate of the robot based on the automation operation data comprises: Counting the total number of the operation steps, as well as the number of the operation steps that are actually operated in an automatic process and the number of the operation steps that are actually operated in a manual intervention process; Calculate the proportion of the operation steps of which the actual operation is an automatic process to the total number of the operation steps; The proportion is determined as the operation automation rate of the robot.

7. The method according to claim 5, characterized in that The method further comprises: Extracting operation information of the robot operation from the operation-related data, wherein the operation information at least includes: basic operation information, operation conclusion data, operation process analysis data, operation deduction data, and operation record data; A job scoring report including the quality and efficiency score and the job automation rate is generated according to the job information.

8. A robot operation evaluation device, characterized in that: The device comprises: An acquisition module, used to acquire operation-related data generated by the robot during operation, and extract characteristic data related to the robot performance from the operation-related data; wherein the characteristic data includes task data and energy data completed by the robot during operation; the task data includes data of the robot completing tasks within a specified time, and data of errors occurring during operation of the robot; A first calculation module is used to calculate the scoring index of the robot according to the characteristic data; the scoring index includes task completion rate, error rate and energy consumption rate; the task completion rate is used to measure the proportion of the robot completing the predetermined task within the specified time; the error rate is used to measure the frequency of errors made by the robot during the operation; the energy consumption rate is used to measure the ratio of the energy consumed by the robot during the operation to the energy required to complete the unit task; The second calculation module is used to calculate the quality and efficiency score of the robot's operation based on the scoring index to evaluate the robot's operation.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

10. A machine-readable storage medium, characterized in that: The machine-readable storage medium stores machine-executable instructions, and when the machine-executable instructions are called and executed by a processor, the machine-executable instructions prompt the processor to implement the method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • High-voltage electrified operation robot system and trajectory planning method

    CN108858252A

  • Actual effect evaluation method and system of inspection robot, storage medium and robot

    CN110705849A

  • Inspection robot performance quantitative evaluation method and system

    CN112277004A

  • Strip steel cold continuous rolling automation rate comprehensive evaluation method based on entropy weight-ideal solution

    CN116187830A

  • Distribution network hot-line work intelligent distribution management method and platform based on big data

    CN117010647A