Research and development quality evaluation method, device and equipment and readable storage medium

Abstract

The invention relates to a research and development quality evaluation method, device and equipment and a readable storage medium, and the method comprises the steps: obtaining key index data of key index items contained in a research and development task when a research and development quality evaluation instruction is received; obtaining a research and development quality evaluation model corresponding to the research and development task; and carrying out preset processing on the key index data by utilizing the research and development quality evaluation model so as to carry out research and development quality evaluation on the research and development task, and determining a research and development task quality evaluation result. The research and development quality evaluation method and device can be applied to the field of digital medical treatment to quantitatively evaluate the research and development quality, the research and development quality is measured on the whole, and meanwhile the research and development quality of all research and development teams can be measured on a unified standard line.

Description

Technical Field

[0001] The present application relates to the field of computer and digital medical technology, and in particular to a method, device, equipment and readable storage medium for evaluating R&D quality. Background Art

[0002] R&D quality assessment is a popular tool for Internet companies. It evaluates the behaviors that occur during the company's product R&D iteration process. However, in related technologies, there are multiple indicator data used to reflect R&D quality. However, since these indicator data are not normalized, it is impossible to quantitatively evaluate R&D quality, measure R&D quality as a whole, or measure the R&D quality of each R&D team on a unified standard line. Summary of the invention

[0003] In order to overcome the problems existing in the related technologies, the present application provides a method, device, equipment and readable storage medium for evaluating R&D quality, which can be applied to the field of digital medicine, can quantitatively evaluate the R&D quality and measure the R&D quality as a whole, and can also measure the R&D quality of each R&D team on a unified standard line.

[0004] The first aspect of the present application provides a method for evaluating R&D quality, comprising:

[0005] When receiving an R&D quality assessment instruction, obtain key indicator data of key indicator items included in the R&D task;

[0006] Acquire a research and development quality assessment model corresponding to the research and development task;

[0007] The key indicator data is preset and processed using the R&D quality assessment model to perform R&D quality assessment on the R&D task, and a quality assessment result of the R&D task is determined.

[0008] The key indicator data of the key indicator items included in the R&D task are obtained, including:

[0009] Obtaining log data corresponding to the R&D task through an online information collection system;

[0010] The log data is preprocessed based on the indicator data processing model to obtain the key indicator data.

[0011] The R&D quality assessment model is pre-constructed in the following manner, including:

[0012] Obtain key indicators related to the research and development tasks;

[0013] Perform basic configuration of the key indicator items according to preset rules;

[0014] According to the basic configuration of each key indicator item, the calculation logic of the key indicator item of each R&D team is determined to obtain the R&D quality evaluation model.

[0015] The acquisition of key indicators related to the research and development task includes:

[0016] Acquire log data of the research and development task, extract key indicator items in the log data, and obtain key indicator items related to the research and development task;

[0017] or;

[0018] Acquire historical data of historical R&D tasks, perform data analysis on the historical data, and extract key indicator items to obtain key indicator items related to the R&D tasks.

[0019] The basic configuration of the key indicator items according to the preset rules includes:

[0020] Display the quality assessment model configuration interface;

[0021] In response to the configuration operation of the quality assessment model configuration interface, basic configuration information of the key indicator items is obtained, and the basic configuration information includes: setting bonus items / subtraction items, key indicator item coefficients, teams corresponding to key indicator items, team size, and indicator value range levels.

[0022] The step of using the R&D quality assessment model to perform preset processing on the indicator data to perform R&D quality assessment on the R&D task and determining the R&D task quality assessment result includes:

[0023] The R&D quality assessment model is used to perform multi-dimensional assessment processing on the indicator data, and the R&D task quality assessment result is determined based on the multi-dimensional assessment processing.

[0024] Among them, the multiple dimensions include different R&D attributes, and the different R&D attributes correspond to different evaluation rules, wherein the different R&D attributes include the number of R&D personnel and / or R&D team attributes; the evaluation rules include one of the following or a combination thereof: a step-by-step evaluation calculation rule and a blacklist.

[0025] The method further comprises:

[0026] The quality assessment results of the R&D tasks are displayed according to a preset quality score statistical dashboard;

[0027] Results displayed include one or a combination of the following:

[0028] Total R&D quality score, team quality score, quality score trend chart and quality score details;

[0029] The quality score details include at least one of the following: indicator item score, indicator item overview and indicator item details.

[0030] A second aspect of the present application provides a device for evaluating R&D quality, comprising:

[0031] A first processing unit, configured to obtain key indicator data of key indicator items included in the R&D task when receiving the R&D quality assessment instruction;

[0032] A second processing unit, used to obtain a research and development quality assessment model corresponding to the research and development task;

[0033] The third processing unit is used to use the R&D quality assessment model to perform preset processing on the key indicator data to perform R&D quality assessment on the R&D task and determine the R&D task quality assessment result.

[0034] A third aspect of the present application provides an electronic device, including:

[0035] Processor; and

[0036] The memory stores executable codes thereon, and when the executable codes are executed by the processor, the processor is caused to execute the method as described above.

[0037] A fourth aspect of the present application provides a non-transitory machine-readable storage medium having executable code stored thereon. When the executable code is executed by a processor of an electronic device, the processor is caused to execute the method as described above.

[0038] The technical solution provided by this application may have the following beneficial effects:

[0039] The present application provides a method for evaluating R&D quality. When an R&D quality evaluation instruction is received, key indicator data of key indicator items included in the R&D task are obtained; a R&D quality evaluation model corresponding to the R&D task is obtained; the key indicator data is preset using the R&D quality evaluation model to evaluate the R&D quality of the R&D task, and the R&D task quality evaluation result is determined. The present application can be applied to the field of digital medicine, and can quantitatively evaluate the R&D quality and measure the R&D quality as a whole. At the same time, it can also measure the R&D quality of each R&D team on a unified standard line.

[0040] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The above and other objects, features and advantages of the present application will become more apparent through a more detailed description of exemplary embodiments of the present application in conjunction with the accompanying drawings, wherein the same reference numerals generally represent the same components in the exemplary embodiments of the present application.

[0042] Figure 1 It is a schematic diagram of an application scenario of the method for evaluating R&D quality shown in an embodiment of the present application;

[0043] Figure 2 It is a flowchart of a method for evaluating R&D quality shown in an embodiment of the present application;

[0044] Figure 3 It is a schematic diagram of the process structure of online problems and online failures shown in the embodiments of the present application;

[0045] Figure 4 is a schematic diagram of indicator item data processing shown in an embodiment of the present application;

[0046] Figure 5 It is an overall architecture design diagram of the R&D quality evaluation method shown in the embodiment of the present application;

[0047] Figure 6 It is a basic configuration diagram of the evaluation method of R&D quality shown in the embodiment of the present application;

[0048] Figure 7 It is a configuration diagram of the index item details shown in the embodiment of the present application and marking the ladder and blacklist to which the calculation formula of the current index item details belongs;

[0049] Figure 8 is a display schematic diagram of a quality score statistics dashboard shown in an embodiment of the present application;

[0050] Fig. 9 is a schematic diagram of the structure of the device for evaluating R&D quality shown in an embodiment of the present application;

[0051] Fig.10 It is a schematic diagram of the structure of an electronic device shown in an embodiment of the present application. DETAILED DESCRIPTION

[0052] The preferred embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although the preferred embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to make the present application more thorough and complete, and to fully convey the scope of the present application to those skilled in the art.

[0053] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0054] It should be understood that although the terms "first", "second", "third", etc. may be used in this application to describe various information, this information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0055] The applicant found through research that there are many online problem feedback channels in the R&D quality assessment scheme in the relevant technology, including various QQ, WeChat, Feishu and other instant messaging groups, community experience feedback, etc., and multi-channel problem follow-up reduces the efficiency of production and research, and it is impossible to quantitatively evaluate the quality of R&D. In addition, online faults are not collected, and there is a lack of unified standard processes and data records. Each online fault follow-up and verification will inevitably lead to a certain loss of human efficiency, resulting in a waste of time and manpower costs, and it is impossible to quantitatively evaluate the quality of R&D. In addition, some indicator data mostly appear in the form of free buried points, access logs, system logs, or monitoring logs, but these indicator data are not normalized, each data is relatively independent, the data types are many, and they are disorganized, and it is impossible to form effective and usable indicator data. Therefore, if these indicator data are used for evaluation, it will take a long time, and with the continuous iteration of each business line, the differentiation of each indicator data will become more and more large, resulting in higher and higher R&D investment costs, and changes in each business line will lead to changes in subsequent indicator data statistics, resulting in a certain loss of R&D human efficiency, and the cost will be higher and higher.

[0056] The evaluation method of R&D quality provided in this application can be applied in Figure 1In the application scenario, the client communicates with the server through the network. The client can be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, portable wearable devices and other devices with display screens and input devices. The server can be implemented with an independent server or a server cluster consisting of multiple servers. The server obtains various indicator data of the R&D task, determines the evaluation score of each indicator data in the R&D task according to the preset calculation logic, and determines the quality evaluation model; the quality evaluation model determines the R&D task quality evaluation result according to the evaluation score of each indicator data in the R&D task. The server can also visualize the determined R&D task quality evaluation result and display it through the client, so that the user can intuitively know the R&D quality distribution status of the R&D task and the R&D team.

[0057] During the R&D process, the evaluation of R&D quality can objectively reflect the quality of R&D tasks by setting and measuring various indicator data. Therefore, this application provides an R&D quality evaluation method that can be applied to the field of digital medicine, can quantitatively evaluate R&D quality, measure R&D quality as a whole, and can also measure the R&D quality of each R&D team on a unified standard line.

[0058] At the same time, a visual quality data indicator platform has been built to enable timely, convenient and intuitive discovery of R&D quality problems and trends.

[0059] The technical solution of the embodiments of the present application is described in detail below with reference to the accompanying drawings.

[0060] Figure 2 is a flow chart of the method for evaluating R&D quality shown in the embodiment of the present application. Figure 2 , the present application embodiment provides a method for evaluating R&D quality, according to Figure 2 As shown, the method includes steps S201 to S204:

[0061] Step S201, when a R&D quality assessment instruction is received, key indicator data of key indicator items included in the R&D task are obtained.

[0062] like Figure 1 As shown, the client sends a R&D quality assessment instruction to the server. After receiving the R&D assessment instruction, the server obtains the R&D task to be evaluated through a unified standard online process and a unified standard data processing model. The key indicator items included in the R&D task to be evaluated can be confirmed through analysis. After determining the key indicator items, the indicator data is captured according to a unified path.

[0063] In a specific embodiment, obtaining key indicator data of key indicator items included in the R&D task includes: obtaining log data corresponding to the R&D task through an online information collection system; preprocessing the log data based on an indicator data processing model to obtain the key indicator data.

[0064] It should be noted that the indicator data pool, which is the most basic data module, needs to be set up in advance. Its main task is to collect standardized indicator data more conveniently for subsequent quality assessment.

[0065] First, you need to plan the collection rules of indicator data:

[0066] For the feedback that has not been collected offline, and the feedback channels are too many, messy, and inconsistent, we need to conduct a unified online sorting, establish a unified standard online process, complete the normalization of data indicators, and plan the process. For example, online problems and online failures, such as Figure 3 shown.

[0067] For other indicator data, most of them appear in various business lines and technical directions in the form of free embedding points, access logs, system logs, monitoring logs, etc. Each data is relatively independent, with many types and disorganized. They need to be uniformly classified and analyzed. The embodiment of the present application establishes a unified standard data processing model, such as back-end interface indicator data: first plan and improve and unify the back-end interface access log record format and path, and then parse the log format according to the unified standard to obtain the required data, so as to quickly process and filter out effective and available indicator data and complete data normalization. For example, Crash rate (IOS) / Crash rate (Android) / Back-end interface time consumption / Back-end interface stability / app page performance (IOS) / app page performance (Android) / Client user experience performance (IOS) / Client user experience performance (Android) / Front-end page performance / Front-end user experience performance, such as Figure 4 shown.

[0068] Secondly, it is necessary to improve the collection methods of indicator data:

[0069] For the newly established unified standard online process, data is collected synchronously in the process, and data is processed asynchronously again after the data changes. For example, online problem feedback: when an online problem is confirmed to be closed, it will be collected and aggregated to the data pool synchronously according to the closing time / problem belonging team / problem level at that time. When the problem is reopened and closed, and the belonging team / problem category changes, the data pool data will be processed asynchronously for the second time.

[0070] It should be noted that in view of the fact that there are many types of existing data and they are disorganized, unified classification and analysis are needed, and a unified standard data processing model is established. The data are classified and summarized according to data indicator items, and the log path and format are gradually unified. Then, the same type of indicator data is captured according to the unified path and parsed according to the unified format.

[0071] It also implements a faster mode for collecting data for newly added indicator items. As long as the collection path is set up, such as the remote indicator data capture path interface, and the corresponding attribute fields that need to be captured are configured, the capture and aggregation of indicator item data can be completed, which greatly reduces the time and cycle for completing the collection of data for each indicator item.

[0072] Furthermore, while establishing the data pool, the process is standardized, online, and unified, and the data is visualized. A detailed overview and statistical dashboard of each indicator data is established to enable timely, convenient, and intuitive discovery of quality problems and quality trends.

[0073] Step S202, obtaining a research and development quality assessment model corresponding to the research and development task.

[0074] Quality score calculation is the core of the R&D quality assessment solution. In the embodiment of this application, the overall architecture design is as follows: Figure 5-6 As shown, through the basic configuration of the existing data in the indicator item data pool, such as team member configuration, quality item setting, and quality item detail setting, the calculation logic of each indicator item is set, so as to obtain the calculation logic of the indicator item belonging to the team, and obtain the team quality score and the total quality score.

[0075] It should be noted that the R&D quality assessment model is pre-constructed in the following manner, including: obtaining key indicator items related to the R&D tasks; performing basic configuration of the key indicator items according to preset rules; determining the calculation logic of the key indicator items of each R&D team based on the basic configuration of each key indicator item, and obtaining the R&D quality assessment model.

[0076] In a specific embodiment, the acquisition of key indicator items related to the R&D task includes: acquiring log data of the R&D task, extracting key indicator items from the log data, and obtaining key indicator items related to the R&D task; or; acquiring historical data of historical R&D tasks, performing data analysis on the historical data, and extracting key indicator items to obtain key indicator items related to the R&D task, specifically including: determining the task type to which the R&D task belongs, thereby obtaining historical data corresponding to the task type based on the task type, for example, if the R&D task is the front-end development of a product, then based on the task type of the front-end development, obtaining historical data of the front-end development. It should be noted that the key indicator items can be determined by acquiring the log data of the R&D task in real time, or can be determined based on the historical data of the historical R&D task.

[0077] Furthermore, the basic configuration of the key indicator items according to preset rules includes: displaying a quality assessment model configuration interface; in response to the configuration operation of the quality assessment model configuration interface, obtaining basic configuration information of the key indicator items, and the basic configuration information includes: setting plus / minus points, key indicator item score formulas, teams corresponding to the key indicator items, team size, and indicator value range levels.

[0078] Furthermore, the R&D quality assessment model is used to perform preset processing on the indicator data to conduct R&D quality assessment on the R&D task and determine the quality assessment result of the R&D task, including: using the R&D quality assessment model to perform multi-dimensional assessment processing on the indicator data, and determining the quality assessment result of the R&D task based on the multi-dimensional assessment processing.

[0079] Furthermore, the multiple dimensions include different R&D attributes, and the different R&D attributes correspond to different evaluation rules, wherein the different R&D attributes include the number of R&D personnel and / or R&D team attributes; the evaluation rules include one or a combination of the following: a step-by-step evaluation calculation rule, a blacklist.

[0080] In the embodiments of the present application, the key indicator items mainly include but are not limited to one or more of the following key indicator items: online failure: according to the failure level, (season / month) according to the preset time length for scoring; online bug: according to the bug level, according to the preset time length for scoring; Crash rate (IOS): according to the IOS opening crash rate, according to the preset time length for scoring; Crash rate (Android): according to the Android opening crash rate, according to the preset time length for scoring; back-end interface time consumption: according to the interface access time consumption divided into steps, according to the preset time length for scoring; back-end interface stability: according to the interface access success rate, according to the preset time length for scoring; app page performance (IOS): according to the IOS page initial rendering time divided into steps, according to the preset time length Scoring; app page performance (Android): divided into steps according to the initial rendering time of the Android page, and scored according to the preset duration; client user experience performance (IOS): divided into steps according to the IOS page loading time, and scored according to the preset duration; client user experience performance (Android): divided into steps according to the Android page loading time, and scored according to the preset duration; front-end page performance: divided into steps according to the initial rendering time of the front-end page, and scored according to the preset duration; front-end user experience performance: divided into steps according to the front-end page loading time, and scored according to the preset duration. It should be noted that scoring can be performed every day or according to the user-set duration. Here, the preset duration is not specifically limited.

[0081] It should be noted that the basic settings can be divided into: setting bonus / subtraction items, setting the score formula of the indicator item, setting the number of team members and marking the number of team members, setting the indicator item split team and marking which teams are responsible for the current indicator item, setting the indicator item details and marking the ladder and blacklist to which the current indicator item detail calculation formula belongs, and the total quality score calculation logic. Among them:

[0082] Set bonus / subtraction items: used to mark whether the current indicator item is a bonus item or a subtraction item, and to express the basic algorithm of quality score: bonus item 1+ bonus item 2+...-subtraction item 1-subtraction item 2-...;

[0083] Set the key indicator score formula: used to mark the score obtained from the indicator data of the current indicator item, and to calculate the indicator item's score for the day. For example: Online bugs: Calculate daily scores based on bug levels. Bug levels are divided into P0~P3, where P0 bugs are 20 points each, P1 bugs are 10 points each, P2 bugs are 5 points each, and P3 bugs are 3 points each. The score for the day is: 100-(P0*20+P1*10+P2*5+P3*3); For example: Page user experience performance: Get daily scores based on the page loading time t matching range, including step 1 and step 2. Step 1 (t≦200ms corresponds to 100 points, 200~300ms corresponds to 90 points, 300~450ms corresponds to 80 points, 450~600ms corresponds to 70 points, 600~800ms corresponds to 60 points, t>800ms corresponds to 50 points), step 2 (t≦500ms corresponds to 100 points, 500~600ms corresponds to 90 points, 600~750ms corresponds to 90 points), For example, page performance: get daily scores by matching the initial rendering time t', t'≦500ms corresponds to 100 points, 500-600ms corresponds to 90 points, 600-750ms corresponds to 80 points, 750-900ms corresponds to 70 points, 900-1100ms corresponds to 50 points). 100ms corresponds to 60 points, t'>1100ms corresponds to 50 points; according to the loading time t” matching range, the daily score is obtained, t”≦1000ms corresponds to 100 points, 1000~1500ms corresponds to 90 points, 1500~1750ms corresponds to 80 points, 1750~1900ms corresponds to 70 points, 1900~2300ms corresponds to 60 points, t'>2300ms corresponds to 50 points;

[0084] Set the index item coefficient: used to mark the weight coefficient of the current index item in the overall quality score, used to calculate the overall quality score: bonus item 1*coefficient+bonus item 2*coefficient+...-minus item 1*coefficient-minus item 2*coefficient-...;

[0085] Set the number of team members and mark the number of team members: used to calculate the weight coefficient of the current indicator item team ratio, indicator item coefficient = indicator item team number / indicator item all team number;

[0086] Set the indicator item to split the team and mark which teams are responsible for the current indicator item. Use the indicator carried by the team to calculate the team quality score. Team quality score = A indicator item score * A indicator item coefficient + B indicator item * B indicator item coefficient + ...;

[0087] Set the indicator item details and mark the ladder and blacklist to which the current indicator item calculation formula belongs, such as Figure 7 As shown, it is used to filter out abnormal detailed data and not participate in the calculation. It can also match different characteristics of technical indicator details with different calculation ladder formulas, so as to obtain a more accurate single indicator item quality score calculation: (Indicator item detail 1 score + indicator item detail 2 score + ...) / indicator item detail number. If the indicator item is added to the blacklist, the indicator item added to the blacklist will not be used as a key indicator item in the calculation of the indicator item quality score.

[0088] Finally, configure the total quality score calculation logic: total quality score of a single project (without splitting the team) = quality score of a single quality item; total quality score calculation of a single indicator item A (split team) = 1 team A indicator item score * 1 team weight coefficient + 2 team A indicator item scores * 2 team weight coefficients +...; total quality score calculation = total quality score of indicator item A * A indicator item coefficient + total quality score of indicator item B * B indicator item coefficient +...

[0089] Step S203, using the R&D quality assessment model to perform preset processing on the indicator data to perform R&D quality assessment on the R&D task, and determine the R&D task quality assessment result.

[0090] In step S202, the configuration of indicator items and the total quality score calculation logic are performed, that is, a R&D quality assessment model is constructed. The system can determine key indicator items based on the R&D tasks. The R&D quality is evaluated by the R&D quality assessment model through the indicator data corresponding to each key indicator item to determine the R&D task quality assessment result.

[0091] Step S204: displaying the R&D task quality assessment result according to a preset quality score statistical dashboard.

[0092] Among them, the displayed results include one of the following or a combination of them: total R&D quality score, team quality score, quality score trend chart and quality score details, among which the quality score details include at least one of the following: indicator item score, indicator item overview and indicator item details.

[0093] In order to visualize the R&D quality assessment platform, a quality score statistical dashboard is also set up on the client to display the R&D task quality assessment results. The quality score statistical dashboard is the external module of the quality assessment solution. The process and result data involved include: R&D total quality score, team quality score, quality score trend diagram and quality score details. The quality score details include indicator item scores, indicator item overview and indicator item details, such as Figure 8 As shown, the embodiment of the present application builds a unified / visualized R&D quality assessment platform by setting up a quality score statistical dashboard, so that the R&D quality assessment can be traced. It further simplifies the access to subsequent indicators, makes the indicator calculation method automated, personalized, and precise, and improves the efficiency of R&D quality score assessment.

[0094] The embodiment of the present application provides a method for evaluating R&D quality. When receiving an R&D quality evaluation instruction, the key indicator data of the key indicator items included in the R&D task is obtained; the R&D quality evaluation model corresponding to the R&D task is obtained; the key indicator data is preset using the R&D quality evaluation model to evaluate the R&D quality of the R&D task, and the R&D task quality evaluation result is determined. The embodiment of the present application can be applied to the field of digital medicine, and can quantitatively evaluate the R&D quality and measure the R&D quality as a whole. At the same time, it can also measure the R&D quality of each R&D team on a unified standard line.

[0095] Corresponding to the aforementioned application function implementation method embodiment, the present application also provides a research and development quality evaluation device, electronic device and corresponding embodiments.

[0096] Fig. 9 Schematic diagram of the structure of the device for evaluating R&D quality shown in the embodiment of the present application. Fig. 9 , the embodiment of the present application provides a device for evaluating R&D quality, the device comprising:

[0097] The first processing unit 901 is used to obtain key indicator data of key indicator items included in the R&D task when receiving the R&D quality assessment instruction;

[0098] The second processing unit 902 is used to obtain a research and development quality assessment model corresponding to the research and development task;

[0099] The third processing unit 903 is used to use the R&D quality assessment model to perform preset processing on the key indicator data to perform R&D quality assessment on the R&D task and determine the R&D task quality assessment result;

[0100] The fourth processing unit 904 is used to display the R&D task quality evaluation result according to a preset quality score statistical dashboard.

[0101] In a specific embodiment, the step of obtaining key indicator data of key indicator items included in the R&D task includes:

[0102] Obtaining log data corresponding to the R&D task through an online information collection system;

[0103] The log data is preprocessed based on the indicator data processing model to obtain the key indicator data.

[0104] In a specific embodiment, the R&D quality assessment model is pre-constructed in the following manner, including:

[0105] Obtain key indicators related to the research and development tasks;

[0106] Perform basic configuration of the key indicator items according to preset rules;

[0107] According to the basic configuration of each key indicator item, the calculation logic of the key indicator item of each R&D team is determined to obtain the R&D quality evaluation model.

[0108] In a specific embodiment, the obtaining of key indicators related to the research and development task includes:

[0109] Acquire log data of the research and development task, extract key indicator items in the log data, and obtain key indicator items related to the research and development task;

[0110] or;

[0111] Acquire historical data of historical R&D tasks, perform data analysis on the historical data, and extract key indicator items to obtain key indicator items related to the R&D tasks.

[0112] In a specific embodiment, the key indicator items are configured according to preset rules.

[0113] include:

[0114] Display the quality assessment model configuration interface;

[0115] In response to the configuration operation of the quality assessment model configuration interface, basic configuration information of the key indicator items is obtained, and the basic configuration information includes: setting bonus items / subtraction items, key indicator item score formulas, teams corresponding to key indicator items, team size, and indicator value range levels.

[0116] In a specific embodiment, the using the R&D quality assessment model to perform preset processing on the indicator data to perform R&D quality assessment on the R&D task, and determining the R&D task quality assessment result, includes:

[0117] The R&D quality assessment model is used to perform multi-dimensional assessment processing on the indicator data, and the R&D task quality assessment result is determined based on the multi-dimensional assessment processing.

[0118] In a specific embodiment, the multiple dimensions include different R&D attributes, and the different R&D attributes correspond to different evaluation rules, wherein the different R&D attributes include the number of R&D personnel and / or R&D team attributes; the evaluation rules include one or a combination of the following: a step-by-step evaluation calculation rule and a blacklist.

[0119] In a specific embodiment, the displayed results include one or a combination of the following:

[0120] Total R&D quality score, team quality score, quality score trend chart and quality score details;

[0121] The quality score details include at least one of the following: indicator item score, indicator item overview and indicator item details.

[0122] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated again here.

[0123] Fig.10 It is a schematic diagram of the structure of an electronic device shown in an embodiment of the present application.

[0124] See also Fig.10 , the electronic device 1000 includes a memory 1010 and a processor 1020 .

[0125] The processor 1020 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0126] The memory 1010 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage devices. Among them, ROM can store static data or instructions required by the processor 1020 or other modules of the computer. The permanent storage device may be a readable and writable storage device. The permanent storage device may be a non-volatile storage device that does not lose the stored instructions and data even after the computer is powered off. In some embodiments, the permanent storage device uses a large-capacity storage device (such as a magnetic or optical disk, flash memory) as a permanent storage device. In some other embodiments, the permanent storage device may be a removable storage device (such as a floppy disk, optical drive). The system memory may be a readable and writable storage device or a volatile readable and writable storage device, such as a dynamic random access memory. The system memory may store some or all instructions and data required by the processor at run time. In addition, the memory 1010 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and disks and / or optical disks may also be used. In some embodiments, the memory 1010 may include a readable and / or writable removable storage device, such as a laser disc (CD), a read-only digital versatile disc (such as a DVD-ROM, a double-layer DVD-ROM), a read-only Blu-ray disc, an ultra-density optical disc, a flash memory card (such as an SD card, a mini SD card, a Micro-SD card, etc.), a magnetic floppy disk, etc. The computer-readable storage medium does not include carrier waves and transient electronic signals transmitted wirelessly or wired.

[0127] The memory 1010 stores executable codes, and when the executable codes are processed by the processor 1020 , the processor 1020 can execute part or all of the methods described above.

[0128] The scheme of the present application has been described in detail above with reference to the accompanying drawings. In the above embodiments, the description of each embodiment has its own emphasis. For the part that is not described in detail in a certain embodiment, refer to the relevant description of other embodiments. Those skilled in the art should also know that the actions and modules involved in the description are not necessarily required for the present application. In addition, it can be understood that the steps in the method of the embodiment of the present application can be adjusted in order, merged and deleted according to actual needs, and the modules in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0129] In addition, the method according to the present application may also be implemented as a computer program or a computer program product, which includes computer program code instructions for executing some or all of the steps in the above method of the present application.

[0130] Alternatively, the present application can also be implemented as a non-temporary machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) on which executable code (or computer program, or computer instruction code) is stored. When the executable code (or computer program, or computer instruction code) is executed by a processor of an electronic device (or electronic device, server, etc.), the processor executes part or all of the steps of the above-mentioned method according to the present application.

[0131] Those skilled in the art will further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the application herein may be implemented as electronic hardware, computer software, or combinations of both.

[0132] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system and method according to multiple embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a part of a module, a program segment or a code, and the part of the module, the program segment or the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or the flow chart, and the combination of the square boxes in the block diagram and / or the flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0133] The embodiments of the present application have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A method for evaluating R&D quality, characterized in that: include: When receiving an R&D quality assessment instruction, obtain key indicator data of key indicator items included in the R&D task; Acquire a research and development quality assessment model corresponding to the research and development task; The key indicator data is preset and processed using the R&D quality assessment model to perform R&D quality assessment on the R&D task, and a quality assessment result of the R&D task is determined.

2. The method for evaluating R&D quality according to claim 1, characterized in that: The key indicator data of the key indicator items included in the R&D task are obtained, including: Obtaining log data corresponding to the R&D task through an online information collection system; The log data is preprocessed based on the indicator data processing model to obtain the key indicator data.

3. The method for evaluating R&D quality according to claim 1, characterized in that: The R&D quality assessment model is pre-built in the following manner, including: Obtain key indicators related to the research and development tasks; Perform basic configuration of the key indicator items according to preset rules; According to the basic configuration of each key indicator item, the calculation logic of the key indicator item of each R&D team is determined to obtain the R&D quality evaluation model.

4. The method for evaluating R&D quality according to claim 3, characterized in that: The obtaining of key indicators related to the research and development task includes: Acquire log data of the research and development task, extract key indicator items in the log data, and obtain key indicator items related to the research and development task; or; Acquire historical data of historical R&D tasks, perform data analysis on the historical data, and extract key indicator items to obtain key indicator items related to the R&D tasks.

5. The method for evaluating R&D quality according to claim 3, characterized in that: The basic configuration of the key indicator items according to the preset rules includes: Display the quality assessment model configuration interface; In response to the configuration operation of the quality assessment model configuration interface, basic configuration information of the key indicator items is obtained, and the basic configuration information includes: setting bonus items / subtraction items, key indicator item score formulas, teams corresponding to key indicator items, team size, and indicator value range levels.

6. The method for evaluating R&D quality according to claim 1, characterized in that: The using the R&D quality assessment model to perform preset processing on the indicator data to perform R&D quality assessment on the R&D task, and determining the R&D task quality assessment result, includes: The R&D quality assessment model is used to perform multi-dimensional assessment processing on the indicator data, and the R&D task quality assessment result is determined based on the multi-dimensional assessment processing.

7. The method for evaluating R&D quality according to claim 6, characterized in that: The multiple dimensions include different R&D attributes, and the different R&D attributes correspond to different evaluation rules, wherein the different R&D attributes include the number of R&D personnel and / or R&D team attributes; the evaluation rules include one or a combination of the following: a step-by-step evaluation calculation rule and a blacklist.

8. The method for evaluating R&D quality according to claim 1, characterized in that: Also includes: The quality assessment results of the R&D tasks are displayed according to a preset quality score statistical dashboard; Results displayed include one or a combination of the following: Total R&D quality score, team quality score, quality score trend chart and quality score details; The quality score details include at least one of the following: indicator item score, indicator item overview and indicator item details.

9. A device for evaluating R&D quality, characterized in that: include: A first processing unit, configured to obtain key indicator data of key indicator items included in the R&D task when receiving the R&D quality assessment instruction; A second processing unit, used to obtain a research and development quality assessment model corresponding to the research and development task; The third processing unit is used to use the R&D quality assessment model to perform preset processing on the key indicator data to perform R&D quality assessment on the R&D task and determine the R&D task quality assessment result.

10. An electronic device, characterized in that: include: processor; as well as A memory having executable codes stored thereon, which, when executed by the processor, causes the processor to execute the method according to any one of claims 1 to 8.

11. A non-transitory machine-readable storage medium, characterized in that: An executable code is stored thereon, and when the executable code is executed by a processor of an electronic device, the processor is caused to execute the method as claimed in any one of claims 1 to 8.

Images