A method, device and storage medium for automatically allocating topic production tasks
By adding the question difficulty information and production efficiency table to the question production task allocation, the intelligent allocation of the question production task is achieved, the problem of insufficient resource utilization in the existing technology is solved, and the production efficiency and optimal allocation of resources are improved.
Patent Information
- Application Number
- CN202110753776.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-07-02
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2041-07-02
AI Technical Summary
The existing problem production task allocation method is simple and has strong randomness, which leads to the inability to effectively utilize resources, the problem production efficiency is not high, and high-quality resources are wasted.
By adding the question difficulty information to the question table and intelligently allocate the production efficiency table of the people to be assigned, the question with high production efficiency is set to set limit allocation ratios to balance resource allocation, and regularly update production. Efficiency and optimization allocation.
It improves the production efficiency of the topic and the utilization rate of resources, ensures the optimal allocation of resources, avoids the waste of high-quality resources, and improves production efficiency.
Smart Images

Figure CN113450006B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of online education technology, and in particular to a method, device and storage medium for automatically allocating question production tasks. Background Art
[0002] Online education can share high-quality educational resources through the Internet platform, which greatly facilitates users and reduces the cost of education. Photo search - a commonly used online education method, users can upload test questions by taking photos through smart devices (such as mobile phones). The cloud server will analyze and extract the uploaded test questions, and retrieve the test database to obtain relevant test search results, and return them to the user, which can greatly facilitate users to understand and master difficult test questions.
[0003] The matching degree of search results of the photo search is often limited by the question database. The questions in the existing question database are all produced through the production process and approved to meet the prescribed format. In the existing question production process, the questions in each question resource in the question resource library are stored in the question table, which contains question attribute information, such as subject, grade, source, year, province, etc.; then the questions in the question table are allocated to the production personnel for question production.
[0004] The existing question allocation method generally screens the conditions based on the basic information of the production personnel (such as subject, grade, etc.), and then allocates the selected qualified questions according to simple rules. The question allocation process is highly random and not targeted and intelligent. However, the difficulty information of the questions and the question production efficiency of the production personnel are key factors affecting question production. If the above two factors are not considered when allocating questions, it may happen that difficult questions are continuously allocated to production personnel with low question production efficiency, resulting in lower question production efficiency, while continuously allocating easy questions to production personnel with high question production efficiency also causes a waste of high-quality resources to some extent.
[0005] In view of this, the present invention is proposed. Summary of the invention
[0006] In order to solve the problem that the existing method of allocating task of question production is simple and highly random, resulting in that the allocated resources cannot be effectively utilized and the question production efficiency cannot be effectively improved, the present invention provides an intelligent allocation scheme with high utilization rate of allocated resources and highly targeted allocation of question production tasks, which greatly improves the efficiency of question production, as follows:
[0007] The present invention proposes a method for automatically allocating topic production tasks, comprising:
[0008] Processing the question resources in the question resource library to obtain a question table, wherein the question table includes question difficulty information;
[0009] The questions in the question table are assigned production tasks according to the personnel efficiency table of the personnel to be assigned and the question difficulty information. The personnel efficiency table contains the question production efficiency of the personnel to be assigned, and the question production efficiency is calculated by comprehensively considering the question production rate and question production quality within a certain period of time.
[0010] As an optional implementation mode of the present invention, the production task allocation of the topics in the topic table according to the personnel efficiency table of the personnel to be allocated and the topic difficulty information includes:
[0011] The topic table contains topic attribute information, and the corresponding personnel to be assigned are matched according to the topic attribute information;
[0012] Automatically allocate question production tasks based on question difficulty information in the question table and question production efficiency information in the matched personnel efficiency table of the personnel to be assigned;
[0013] Optionally, the personnel efficiency table includes the subject and / or grade of the personnel producing the questions, and the question attribute information includes the subject, and / or grade, and / or year, and / or city, and / or source, and the corresponding personnel to be assigned are matched in the personnel efficiency table according to the subject and / or grade information in the question table.
[0014] As an optional implementation mode of the present invention, the automatic allocation of question production by integrating the question difficulty information in the question table and the question production efficiency information in the matched personnel efficiency table of the personnel to be assigned includes:
[0015] The difficult questions in the question table are tended to be assigned to the personnel with high question production efficiency in the personnel efficiency table;
[0016] Optionally, a quota ratio of difficult questions that can be assigned to each person is set. When performing the tendency allocation, it is necessary to determine whether the number of difficult questions currently assigned to the person to be assigned meets the quota ratio. If the determination result is yes, the tendency allocation of difficult questions is stopped. If the determination result is no, the tendency allocation of difficult questions is performed.
[0017] Optionally, the topic table further includes priority information of the topics, and the topics with high priority in the topic table are preferentially allocated to the personnel to be allocated with high topic production efficiency in the personnel efficiency table.
[0018] As an optional implementation mode of the present invention, the question production efficiency of each person in the personnel efficiency table is regularly updated, including:
[0019] Statistics on the topic production time of each personnel in the topic production task within the set time period and the topic production pass rate of the topics produced that have been reviewed and approved;
[0020] Summarize and calculate the question production time and question production pass rate of each person to obtain the question production efficiency, and synchronously update the personnel efficiency table;
[0021] Optionally, the topic production time includes the time from the production of a single topic to its submission for review, and the time for re-production and modification of the topic after the topic is rejected for review;
[0022] The question production pass rate includes a single question that passes the review once and is not modified, which is recorded as 1; a single question that passes the review and modification after completion or passes after multiple reviews, which is recorded as 0.
[0023] As an optional implementation manner of the present invention, the step of aggregating and calculating the question production time and question production pass rate of each person to obtain the question production efficiency includes:
[0024] Summarize the question production time of a single person who completes each question production task within a set time period, and perform normalization to obtain the question production rate x;
[0025] Summarize the question production pass rate of each question production task completed by a single person within a set time period, and perform normalization to obtain the question production quality y;
[0026] The question production efficiency of the personnel is n=x*k1+y*k2, where k1 and k2 are the set weight ratios;
[0027] Optionally, k1=k2=50%.
[0028] As an optional implementation manner of the present invention, the question difficulty information in the question table includes a question difficulty value, and the method for obtaining the question difficulty value includes:
[0029] Extract keywords / words from the topics in the topic table and perform topic search in the current topic search database;
[0030] Sort the retrieved related topics by relevance;
[0031] Get the difficulty values of the top-N related questions whose relevance is greater than the set value;
[0032] Calculate the weighted average difficulty of the top-N related questions to get the question difficulty value.
[0033] As an optional implementation manner of the present invention, the processing of the topic resources in the topic resource library to obtain the topic table includes:
[0034] Split the question resources in the question resource library to obtain multiple questions;
[0035] Perform duplicate search on each topic in the current topic search database to filter out non-duplicate topics;
[0036] The non-repeated questions are saved in a set format as a question table containing question attribute information, question priority information and question difficulty information.
[0037] As an optional implementation mode of the present invention, the production allocation of the topics in the topic table is performed according to the personnel efficiency table of the personnel to be assigned to obtain a task table, and the task allocation of topic production is performed according to the task table;
[0038] When the topic production task in the task table is not completed within the set period, the topic will be recycled to the topic table for re-assignment of topic production tasks;
[0039] Optionally, the task table includes task processing status information, and the topic table includes topic allocation status information indicating whether a topic has been allocated.
[0040] The present invention also provides a device for automatically allocating topic production tasks, comprising:
[0041] A question table generating module processes the question resources in the question resource library to obtain a question table, wherein the question table includes question difficulty information;
[0042] The question allocation module allocates production tasks to the questions in the question table according to the personnel efficiency table of the personnel to be assigned and the question difficulty information. The personnel efficiency table contains the question production efficiency of the personnel to be assigned, and the question production efficiency is calculated by comprehensively calculating the question production rate and question production quality within a certain period of time.
[0043] The present invention also provides a storage medium storing a computer executable program, and when the computer executable program is executed, the method of automatically allocating topic production tasks is implemented.
[0044] Compared with the prior art, the present invention has the following beneficial effects:
[0045] The method for automatically allocating question production tasks of the present invention adds question difficulty information to the generated question table, introduces a personnel efficiency table when allocating question production tasks, and implements more targeted intelligent allocation of question production tasks based on the question production efficiency of the personnel to be assigned in the personnel efficiency table and the question difficulty information, thereby achieving optimal allocation of resources and improving the efficiency of question production. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] Figure 1The overall processing flow chart of the method for automatically allocating topic production tasks of the present invention;
[0047] Figure 2 Flow chart of the method for automatically allocating topic production tasks of the present invention Figure 1 ;
[0048] Figure 3 Flow chart of the method for automatically allocating topic production tasks of the present invention Figure 2 ;
[0049] Figure 4 Flow chart of the method for automatically allocating topic production tasks of the present invention Figure 3 ;
[0050] Figure 5 Flow chart of the method for automatically allocating topic production tasks of the present invention Figure 4 ;
[0051] Figure 6 Flow chart of the method for automatically allocating topic production tasks of the present invention Figure 5 ;
[0052] Figure 7 Flow chart of the method for automatically allocating topic production tasks of the present invention Figure 6 ;
[0053] Figure 8 Flow chart of the method for automatically allocating topic production tasks of the present invention Figure 7 . DETAILED DESCRIPTION
[0054] To make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them.
[0055] Therefore, the following detailed description of the embodiments of the present invention is not intended to limit the scope of the invention claimed for protection, but merely represents some embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0056] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features and technical solutions in the embodiments may be combined with each other.
[0057] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.
[0058] In the description of the present invention, it should be noted that the orientation or positional relationship indicated by the terms "upper", "lower", etc. is based on the orientation or positional relationship shown in the drawings, or the orientation or positional relationship in which the invention product is usually placed when in use, or the orientation or positional relationship commonly understood by those skilled in the art. Such terms are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance.
[0059] See also Figure 1 and Figure 2 As shown, this embodiment provides a method for automatically allocating topic production tasks, including:
[0060] The server processes the question resources in the question resource library to obtain a question table, wherein the question table includes question difficulty information;
[0061] The server assigns production tasks to the questions in the question table according to the personnel efficiency table of the personnel to be assigned and the question difficulty information. The personnel efficiency table includes the question production efficiency of the personnel to be assigned, and the question production efficiency is calculated by comprehensively considering the question production rate and question production quality within a certain period of time.
[0062] In the method of automatically allocating question production tasks in this embodiment, the server adds question difficulty information to the generated question table, and introduces a personnel efficiency table when allocating question production tasks. Based on the question production efficiency of the personnel to be assigned in the personnel efficiency table and combined with the question difficulty information, more targeted and intelligent allocation of question production tasks is achieved, which can achieve optimal allocation of resources and improve the efficiency of question production.
[0063] Therefore, compared with the traditional manual assignment, the method of automatically allocating question production tasks in this embodiment can intelligently assign question tasks according to question information (grade, subject, project importance, production time, delivery time, etc.), and can balance the directionality and randomness of question allocation as much as possible.
[0064] The question resources in the question resource library of this embodiment are generally test papers, textbooks, and teaching supplementary materials. The question resources can be obtained automatically, such as automatically grabbing test paper resources through subscription or purchase, or manually uploaded test paper resources (such as pictures, documents, etc.) can be received.
[0065] Further, see Figure 1 and Figure 3As shown, in the method for automatically allocating topic production tasks in this embodiment, the server allocates production tasks to topics in the topic table according to the personnel efficiency table of the personnel to be assigned and the topic difficulty information, including:
[0066] The topic table contains topic attribute information, and the corresponding personnel to be assigned are matched according to the topic attribute information;
[0067] The server automatically allocates question production tasks based on the question difficulty information in the comprehensive question table and the question production efficiency information in the matched personnel efficiency table of the personnel to be assigned.
[0068] In the method of automatically assigning question production tasks in the present embodiment, the server first matches the questions in the question table with the persons to be assigned, and matches the corresponding persons to be assigned according to the subject or grade, to ensure that the questions can be produced and processed after assignment. On this basis, the question difficulty information in the question table and the question production efficiency information in the personnel efficiency table of the matched persons to be assigned are comprehensively used to automatically assign question production tasks, making question assignment more intelligent, making full use of the personnel resources under current conditions, and greatly improving the efficiency of question production.
[0069] Optionally, the personnel efficiency table described in this embodiment includes the subject and / or grade of the personnel producing the questions, and the question attribute information includes the subject, and / or grade, and / or year, and / or city, and / or source, and the corresponding personnel to be assigned are matched in the personnel efficiency table according to the subject and / or grade information in the question table.
[0070] As an optional implementation of this embodiment, see Figure 1 and Figure 3 As shown, in a method for automatically allocating question production tasks described in this embodiment, the server integrates question difficulty information in the question table and question production efficiency information in the matched personnel efficiency table of the personnel to be assigned to automatically allocate question production, including:
[0071] The server tends to assign the difficult questions in the question table to the personnel with high question production efficiency in the personnel efficiency table.
[0072] It should be noted that, under the same processing capacity, questions with greater difficulty will take longer to process, and under the same question difficulty, personnel with high question production efficiency will naturally have stronger processing capabilities. Therefore, this embodiment uses question production efficiency as a representation of processing capacity, and tends to assign questions with greater difficulty to personnel with high question production efficiency, and assign questions with less difficulty to personnel with low question production efficiency, thereby simultaneously improving question production efficiency.
[0073] Furthermore, in the method of automatically allocating question production tasks in the present embodiment, the server also needs to consider the balance of question allocation when performing question tendency allocation, so as to avoid continuously allocating high-difficulty questions to personnel with high question production efficiency, thereby increasing the burden of question production. Moreover, since the question production efficiency is updated regularly, continuously allocating high-difficulty questions to personnel with high question production efficiency may lead to a decrease in question production efficiency. The method of automatically allocating question production tasks in the present embodiment is to balance the use of existing resources and improve the efficiency of question production. The tendency allocation method of the present embodiment uses question difficulty and question production efficiency as allocation reference factors, rather than the only factors, relative to the processing capacity of the personnel to be assigned.
[0074] Therefore, in the method of automatically allocating question production tasks in the present embodiment, a quota ratio of difficult questions that can be allocated to each person is set. When performing the above-mentioned preference allocation, the server needs to determine whether the number of difficult questions currently handled by the person to be assigned meets the quota ratio. If the judgment result is yes, the preference allocation of difficult questions is stopped; if the judgment result is no, the preference allocation of difficult questions is carried out.
[0075] The quota ratio in this embodiment is different for personnel with different question production efficiency. The higher the question production efficiency, the larger the quota ratio. This is mainly to make full use of personnel resources. Moreover, questions that are more difficult for personnel with low question production efficiency may be of average or no difficulty for personnel with high question production efficiency.
[0076] As an optional implementation of this embodiment, the topic table described in this embodiment also includes priority information of the topic, and the server tends to allocate the topics with high priority in the topic table to the personnel to be assigned with high topic production efficiency in the personnel efficiency table. Since high-priority topics require faster production time, they are tendentiously allocated to personnel to be assigned with high production efficiency, which can meet the processing requirements of high-priority topics.
[0077] As an optional implementation of this embodiment, see Figure 1 and Figure 4 As shown, in the method for automatically allocating topic production tasks in this embodiment, the topic production efficiency of each person in the personnel efficiency table is regularly updated, including:
[0078] Statistics on the topic production time of each personnel in the topic production task within the set time period and the topic production pass rate of the topics produced that have been reviewed and approved;
[0079] The server calculates the question production time and question production pass rate of each person to obtain the question production efficiency, and synchronously updates the personnel efficiency table.
[0080] The question production efficiency in the personnel efficiency table of this embodiment is updated according to a certain period. The specific update period can be daily, weekly or monthly. The update period of this embodiment is daily, that is, the efficiency value of the personnel within 7 days is updated every day. Optionally, the question production time includes the time from the production of a single question to the submission for review, and the time for re-production and modification of the question after the question is rejected for review.
[0081] The question production pass rate includes a single question that passes the review once and is not modified, which is recorded as 1; a single question that passes the review and modification after completion or passes after multiple reviews, which is recorded as 0.
[0082] In this embodiment, there may be many methods for summarizing and calculating each person's question production time and question production pass rate to obtain the question production efficiency. Here, statistical processing of the question production time and question production pass rate is performed to obtain parameter values that can characterize the question production efficiency.
[0083] As an optional implementation of this embodiment, see Figure 1 and Figure 5 As shown, the server aggregates and calculates the question production time and question production pass rate of each person to obtain the question production efficiency, including:
[0084] Summarize the question production time of a single person who completes each question production task within a set time period, and perform normalization to obtain the question production rate x;
[0085] Summarize the question production pass rate of each question production task completed by a single person within a set time period, and perform normalization to obtain the question production quality y;
[0086] The question production efficiency of the personnel is n=x*k1+y*k2, where k1 and k2 are the set weight ratios.
[0087] Optionally, k1=k2=50%.
[0088] Data normalization is a basic work of data mining. Different evaluation indicators (question production time, question production pass rate) often have different dimensions and dimensional units, which will affect the results of data analysis. In order to eliminate the dimensional impact between indicators, data normalization is required to solve the comparability between data indicators. After the original data is normalized, each indicator is at the same order of magnitude, which is suitable for comprehensive comparative evaluation.
[0089] There are two commonly used normalization methods:
[0090] 1. Min-Max Normalization
[0091] Also known as deviation normalization, it is a linear transformation of the original data so that the resulting value is mapped to between [0-1]. The conversion function is as follows:
[0092]
[0093] Where max is the maximum value of the sample data, and min is the minimum value of the sample data. A drawback of this method is that when new data is added, max and min may change and need to be redefined.
[0094] 2. Z-score Standardization Method
[0095] This method gives the original data a mean and standard deviation to standardize the data. The processed data conforms to the standard normal distribution, that is, the mean is 0 and the standard deviation is 1. The conversion function is:
[0096]
[0097] Where μ is the mean of all sample data, and σ is the standard deviation of all sample data.
[0098] See also Figure 1 and Figure 6 As shown, in the method for automatically allocating question production tasks in this embodiment, the question difficulty information in the question table includes a question difficulty value, and the method for obtaining the question difficulty value includes:
[0099] Extract keywords / words from the topics in the topic table and perform topic search in the current topic search database;
[0100] Sort the retrieved related topics by relevance;
[0101] Get the difficulty values of the top-N related questions whose relevance is greater than the set value;
[0102] Calculate the weighted average difficulty of the top-N related questions to get the question difficulty value.
[0103] The weighted average is to multiply each value by the corresponding weight, then add up the total value, and then divide it by the total number of units. The size of the weighted average depends not only on the size of the value (variable value) of each unit in the population, but also on the weight of each value. Therefore, when calculating the difficulty value of a question, this embodiment performs a weighted average calculation based on the difficulty values of the top-N related questions retrieved, and the more relevant the question, the greater the weight.
[0104] See also Figure 1 and Figure 7As shown, in the method for automatically allocating topic production tasks in this embodiment, the topic resources in the topic resource library are processed to obtain a topic table, including:
[0105] Split the question resources in the question resource library to obtain multiple questions;
[0106] Perform duplicate search on each topic in the current topic search database to filter out non-duplicate topics;
[0107] The non-repeated questions are saved in a set format as a question table containing question attribute information, question priority information and question difficulty information.
[0108] The question splitting process in this embodiment refers to the process of splitting the questions in the question resources (such as test papers). When saving the question table, the question attribute information associated with the question resources (such as test papers) also needs to be saved, such as the year, province and other information of the question.
[0109] See also Figure 1 and Figure 8 As shown, the method of automatically allocating topic production tasks in this embodiment, the production allocation of topics in the topic table is performed according to the personnel efficiency table of the personnel to be allocated to obtain a task table, and the task allocation of topic production is performed according to the task table;
[0110] When a topic production task in the task table is not completed within the set deadline, the topic will be recycled to the topic table and the topic production task will be reassigned.
[0111] This embodiment monitors the assigned topic production tasks. If the assigned topic production tasks are not completed for a long time, in order to ensure the efficiency of topic production, this embodiment adds a topic recycling process to recycle the assigned topics into the topic table for reallocation.
[0112] Specifically, the task table contains task processing status information, and the processing status information includes processing statuses such as unprocessed, in process, under review, and completed. The question table contains question allocation status information on whether the question is assigned, and the question allocation status information includes information such as pending allocation, assigned, and suspended allocation. When the question production task in the task table is in an unprocessed state for longer than a set period, the corresponding question will be recycled and returned to the question table, and the question allocation status information of the recycled question will be changed from assigned to pending allocation, and the question allocation process will be repeated.
[0113] Furthermore, this embodiment monitors the execution process of the topic production task in the task table, collects the topic production time and the review pass rate during the topic production task, and is used to calculate the topic production efficiency of the updater.
[0114] After the question production task of this embodiment is completed, the questions produced are added to the question retrieval database and used as retrieval data for photo search. They can also be used for searching the top-N related questions in the question retrieval database before calculating the question difficulty value in this embodiment. They can also be used for checking for duplicates in the current question retrieval database for each question in this embodiment to filter out non-duplicate questions.
[0115] The question production task of this embodiment is to process and produce the questions in the question resources obtained through various channels according to a fixed format, obtain question data in a unified format (such as including question stem, answer, analysis, knowledge points, year, province, subject, grade, difficulty label, other labels, etc.), and add it to the current question retrieval database.
[0116] This embodiment also provides a device for automatically allocating topic production tasks, including:
[0117] A question table generating module processes the question resources in the question resource library to obtain a question table, wherein the question table includes question difficulty information;
[0118] The question allocation module produces and allocates the questions in the question table according to the personnel efficiency table of the personnel to be assigned and the question difficulty information. The personnel efficiency table contains the question production efficiency of the personnel to be assigned, and the question production efficiency is calculated by comprehensively calculating the question production rate and question production quality within a certain period of time.
[0119] In the device for automatically allocating question production tasks of this embodiment, the question table generation module adds question difficulty information to the generated question table, and the question allocation module introduces a personnel efficiency table when allocating question production tasks. The question production efficiency of the personnel to be assigned in the personnel efficiency table is combined with the question difficulty information to achieve more targeted intelligent allocation of question production tasks, thereby achieving optimal allocation of resources and improving the efficiency of question production.
[0120] The question resources in the question resource library of this embodiment are generally test papers, textbooks, and supplementary teaching materials, etc. The question resources can be obtained automatically, such as automatically grabbing test paper resources, or manually uploaded.
[0121] Furthermore, the topic assignment module of this embodiment includes:
[0122] A matching unit, wherein the topic table includes topic attribute information, and matches the corresponding personnel to be assigned according to the topic attribute information in the topic table;
[0123] The allocation unit automatically allocates the question production tasks based on the question difficulty information in the question table and the question production efficiency information in the personnel efficiency table of the matched personnel to be allocated.
[0124] In the device for automatically allocating question production tasks of this embodiment, the matching unit first matches the questions in the question table with the persons to be assigned, and matches the corresponding persons to be assigned according to the subject or grade, to ensure that the questions can be produced and processed after being assigned. On this basis, the allocation unit automatically allocates question production tasks based on the question difficulty information in the question table and the question production efficiency information in the personnel efficiency table of the matched persons to be assigned, making the question allocation more intelligent, making full use of the personnel resources under the current conditions, and greatly improving the efficiency of question production.
[0125] Optionally, the personnel efficiency table described in this embodiment includes the subject and / or grade of the personnel producing the questions, and the question attribute information includes the subject, and / or grade, and / or year, and / or city, and / or source, and the corresponding personnel to be assigned are matched in the personnel efficiency table according to the subject and / or grade information in the question table.
[0126] As an optional implementation of this embodiment, the allocation unit of this embodiment integrates the question difficulty information in the question table and the question production efficiency information in the matched personnel efficiency table of the personnel to be allocated to automatically allocate the question production, including:
[0127] The difficult questions in the question table are tended to be allocated to the personnel with high question production efficiency in the personnel efficiency table.
[0128] It should be noted that, under the same processing capacity, questions with greater difficulty will take longer to process, and under the same question difficulty, personnel with high question production efficiency will naturally have stronger processing capabilities. Therefore, this embodiment uses question production efficiency as a representation of processing capacity, and tends to assign questions with greater difficulty to personnel with high question production efficiency, and assign questions with less difficulty to personnel with low question production efficiency, thereby simultaneously improving question production efficiency.
[0129] Furthermore, the allocation unit of the present embodiment also needs to consider the balance of question allocation when performing question tendency allocation, so as to avoid continuously allocating high-difficulty questions to personnel with high question production efficiency, thereby increasing the burden of question production. Moreover, since the question production efficiency is updated regularly, continuously allocating high-difficulty questions to personnel with high question production efficiency may lead to a decrease in question production efficiency. The device for automatically allocating question production tasks of the present embodiment is to balance the use of existing resources and improve the efficiency of question production. The tendency allocation method of the present embodiment uses question difficulty and question production efficiency as allocation reference factors, rather than the only factors, relative to the processing capacity of the personnel to be allocated.
[0130] Therefore, the topic allocation module of this embodiment includes:
[0131] The configuration unit sets a quota ratio of difficult questions that can be allocated to each person. When performing the tendency allocation, the allocation unit needs to determine whether the number of difficult questions currently answered by the person to be allocated meets the quota ratio. If the judgment result is yes, the tendency allocation of difficult questions is stopped; if the judgment result is no, the tendency allocation of difficult questions is performed.
[0132] The quota ratio in this embodiment is different for personnel with different question production efficiency. The higher the question production efficiency, the larger the quota ratio. This is mainly to make full use of personnel resources. Moreover, questions that are more difficult for personnel with low question production efficiency may be of average or no difficulty for personnel with high question production efficiency.
[0133] As an optional implementation of this embodiment, the topic table described in this embodiment also includes the priority information of the topic, and the topics with high priority in the topic table are preferentially allocated to the personnel to be assigned with high topic production efficiency in the personnel efficiency table. Since high-priority topics require faster production time, preferentially allocating them to personnel to be assigned with high production efficiency can meet the processing requirements of high-priority topics.
[0134] As an optional implementation of this embodiment, the device for automatically allocating topic production tasks in this embodiment includes:
[0135] The updating module regularly updates the question production efficiency of each person in the personnel efficiency table, including:
[0136] The update module counts the time of question production by each person in the process of question production within the set time period and the question production pass rate of the questions produced that have been reviewed and approved;
[0137] The update module summarizes and calculates each person's question production time and question production pass rate to obtain question production efficiency, and synchronously updates the personnel efficiency table.
[0138] The update module of this embodiment updates the production efficiency of the questions in the staff efficiency table according to a certain period. The specific update period can be daily, weekly or monthly. The update period of this embodiment is daily update, that is, the staff efficiency value within 7 days is updated every day.
[0139] Optionally, the topic production time includes the time from the production of a single topic to its submission for review, and the time for re-production and modification of the topic after the topic fails the review and is rejected.
[0140] The question production pass rate includes a single question that passes the review once and is not modified, which is recorded as 1; a single question that passes the review and modification after completion or passes after multiple reviews, which is recorded as 0.
[0141] In this embodiment, the update module summarizes and calculates the question production time and question production pass rate of each person to obtain the question production efficiency. There may be many methods. Here, statistical processing of the question production time and question production pass rate is performed to obtain parameter values that can characterize the question production efficiency.
[0142] As an optional implementation of this embodiment, the updating module aggregates and calculates the question production time and question production pass rate of each person to obtain the question production efficiency, including:
[0143] Summarize the question production time of a single person who completes each question production task within a set time period, and perform normalization to obtain the question production rate x;
[0144] Summarize the question production pass rate of each question production task completed by a single person within a set time period, and perform normalization to obtain the question production quality y;
[0145] The question production efficiency of the personnel is n=x*k1+y*k2, where k1 and k2 are the set weight ratios.
[0146] Optionally, k1=k2=50%.
[0147] Data normalization is a basic work of data mining. Different evaluation indicators (question production time, question production pass rate) often have different dimensions and dimensional units, which will affect the results of data analysis. In order to eliminate the dimensional impact between indicators, data normalization is required to solve the comparability between data indicators. After the original data is normalized, each indicator is at the same order of magnitude, which is suitable for comprehensive comparative evaluation.
[0148] There are two commonly used normalization methods:
[0149] 1. Min-Max Normalization
[0150] Also known as deviation normalization, it is a linear transformation of the original data so that the resulting value is mapped to between [0-1]. The conversion function is as follows:
[0151]
[0152] Where max is the maximum value of the sample data, and min is the minimum value of the sample data. A drawback of this method is that when new data is added, max and min may change and need to be redefined.
[0153] 2. Z-score Standardization Method
[0154] This method gives the original data a mean and standard deviation to standardize the data. The processed data conforms to the standard normal distribution, that is, the mean is 0 and the standard deviation is 1. The conversion function is:
[0155]
[0156] Where μ is the mean of all sample data, and σ is the standard deviation of all sample data.
[0157] The device for automatically allocating topic production tasks in this embodiment includes:
[0158] The question difficulty acquisition module is used to calculate the question difficulty value in the question table. The method for acquiring the question difficulty value includes:
[0159] Extract keywords / words from the topics in the topic table and perform topic search in the current topic search database;
[0160] Sort the retrieved related topics by relevance;
[0161] Get the difficulty values of the top-N related questions whose relevance is greater than the set value;
[0162] Calculate the weighted average difficulty of the top-N related questions to get the question difficulty value.
[0163] The weighted average is to multiply each value by the corresponding weight, then add up the total value, and then divide it by the total number of units. The size of the weighted average depends not only on the size of the value (variable value) of each unit in the population, but also on the weight of each value. Therefore, when calculating the difficulty value of a question, this embodiment performs a weighted average calculation based on the difficulty values of the top-N related questions retrieved, and the more relevant the question, the greater the weight.
[0164] The topic table generation module of this embodiment includes:
[0165] A question splitting unit splits the question resources in the question resource library to obtain multiple questions;
[0166] A search unit searches for duplicates in a current topic search database for each topic and selects non-duplicate topics;
[0167] The question table unit saves non-repeated questions according to a set format as a question table containing question attribute information, question priority information and question difficulty information.
[0168] The question splitting unit of this embodiment splits the questions in the question resources (such as test papers). When saving the question table, the split questions also need to save the question attribute information associated with the question resources (such as test papers), such as the year and province of the question.
[0169] The device for automatically allocating topic production tasks in this embodiment includes:
[0170] The topic recovery module is used to recover the topic to the topic table and re-assign the topic production task when the topic production task in the task table is not completed within the set period.
[0171] This embodiment monitors the assigned topic production tasks. If the assigned topic production tasks are not completed for a long time, in order to ensure the efficiency of topic production, this embodiment adds a topic recycling process to recycle the assigned topics into the topic table for reallocation.
[0172] Specifically, the task table contains task processing status information, and the processing status information includes processing statuses such as unprocessed, in process, under review, and completed. The question table contains question allocation status information on whether the question is assigned, and the question allocation status information includes information such as pending allocation, assigned, and suspended allocation. When the question production task in the task table is in an unprocessed state for longer than a set period, the corresponding question will be recycled and returned to the question table, and the question allocation status information of the recycled question will be changed from assigned to pending allocation, and the question allocation process will be repeated.
[0173] Furthermore, this embodiment monitors the execution process of the topic production task in the task table, collects the topic production time and the review pass rate during the topic production task, and is used to calculate the topic production efficiency of the updater.
[0174] After the question production task of this embodiment is completed, the questions produced are added to the question retrieval database and used as retrieval data for photo search. They can also be used for searching the top-N related questions in the question retrieval database before calculating the question difficulty value in this embodiment. They can also be used for checking for duplicates in the current question retrieval database for each question in this embodiment to filter out non-duplicate questions.
[0175] The question production task of this embodiment is to process and produce the questions in the question resources obtained through various channels according to a fixed format, obtain question data in a unified format (such as including question stem, answer, analysis, knowledge points, year, province, subject, grade, difficulty label, other labels, etc.), and add it to the current question retrieval database.
[0176] This embodiment also provides a storage medium storing a computer executable program, which, when executed, implements the method of automatically allocating topic production tasks.
[0177] The storage medium described in the present embodiment may include a data signal propagated in a baseband or as a part of a carrier wave, wherein a readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by an instruction execution system, an apparatus, or a device or used in combination with it. The program code contained on the readable storage medium may be transmitted with any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.
[0178] This embodiment also provides an electronic device, including a processor and a memory, wherein the memory is used to store a computer executable program. When the computer program is executed by the processor, the processor executes the method of automatically allocating question production tasks.
[0179] The electronic device is presented in the form of a general-purpose computing device. The processor may be one or more than one and work in coordination. The present invention does not exclude distributed processing, that is, the processor may be dispersed in different physical devices. The electronic device of the present invention is not limited to a single entity, but may also be the sum of multiple physical devices.
[0180] The memory stores a computer executable program, which is usually a machine-readable code. The computer-readable program can be executed by the processor to enable the electronic device to perform the method of the present invention, or at least part of the steps in the method.
[0181] The memory includes a volatile memory, such as a random access memory unit (RAM) and / or a cache memory unit, and may also be a non-volatile memory, such as a read-only memory unit (ROM).
[0182] It should be understood that the electronic device of the present invention may also include elements or components not shown in the above examples. For example, some electronic devices also include display units such as display screens, and some electronic devices also include human-computer interaction elements such as buttons, keyboards, etc. As long as the electronic device can execute the computer-readable program in the memory to implement the method of the present invention or at least part of the steps of the method, it can be considered as an electronic device covered by the present invention.
[0183] Through the above description of the implementation mode, it is easy for those skilled in the art to understand that the present invention can be implemented by hardware capable of executing a specific computer program, such as the system of the present invention, and the electronic processing unit, server, client, mobile phone, control unit, processor, etc. contained in the system. The present invention can also be implemented by computer software that executes the method of the present invention, such as control software executed by a microprocessor, an electronic control unit, a client, a server, etc. However, it should be noted that the computer software that executes the method of the present invention is not limited to being executed by one or a specific hardware entity, and it can also be implemented in a distributed manner by unspecified specific hardware. For computer software, the software product can be stored in a computer-readable storage medium (which can be a CD-ROM, a U disk, a mobile hard disk, etc.), and can also be distributed and stored on the network, as long as it can enable the electronic device to execute the method according to the present invention.
[0184] The above embodiments are only used to illustrate the present invention and are not intended to limit the technical solutions described in the present invention. Although the present invention has been described in detail with reference to the above embodiments, the present invention is not limited to the above specific implementation methods. Therefore, any modification or equivalent replacement of the present invention; and all technical solutions and improvements thereof that do not depart from the spirit and scope of the invention are included in the scope of the claims of the present invention.
Claims
1. A method for automatically allocating topic production tasks, characterized in that: include: Processing the question resources in the question resource library to obtain a question table, wherein the question table includes question difficulty information; The production tasks are assigned to the questions in the question table according to the personnel efficiency table of the personnel to be assigned and the question difficulty information. The personnel efficiency table includes the question production efficiency of the personnel to be assigned. The question production efficiency is calculated by comprehensively considering the question production rate and question production quality within a certain period of time. The production task allocation of the topics in the topic table according to the personnel efficiency table of the personnel to be allocated and the topic difficulty information includes: The topic table contains topic attribute information, and the corresponding personnel to be assigned are matched according to the topic attribute information; Automatically allocate question production tasks based on question difficulty information in the question table and question production efficiency information in the matched personnel efficiency table of the personnel to be assigned; The automatic allocation of question production by integrating the question difficulty information in the question table and the question production efficiency information in the matched personnel efficiency table of the personnel to be assigned includes: The difficult questions in the question table are tended to be assigned to the personnel with high question production efficiency in the personnel efficiency table; A quota ratio of difficult questions that can be assigned to each person is set. When performing the tendency allocation, it is necessary to determine whether the number of difficult questions currently assigned to the person to be assigned meets the quota ratio. If the determination result is yes, the tendency allocation of difficult questions is stopped. If the determination result is no, the tendency allocation of difficult questions is performed. The topic table also includes priority information of the topics, and the topics with high priority in the topic table are tendentiously allocated to the personnel to be allocated with high topic production efficiency in the personnel efficiency table; The production efficiency of each person in the personnel efficiency table is updated regularly, including: Statistics on the topic production time of each personnel in the topic production task within the set time period and the topic production pass rate of the topics produced that have been reviewed and approved; Summarize and calculate the question production time and question production pass rate of each person to obtain the question production efficiency, and synchronously update the personnel efficiency table; The topic production time mentioned above includes the time from the production of a single topic to its submission for review, and the time for re-production and modification of the topic after the topic fails the review and is rejected; The question production pass rate includes a single question that has been reviewed and approved once and has not been modified, which is recorded as 1, and a single question that has been reviewed and approved after one modification or after multiple reviews, which is recorded as 0; The summary calculation of each person's question production time and question production pass rate to obtain question production efficiency includes: Summarize the question production time of a single person who completes each question production task within a set time period, and perform normalization to obtain the question production rate x; Summarize the question production pass rate of each question production task completed by a single person within a set time period, and perform normalization to obtain the question production quality y; The question production efficiency of the personnel is n=x*k1+y*k2, where k1 and k2 are the set weight ratios; The question difficulty information in the question table includes a question difficulty value, and the method for obtaining the question difficulty value includes: Extract keywords / words from the topics in the topic table and perform topic search in the current topic search database; Sort the retrieved related topics by relevance; Get the difficulty values of the top-N related questions whose relevance is greater than the set value; Calculate the weighted average difficulty of the top-N related questions to get the question difficulty value.
2. A method for automatically allocating topic production tasks according to claim 1, characterized in that: The personnel efficiency table includes the subjects and / or grades of the questions produced by the personnel, and the question attribute information includes the subject, and / or grade, and / or year, and / or city, and / or source. The corresponding personnel to be assigned are matched in the personnel efficiency table according to the subject and / or grade information in the question table.
3. A method for automatically allocating topic production tasks according to claim 1, characterized in that: Said k1=k2=50%.
4. A method for automatically allocating topic production tasks according to claim 1, characterized in that: The processing of the topic resources in the topic resource library to obtain the topic table includes: Split the question resources in the question resource library to obtain multiple questions; Perform duplicate search on each topic in the current topic search database to filter out non-duplicate topics; The non-repeated questions are saved in a set format as a question table containing question attribute information, question priority information and question difficulty information.
5. A method for automatically allocating topic production tasks according to claim 1, characterized in that: The production allocation of the topics in the topic table is performed according to the personnel efficiency table of the personnel to be assigned to obtain a task table, and the task allocation of topic production is performed according to the task table; When the topic production task in the task table is not completed within the set period, the topic will be recycled to the topic table for re-assignment of topic production tasks; The task table includes task processing status information, and the topic table includes topic allocation status information indicating whether a topic has been allocated.
6. A device for automatically allocating topic production tasks, characterized in that: include: A question table generating module processes the question resources in the question resource library to obtain a question table, wherein the question table includes question difficulty information; A question allocation module allocates production tasks to the questions in the question table according to the personnel efficiency table of the personnel to be allocated and the question difficulty information. The personnel efficiency table includes the question production efficiency of the personnel to be allocated, and the question production efficiency is calculated by combining the question production rate and question production quality within a certain period of time; The production task allocation of the topics in the topic table according to the personnel efficiency table of the personnel to be allocated and the topic difficulty information includes: The topic table contains topic attribute information, and the corresponding personnel to be assigned are matched according to the topic attribute information; Automatically allocate question production tasks based on question difficulty information in the question table and question production efficiency information in the matched personnel efficiency table of the personnel to be assigned; The automatic allocation of question production by integrating the question difficulty information in the question table and the question production efficiency information in the matched personnel efficiency table of the personnel to be assigned includes: The difficult questions in the question table are tended to be assigned to the personnel with high question production efficiency in the personnel efficiency table; A quota ratio of difficult questions that can be assigned to each person is set. When performing the tendency allocation, it is necessary to determine whether the number of difficult questions currently assigned to the person to be assigned meets the quota ratio. If the determination result is yes, the tendency allocation of difficult questions is stopped. If the determination result is no, the tendency allocation of difficult questions is performed. The topic table also includes priority information of the topics, and the topics with high priority in the topic table are tendentiously allocated to the personnel to be allocated with high topic production efficiency in the personnel efficiency table; The device for automatically allocating topic production tasks includes an updating module, which regularly updates the topic production efficiency of each person in the personnel efficiency table, including: The update module counts the time of question production by each person in the process of question production within the set time period and the question production pass rate of the questions produced that have been reviewed and approved; The update module calculates the question production time and question production pass rate of each person to obtain the question production efficiency, and synchronously updates the personnel efficiency table; The topic production time mentioned above includes the time from the production of a single topic to its submission for review, and the time for re-production and modification of the topic after the topic fails the review and is rejected; The question production pass rate includes a single question that has been reviewed and approved once and has not been modified, which is recorded as 1, and a single question that has been reviewed and approved after one modification or after multiple reviews, which is recorded as 0; The update module calculates the question production time and question production pass rate of each person to obtain the question production efficiency, including: Summarize the question production time of a single person who completes each question production task within a set time period, and perform normalization to obtain the question production rate x; Summarize the question production pass rate of each question production task completed by a single person within a set time period, and perform normalization to obtain the question production quality y; The question production efficiency of the personnel is n=x*k1+y*k2, where k1 and k2 are the set weight ratios; The device for automatically allocating question production tasks includes a question difficulty acquisition module, which is used to calculate the question difficulty value in the question table. The method for acquiring the question difficulty value includes: Extract keywords / words from the topics in the topic table and perform topic search in the current topic search database; Sort the retrieved related topics by relevance; Get the difficulty values of the top-N related questions whose relevance is greater than the set value; Calculate the weighted average difficulty of the top-N related questions to get the question difficulty value.
7. A storage medium, characterized in that: A computer executable program is stored, and when the computer executable program is executed, a method for automatically allocating topic production tasks as described in any one of claims 1 to 5 is implemented.
