A flowchart-based automatic grading method for operation questions and an online examination system

Abstract

This application relates to an automatic grading method for flowchart-based operation questions and an online examination system. The method includes: acquiring examinee answer data and question answer data; constructing a first matrix based on the examinee answer data and a second matrix based on the question answer data; comparing the first and second matrices, and determining the examinee's score based on the comparison result. This method enables automatic grading of flowchart-based operation questions, solving the problem in related technologies where automatic grading of flowchart-based operation questions is not possible, greatly improving grading efficiency and reducing labor costs.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to an automatic grading method for operation questions based on flowchart design and an online examination system. Background Technology

[0002] The rapid development of information technology has driven the advancement of online examination technology, leading to paperless examinations and making the examination process more convenient, faster, and more efficient. However, due to the limitations of current computer-based testing technology, some highly specialized exam content, which is difficult to cover in traditional exams, is hard to achieve through computer-based testing. For example, the practical questions for financial technology professionals, which can be completed with just a few strokes of the pen in traditional exams, are difficult to implement in computer-based testing.

[0003] In existing technologies, third-party flowchart design software is typically used to answer questions in the fintech professional skills exam. Candidates design flowcharts using independent software and submit them as images or files. Examiners then manually review these submitted flowchart images or files, requiring specialized examiners to spend several minutes analyzing the candidates' answers for accuracy. Furthermore, this method carries inherent risks; during data transmission, submitted answers may be corrupted, stolen, or tampered with. Therefore, this approach is inconvenient for both candidates and examiners, is time-consuming and inefficient, and data security cannot be guaranteed.

[0004] There is currently no effective solution to the problem that related technologies cannot automatically grade operation questions designed based on flowcharts. Summary of the Invention

[0005] Therefore, it is necessary to address the aforementioned technical problems by providing an automatic grading method and online examination system for flowchart-based operation questions that can automatically grade operation questions designed based on flowcharts.

[0006] Firstly, this application provides an automatic grading method for operation questions based on flowchart design, the method comprising:

[0007] Obtain candidate answer data and test question answer data; construct a first matrix based on the candidate answer data, and construct a second matrix based on the test question answer data;

[0008] The first matrix and the second matrix are compared, and the candidate's score is determined based on the comparison result.

[0009] In one embodiment, constructing a first matrix based on the examinee's answer data and constructing a second matrix based on the test question answer data includes:

[0010] The candidate's answer data is parsed and processed to extract the first key information of each part of the candidate's flowchart;

[0011] The test question answer data is parsed and processed to extract the second key information of each part of the test question answer flowchart;

[0012] The first matrix is ​​constructed based on the first key information; the first key information includes the first component information, the first group information, the first component association information, and the first group association information in the flowchart drawn by the examinee;

[0013] The second matrix is ​​constructed based on the second key information; the second key information includes the second component information, the second grouping information, the second component association information, and the second grouping association information in the question answer flowchart.

[0014] In one embodiment, constructing the first matrix based on the first key information includes:

[0015] A first component type matrix is ​​constructed based on the first component information; the first component information includes the component type number;

[0016] A first group content matrix is ​​constructed based on the first group information; the first group information includes the name of the group and the type number of the component in each group;

[0017] A first component association topology matrix is ​​constructed based on the first component association information; the first component association information includes the component type number and the association relationship between components.

[0018] A first group association topology matrix is ​​constructed based on the first group association information; the first group association information includes the name of the group and the association relationship between the groups.

[0019] In one embodiment, constructing the first matrix based on the first key information includes:

[0020] The type numbers of each component are arranged in a first preset order to form the first component type matrix;

[0021] The names of each group are arranged sequentially, and the type numbers of all components in each group are arranged sequentially below the group according to a second preset order to form the first group content matrix;

[0022] Using the component type number as the vertex and the association relationship between components as the edge, a first directed graph adjacency matrix is ​​constructed, and the first directed graph adjacency matrix is ​​used as the first component association topology matrix;

[0023] Using the names of the groups as vertices and the relationships between groups as edges, a second directed graph adjacency matrix is ​​constructed, and this second directed graph adjacency matrix is ​​used as the first group association topology matrix.

[0024] In one embodiment, constructing the second matrix based on the second key information includes: constructing a second component type matrix based on the second component information; constructing a second group content matrix based on the second grouping information; constructing a second component association topology matrix based on the second component association information; and constructing a second group association topology matrix based on the second group association information.

[0025] Secondly, this application also provides an online examination system based on flowchart design, the system including an online answering subsystem and an automatic grading subsystem, wherein: the online answering subsystem is used for candidates to design flowcharts online and to store candidates' answer data;

[0026] The automatic marking subsystem is connected to the online answering subsystem and is used to acquire candidate answer data and test question answer data; construct a first matrix based on the candidate answer data and a second matrix based on the test question answer data; compare the first matrix and the second matrix, and determine the candidate's answer score based on the comparison result.

[0027] In one embodiment, the online answering subsystem includes: a component editing module, a component grouping module, an association creation module, and a data storage module, wherein:

[0028] The component editing module is used to add components, delete components, and modify component attribute information; the component grouping module is used to create groups, delete groups, and modify group attribute information; the association creation module is used to create associations between components, between components and groups, between groups, and modify association attribute information; the data storage module is used to store candidate answer data.

[0029] In one embodiment, the automatic marking subsystem includes a data parsing module and a matrix construction module, wherein:

[0030] The data parsing module is used to parse and process the candidate's answer data to extract the first key information of each part of the candidate's flowchart; and to parse and process the test question answer data to extract the second key information of each part of the test question answer flowchart.

[0031] The matrix construction module is used to construct the first matrix based on the first key information; the first key information includes the first component information, the first group information, the first component association information, and the first group association information in the candidate's flowchart; and to construct the second matrix based on the second key information; the second key information includes the second component information, the second group information, the second component association information, and the second group association information in the test question answer flowchart.

[0032] In one embodiment, the matrix construction module includes a component type matrix construction unit, a group content matrix construction unit, a component association matrix construction unit, and a group association matrix construction unit, wherein:

[0033] The component type matrix construction unit is used to construct a first component type matrix based on the first component information; the first component information includes the component type number.

[0034] The group content matrix construction unit is used to construct a first group content matrix based on the first group information; the first group information includes the name of the group and the type number of the component in each group.

[0035] The component association matrix construction unit is used to construct a first component association topology matrix based on the first component association information; the first component association information includes the component type number and the association relationship between components.

[0036] The group association matrix construction unit is used to construct a first group association topology matrix based on the first group association information; the first group association information includes the name of the group and the association relationship between the groups.

[0037] In one embodiment, the component type matrix construction unit is further configured to arrange the type numbers of each component in a first preset order to form the first component type matrix;

[0038] The group content matrix construction unit is also used to arrange the names of each group sequentially, and to arrange the type numbers of all components in each group in a second preset order below the group to form the first group content matrix;

[0039] The component association matrix construction unit is further configured to construct a first directed graph adjacency matrix using the component type number as the vertex and the association relationship between components as the edge, and use the first directed graph adjacency matrix as the first component association topology matrix;

[0040] The group association matrix construction unit is further configured to construct a second directed graph adjacency matrix using the group name as a vertex and the association relationship between groups as an edge, and use the second directed graph adjacency matrix as the first group association topology matrix.

[0041] The aforementioned automatic grading method and online examination system for operation questions based on flowchart design includes: acquiring candidate answer data and question answer data; constructing a first matrix based on the candidate answer data and a second matrix based on the question answer data; comparing the first matrix and the second matrix, and determining the candidate's score based on the comparison result. This application, targeting the characteristics of operation questions designed with flowcharts, converts candidate answer data and question answer data into easily comparable first and second matrices. By comparing the differences between the first and second matrices, it achieves a comparison between the candidate answer data and the question answer data, thereby determining whether the flowchart drawn by the candidate matches the flowchart in the question answer. Figure 1 This technology enables automatic grading of flowchart-based operational questions, further determining the candidates' scores. It solves the problem of inability to automatically grade flowchart-based operational questions in related technologies, greatly improving grading efficiency and reducing labor costs. Attached Figure Description

[0042] Figure 1 This is a flowchart illustrating an automatic grading method for operational questions based on a flowchart design in one embodiment.

[0043] Figure 2 This is a flowchart illustrating the process of constructing the first and second matrices in one embodiment;

[0044] Figure 3 Here is a flowchart illustrating the process of constructing a first matrix based on first key information in one embodiment. Figure 1 ;

[0045] Figure 4 Here is a flowchart illustrating the process of constructing a first matrix based on first key information in one embodiment. Figure 2 ;

[0046] Figure 5 This is a flowchart illustrating the process of determining a candidate's score in one embodiment;

[0047] Figure 6 This is a schematic diagram of the association topology graph between candidate answers and test question answers in one embodiment;

[0048] Figure 7 This is a block diagram of an online examination system in one embodiment;

[0049] Figure 8 This is an operation flowchart of the online response subsystem in one embodiment;

[0050] Figure 9 Here is a structural block diagram of the matrix construction module in one embodiment;

[0051] Figure 10 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0052] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0053] In one embodiment, Figure 1 This is a flowchart illustrating an automatic grading method for operational questions based on a flowchart design in one embodiment, as shown below. Figure 1 As shown, the automatic grading method for operation questions based on flowchart design provided in this application includes the following steps:

[0054] Step 110: Obtain candidate's answer data and test question answer data. The candidate's answer data includes, but is not limited to, flowcharts drawn by the candidate. The test question answer data includes, but is not limited to, flowcharts of test question answers.

[0055] Step 120: Construct a first matrix based on the candidate's answer data, and construct a second matrix based on the test question answer data.

[0056] Step 130: Compare the first matrix and the second matrix, and determine the candidate's score based on the comparison result.

[0057] The aforementioned automatic grading method for operation questions based on flowchart design includes acquiring candidate answer data and question answer data; constructing a first matrix based on the candidate answer data and a second matrix based on the question answer data; comparing the first matrix and the second matrix; and determining the candidate's score based on the comparison result. This application, addressing the characteristics of operation questions designed with flowcharts, converts candidate answer data and question answer data into easily comparable first and second matrices. By comparing the differences between the first and second matrices, it achieves a comparison between the candidate's answer data and the question answer data, thereby determining whether the flowchart drawn by the candidate matches the flowchart in the question answer. Figure 1 This technology enables automatic grading of flowchart-based operational questions, further determining the candidates' scores. It solves the problem of inability to automatically grade flowchart-based operational questions in related technologies, greatly improving grading efficiency and reducing labor costs.

[0058] In one embodiment, Figure 2This is a flowchart illustrating the process of constructing the first and second matrices in one embodiment, as shown below. Figure 2 As shown, the process includes the following steps:

[0059] Step 210: Analyze and process the candidate's answer data to extract the first key information of each part of the candidate's flowchart.

[0060] Step 220: Analyze the test answer data to extract the second key information of each part of the test answer flowchart.

[0061] Step 230: Construct a first matrix based on the first key information; the first key information includes the first component information, the first group information, the first component association information, and the first group association information in the flowchart drawn by the candidate.

[0062] Step 240: Construct a second matrix based on the second key information; the second key information includes the second component information, the second grouping information, the second component association information, and the second grouping association information in the question answer flowchart.

[0063] The candidate's answer data includes the flowchart answer ID, timestamp, component information, relationship information, and grouping information. Component information includes the position, content, and size of each component. Relationship information includes the position, content, and size of each relationship. Grouping information includes the position, content, and size of each group.

[0064] In one embodiment, Figure 3 Here is a flowchart illustrating the process of constructing a first matrix based on first key information in one embodiment. Figure 1 The process includes the following steps:

[0065] Step 310: Construct a first component type matrix based on the first component information; the first component information includes the type number of the component.

[0066] The component type number can be letters, numbers, or a combination of various symbols, and this application does not impose any restrictions. It should be noted that the component type matrix is ​​used to determine whether the candidate's selection of component types is correct. For example, if the test answer requires four components—two circular components, one square component, and one triangular component—the candidate's answer is determined by comparing the component selections in the candidate's answer data with those in the test answer.

[0067] Step 320: Construct a first group content matrix based on the first group information; the first group information includes the name of the group and the type number of the component in each group.

[0068] Similarly, the group names can be used to construct a group content matrix to determine whether the candidate has correctly selected the component type.

[0069] Step 330: Construct a first component association topology matrix based on the first component association information; the first component association information includes the component type number and the association relationship between components.

[0070] Step 340: Construct a first group association topology matrix based on the first group association information; the first group association information includes the name of the group and the association relationship between the groups.

[0071] In one embodiment, Figure 4 Here is a flowchart illustrating the process of constructing a first matrix based on first key information in one embodiment. Figure 2 The process includes the following steps:

[0072] Step 410: Arrange the type numbers of each component in a first preset order to form a first component type matrix.

[0073] The first preset order can be a sequential order, a reverse order, or another order; this embodiment does not impose any restrictions.

[0074] In one embodiment, the type numbers of each component are arranged sequentially below the corresponding preset component type numbers according to a first preset order to form a first component type matrix. For example, as shown in Table 1, the preset component type numbers include a1 to a8, where each component type number represents a component type. The type numbers a1, a3, a4, and a8 of the components selected by the examinee are arranged sequentially below the corresponding preset component type numbers to form the first component type matrix.

[0075] Table 1 First Component Type Matrix

[0076] Alternative component types a1 a2 a3 a4 a5 a6 a7 a8 Candidate answer component types a1 a3 a4 a8

[0077] Step 420: Arrange the names of each group sequentially, and arrange the type numbers of all components in each group in a second preset order below the group to form the first group content matrix.

[0078] The second preset order can be a sequential order, a reverse order, or another order; this embodiment does not impose any restrictions. The first preset order and the second preset order can be the same or different; this embodiment does not impose any restrictions.

[0079] In one embodiment, as shown in Table 2, the candidate's answer includes group names b1, b2, and b3. Group name b1 contains the component type number a1, group name b2 contains component type numbers a3 and a4, and group name b3 contains the component type number a8. Arranging group names b1, b2, and b3 sequentially, with component type number a1 below group name b1, component type numbers a3 and a4 below group name b2, and component type number a8 below group name b3, forms the first group content matrix.

[0080] Table 2 Content Matrix of the First Group

[0081]

[0082] Step 430: Construct a first directed graph adjacency matrix using the component type number as the vertex and the association relationship between components as the edge, and use the first directed graph adjacency matrix as the first component association topology matrix.

[0083] The adjacency matrix of a directed graph is defined as follows: Let G = (V, E) be a graph with n vertices, and its vertex set V and edge set E be {v1, v2, ..., v3}, respectively. n} and {e1,e2,......,e m The incidence matrix of G is an n×n 0-1 matrix, denoted as M(G)=[m i,j ] n×n .

[0084] in:

[0085] In the above formula (1), when the vth element in the correlation matrix of G... i line, v j When the edge corresponding to the column belongs to the edge set E, the vth edge... i line, v j The value of a column is 1 if it is not 0 otherwise. When establishing the component association topology matrix according to the above mathematical definition, for example, the association from a1 to a2 is set to 1 at the corresponding position in row a1 and column a2.

[0086] Specifically, as shown in Table 3, the component type numbers a1, a3, a4, and a8 are used as vertices, and the association relationships between component a1 and component a3, component a3 and component a4, component a1 and component a8, and component a4 and component a8 are used as edges to construct a first directed graph adjacency matrix. The first directed graph adjacency matrix is ​​then used as the first component association topology matrix. In Table 3, 0 values ​​are represented by spaces.

[0087] Table 3. Association Topology Matrix of the First Component

[0088] Candidate's Answer a1 a3 a4 a8 a1 1 1 a3 1 a4 1 a8

[0089] Step 440: Construct a second directed graph adjacency matrix using the group name as the vertex and the association relationship between groups as the edge, and use the second directed graph adjacency matrix as the first group association topology matrix.

[0090] Specifically, as shown in Table 4, the names of the groups b1, b2, and b3 are used as vertices, and the relationships between groups b1 and b2 and between groups b1 and b3 are used as edges. A second directed graph adjacency matrix is ​​constructed, and the second directed graph adjacency matrix is ​​used as the first group association topology matrix. In Table 4, 0 values ​​are represented by spaces.

[0091] Table 4. Association Topology Matrix of the First Group

[0092] Answer Key b1 b2 b3 b1 1 1 b2 b3

[0093] In one embodiment, step 240 specifically includes the following steps: constructing a second component type matrix based on the second component information; constructing a second group content matrix based on the second group information; constructing a second component association topology matrix based on the second component association information; and constructing a second group association topology matrix based on the second group association information.

[0094] The second component information includes the component's type number. The second grouping information includes the group name and the type number of the components within each group. The second component association information includes the component's type number and the association relationships between components. The second group association information includes the group name and the association relationships between groups.

[0095] In one embodiment, the type numbers of each component are arranged sequentially according to a third preset order to form a second component type matrix.

[0096] The third preset order can be a sequential order, a reverse order, or another order; this embodiment does not impose any restrictions. Specifically, the type number of each component is arranged sequentially below the corresponding preset component type number according to the third preset order to form a second component type matrix. For example, as shown in Table 5, the preset component type numbers include a1 to a8. The component type numbers a1, a2, a4, and a8 are arranged sequentially below the corresponding preset component type numbers to form the second component type matrix.

[0097] Table 5 Second Component Type Matrix

[0098] Alternative component types a1 a2 a3 a4 a5 a6 a7 a8 Test Answer Component Types a1 a2 a4 a8

[0099] Arrange the names of each group sequentially, and then arrange the type numbers of all components in each group in the fourth preset order below the group to form the second group content matrix.

[0100] The fourth preset order can be a sequential order, a reverse order, or another order; this embodiment does not impose any restrictions. The third preset order and the fourth preset order can be the same or different; this embodiment does not impose any restrictions.

[0101] Specifically, as shown in Table 6, group names b1, b2, and b3 are arranged in sequence, and component type numbers a1 and a2 are arranged in sequence below group name b1, component type number a4 is arranged below group name b2, and component type number a8 is arranged below group name b3, forming the second group content matrix.

[0102] Table 6. Content Matrix of the Second Group

[0103]

[0104] Using the component type number as the vertex and the association relationship between components as the edge, construct a third directed graph adjacency matrix, and use the third directed graph adjacency matrix as the second component association topology matrix.

[0105] Specifically, as shown in Table 7, the component type numbers a1, a2, a4, and a8 are used as vertices, and the relationships between components a1 and a2, a1 and a4, a2 and a4, and a4 and a8 are used as edges to construct a third directed graph adjacency matrix. This third directed graph adjacency matrix is ​​then used as the second component association topology matrix. In Table 7, 0 values ​​are represented by spaces.

[0106] Table 7. Association Topology Matrix of the Second Component

[0107] Answer Key a1 a2 a4 a8 a1 1 1 a2 1 a4 1 a8

[0108] Using the names of the groups as vertices and the relationships between groups as edges, construct a fourth directed graph adjacency matrix, and use the fourth directed graph adjacency matrix as the second group association topology matrix.

[0109] Specifically, as shown in Table 8, the names of groups b1, b2, and b3 are used as vertices, and the relationships between groups b1 and b2, and between groups b2 and b3 are used as edges. A fourth directed graph adjacency matrix is ​​constructed, and the fourth directed graph adjacency matrix is ​​used as the second group association topology matrix. In Table 8, 0 values ​​are represented by spaces.

[0110] Table 8. Association Topology Matrix of the Second Group

[0111]

[0112]

[0113] In one embodiment, Figure 5 This is a schematic diagram of a process for determining a candidate's score in one embodiment. The process includes the following steps:

[0114] Step 510: Compare the first component type matrix and the second component type matrix to obtain the component type comparison result.

[0115] It should be noted that the first component type matrix and the second component type matrix can be compared directly, or they can be concatenated before comparison; this application does not impose any restrictions. For example, as shown in Table 9, the first component type matrix and the second component type matrix can be concatenated to clearly compare their differences.

[0116] Table 9. Matrix of splicing component types

[0117] Alternative component types a1 a2 a3 a4 a5 a6 a7 a8 Test Answer Component Types a1 a2 a4 a8 Candidate answer component types a1 a3 a4 a8

[0118] Step 520: Compare the first group content matrix and the second group content matrix to obtain the group content comparison result.

[0119] It should be noted that the first group content matrix and the second group content matrix can be compared directly, or they can be concatenated before comparison; this application does not impose any restrictions. For example, as shown in Table 10, the first group content matrix and the second group content matrix can be concatenated to clearly compare their differences.

[0120] Table 10. Matrix of Grouped Content

[0121]

[0122] Step 530: Compare the first component association topology matrix and the second component association topology matrix to obtain the component association comparison result.

[0123] It should be noted that the association topology matrix of the first component and the association topology matrix of the second component can be directly compared, or they can be concatenated before comparison; this application does not impose any restrictions. For example, as shown in Table 11, the association topology matrix of the first component and the association topology matrix of the second component can be concatenated, thereby clearly showing the differences between them.

[0124] Table 11. Topology Matrix of Splicing Components

[0125] Candidate's Answer a1 a3 a4 a8 a1 1 1 a3 1 a4 1 a8 Answer Key a1 a2 a4 a8 a1 1 1 a2 1 a4 1 a8

[0126] Step 540: Compare the first group association topology matrix and the second group association topology matrix to obtain the group association comparison result.

[0127] It should be noted that the first group association topology matrix and the second group association topology matrix can be directly compared, or they can be concatenated before comparison; this application does not impose any restrictions. For example, as shown in Table 12, the first group association topology matrix and the second group association topology matrix can be concatenated, thereby clearly showing the differences between them.

[0128] Table 12. Associative Topology Matrix of Grouping and Concatenation

[0129] Answer Key b1 b2 b3 b1 1 1 b2 b3 Candidate's Answer b1 b2 b3 b1 1 b2 1 b3

[0130] Figure 6 This is a schematic diagram of the association topology graph between candidate answers and test question answers in one embodiment, such as... Figure 6 As shown, the association topology matrix of the splicing components shown in Table 11 and the association topology matrix of the splicing group shown in Table 12 can be used to draw the association topology diagram of the candidate's answer and the test question answer. This makes it clearer to see the difference between the candidate's answer data and the test question answer data, thereby accurately determining the candidate's answer score and improving the accuracy of automatic marking.

[0131] Step 550: Determine the candidate's score based on the component type comparison results, group content comparison results, component association comparison results, and group association comparison results.

[0132] This application also provides a specific embodiment applied to an online examination system, including the following steps:

[0133] Step 1: Obtain candidate's answer data and test question answer data; parse and process the candidate's answer data to extract the first key information of each part of the candidate's flowchart; the first key information includes the first component information, first group information, first component association information, and first group association information of the candidate's flowchart; the first component information includes the component type number; the first group information includes the group name and the type number of the components in each group; the first component association information includes the component type number and the association relationship between components; the first group association information includes the group name and the association relationship between groups.

[0134] Step 2: Arrange the type numbers of each component in a first preset order to form a first component type matrix; arrange the names of each group in a first preset order, and arrange the type numbers of all components in each group in a second preset order below the group to form a first group content matrix; construct a first directed graph adjacency matrix using the component type numbers as vertices and the relationships between components as edges, and use the first directed graph adjacency matrix as the first component association topology matrix; construct a second directed graph adjacency matrix using the group names as vertices and the relationships between groups as edges, and use the second directed graph adjacency matrix as the first group association topology matrix.

[0135] Step 3: Analyze the test answer data to extract the second key information of each part of the test answer flowchart; the second key information includes the second component information, the second grouping information, the second component association information, and the second grouping association information in the test answer flowchart.

[0136] Step 4: Construct a second component type matrix based on the second component information; construct a second group content matrix based on the second group information; construct a second component association topology matrix based on the second component association information; construct a second group association topology matrix based on the second group association information.

[0137] Step 5: Compare the first component type matrix and the second component type matrix to obtain the component type comparison result; compare the first group content matrix and the second group content matrix to obtain the group content comparison result; compare the first component association topology matrix and the second component association topology matrix to obtain the component association comparison result; compare the first group association topology matrix and the second group association topology matrix to obtain the group association comparison result; based on the component type comparison result, the group content comparison result, the component association comparison result, and the group association comparison result, determine the candidate's answer score.

[0138] The automatic grading method for operation questions based on flowchart design provided in this application transforms subjective flowchart-designed operation questions into objective questions that are easier to grade automatically. It relies on graph theory support without the need for complex artificial intelligence algorithm design, huge arithmetic support, and tedious mathematical calculations. The method is simple to operate and easy to implement, making the various stages of candidate answering, data saving, and post-exam grading more coherent and convenient. It eliminates the need for third-party flowchart software and manual grading, thus saving labor costs.

[0139] It should be understood that although the steps in the flowcharts of the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0140] In one embodiment, this application also provides an online examination system based on flowchart design. Figure 7 Here is a structural block diagram of an online examination system in one embodiment, such as... Figure 7 As shown, the online examination system 100 includes an online answering subsystem 10 and an automatic grading subsystem 20, wherein: the online answering subsystem 10 is used for candidates to design flowcharts online and to store candidates' answer data.

[0141] The automatic marking subsystem 20 is connected to the online answering subsystem 10 to obtain candidate answer data and test question answer data; construct a first matrix based on candidate answer data and a second matrix based on test question answer data; compare the first matrix and the second matrix, and determine the candidate's answer score based on the comparison result.

[0142] In one embodiment, the online answering subsystem 10 includes: a component editing module 11, a component grouping module 12, an association creation module 13, and a data storage module 14, wherein:

[0143] The component editing module 11 is used to add, delete, and modify component attributes. The component grouping module 12 is used to create, delete, and modify group attributes. The relationship creation module 13 is used to create relationships between components, between components and groups, and between groups, and to modify relationship attributes. The data storage module 14 is used to store examinee answer data.

[0144] The component attribute information includes, but is not limited to, the component's type name, size, position information, content, color, number of connection points, and distribution method. Users can modify the component size by dragging the component or by entering the target component size. This embodiment does not impose any restrictions.

[0145] Modifying group attribute information includes, but is not limited to, the group's size, range, color, border, and type name. Similarly, users can also modify the group size by dragging the group or entering the target group size. This embodiment does not impose any restrictions.

[0146] The relationship attribute information includes, but is not limited to, the name, size, color, and orientation information of the relationship.

[0147] In one embodiment, the component editing module 11 is further configured to manage components and create component instances. The component grouping module 12 is further configured to manage groups and create group instances. The association creation module 13 is further configured to manage associations and create association instances.

[0148] Furthermore, the online answering subsystem 10 contains many classes that are abstractions of objects within the system, such as the Editor, Component, Relationship, Utilities, and Group classes. The Editor class implements component management, component association, and component grouping functionalities. The Component class implements component creation and instantiation functionalities. The Group class implements group creation and instantiation functionalities. The Relationship class implements relationship creation and instantiation functionalities. The Utilities class implements basic parameter configuration and interface refresh functionalities.

[0149] Furthermore, the candidate's answer data is stored in the data storage module 14 in a preset data format. The preset data format can be JSON format or other data formats, and this embodiment does not impose any restrictions.

[0150] In one embodiment, Figure 8Here is a flowchart of the operation of the online response subsystem in one embodiment, such as... Figure 8 As shown, after the candidate begins answering the question, they can select appropriate components from the component selection bar and drag them to the design panel, and edit the component information; select multiple components to build groups and edit the group content; build the relationship between two groups and edit the group relationship information; build the relationship between two components and edit the component relationship information; after completing the answer, save the flowchart and submit the drawn flowchart to the automatic marking subsystem 20.

[0151] Specifically, the component selection bar on the side offers dozens of different components for candidates to choose from. Drag and drop the selected component onto the design panel to complete its drawing. After dragging out a component, clicking on it allows you to edit the properties panel on the right, modifying its size, color, border, text, and other component attributes, or to complete your answer. Selecting one or more components and clicking the group button will group the selected components into a single group. Clicking on a group allows you to edit the properties panel on the right, modifying the group's size, color, border, text, and other group attributes.

[0152] When there are two or more components, you can click the connection point surrounding one component and drag it to the connection point of another component to establish the component relationship. If there are not two or more components, you need to add more components. Clicking the line corresponding to the component relationship allows you to edit the properties panel on the right to modify the line color, style, text, and other relationship attributes, or to create a new component or complete the answer.

[0153] When there are two or more groups, you can click the connection point around the group and drag the connection point to other group connection points to complete the group association. If there are no more than two groups, you need to continue creating groups. Clicking the line corresponding to the group association allows you to edit the properties panel on the right to modify the line's color, style, text, and other association attribute information, or create a new component or complete the answer.

[0154] In one embodiment, the automatic marking subsystem 20 includes a data parsing module 21 and a matrix construction module 22, wherein: the data parsing module 21 is used to parse and process the candidate's answer data to extract the first key information of each part of the candidate's flowchart; and to parse and process the test question answer data to extract the second key information of each part of the test question answer flowchart.

[0155] The matrix construction module 22 is used to construct a first matrix based on the first key information; the first key information includes the first component information, the first group information, the first component association information, and the first group association information in the flowchart drawn by the examinee; and to construct a second matrix based on the second key information; the second key information includes the second component information, the second group information, the second component association information, and the second group association information in the flowchart of the test answer.

[0156] In one embodiment, Figure 9 Here is a structural block diagram of the matrix construction module in one embodiment, such as Figure 9 As shown, the matrix construction module 22 includes a component type matrix construction unit 221, a group content matrix construction unit 222, a component association matrix construction unit 223, and a group association matrix construction unit 224, wherein:

[0157] The component type matrix construction unit 221 is used to construct a first component type matrix based on the first component information; the first component information includes the type number of the component.

[0158] The group content matrix construction unit 222 is used to construct a first group content matrix based on the first group information; the first group information includes the name of the group and the type number of the component in each group.

[0159] The component association matrix construction unit 223 is used to construct a first component association topology matrix based on the first component association information; the first component association information includes the component type number and the association relationship between components.

[0160] The group association matrix construction unit 224 is used to construct a first group association topology matrix based on the first group association information; the first group association information includes the name of the group and the association relationship between the groups.

[0161] In one embodiment, the component type matrix construction unit 221 is further configured to arrange the type number of each component in a first preset order to form a first component type matrix.

[0162] The group content matrix construction unit 222 is also used to arrange the names of each group sequentially, and to arrange the type numbers of all components in each group in a second preset order below the group to form a first group content matrix.

[0163] The component association matrix construction unit 223 is also used to construct a first directed graph adjacency matrix using the component type number as the vertex and the association relationship between components as the edge, and to use the first directed graph adjacency matrix as the first component association topology matrix.

[0164] The group association matrix construction unit 224 is also used to construct a second directed graph adjacency matrix with the group name as the vertex and the association relationship between groups as the edge, and to use the second directed graph adjacency matrix as the first group association topology matrix.

[0165] In one embodiment, the component type matrix construction unit 221 is further configured to construct a second component type matrix based on the second component information. The group content matrix construction unit 222 is further configured to construct a second group content matrix based on the second group information. The component association matrix construction unit 223 is further configured to construct a second component association topology matrix based on the second component association information. The group association matrix construction unit 224 is further configured to construct a second group association topology matrix based on the second group association information.

[0166] In one embodiment, the automatic marking subsystem 20 further includes a matrix comparison module 23, which includes a first comparison unit, a second comparison unit, a third comparison unit, a fourth comparison unit, and a score determination unit, wherein:

[0167] The first comparison unit is used to compare the first component type matrix and the second component type matrix to obtain the component type comparison result. The second comparison unit is used to compare the first group content matrix and the second group content matrix to obtain the group content comparison result.

[0168] The third comparison unit is used to compare the first component association topology matrix and the second component association topology matrix to obtain the component association comparison result. The fourth comparison unit is used to compare the first group association topology matrix and the second group association topology matrix to obtain the group association comparison result.

[0169] The score determination unit is used to determine the candidate's score based on the component type comparison results, group content comparison results, component association comparison results, and group association comparison results.

[0170] The online examination system 100 based on flowchart design provided in this application allows candidates to answer flowchart design operation questions in the form of an embedded page or examination software. Like other examination questions, candidates can complete the flowchart design operation questions without leaving the browser, examination software, or other candidate answering interface, expanding the range of questions that can be implemented in computer-based examinations and enabling online examinations to test flowchart-related knowledge. Furthermore, candidate answer data is saved and transmitted in a formatted data format, effectively ensuring data security under an encrypted link. Compared to saving candidate-drawn flowcharts as images for submission, there is no issue of reduced resolution due to image compression, and no problem of incomplete or unopenable files when saving candidate-drawn flowcharts as files. It also eliminates the need to use other flowchart software to reopen the files for manual grading. The candidate answer data in this application is formatted data that can be directly read by the automatic grading subsystem 20 for automated grading without manual intervention, making it convenient and efficient.

[0171] The online examination system based on flowchart design provided in this application transforms subjective flowchart-based operational questions into objective questions that are easier to score automatically in terms of data organization and submission. Relying on the theoretical support of graph theory, it does not require complex artificial intelligence algorithm design, huge arithmetic support, or tedious mathematical calculations. It is simple to operate and easy to implement, making the various stages of candidate answering, data saving, and post-exam scoring more coherent and convenient, without the need for third-party flowchart software or manual scoring.

[0172] Based on the same inventive concept, this application also provides a flowchart-based automatic grading device for implementing the flowchart-based automatic grading method for operational questions as described above. The solution provided by this device is similar to the solution described in the above method; therefore, the specific limitations of one or more flowchart-based automatic grading device embodiments provided below can be found in the limitations of the flowchart-based automatic grading method for operational questions described above, and will not be repeated here.

[0173] In one embodiment, an automated marking device based on a flowchart design is provided, comprising: a data acquisition module, a matrix construction module 22, and a score determination module, wherein:

[0174] The data acquisition module is used to acquire candidate answer data and test question answer data.

[0175] Matrix construction module 22 is used to construct a first matrix based on the candidate's answer data and a second matrix based on the test question answer data.

[0176] The score determination module is used to compare the first matrix and the second matrix and determine the candidate's score based on the comparison result.

[0177] In one embodiment, the matrix construction module 22 is further configured to parse and process the candidate's answer data to extract first key information of each part of the candidate's flowchart; parse and process the test question answer data to extract second key information of each part of the test question answer flowchart; construct a first matrix based on the first key information; the first key information includes first component information, first grouping information, first component association information, and first group association information in the candidate's flowchart; and construct a second matrix based on the second key information; the second key information includes second component information, second grouping information, second component association information, and second group association information in the test question answer flowchart.

[0178] In one embodiment, the matrix construction module 22 is further configured to construct a first component type matrix based on first component information; the first component information includes the component type number; construct a first group content matrix based on first group information; the first group information includes the group name and the component type number in each group; construct a first component association topology matrix based on first component association information; the first component association information includes the component type number and the association relationship between components; construct a first group association topology matrix based on first group association information; the first group association information includes the group name and the association relationship between groups.

[0179] In one embodiment, the matrix construction module 22 is further configured to: arrange the type numbers of each component in a first preset order to form a first component type matrix; arrange the names of each group in a first preset order and arrange the type numbers of all components in each group in a second preset order below the group to form a first group content matrix; construct a first directed graph adjacency matrix using the component type numbers as vertices and the association relationships between components as edges, and use the first directed graph adjacency matrix as the first component association topology matrix; construct a second directed graph adjacency matrix using the group names as vertices and the association relationships between groups as edges, and use the second directed graph adjacency matrix as the first group association topology matrix.

[0180] In one embodiment, the matrix construction module 22 is further configured to construct a second component type matrix based on the second component information; construct a second group content matrix based on the second group information; construct a second component association topology matrix based on the second component association information; and construct a second group association topology matrix based on the second group association information.

[0181] In one embodiment, the score determination module is further configured to compare the first component type matrix and the second component type matrix to obtain a component type comparison result; compare the first group content matrix and the second group content matrix to obtain a group content comparison result; compare the first component association topology matrix and the second component association topology matrix to obtain a component association comparison result; compare the first group association topology matrix and the second group association topology matrix to obtain a group association comparison result; and determine the examinee's answer score based on the component type comparison result, the group content comparison result, the component association comparison result, and the group association comparison result.

[0182] The modules in the flowchart-based automated marking device described above can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the computer device's memory as software, so that the processor can call and execute the corresponding operations of each module.

[0183] In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 10 As shown, the computer device includes a processor, memory, and a network interface connected via a system bus. The processor provides computational and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database stores student answer data and test question answer data. The network interface communicates with external terminals via a network connection. When executed by the processor, the computer program implements a flowchart-based automatic grading method for operational questions.

[0184] Those skilled in the art will understand that Figure 10 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0185] In one embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above method embodiments.

[0186] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above method embodiments.

[0187] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0188] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0189] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0190] The above embodiments are merely illustrative of several implementation methods of this application, and their descriptions are relatively specific and detailed. However, they should not be construed as limiting the scope of this application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. An automatic grading method for operation questions based on flowchart design, characterized in that, The method includes: Obtain test-taker response data and test question answer data; Constructing a first matrix based on the candidate's answer data and a second matrix based on the test question answer data includes: parsing the candidate's answer data to extract first key information of each part of the candidate's flowchart; parsing the test question answer data to extract second key information of each part of the test question answer flowchart; constructing the first matrix based on the first key information; the first key information includes first component information, first grouping information, first component association information, and first group association information in the candidate's flowchart; constructing the second matrix based on the second key information; the second key information includes second component information, second grouping information, second component association information, and second group association information in the test question answer flowchart. The first matrix and the second matrix are compared, and the candidate's score is determined based on the comparison result; The step of constructing the first matrix based on the first key information includes: A first component type matrix is ​​constructed based on the first component information; the first component information includes the component type number; A first group content matrix is ​​constructed based on the first group information; the first group information includes the name of the group and the type number of the component in each group; A first component association topology matrix is ​​constructed based on the first component association information; the first component association information includes the component type number and the association relationship between components. A first group association topology matrix is ​​constructed based on the first group association information; the first group association information includes the name of the group and the association relationship between the groups. The step of constructing the first matrix based on the first key information includes: The type numbers of each component are arranged in a first preset order to form the first component type matrix; The names of each group are arranged sequentially, and the type numbers of all components in each group are arranged sequentially below the group according to a second preset order to form the first group content matrix; Using the component type number as the vertex and the association relationship between components as the edge, a first directed graph adjacency matrix is ​​constructed, and the first directed graph adjacency matrix is ​​used as the first component association topology matrix; Using the names of the groups as vertices and the relationships between groups as edges, a second directed graph adjacency matrix is ​​constructed, and this second directed graph adjacency matrix is ​​used as the first group association topology matrix.

2. The method according to claim 1, characterized in that, The step of constructing the second matrix based on the second key information includes: Construct a second component type matrix based on the second component information; Construct a second group content matrix based on the second group information; Construct a second component association topology matrix based on the association information of the second component; A second group association topology matrix is ​​constructed based on the second group association information.

3. An online examination system based on flowchart design, characterized in that, The system includes an online answering subsystem and an automatic grading system, wherein: the online answering subsystem is used for candidates to design flowcharts online and to store candidates' answer data; The online answering subsystem includes: a component editing module, a component grouping module, a relationship creation module, and a data storage module. The component editing module is used to add, delete, and modify component attribute information. The component grouping module is used to create, delete, and modify group attribute information. The relationship creation module is used to create relationships between components, between components and groups, and between groups, and to modify relationship attribute information. The data storage module is used to store examinee answering data. The automatic marking subsystem is connected to the online answering subsystem and is used to acquire candidate answer data and test question answer data; construct a first matrix based on the candidate answer data and a second matrix based on the test question answer data; compare the first matrix and the second matrix, and determine the candidate's answer score based on the comparison result; The automatic marking system includes a data parsing module and a matrix construction module, wherein: The data parsing module is used to parse and process the candidate's answer data to extract the first key information of each part of the candidate's flowchart; and to parse and process the test question answer data to extract the second key information of each part of the test question answer flowchart. The matrix construction module is used to construct the first matrix based on the first key information; the first key information includes the first component information, the first grouping information, the first component association information, and the first group association information in the candidate's drawing flowchart; the second matrix is ​​constructed based on the second key information; the second key information includes the second component information, the second grouping information, the second component association information, and the second group association information in the test question answer flowchart; The matrix construction module includes a component type matrix construction unit, a group content matrix construction unit, a component association matrix construction unit, and a group association matrix construction unit, wherein: The component type matrix construction unit is used to construct a first component type matrix based on the first component information; the first component information includes the component type number. The group content matrix construction unit is used to construct a first group content matrix based on the first group information; the first group information includes the name of the group and the type number of the component in each group. The component association matrix construction unit is used to construct a first component association topology matrix based on the first component association information; the first component association information includes the component type number and the association relationship between components. The group association matrix construction unit is used to construct a first group association topology matrix based on the first group association information; the first group association information includes the name of the group and the association relationship between the groups. The component type matrix construction unit is also used to arrange the type number of each component in a first preset order to form the first component type matrix; The group content matrix construction unit is also used to arrange the names of each group sequentially, and to arrange the type numbers of all components in each group in a second preset order below the group to form the first group content matrix; The component association matrix construction unit is further configured to construct a first directed graph adjacency matrix using the component type number as the vertex and the association relationship between components as the edge, and use the first directed graph adjacency matrix as the first component association topology matrix; The group association matrix construction unit is further configured to construct a second directed graph adjacency matrix using the group name as a vertex and the association relationship between groups as an edge, and use the second directed graph adjacency matrix as the first group association topology matrix.

Images