A method and device for correcting table-type questions in a certified public accountant examination

Abstract

The application discloses a method and device for correcting table type questions in CPA (Certified Public Accountant) examination, and relates to the online education technical field.The method comprises the following steps: obtaining the stem information of the table type questions and the answer information corresponding to the stem information; analyzing the answer information according to the stem information to obtain the answer analysis information of multiple table cells; and correcting according to the answer analysis information.The application is designed according to the overall characteristics of the table type questions in the CPA examination, and can effectively analyze the complex, coded, special operation defined mathematical formula and the answer containing the CPA examination specific professional terms in the student answer table, and then compare and match each text content or numerical content in the user answer with the content or numerical value in the reference answer, and obtain the student answer score and the correction result.The application simplifies the correction process, and can stably, accurately and automatically correct the answer efficiently.

Description

Technical Field

[0001] This invention relates to the field of online education technology, specifically to a method and apparatus for grading table-type questions in the Certified Public Accountant (CPA) exam. Background Technology

[0002] With the development of modern information technology and the demands of the education market, automated grading, as an emerging technology, is being increasingly promoted and popularized. Automated grading brings great convenience to teachers and students. Compared with manual grading, the process is simpler, efficiency is greatly improved, and accuracy is stable, saving human, material, and educational resources. However, existing automated grading solutions for table-type questions are not specifically designed for the areas covered in the Chinese Certified Public Accountants (CPA) qualification examination (hereinafter referred to as the CPA exam) organized by the Chinese Institute of Certified Public Accountants, and therefore cannot effectively grade table-type questions in the CPA exam. The CPA exam contains a large number of tables in various subjects, concentrated in Financial Cost Management (hereinafter referred to as Financial Management) and Auditing, with the Financial Management subject having the most complex tables.

[0003] The existing technology and its disadvantages are as follows:

[0004] 1. Existing methods assume that the coordinates of the student's answer table and the standard answer table are aligned one-to-one. This fails to address scenarios where students fill in the table in random order, freely selecting rows and columns. They can only handle simple tables with the same order and coordinates. However, in the CPA exam's financial management subject, a single table often contains multiple out-of-order tables requiring grading, and students frequently split or merge rows or columns. Therefore, existing table grading methods cannot specifically address this situation.

[0005] 2. Existing methods do not consider the rich text formulas widely used in CPA exam system grading. The CPA exam is a computer-based exam, and the answer area provides a formula editor for students to input complex financial and mathematical formulas. Formulas entered through the editor are encoded in LaTeX format, and web-based answers may also contain HTML and CSS code. Existing grading schemes are not specifically designed for the rich text formulas in the CPA exam system, and therefore cannot effectively parse calculation formulas with LaTeX encoding and HTML / CSS formatting.

[0006] Existing methods lack specific design for the unique terminology used in the CPA exam, cannot distinguish between different professional terms, and can only handle general vocabulary, failing to provide targeted correction for the professional terms involved in the CPA exam. This invention achieves targeted correction of professional terms by collecting, classifying, and compiling a CPA professional vocabulary list.

[0007] In summary, the purpose of this invention is to solve the problem of how to reliably and efficiently grade the complex and unique table-based questions submitted by students while ensuring accuracy. Summary of the Invention

[0008] To address the shortcomings of existing technologies, this invention provides a method and apparatus for grading tabular questions in the Certified Public Accountant (CPA) examination.

[0009] On the one hand, a method for grading table-type questions in the Certified Public Accountant (CPA) exam, the method including:

[0010] Obtain the question stem information and the corresponding answer information for the table-type questions, wherein the question stem information is used to indicate the subject and question number of the table-type questions;

[0011] The answer information is parsed based on the question information to obtain answer parsing information for multiple table cells. The answer parsing information includes the grading interval where the cell is located, the row and column coordinates of the cell, the cell type, and the cell content.

[0012] The answers will be graded based on the provided explanation.

[0013] Preferably, the method for parsing the answer information based on the question stem information to obtain the answer parsing information includes:

[0014] The answer information is mapped to the corresponding grading interval based on the question information. The grading interval includes a first grading interval and a second grading interval. The first grading interval includes a non-random grading interval, and the second grading interval includes a non-random grading interval and a random grading interval.

[0015] The system analyzes all cells in the grading area to obtain the answer analysis information.

[0016] Preferably, the grid type includes text-based tables and numerical tables, and the table content includes text content and numerical content.

[0017] Preferably, the method for grading based on the answer parsing information includes:

[0018] When the grading interval of the cell is not a random grading interval, the reference answer corresponding to the row and column coordinates of the cell is obtained by using a single comparison grading method. When the grading interval of the cell is a random grading interval, the reference answer corresponding to the row and column coordinates of the cell is obtained by using a specified path comparison grading method.

[0019] Based on the grid type, grid content, and reference content of the grid, the grid is corrected using a preset correction model.

[0020] Preferably, the method for correcting the grid based on the grid content and reference content using a preset correction model includes:

[0021] Input the text content and reference content of the text-type grid into the text implication model to obtain the association result between the text and the reference content, and determine the score based on the association result;

[0022] Input the numerical values ​​of the numerical cells into the formula to revise the model, obtain the calculation results, and determine the score based on the calculation results.

[0023] Preferably, the method prior to obtaining the question stem information and the corresponding answer information for table-type questions further includes:

[0024] Obtain the question stem information and corresponding reference answer information for all table-type questions in the CPA exam; parse the reference answer information to obtain reference answer analysis information for multiple table cells, including the grading interval of the cell, the row and column coordinates of the cell, the cell type, and the reference content of the cell.

[0025] On the other hand, a grading device for table-type questions in a certified public accountant (CPA) exam includes:

[0026] The acquisition module is used to acquire the question stem information of the table-type questions and the corresponding answer information, wherein the question stem information is used to indicate the subject and question number of the table-type questions;

[0027] The parsing module is used to parse the answer information based on the question stem information to obtain answer parsing information for multiple table cells. The answer parsing information includes the grading interval where the cell is located, the row and column coordinates of the cell, the cell type, and the cell content.

[0028] The grading module is used to grade answers based on the provided answer parsing information.

[0029] Preferably, it further includes:

[0030] The preprocessing module is used to obtain the question stem information of all table-type questions in the CPA exam and the corresponding reference answer information; and to parse the reference answer information to obtain reference answer parsing information for multiple table cells. The reference answer parsing information includes the grading interval where the cell is located, the preset loop path, the row and column coordinates of the cell, the cell type, and the reference content of the cell.

[0031] The beneficial effects of this invention are as follows: This invention, tailored to the overall characteristics of table-based questions in the Certified Public Accountant (CPA) exam, is specifically designed to effectively parse complex, coded mathematical formulas containing special operational definitions and answers with CPA-specific professional terminology from student answer tables. It then compares and matches the textual or numerical content of the student's answer with the content or numerical content of the reference answer to derive the student's score and grading result. This simplifies the grading process, providing stable, accurate, and efficient automatic grading of student answers; it saves human and educational resources, provides automatic grading services for CPA exam candidates, and has significant implications for CPA exam education and candidate preparation, offering guidance for educational evaluation. Attached Figure Description

[0032] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. In the drawings, the elements or parts are not necessarily drawn to scale.

[0033] Figure 1 A flowchart illustrating a method for grading tabular questions in a certified public accountant (CPA) exam, provided as an embodiment of the present invention.

[0034] Figure 2 This is the edit page provided in the embodiment of the present invention;

[0035] Figure 3 This is a schematic diagram of a device for grading tabular questions in a certified public accountant (CPA) exam, provided as an embodiment of the present invention. Detailed Implementation

[0036] The embodiments of the technical solution of the present invention will now be described in detail with reference to the accompanying drawings. These embodiments are merely illustrative of the technical solution of the present invention and are therefore intended to limit the scope of protection of the present invention.

[0037] It should be noted that, unless otherwise stated, the technical or scientific terms used in this application should have the ordinary meaning as understood by one of ordinary skill in the art to which this invention pertains.

[0038] Example 1

[0039] refer to Figure 1 , Figure 1 A flowchart illustrating a method for grading tabular questions in a certified public accountant (CPA) exam, provided as an embodiment of the present invention, is shown below. Figure 1 As shown, the method includes:

[0040] Step 1: Obtain the question stem information and the corresponding answer information for the table-type questions. The question stem information is used to indicate the subject and question number of the table-type questions.

[0041] Specifically, the question stem information includes at least one parameter for indicating the subject and question number of the table-type question. The parameter can be A-12 or B-4, representing question 12 of the audit subject and question 4 of the financial cost management subject, respectively. The specific value or form of the parameter is not limited in this embodiment of the invention.

[0042] In this embodiment of the invention, the method prior to obtaining the question stem information of the table-type questions and the corresponding answer information further includes: obtaining the question stem information of all table-type questions in the CPA exam and the corresponding reference answer information; parsing the reference answer information to obtain reference answer parsing information for multiple table cells, wherein the reference answer parsing information includes the grading interval where the cell is located, the row and column coordinates of the cell, the cell type, the reference content of the cell, and the cell score.

[0043] The professional stage of the CPA exam is the most difficult, encompassing six subjects: Accounting, Auditing, Tax Law, Economic Law, Corporate Strategy and Risk Management, and Financial Cost Management, totaling 1473 knowledge points and 9575 exam points. From a database cluster, all past exam papers (Version A and Version B), mock exams, and speed-test questions, along with related information, for the Auditing and Financial Cost Management subjects (which contain table-based questions) from 2010 to 2022 were extracted, analyzed, and broken down. Specifically, multiple sets of reference answer analysis data for each question within the tables were extracted, including information such as the grading interval, cell row and column coordinates, cell type, and cell reference content, and stored in the database for easy retrieval later.

[0044] Step 2: Parse the answer information based on the question stem information to obtain answer parsing information for multiple table cells. The answer parsing information includes the grading interval where the cell is located, the row and column coordinates of the cell, the cell type, and the cell content.

[0045] To facilitate comparison and correction between the reference answers and user answers, the form-type questions submitted by users have also been analyzed.

[0046] In this embodiment of the invention, the method for parsing the answer information based on the question stem information to obtain answer parsing information includes: mapping the answer information to a corresponding grading interval based on the question stem information, wherein the grading interval includes a first grading interval and a second grading interval, wherein the first grading interval includes a non-randomized grading interval, and the second grading interval includes a non-randomized grading interval and a randomized grading interval; and parsing all the table cells in the grading interval to obtain the answer parsing information.

[0047] The question stem information indicates the subject and question number, determining the corresponding grading interval. Specifically, the grading interval for table-type questions in the Audit subject is the first grading interval, meaning there are no cases of merging or splitting. However, the grading interval for table-type questions in the Financial Cost Management subject is the second grading interval, meaning there may be cases of merging or splitting, as follows: Figure 2 As shown, the answer information (answer form) for the financial cost management subject can be divided into multiple grading areas. In grading areas 1 and 3, each row can be interchanged, and the subjects can be merged or split depending on the specific subject to be filled in. In grading areas 2 and 4, the subjects in each row are pre-set in the question, so they cannot be merged, split, or interchanged, and the content to be filled in is fixed.

[0048] Therefore, each answer information can be parsed into multiple grid answer parsing information such as the grading interval, grid row and column coordinates, grid type, and grid content, making it convenient to quickly retrieve the corresponding reference answer parsing information for comparison and grading.

[0049] It should be noted that the grid type includes text tables and numerical tables, and the table content includes text content and numerical content.

[0050] Step 3: Correct the answers based on the provided answer analysis information.

[0051] Specifically, for grids located in non-randomized grading intervals, a single comparison grading method is used to obtain the reference answer corresponding to the row and column coordinates of the grid. For grids located in randomized grading intervals, a specified path comparison grading method is used to obtain the reference answer corresponding to the row and column coordinates of the grid. Based on the grid type, grid content, and reference content of the grid, a preset grading model is used to grade the grid.

[0052] Since the grading intervals for the tabular questions in the audit subjects are all non-random grading intervals, the grading methods corresponding to the non-random grading intervals mentioned above are used for grading the tabular questions in the audit subjects. Since the grading intervals for the financial cost management subjects include both random and non-random grading intervals, the grading methods corresponding to both random and non-random grading intervals mentioned above are used for grading the tabular questions in the financial cost management subjects.

[0053] Specifically, the single comparison grading method involves comparing and grading based on the same grid row and column coordinates and grid type to obtain the score for a single grid. This process is repeated to obtain the scores for all grids, thus completing the grading of the audit subject table and the grading of the non-randomized grading intervals of table-type questions in the financial cost management subject. The specified path comparison grading method involves following a preset loop path (the preset loop path is used to indicate the merging and splitting situation and the order of answer filling). Comparison grading is performed according to all preset loop paths to obtain multiple results (scores) corresponding to the randomized grading intervals. The optimal result is selected as the score for that interval, thus completing the grading of the randomized grading intervals in the financial cost management subject.

[0054] Preferably, the method for grading the grid based on the grid content and reference content using a preset grading model includes: inputting the text content and reference content of text-type grids into a text implication model to obtain the association result between the text and the reference content, and determining the score based on the association result; inputting the numerical content of numerical-type grids into a formula grading model to obtain the calculation result, and determining the score based on the calculation result.

[0055] Specifically, the textual implication model works by comparing and labeling a large number of answers to be graded with the standard answers to obtain a training dataset. This dataset includes text content (answers to be graded), reference content (standard answers), and labels indicating the relevance of the text content to the reference content (1 for relevance, 2 for irrelevance). The grading model is pre-trained using this labeled dataset to obtain the textual implication model. The method for grading text-based tables using the textual implication model is as follows: the model identifies the correlation between the answers to be graded and the standard answers; if they are relevant, points are awarded; otherwise, no points are awarded. The textual implication model can effectively identify answers containing technical terminology in the CPA exam, improving grading accuracy.

[0056] Specifically, the formula parsing and grading model: This model is based on the calculations and numerical designs that may appear in the CPA exam. It can parse and calculate the results of formula-based numerical text. The method of grading numerical tables using the formula parsing and grading model is as follows: The model parses the numerical content (answers to be graded) to obtain the calculation results, compares the calculation results of the answers to be graded with the standard answers. If they match, a score is given; otherwise, no score is given. The formula parsing and grading model can effectively parse complex, coded mathematical formulas with special operational definitions in students' answer tables, further improving the accuracy of grading.

[0057] In summary, this invention, tailored to the characteristics of table-based questions in the CPA exam, is specifically designed to effectively parse complex, coded mathematical formulas containing special operational definitions and answers with CPA-specific terminology from student answer tables. It then compares and matches the textual or numerical content of the student's answer with the content or values ​​in the reference answer to derive the student's score and grading result. This simplifies the grading process, providing stable, accurate, and efficient automatic grading of student answers; it saves human and educational resources, offering automated grading services for CPA exam candidates, and has significant implications for CPA exam education and candidate preparation, providing guidance for educational evaluation.

[0058] Example 2

[0059] refer to Figure 3 , Figure 3 This invention provides a schematic diagram of a grading device for tabular questions in a certified public accountant (CPA) exam. The system includes:

[0060] The acquisition module is used to acquire the question stem information of the table-type questions and the corresponding answer information, wherein the question stem information is used to indicate the subject and question number of the table-type questions;

[0061] The parsing module is used to parse the answer information based on the question stem information to obtain answer parsing information for multiple table cells. The answer parsing information includes the grading interval where the cell is located, the row and column coordinates of the cell, the cell type, and the cell content.

[0062] The grading module is used to grade answers based on the provided answer parsing information.

[0063] In a preferred embodiment, the system further includes:

[0064] The preprocessing module is used to obtain the question stem information of all table-type questions in the CPA exam and the corresponding reference answer information; and to parse the reference answer information to obtain reference answer parsing information for multiple table cells. The reference answer parsing information includes the grading interval where the cell is located, the preset loop path, the row and column coordinates of the cell, the cell type, and the reference content of the cell.

[0065] The grading device for table-type questions in the CPA exam provided in this embodiment of the invention and the grading method for table-type questions in the CPA exam provided in the above embodiment are based on the same inventive concept. For more specific working principles of each module in this embodiment of the invention, please refer to the above embodiment, which will not be repeated in this embodiment of the invention.

[0066] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention, and they should all be covered within the scope of the claims and specification of the present invention.

Claims

1. A method for grading table-type questions in the Certified Public Accountant (CPA) exam, characterized in that... The method includes: Obtain the question stem information and corresponding reference answer information for all table-type questions in the Certified Public Accountant (CPA) exam; parse the reference answer information to obtain reference answer analysis information for multiple table cells, including the grading interval of the cell, the row and column coordinates of the cell, the cell type, the reference content of the cell, and the cell score; Obtain the question stem information and the corresponding answer information for the table-type questions. The question stem information is used to indicate the subject and question number of the table-type questions, and the answer information is the user's answer. The answer information is parsed based on the question stem information to obtain answer parsing information for multiple table cells. The answer parsing information includes the grading interval where the cell is located, the row and column coordinates of the cell, the cell type, and the cell content. The grading interval is a grading unit divided according to the characteristics of table questions in different subjects of the Chinese Certified Public Accountant Qualification Examination. Based on the subject and question number indicated by the question stem information, the corresponding question grading interval division rules preset in the database are matched to map the candidate's answer information to the corresponding grading interval. The answers will be graded based on the provided explanations. The method for parsing the answer information based on the question stem information to obtain the answer parsing information includes: mapping the answer information to the corresponding grading interval based on the question stem information, wherein the grading interval includes a first grading interval and a second grading interval, wherein the first grading interval includes a non-randomized grading interval, and the second grading interval includes a non-randomized grading interval and a randomized grading interval; and parsing all the table cells in the grading interval to obtain the answer parsing information. The grid types include text-based tables and numerical tables, and the grid content includes text content and numerical content; The methods for grading based on the answer analysis information include: When the grading interval of the cell is not a random grading interval, the reference answer corresponding to the row and column coordinates of the cell is obtained by using a single comparison grading method. When the grading interval of the cell is a random grading interval, the reference answer corresponding to the row and column coordinates of the cell is obtained by using a specified path comparison grading method. Based on the grid type, grid content, and reference content of the grid, the grid is corrected using a preset correction model.

2. The method for grading table-type questions in the Certified Public Accountant (CPA) exam according to claim 1, characterized in that, The method for correcting the grid based on the grid content and reference content using a preset correction model includes: Input the text content and reference content of the text-type grid into the text implication model to obtain the association result between the text and the reference content, and determine the score based on the association result; Input the numerical values ​​of the numerical cells into the formula to revise the model, obtain the calculation results, and determine the score based on the calculation results.

3. A grading device for table-type questions in the Certified Public Accountant (CPA) examination, characterized in that, include: The acquisition module is used to acquire the question stem information of all table-type questions in the CPA exam and the corresponding reference answer information; The reference answer information is parsed to obtain reference answer parsing information for multiple table cells. The reference answer parsing information includes the grading interval where the cell is located, the row and column coordinates of the cell, the cell type, the reference content of the cell, and the cell score. The question stem information of the table-type questions and the corresponding answer information are obtained. The question stem information is used to indicate the subject and question number of the table-type questions, and the answer information is the user's answer. The parsing module is used to parse the answer information based on the question stem information to obtain answer parsing information for multiple table cells. The answer parsing information includes the grading interval where the cell is located, the row and column coordinates of the cell, the cell type, and the cell content. The grading module is used to grade answers based on the provided answer parsing information. The method for parsing the answer information based on the question stem information to obtain the answer parsing information includes: mapping the answer information to the corresponding grading interval based on the question stem information, wherein the grading interval includes a first grading interval and a second grading interval, wherein the first grading interval includes a non-randomized grading interval, and the second grading interval includes a non-randomized grading interval and a randomized grading interval; and parsing all the table cells in the grading interval to obtain the answer parsing information. The grid types include text-based tables and numerical tables, and the grid content includes text content and numerical content; The method for grading based on the answer parsing information includes: when the grading interval of the cell is a non-random grading interval, a single comparison grading method is used to obtain the reference answer corresponding to the row and column coordinates of the cell; when the grading interval of the cell is a random grading interval, a specified path comparison grading method is used to obtain the reference answer corresponding to the row and column coordinates of the cell; and based on the cell type, cell content, and reference content of the cell, a preset grading model is used to grade the cell.

4. The grading device for tabular questions in the Certified Public Accountant (CPA) examination according to claim 3, characterized in that, Also includes: The preprocessing module is used to obtain the question stem information of all table-type questions in the CPA exam and the corresponding reference answer information; The reference answer information is parsed to obtain reference answer parsing information for multiple table cells. The reference answer parsing information also includes a preset loop path, which is used to indicate the merging and splitting of the disordered grading interval and the answer filling order. The grading is compared and corrected according to all preset loop paths to obtain multiple results corresponding to the disordered grading interval. The optimal result is selected as the score of the disordered grading interval.

Images