A test question knowledge point annotation method and system based on artificial intelligence

Through the multi-solution knowledge point annotation method based on artificial intelligence, combining knowledge point types and argumentation connections, the contribution scores of multiple knowledge points are calculated, and the one-sided problem of single solution annotation is solved, and the comprehensiveness and multi-angleness of knowledge point annotation is realized. Learning perspective promotes the cultivation of students' innovative thinking.

CN118657140BActive Publication Date: 2024-11-08GUANG ZHOU SHI XIAO MA ZHI XUE JI SHU YOU XIAN GONG SI
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411133598.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-19
Publication Date
2024-11-08
Estimated Expiration
2044-08-19

AI Technical Summary

Technical Problem

The existing methods of marking knowledge points in the test questions rely too much on a single solution, neglecting the diversity and complexity of the problems, resulting in the one-sidedness and limitations of marking knowledge points, and limiting the expansion of students' thinking and the cultivation of creativity.

Method used

Using the multi-solution knowledge point annotation method based on artificial intelligence, multiple solution texts are collected, knowledge point contribution analysis is carried out, and the knowledge point contribution scores are calculated to generate multi-solution knowledge. Click the data to be marked, integrate and visually display.

Benefits of technology

It significantly improves the comprehensiveness of knowledge point annotation, captures the unique knowledge points behind different solutions, reveals the inherent connections between knowledge points, promotes the cultivation of critical thinking and innovative abilities, provides data support for educational decision-making, optimizes curriculum design and Teaching strategies.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118657140B_ABST
    Figure CN118657140B_ABST
Patent Text Reader

Abstract

The present invention discloses a method and system for marking test knowledge points based on artificial intelligence, which belongs to the technical field of test knowledge point marking. The method includes: collecting test data to be marked, the test data includes a question text and multiple answer texts; performing knowledge point contribution analysis and processing on multiple answer texts in turn to obtain multiple knowledge point contribution scores; based on the question text, integrating multiple knowledge point contribution scores corresponding to each answer text to obtain multi-solution knowledge point marking data. The present invention significantly improves the comprehensiveness of knowledge point marking by introducing a knowledge point marking strategy of multiple solutions. By analyzing multiple problem-solving strategies, the present invention can not only capture the unique knowledge points behind different solutions, but also reveal the internal connection between knowledge points, provide students with a multi-angle learning perspective, and promote the cultivation of critical thinking and innovation ability.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of exercise annotation, and in particular to a method and system for annotating test question knowledge points based on artificial intelligence. Background Art

[0002] Currently, in the field of educational technology, the annotation of knowledge points in test questions is mainly focused on the analysis of a single solution. Although this approach can provide a more in-depth annotation of knowledge points for a specific problem-solving path, it ignores the diversity and complexity of problem solving. In real educational scenarios, many problems often have multiple solutions, and each solution contains unique knowledge points and ways of thinking. However, the traditional single solution annotation method often only focuses on the most common or most direct way to solve the problem, which leads to the neglect of other potential knowledge points and limits the expansion of students' thinking and the cultivation of creativity. Summary of the invention

[0003] In order to solve at least one of the technical problems raised above, the present invention provides a test question knowledge point labeling method based on artificial intelligence, which significantly improves the comprehensiveness of knowledge point labeling by introducing a knowledge point labeling strategy with multiple solutions.

[0004] In one aspect, the present invention provides a method for labeling test knowledge points based on artificial intelligence, the method comprising:

[0005] Collecting test data to be annotated, the test data including a question text and a plurality of answer texts, each answer text corresponding to a different problem-solving strategy;

[0006] Performing knowledge point contribution analysis on the plurality of answer texts in sequence to obtain a plurality of knowledge point contribution scores;

[0007] Based on the question text, the contribution scores of the multiple knowledge points corresponding to each of the answer texts are integrated to obtain multi-solution knowledge point annotation data.

[0008] Preferably, the step of sequentially performing knowledge point contribution analysis on the plurality of answer texts to obtain a plurality of knowledge point contribution scores includes:

[0009] Performing knowledge point type word segmentation processing on the answer text to obtain multiple knowledge point type text information sets and multiple argumentation connectives;

[0010] Obtaining knowledge point basic weight data from a preset knowledge point type basic contribution weight table, and matching corresponding contribution weights from a preset argumentation connective contribution weight table based on a plurality of the argument connectives to obtain logical contribution weight data;

[0011] Based on the knowledge point basic weight data and the positional relationship between the knowledge point and the argument connective, and according to the logic contribution weight data and the knowledge point type text information set, a knowledge point contribution analysis is performed to obtain a plurality of the knowledge point contribution scores.

[0012] Preferably, the knowledge point contribution analysis is performed based on the knowledge point basic weight data and the positional relationship between the knowledge point and the argument connective, and according to the logical contribution weight data and the knowledge point type text information set to obtain a plurality of the knowledge point contribution scores, including:

[0013] Assume the logical contribution weight data is , the basic weight data of knowledge points is , the knowledge point type text information set is ,in is the number of knowledge point types, knowledge point type The set of distances from all argument connectives ,in To prove the number of conjunctions, Knowledge point type Connective words with argument , then for the first The knowledge point contribution score of each solution It is expressed as follows:

[0014] ,

[0015] ,

[0016] in Knowledge point type The basic weight value of Knowledge point type The contribution score of The basic weight and argument connective influence weight adjustment factor, default is 0.5.

[0017] Preferably, the knowledge point type segmentation processing is performed on the answer text to obtain multiple knowledge point type text information sets and multiple argumentation conjunctions, including:

[0018] Using a word segmentation tool to perform word segmentation processing on the answer text to obtain multiple answer word segmentation data;

[0019] Collect reference knowledge point word segmentation data containing L different knowledge point types, and obtain multiple reference argumentation connectives;

[0020] Integrate the plurality of the answer word segmentation data, the plurality of the reference knowledge point word segmentation data and the plurality of the reference argumentation connectives to obtain a mixed text data set;

[0021] Using K-means algorithm to perform L+1 cluster classification processing on the mixed text data set to obtain L+1 classification cluster data;

[0022] Analyze the distribution of the answer word segmentation data in the L+1 classification cluster data in turn, determine the answer word segmentation data in the classification cluster data containing the most reference argument connectives as argument connectives, and determine the knowledge point type of the answer word segmentation data as the knowledge point type corresponding to the reference knowledge point word segmentation data with the largest data volume in the classification cluster data.

[0023] Preferably, after collecting the test question data to be marked, the method further includes:

[0024] The text in the collected test data is preprocessed, including text normalization, mathematical formula conversion processing and mathematical entity synonymization processing.

[0025] Preferably, before acquiring the knowledge point basic weight data from the preset knowledge point type basic contribution weight table, the method further includes:

[0026] Constructing the basic contribution weight table of the knowledge point type, specifically including:

[0027] Collecting history test questions and solutions to obtain history test question data, and obtaining a teaching syllabus, wherein the teaching syllabus includes all knowledge point types;

[0028] Combined with the frequency of occurrence of the knowledge point type in the history test data, a statistical method is used to calculate the contribution weight of each knowledge point type.

[0029] Preferably, after obtaining the plurality of knowledge point contribution scores, the method further comprises:

[0030] The integrated knowledge point annotation data is visualized to generate a knowledge graph.

[0031] In a second aspect, the present invention provides a test question knowledge point annotation system based on artificial intelligence, the system comprising:

[0032] A data collection module is used to collect test data to be marked, wherein the test data includes a question text and a plurality of answer texts, each of which corresponds to a different problem-solving strategy;

[0033] A data processing module, used to sequentially perform knowledge point contribution analysis on the plurality of answer texts to obtain a plurality of knowledge point contribution scores;

[0034] The data integration module is used to integrate the contribution scores of the multiple knowledge points corresponding to each of the answer texts based on the question text to obtain multi-solution knowledge point annotation data.

[0035] Preferably, the data processing module includes:

[0036] The answer text segmentation unit is used to perform knowledge point type segmentation processing on the answer text to obtain multiple knowledge point type text information sets and multiple argumentation connectives;

[0037] A static data acquisition unit, used to acquire knowledge point basic weight data from a preset knowledge point type basic contribution weight table, and based on a plurality of the argument connectives, match corresponding contribution weights from a preset argument connective contribution weight table to obtain logical contribution weight data;

[0038] The knowledge point contribution analysis unit is used to perform knowledge point contribution analysis based on the knowledge point basic weight data and the positional relationship between the knowledge point and the argument connective, and according to the logical contribution weight data and the knowledge point type text information set to obtain multiple knowledge point contribution scores.

[0039] Preferably, the system further comprises:

[0040] The visualization module is used to visualize the integrated knowledge point annotation data and generate a knowledge graph.

[0041] The beneficial effects of the present invention are:

[0042] (1) The present invention significantly improves the comprehensiveness of knowledge point annotation by introducing a multi-solution knowledge point annotation strategy. Traditional single-solution annotation is often limited to one thinking mode and easily ignores the multiple solutions to the problem and the potential knowledge point network. The present invention analyzes multiple problem-solving strategies and can not only capture the unique knowledge points behind different solutions, but also reveal the internal connections between knowledge points, providing students with a multi-angle learning perspective and promoting the cultivation of critical thinking and innovation ability.

[0043] (2) Based on the positional relationship between the basic weight data of knowledge points and argument connectives, combined with the logical contribution weight data and the knowledge point type text information set, the present invention realizes the refinement and intelligence of knowledge point contribution analysis. By quantifying the basic weights of knowledge points and the logical contributions of argument connectives, the actual role of knowledge points in the answering process can be accurately evaluated. It not only focuses on the static importance of knowledge points, but also considers their dynamic contributions in logical reasoning, thereby providing a more comprehensive and in-depth perspective for the evaluation of knowledge points.

[0044] (3) By introducing the influence weight and distance factor of argument connectives, the present invention can more accurately evaluate the role of knowledge points in the problem-solving process on the basis of quantitative analysis, and provide data-based decision support for educational decision makers and teachers. Educational decision makers can optimize course design and reasonably allocate educational resources based on the contribution scores and relevance of knowledge points; teachers can adjust teaching strategies based on the evaluation results of knowledge points to ensure that core knowledge points are fully explained and auxiliary knowledge points are appropriately covered, thereby improving teaching quality and efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the background technology, the drawings required for use in the embodiments of the present invention or the background technology will be described below.

[0046] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and, together with the specification, are used to illustrate the technical solutions disclosed in the present invention.

[0047] Figure 1 A flowchart of a method for labeling test questions and knowledge points based on artificial intelligence provided by an embodiment of the present invention;

[0048] Figure 2 A schematic diagram of a process flow of analyzing knowledge point contribution scores of a single solution provided by an embodiment of the present invention;

[0049] Figure 3 A schematic diagram of a process for performing knowledge point type word segmentation processing on an answer text provided by an embodiment of the present invention;

[0050] Figure 4 A schematic diagram of the structure of an artificial intelligence-based test question knowledge point annotation system provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0051] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0052] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0053] The term "and / or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

[0054] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0055] In addition, in order to better illustrate the present invention, numerous specific details are provided in the following specific embodiments. It should be understood by those skilled in the art that the present invention can be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present invention.

[0056] At present, the existing test knowledge point annotation methods rely too much on a single solution, which leads to the one-sidedness and limitations of knowledge point annotation.

[0057] Example 1

[0058] The present invention provides a test question knowledge point annotation method based on artificial intelligence, referring to Figure 1 , methods include:

[0059] S100, collecting test data to be annotated, the test data including a question text and a plurality of answer texts, each answer text corresponding to a different problem-solving strategy;

[0060] S200, performing knowledge point contribution analysis on multiple answer texts in sequence to obtain multiple knowledge point contribution scores;

[0061] S300, based on the question text, integrating the contribution scores of multiple knowledge points corresponding to each answer text to obtain multi-solution knowledge point annotation data.

[0062] In this embodiment, the test data to be annotated is collected from the question bank. In addition to the question text, each test question should also be accompanied by at least two different answer texts, and each answer text represents an independent problem-solving strategy. Furthermore, natural language processing (NLP) technology and machine learning algorithms are used to deeply analyze each answer text, identify and quantify the knowledge points involved, and calculate the contribution of each knowledge point to the answer text (i.e., the knowledge point contribution score). This process may involve semantic understanding, keyword extraction, concept mapping and other technologies. Finally, the knowledge point contribution scores of all answer texts under the same test question are summarized, and the comprehensive knowledge point annotation data of the test question is generated by weighted average or other statistical methods. In this way, even for the same question, the multi-dimensional knowledge point coverage brought by different problem-solving strategies can be reflected.

[0063] In one possible embodiment, test data is collected from an education database, an online education platform, or materials submitted by teachers. Each test data contains at least one question text and multiple answer texts, ensuring that each answer text represents a different problem-solving strategy, removing noise information in the text, such as irrelevant symbols, spaces, etc., to ensure the accuracy of subsequent analysis, and using NLP technology to perform semantic parsing on each answer text to identify the knowledge points involved. This step may include techniques such as part-of-speech tagging, named entity recognition, and dependency syntax analysis to understand the core concepts and logical relationships in the answer text. The identified knowledge points are matched with a predefined knowledge point library to calculate a contribution score for each knowledge point. The calculation of the contribution score can be based on a comprehensive evaluation of multiple factors such as the frequency of occurrence of the knowledge point in the answer text, criticality, and relevance to the question. Considering that different problem-solving strategies may have different coverage of knowledge points, a weight is assigned to each answer text to reflect its importance in the overall knowledge point annotation. Based on the question text, the weighted average of the multiple knowledge point contribution scores corresponding to each answer text is generated to generate a comprehensive knowledge point annotation result. This process can use statistical methods, such as weighted average, maximum value selection, etc., to ensure the comprehensiveness and accuracy of the labeling results.

[0064] Compared with the traditional knowledge point annotation that only focuses on a single solution, the present invention can capture more knowledge points under more problem-solving paths, thereby providing more comprehensive learning resources, helping students understand and master different problem-solving ideas. Furthermore, multi-solution knowledge point annotation provides students with multiple angles for solving problems, which helps to stimulate students' innovative thinking and critical thinking ability, while also meeting the needs of students with different learning styles and levels, and promoting personalized learning. Teachers can use these multi-angle knowledge point annotations to design more targeted teaching activities, such as organizing discussions, case analysis, etc., to improve teaching effectiveness and student participation.

[0065] Preferably, reference Figure 2 , perform knowledge point contribution analysis on multiple answer texts in turn to obtain multiple knowledge point contribution scores, including:

[0066] S210, performing knowledge point type word segmentation processing on the answer text to obtain multiple knowledge point type text information sets and multiple argumentation connectives;

[0067] S220, obtaining knowledge point basic weight data from a preset knowledge point type basic contribution weight table, and matching corresponding contribution weights from a preset argumentation connective contribution weight table based on a plurality of argumentation connectives to obtain logic contribution weight data;

[0068] S230, based on the knowledge point basic weight data and the positional relationship between the knowledge point and the argument connective, and according to the logic contribution weight data and the knowledge point type text information set, a knowledge point contribution analysis is performed to obtain a plurality of knowledge point contribution scores.

[0069] In this embodiment, a deep learning model (such as BiLSTM-CRF, BERT, etc.) is used for semantic understanding and word segmentation, to identify key words in the answer text, and to classify them into preset knowledge point types, such as mathematical formulas, theorem references, experimental steps, etc. At the same time, argumentation connectives in the text, such as "therefore", "however", "and", etc., are extracted for analyzing the logic of problem solving. The basic weight of each identified knowledge point type is searched and obtained from the pre-established knowledge point type basic contribution weight table. This table is based on the experience of domain experts and big data analysis, and reflects the importance of different knowledge points for problem solving. According to the extracted argumentation connectives, the corresponding logical contribution weights are matched from the preset argumentation connective contribution weight table (which reflects the logical value of different argumentation connectives in the problem solving process). This step takes into account the logical coherence in the problem solving process and ensures that the contribution of knowledge points in the argument chain is accurately quantified. Further, combined with the knowledge point basic weight data and the logical contribution weight data, according to the positional relationship between the knowledge point and the argumentation connective in the knowledge point type text information set, a comprehensive evaluation is performed through an algorithm (such as weighted summation, hierarchical analysis method, etc.) to obtain the specific contribution score of each knowledge point.

[0070] In this embodiment, the word segmentation technology based on deep learning and the preset weight table can more accurately identify and quantify the contribution of knowledge points, avoid the subjectivity and inconsistency of manual annotation, and improve the accuracy of knowledge point annotation. By analyzing and demonstrating the conjunctions and their contribution weights, the logical coherence of the knowledge point contribution analysis is enhanced, ensuring that the annotation results not only cover the knowledge points themselves, but also reflect the logical relationship between them, which is conducive to students' understanding of the internal logic in the problem-solving process. Furthermore, the automated knowledge point contribution analysis process greatly reduces the need for manual intervention and improves work efficiency. It also provides a feasible solution for the knowledge point annotation of large-scale test question banks and promotes the intelligent management of educational resources.

[0071] Preferably, based on the knowledge point basic weight data and the positional relationship between the knowledge point and the argument connective, and according to the logical contribution weight data and the knowledge point type text information set, a knowledge point contribution analysis is performed to obtain multiple knowledge point contribution scores, including:

[0072] Assume the logical contribution weight data is , the basic weight data of knowledge points is , the knowledge point type text information set is ,in is the number of knowledge point types, knowledge point type The set of distances from all argument connectives ,in To prove the number of conjunctions, Knowledge point type Connective words with argument , then for the first The knowledge point contribution score of each solution It is expressed as follows:

[0073] ,

[0074] ,

[0075] in Knowledge point type The basic weight value of Knowledge point type The contribution score of The basic weight and argument connective influence weight adjustment factor, default is 0.5.

[0076] In this embodiment, the logical contribution weight data Indicates the weight of each argument connective's contribution to the knowledge point, reflecting the impact of the argument structure on the value of the knowledge point, and the basic weight data of the knowledge point The basic importance index preset for each knowledge point type is not affected by the argument structure. is a moderating factor used to balance the contribution of the base weight and the influence of the argument connectives. By default, It is set to 0.5, which means that the basic weight is equally important as the weight of the argument connective influence, and can be adjusted according to actual conditions.

[0077] By introducing the influence weights of argument connectives and the distance factor, the present invention can more comprehensively evaluate the role of knowledge points in the answering process, avoiding the limitation of relying solely on the basic weights, making the knowledge point contribution score more objective and comprehensive. Furthermore, the setting of the adjustment factor β allows the user to adjust the proportion of the basic weights and the influence of argument connectives according to actual conditions, increasing the flexibility and adaptability of the model and making it suitable for test questions of different subject areas and complexity. The introduction of enables the model to finely analyze the positional relationship between knowledge points and argument connectors, and more accurately reflects the actual contribution of knowledge points in the solution logic. By quantifying the contribution of knowledge points in different solutions, teachers and students can gain in-depth insights into problem-solving strategies, promote the understanding and application of the essence of knowledge points, and thus improve the quality of education and learning outcomes.

[0078] Preferably, reference Figure 3 , perform knowledge point type word segmentation processing on the answer text, and obtain multiple knowledge point type text information sets and multiple argumentation connectives, including:

[0079] S211, using a word segmentation tool to perform word segmentation processing on the answer text to obtain a plurality of answer word segmentation data;

[0080] S212, collecting reference knowledge point segmentation data including L different knowledge point types, and obtaining a plurality of reference argumentation connectives;

[0081] S213, integrating a plurality of answer segmentation data, a plurality of reference knowledge point segmentation data, and a plurality of reference argumentation connectives to obtain a mixed text data set;

[0082] S214, using K-means algorithm to perform L+1 cluster classification processing on the mixed text data set to obtain L+1 classification cluster data;

[0083] S215, analyze the distribution of the answer word segmentation data in the L+1 classification cluster data in turn, determine the answer word segmentation data in the classification cluster data containing the most reference argument connectives as argument connectives, and determine the knowledge point type of the answer word segmentation data as the knowledge point type corresponding to the reference knowledge point word segmentation data with the largest data volume in the classification cluster data.

[0084] In this embodiment, advanced natural language processing (NLP) word segmentation tools, such as Jieba word segmentation, StanfordNLP, etc., are used to perform preliminary vocabulary segmentation on the answer text to obtain a series of answer word segmentation data. Reference texts containing L different types of knowledge points are collected and word segmentation is performed on them to obtain reference knowledge point word segmentation data, which represent typical expressions of known knowledge point types, and a list of multiple common argumentation conjunctions, such as "therefore", "however", "in addition", etc., are sorted out to identify the logical structure in the answer text, and the answer word segmentation data, reference knowledge point word segmentation data and reference argumentation conjunctions are merged to form a comprehensive mixed text data set. Further, the K-means algorithm is used to classify the mixed text data set into L+1 clusters, where L is the number of reference knowledge point types, and an additional cluster is used to accommodate knowledge points or argumentation conjunctions that are not clearly attributed. The K-means algorithm classifies similar words into the same cluster through iterative calculations to form L+1 classified cluster data. Then, the distribution of the answer segmentation data in the L+1 classification cluster data is analyzed one by one, and the classification cluster containing the most reference argumentation connectives is identified and marked as the argumentation connective cluster. For other classification clusters, the knowledge point type corresponding to the reference knowledge point segmentation data with the largest amount of data is determined as the knowledge point type of the answer segmentation data in the cluster.

[0085] In this embodiment, by means of the K-means clustering algorithm, the method can effectively distinguish different types of knowledge points and argument connectives, improve the accuracy of recognition, and avoid the subjectivity and errors of manual judgment. Furthermore, since the reference knowledge point segmentation data and argument connectives are used as classification references, the method has strong adaptability and can be applied to different disciplines, such as mathematics, physics, chemistry, etc., and only the reference knowledge points need to be adjusted accordingly.

[0086] Preferably, after collecting the test question data to be marked, the method further includes:

[0087] The text in the collected test data is preprocessed, including text normalization, mathematical formula conversion processing and mathematical entity synonymization processing.

[0088] In this embodiment, the text content is converted into a unified encoding format, such as UTF-8, to ensure the correct display and processing of the text between different systems and devices. Useful characters, blanks, punctuation marks, etc. in the text are removed by regular expressions or NLP tools to maintain the cleanliness of the text and reduce interference in subsequent analysis. Correct spelling errors, unify the writing form of abbreviations and terms, and ensure the consistency and professionalism of the text. Use specialized mathematical formula recognition software or tools, such as Mathpix, LaTeXML, etc., to accurately identify and extract mathematical formulas from the text. Convert the extracted mathematical formulas to a standard format, such as MathML or LaTeX, for easy computer understanding and processing. This process may involve parsing and reconstruction of the formula structure. The converted mathematical formula is re-embedded into the original text to ensure the accuracy of its position and context. Use NLP technology to identify mathematical entities in the text, such as variable names, function names, constants, etc., establish a synonym library of mathematical entities, and include mathematical entities with different expressions but the same or similar meanings, such as π and pi, sin and sine function, etc. According to the synonym library, replace the mathematical entities appearing in the text with their standard or unified expression forms to eliminate the understanding barriers caused by differences in expression.

[0089] In this embodiment, text normalization ensures data consistency and readability, mathematical formula conversion processing ensures formula accuracy and processability, and mathematical entity synonymization processing eliminates expression differences, which together improve the overall quality of the data. High-quality preprocessing results provide a solid foundation for subsequent knowledge point identification and contribution analysis, reduce analysis deviations caused by data quality issues, and enhance the accuracy of the final annotation results. The standardized and normalized data format simplifies subsequent processing procedures, reduces unnecessary data cleaning work, speeds up the entire analysis process, and improves work efficiency.

[0090] Preferably, before obtaining the knowledge point basic weight data from the preset knowledge point type basic contribution weight table, the method further includes:

[0091] Construct a basic contribution weight table of knowledge point types, including:

[0092] Collect history test questions and solutions to obtain history test data, and obtain the teaching syllabus, which contains all types of knowledge points;

[0093] Based on the frequency of occurrence of knowledge point types in historical test data, statistical methods are used to calculate the contribution weight of each knowledge point type.

[0094] In this embodiment, the examination questions of previous years and their official or recognized solutions are collected from channels such as education departments, schools, and examination institutions to ensure the authority and reliability of the data. The collected historical examination question data are classified and sorted, and divided according to the dimensions of subject, grade, examination type, etc., to facilitate subsequent analysis and processing. Further, the latest teaching syllabus is obtained from the education department or the official textbook publishing unit to ensure that all necessary knowledge point types are covered. The teaching syllabus is parsed, all knowledge point types are extracted, and a list of knowledge point types is formed to provide a reference for subsequent weight calculation. Based on the historical examination question data, text analysis and data mining techniques are used to count the number of occurrences of each knowledge point type in the examination question, reflecting the importance and commonness of the knowledge point in the examination. Statistical methods such as frequency analysis, principal component analysis, regression analysis, etc. are used to combine the frequency of occurrence of the knowledge point type in the historical examination questions to calculate the contribution weight of each knowledge point type. This process may also need to consider factors such as the difficulty and relevance of the knowledge point. According to the requirements of the teaching syllabus and the opinions of education experts, the calculated contribution weight is manually calibrated to ensure the rationality and educational applicability of the weight.

[0095] In this embodiment, based on the historical test data and teaching syllabus, the contribution weights are calculated using statistical methods to ensure the scientificity and objectivity of the weight setting and avoid the influence of human bias. Furthermore, the construction of the weight table is closely aligned with the teaching syllabus, ensuring the consistency of knowledge point annotations with educational objectives, helping to guide students and teachers to focus on the key points and difficulties of the exam, and improving teaching efficiency and learning outcomes. Furthermore, by regularly updating the historical test data and teaching syllabus, the knowledge point type basic contribution weight table can be adjusted in a timely manner to reflect the latest educational trends and exam requirements, and to maintain the timeliness and effectiveness of the weight table.

[0096] Preferably, after obtaining the contribution scores of the multiple knowledge points, the method further includes:

[0097] The integrated knowledge point annotation data is visualized to generate a knowledge graph.

[0098] In this embodiment, the quality check of the integrated knowledge point annotation data is performed to remove duplicate, missing or abnormal data points to ensure the accuracy and consistency of the data. The knowledge point contribution score is standardized, for example, Z-score standardization or Min-Max normalization is used so that data of different dimensions can be compared on the same scale. Data mining techniques, such as Apriori algorithm or FP-growth algorithm, are used to discover the association rules between knowledge points, identify which knowledge points often appear together in the same test questions, and reflect the potential connection between knowledge points. Using algorithms such as K-means, hierarchical clustering or DBSCAN, knowledge points are divided into different subject areas according to the knowledge point contribution scores and association rules to reveal the knowledge point structure. Knowledge points are used as nodes in the knowledge graph, and each node contains attributes such as the name, description, and contribution score of the knowledge point. According to the association rules between knowledge points and the clustering results of the subject area, the edges between nodes are defined to represent the degree of association and logical relationship between knowledge points. Choose a suitable graph layout algorithm, such as the Fruchterman-Reingold algorithm or the Spring-Electric model, to determine the position of nodes in two-dimensional or three-dimensional space, so that the structure of the knowledge graph is clear and easy to understand. Design different colors, shapes, and sizes for nodes and edges to distinguish different types of knowledge points and association strengths, and enhance visual expression. Develop functions such as hovering the mouse to display detailed information, clicking to zoom in to view details, and dragging to re-layout to enhance the user experience of exploring the knowledge graph.

[0099] In this embodiment, the knowledge graph graphically displays the complex relationship between knowledge points, helping users quickly grasp the overall structure and mutual influence of knowledge points, and promoting understanding and memory of the knowledge system. Furthermore, teachers can identify teaching key points and difficulties based on the knowledge graph, adjust course content and teaching strategies; students can discover their own knowledge blind spots through the knowledge graph and supplement their learning in a targeted manner.

[0100] Example 2

[0101] The present invention provides a test question knowledge point annotation system based on artificial intelligence, referring to Figure 4 , the system includes:

[0102] The data collection module 100 is used to collect the test data to be marked, the test data includes the question text and multiple answer texts, each answer text corresponds to a different problem-solving strategy;

[0103] The data processing module 200 is used to sequentially perform knowledge point contribution analysis on multiple answer texts to obtain multiple knowledge point contribution scores;

[0104] The data integration module 300 is used to integrate the multiple knowledge point contribution scores corresponding to each answer text based on the question text to obtain multi-solution knowledge point annotation data.

[0105] Preferably, the data processing module includes:

[0106] The answer text segmentation unit is used to perform knowledge point type segmentation processing on the answer text to obtain multiple knowledge point type text information sets and multiple argumentation connectors;

[0107] A static data acquisition unit is used to acquire knowledge point basic weight data from a preset knowledge point type basic contribution weight table, and based on a plurality of argument connectives, matches corresponding contribution weights from a preset argument connective contribution weight table to obtain logical contribution weight data;

[0108] The knowledge point contribution analysis unit is used to perform knowledge point contribution analysis based on the knowledge point basic weight data and the positional relationship between the knowledge point and the argument connective, and according to the logical contribution weight data and the knowledge point type text information set to obtain multiple knowledge point contribution scores.

[0109] Preferably, continue to refer to Figure 4 , the system further comprises:

[0110] The visualization module 400 is used to visualize the integrated knowledge point annotation data and generate a knowledge graph.

[0111] The foregoing is merely a specific embodiment of the present invention, which enables those skilled in the art to understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A test question knowledge point annotation method based on artificial intelligence, characterized in that: The method comprises: Collecting test data to be annotated, the test data including a question text and a plurality of answer texts, each answer text corresponding to a different problem-solving strategy; Performing knowledge point contribution analysis on the plurality of answer texts in sequence to obtain a plurality of knowledge point contribution scores, wherein the knowledge point contribution score is the contribution degree of each knowledge point to the answer text; Based on the question text, integrating the contribution scores of the plurality of knowledge points corresponding to each of the answer texts to obtain multi-solution knowledge point annotation data; The step of sequentially performing knowledge point contribution analysis on the plurality of answer texts to obtain a plurality of knowledge point contribution scores includes: Performing knowledge point type word segmentation processing on the answer text to obtain multiple knowledge point type text information sets and multiple argument connectives, where the argument connectives are words used to analyze the logic of problem solving, including therefore, however, and and; Obtaining knowledge point basic weight data from a preset knowledge point type basic contribution weight table, and based on a plurality of the argument connectives, matching corresponding contribution weights from a preset argument connective contribution weight table to obtain logical contribution weight data, wherein the logical contribution weight data represents the weight of each argument connective contribution to the knowledge point; Based on the knowledge point basic weight data and the positional relationship between the knowledge point and the argument connective, and according to the logic contribution weight data and the knowledge point type text information set, a knowledge point contribution analysis is performed to obtain a plurality of the knowledge point contribution scores.

2. The method for labeling test knowledge points based on artificial intelligence according to claim 1, characterized in that: The knowledge point contribution analysis is performed based on the knowledge point basic weight data and the positional relationship between the knowledge point and the argument connective, and according to the logical contribution weight data and the knowledge point type text information set to obtain a plurality of the knowledge point contribution scores, including: Assume the logical contribution weight data is , the basic weight data of knowledge points is , the knowledge point type text information set is ,in is the number of knowledge point types, knowledge point type The set of distances from all argument connectives ,in To prove the number of conjunctions, Knowledge point type Connective words with argument , then for the first The knowledge point contribution score of each solution It is expressed as follows: , , in Knowledge point type The basic weight value of Knowledge point type The contribution score of The basic weight and argument connective influence weight adjustment factor, default is 0.5, Connective words indicating argument The weight of contribution to knowledge points; is the distance function.

3. The method for labeling test knowledge points based on artificial intelligence according to claim 1, characterized in that: The step of performing knowledge point type word segmentation processing on the answer text to obtain a plurality of knowledge point type text information sets and a plurality of argumentation conjunctions includes: Using a word segmentation tool to perform word segmentation processing on the answer text to obtain multiple answer word segmentation data; Collect reference knowledge point word segmentation data containing L different knowledge point types, and obtain multiple reference argumentation connectives; Integrate the plurality of the answer word segmentation data, the plurality of the reference knowledge point word segmentation data and the plurality of the reference argumentation connectives to obtain a mixed text data set; Using K-means algorithm to perform L+1 cluster classification processing on the mixed text data set to obtain L+1 classification cluster data; Analyze the distribution of the answer word segmentation data in the L+1 classification cluster data in turn, determine the answer word segmentation data in the classification cluster data containing the most reference argument connectives as argument connectives, and determine the knowledge point type of the answer word segmentation data as the knowledge point type corresponding to the reference knowledge point word segmentation data with the largest data volume in the classification cluster data.

4. The method for labeling test question knowledge points based on artificial intelligence according to claim 1, characterized in that: After collecting the test question data to be marked, the method further includes: The text in the collected test data is preprocessed, including text normalization, mathematical formula conversion processing and mathematical entity synonymization processing.

5. The method for labeling test knowledge points based on artificial intelligence according to claim 1, characterized in that: Before obtaining the knowledge point basic weight data from the preset knowledge point type basic contribution weight table, the method further includes: Constructing the basic contribution weight table of the knowledge point type, specifically including: Collecting history test questions and solutions to obtain history test question data, and obtaining a teaching syllabus, wherein the teaching syllabus includes all knowledge point types; Combined with the frequency of occurrence of the knowledge point type in the history test data, a statistical method is used to calculate the contribution weight of each knowledge point type.

6. The method for labeling test knowledge points based on artificial intelligence according to claim 1, characterized in that: After obtaining the plurality of knowledge point contribution scores, the method further includes: The integrated knowledge point annotation data is visualized to generate a knowledge graph.

7. An artificial intelligence-based test question knowledge point annotation system, applied to an artificial intelligence-based test question knowledge point annotation method as claimed in any one of claims 1 to 6, characterized in that: The system comprises: A data collection module is used to collect test data to be marked, wherein the test data includes a question text and a plurality of answer texts, each of which corresponds to a different problem-solving strategy; A data processing module, used to sequentially perform knowledge point contribution analysis on the plurality of answer texts to obtain a plurality of knowledge point contribution scores; The data integration module is used to integrate the contribution scores of the multiple knowledge points corresponding to each of the answer texts based on the question text to obtain multi-solution knowledge point annotation data.

8. The test question knowledge point annotation system based on artificial intelligence according to claim 7, characterized in that: The data processing module comprises: The answer text segmentation unit is used to perform knowledge point type segmentation processing on the answer text to obtain multiple knowledge point type text information sets and multiple argumentation connectives; A static data acquisition unit, used to acquire knowledge point basic weight data from a preset knowledge point type basic contribution weight table, and based on a plurality of the argument connectives, match corresponding contribution weights from a preset argument connective contribution weight table to obtain logical contribution weight data; The knowledge point contribution analysis unit is used to perform knowledge point contribution analysis based on the knowledge point basic weight data and the positional relationship between the knowledge point and the argument connective, and according to the logical contribution weight data and the knowledge point type text information set to obtain multiple knowledge point contribution scores.

9. The test question knowledge point annotation system based on artificial intelligence according to claim 7, characterized in that: The system further comprises: The visualization module is used to visualize the integrated knowledge point annotation data and generate a knowledge graph.

Citation Information

Cited By

  • Cross-platform mathematical application question automatic solving system based on large model and subject knowledge enhancement

    CN119671802A