Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Confidence evaluation method and device for test question difficulty value and storage medium

An evaluation method and confidence technology, applied in the confidence evaluation method, device and storage medium field of the difficulty value of the test questions, can solve the labeling deviation of the difficulty value of the same test question, the inability to evaluate the confidence degree of the difficulty value of the test questions, and different evaluation standards, etc. question

Pending Publication Date: 2022-02-01
北京百舸飞驰科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For the test questions in the test question database, in order to provide users with a more comprehensive user experience, the subject, grade, area and difficulty value of the test question are often marked with test question attribute labels, among which the subject, grade, region and other test question attribute labels can be obtained from the test paper It is automatically obtained from resources, but the difficulty value of the test questions is highly subjective. Due to the lack of evaluation standards, the confidence of the difficulty value of the test questions cannot be evaluated
[0003] Most of the difficulty values ​​of existing test questions are marked manually by teachers. Due to the subjective factors of the difficulty value of the test questions, multiple teachers have different evaluation standards for the same test question, resulting in deviations in the labeling of the difficulty value of the same test question.
This characteristic makes it difficult to evaluate whether the difficulty value of a test question is reasonable, that is, whether the difficulty value of the test question has reference value

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Confidence evaluation method and device for test question difficulty value and storage medium
  • Confidence evaluation method and device for test question difficulty value and storage medium
  • Confidence evaluation method and device for test question difficulty value and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0072] see figure 1 and figure 2 As shown, this embodiment provides a confidence evaluation method for the difficulty value of the test questions, including:

[0073] Step S100, extract a certain number of test questions from the test question bank, and form test question pairs in pairs;

[0074] Step S200, obtaining the difficulty value of the test questions in the test question pair, comparing the difficulty value of the test questions, and summarizing to obtain the system evaluation result data;

[0075] Step S300, performing manual evaluation on the relationship between the difficulty level of the test questions and the intermediate test questions, and obtaining the manual evaluation result data;

[0076] Step S400, taking the manual evaluation result data as the evaluation standard, comparing the results with the system evaluation result data, statistically calculating and comparing the proportion of the same test question pairs, and obtaining the confidence for evalua...

Embodiment 2

[0190] This embodiment provides a method for marking the difficulty of test questions based on the structure of the test paper, which is used to automatically mark the test questions in the test question database in batches. reliability judgment.

[0191] see Figure 7 As shown, the method for labeling the difficulty of the test questions based on the test paper structure of the present embodiment includes:

[0192] Obtain the set of test papers with the same test paper attribute information in the test paper library;

[0193] Analyze the structure of the test paper and the information of the test questions for the test papers in the test paper collection;

[0194] According to the difficulty relationship of the test questions corresponding to the structure of each type of test paper preset by the system, construct the transfer structure diagram of the test question difficulty of all the test questions in the test paper set;

[0195] The difficulty of each test question is ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a confidence evaluation method and device for a test question difficulty value and a storage medium, and the method comprises the steps: extracting a certain number of test questions in a test question library, and forming a test question pair in pairs; obtaining test question difficulty values of test questions in the test question pair, comparing the test question difficulty values, and summarizing to obtain system evaluation result data; performing manual evaluation on the difficulty size relationship of the test questions in the test question pair to obtain manual evaluation result data; and taking the manual evaluation result data as an evaluation standard, performing result comparison with the system evaluation result data, performing statistical calculation and comparison on the proportion of the same test question pairs, and obtaining the confidence coefficient for evaluating the difficulty value information of the test questions in the test question bank. According to the method, the test question difficulty value of each specific test question is not concerned any more, and the consistent proportion of the manual evaluation result data and the system evaluation result data is counted and calculated according to the comparison result of the test question to the difficulty value size relationship, so that the confidence evaluation of the test question difficulty values is realized.

Description

technical field [0001] The present invention relates to the technical field of online education, in particular to a confidence evaluation method, device and storage medium for the difficulty value of test questions. Background technique [0002] In order to provide online services such as photo search, intelligent practice, and homework correction, online education platforms generally need to be based on a powerful test question database. For the test questions in the test question database, in order to provide users with a more comprehensive user experience, the subject, grade, area and difficulty value of the test question are often marked with test question attribute labels, among which the subject, grade, region and other test question attribute labels can be obtained from the test paper of the test question It is automatically obtained from resources, but the labeling of the difficulty value of the test questions is highly subjective. Due to the lack of evaluation stand...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/06G06Q50/20
CPCG06Q10/06393G06Q50/205
Inventor 王伟戌陶扬陈俊文崔寅生张思羽刘洋
Owner 北京百舸飞驰科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products