Intelligent correction system

[0098] The following describes the present invention in detail with reference to the accompanying drawings and embodiments, but the protection scope of the present invention is not limited to the scope described in the embodiments.

[0099] Such as figure 1 As shown, the intelligent correction system in this embodiment includes: a question paper generating device 1, an image acquisition device 2, and a question paper identifying and reviewing device 3.

[0100] The question paper generation device 1 and the question paper recognition and review device 3 can be implemented on a cloud server, and the image acquisition device 2 can be a scanner, a camera or other user-end equipment.

[0101] The question sheet generating device 1 includes an online question log-in system 1-1, an answer sheet cloud storage 1-2, a question database 1-3, and the question sheet recognition and review device 3 includes: an intelligent image recognition judgment system 3-1, and online grading by teachers System 3-2, student/test question analysis system 3-3, student achievement database 3-4, answer entry module 3-5. The basic style of answer sheet is as figure 2 with image 3 Shown. It should be noted that although in this embodiment, the above-mentioned modules are formed in the question paper generating device 1 and the question paper identifying and reviewing device 3 respectively, those skilled in the art should understand that the implementation positions of the above modules can be changed or independent. exist.

[0102] The image acquisition device 2 is implemented on the user client. The basic functions of the user client include answer sheet scanning, answer sheet scanning for other devices with image capture function, access/browse/check/print correction analysis results, and parent notification. The user client may also have the function of communicating with the question paper generating device 1 so as to remotely use the question paper generating device 1 to generate test questions. Or the user client can integrate the question paper generating device 1.

[0103] Answer sheet cloud storage can provide teachers with one or several universal version of answer sheet templates (for example: template 1 containing 30 multiple-choice questions, 30 fill-in-the-blank questions and 5 essay questions, or 40 multiple-choice questions , 20 fill-in-the-blank questions and 3 essay questions template 2, or template 3, template 4, etc.). If the teacher can find an answer sheet template in these universal templates, make the number of answer areas in the corresponding part (such as the multiple-choice part, fill-in-the-blank part, etc.) greater than or equal to the number of questions in the corresponding part of the test paper, Then this answer template is considered a usable template. This is like the answer sheets used in the national formal examination. These answer sheets have uniform specifications, and the number of answer areas is generally greater than the number of questions on the test paper in the actual exam. If teachers find that universal templates are not available, they need to redesign the answer sheet. The question sheet generating device 1 provides a convenient answer sheet generating module. When the teacher runs this module, the question sheet generating device 1 prompts the user to check the question types (such as multiple-choice questions, fill-in-the-blank questions, judgment questions) through the display device of the user client. , Essay questions, etc.), then the user enters the number of questions, and so on to complete the setting of all questions, and then click the Finish and Generate button, the question paper generating device 1 will automatically optimize the layout according to the user's settings.

[0104] The final typesetting style covers two modes: such as figure 2 The handwritten answer pattern shown and such as image 3 The filling/marking answer mode shown, they include locators (201, 202, 301, 302), score column (203, 303), total score column (204, 304), question number prompt and answer box (205, 206, 207, 305, 306, 307, 308), score boxes (208, 309) for teachers to fill in, and test information bar or two-dimensional codes (209, 310).

[0105] The teacher uses the system of the present invention to generate the answer sheet and print the required number of copies, and send it to the students to fill in. After the students complete the answer, the answer sheet is collected. The teacher puts the stack of answer sheets into the scanner for batch scanning, using the image recognition of the cloud system The module recognizes the test paper information on the answer sheet (such as test name serial number, candidate name, student number, etc.) and uses it in the number naming of the picture file. The scanned picture will be stored in the cloud system through the user client. This completes the initial conversion of offline content to online content.

[0106] The teacher logs in to the user client, and enters standard answers of multiple-choice questions, true or false questions, etc., with a single character as the answer, into the question paper recognition and review device 3. This process can be manually input by the teacher, or the image recognition module of the system can use the system's image recognition module to recognize the printed text with standard answers or the handwritten text with standard answers and extract them to the corresponding storage location. In addition, teachers can also enter standard answers for the fill-in-the-blank questions according to their personal wishes. The question paper recognition and review device 3 can compare the answers of the fill-in-the-blank questions with the characters recognized from the corresponding recognition area, and then automatically judge this part of the question. Alternatively, the question paper recognition and review device 3 can display the standard answer and the student's answer image side by side, and judge whether the question is correct or not by manual comparison. The question paper recognition and review device 3 includes a learning module. The learning module receives artificially processed answer images and judgment results, and uses deep learning algorithms to recognize and train handwritten answers to fill-in-the-blank questions. With the accumulation of samples and the advancement of algorithm technology, The correct rate of automatic judgment of the learning module for filling in the blank questions will be improved, so that the scope of the automatic judgment of the learning module can cover the part of the filling in the blank questions.

[0107] The learning module automatically analyzes and processes each scanned picture. The process is roughly as follows:

[0108] (1). Through the image processing module, first identify the answer box, extract the answer box together with the answer in the box, save it as a picture, and number the file name according to the question type and question number.

[0109] (2). First, analyze and process multiple-choice questions and true or false questions with a single letter as the answer. Use the text recognition module to recognize and extract the corresponding numbered pictures above, and compare them with the standard answers entered by the teacher in advance. One comparison, the same judgment is correct, different judgments are wrong, the right and wrong information of each picture is saved to the corresponding position, so that the automatic judgment of some question types in the answer sheet is completed.

[0110] (3) Then the question paper recognition and review device 3 assigns each student's answering picture to the same question to the manual judgment module. The types of manual judgment questions include fill-in-the-blank questions, calculation questions, short answer questions, essay questions, For composition, etc., if there are 50 students answering, then each question will have 50 pictures. Figure 5 It is a manual judgment interface for filling in the blanks. The cloud system displays a corresponding number of pictures on each screen of the user's device (mobile phone, tablet, computer, etc.), and displays the question number and standard answer (501) at the top of the screen for judgment The questioner is compared horizontally. The judge can check the check/cross (502) according to the student's answering situation. The check indicates the positive selection mode (used when students answer correctly), and the cross indicates the negative selection mode (comparison of students' wrong answers) Used frequently). In the positive selection mode, the judger clicks on the answer picture of the student that is different from the standard answer (504); in the negative selection mode, the judge clicks the answer picture of the student with the same standard answer (504). The question paper recognition and review device 3 categorizes the student's answer pictures into the correct/false database and stores them according to the judgment operation of the judge. If the judge finds a misjudgment, he can also click to access the correct/wrong database (503) to correct the misjudgment. After judging one screen of questions, click the next screen (505), or you can click the previous screen (506) to correct the judgment.

[0111] Image 6 It is an example of a question with standard scoring steps (such as calculation questions, short answer questions, etc.). If the question has two standard scoring steps (601), one screen lists the corresponding number of students' answer pictures (604) for the teacher to judge the questions horizontally, then In the positive selection mode, the judger clicks on the picture of the student who has deducted points, and then clicks the step (601) that needs to be deducted; in the negative selection mode, the judger clicks the student who has the correct step to answer Picture, and then click the step (601) that needs extra points. Image 6 Other functions are similar Figure 5 , After one screen is judged, click on the next screen until all students have answered the picture judgment question.

[0112] Figure 7 It is an example of question types with a large number of text descriptions such as essay questions and composition questions. In the positive selection mode, the judge will mark the wrong places in the corresponding student's answer picture by marking or marking the wrong place. The question paper recognition and review device 3 The position coordinates of the label in this mode relative to the answer box will be recorded. The judge enters the score in the sub-area (701). If necessary, you can click the fine-tuning button (702) to add 0.5 points or deduct 0.5 points. In the comment area, enter the comment on the question; in the reverse selection mode, the judge can mark the colorful places in the corresponding student's answer picture, and the cloud system will record the mark in this mode relative to the answer box The judges input the score for the sub-area (701). If necessary, you can click the fine-tuning button (702) to add 0.5 points or deduct 0.5 points, and you can also enter comments on the topic in the comment area. Figure 7 Other functions are similar Figure 5 with Image 6 , Click on the next screen (707) after one screen is judged until all students have answered the picture and judged the questions.

[0113] (4). After the teacher's manual judgment is completed, the question paper recognition and review device 3 will calculate and analyze the scores of each student's test paper, and store the results in the cloud database. The teacher can export the results to the electronic In the document, electronic documents can also be printed into paper documents for students to correct, review, save and archive. The student's answer and the traces of the question (checks, wrong crosses, marks, etc.) are printed on paper documents. In addition to the total score and the score, the cloud system also prints the student's test paper where appropriate Some analysis, such as: inferring the knowledge links that need to be reinforced from the deduction situation.

[0114] (5). The cloud system stores the data generated for each test (homework) in the database for teachers to analyze the data of students horizontally (the same test for different students) and vertical (multiple tests for the same student) , It is convenient for teachers to track the learning situation of each student and the overall learning situation of students. Teachers can send each student's learning situation to the parent client through the parent notification module for their parents to grasp and understand. There is a part of the data in the database for deep learning handwriting recognition training, which can help the cloud system improve the accuracy of filling in the blanks. Teachers can also analyze students' plagiarism and cheating from the database.

[0115] Such as Picture 9 As shown, for judgment questions with more answer content and longer text, click and label operations can be performed. Take the iPad user terminal as an example. The correction system of the present invention provides an intelligent dot-and-draw correction function to facilitate teachers to judge questions online. Long press on a place with your finger, and an option tray will appear somewhere. The options include plus and minus points (-1, -2, -3, +1, +2...) and correction marks (pictured below) Straight line, descending squiggly line, strikethrough, cross, circle...), comment comments (you can set and correct high-frequency words in advance, such as: misspellings, grammatical errors, sentence failures, incorrect text... ., you can also type a comment), etc. These options are distributed in different directions centered on a long finger press somewhere. When the finger is swiped in a certain direction and lifted off the screen, the options in the corresponding direction will take effect. For example, when correcting calculation questions, it is often to find extra points, so the options are mainly to add points +1, +2, +3...; and when correcting subjective questions such as composition, it is often to find deductions. Points, so the options are based on deductions of -1, -2, -3... After the teacher completes the deduction/extra points for each of the students' answers, the system automatically calculates the score of the question. If the finger is drawn towards the correction mark, then the finger can also perform subsequent operations (circle, draw, check, cross), and the system will display these marks in the corresponding position according to the track of the finger touch. If the finger is drawn to the comment annotation, the system will display these annotations in the blank position near the place where the finger is long pressed, and the corresponding relationship is indicated by the solid line or the dotted line connection (just like the annotation in the office word). Users can edit the options in the management options tray through customization to improve actual use efficiency and operational comfort.

[0116] Such as Picture 10 with 11 As shown, the answer frame can be specially designed for image recognition and corresponding to the question of the corresponding question number. such as:

[0117] 1. The three vertices of each answer rectangular box have solid dots for easy positioning. There is question number coding information on the periphery of the answer box, and barcode marks can be printed on one or more sides of the answer box close to the outside of the rectangle. Question number; it can also be printed with a QR code on one side of the rectangular box to mark the question number, or place the answer box in an area of ​​a QR code that does not affect recognition. It can be a single answer box printed with a barcode or QR code, or several answer boxes can be combined together. One of the answer boxes is printed with a barcode or QR code on the outside, and the other answer boxes in the combination will be The system automatically corresponds to the question number according to its location. The advantage of using barcodes and QR codes is that redundancy algorithms and verification can be done to improve the recognition rate.

[0118] 2. The three vertices of each answer rectangular box have solid dots for easy positioning. Numbers, letters or other marks are printed on one or more sides of the answer box close to the outside of the rectangular edge to correspond to the question number. Other signs can have the following forms: It is agreed in advance that the outer line segment on the left side of the rectangular answer box represents the number 1, the upper outer line segment represents the number 2, the outer line segment on the right represents the number 5, and the lower outer line segment represents the number 10, assuming the upper left There are a, b, c, d line segments at the bottom right, then the question number corresponding to this answer box is the sum of the numbers represented by these line segments, that is, a*1+b*2+c*5+d*10, do this The advantage is that it makes the answer box less bloated and does not affect the appearance. Number each or every few answer boxes, so that you can not stick to a fixed form of answer sheet, so you can use the following method: use a high-speed instrument to make the entire blank roll (or student newspapers, etc.) that contain questions The system first preprocesses the position and number of the answer box when it is photographed, and then manually proofreads and calibrates the answer box and question number, so that students can answer on the mixed question paper in the test questions and the answer area, and the system can identify the answer area And for subsequent processing.

[0119] Based on the answer box with the question number code, the form of the question paper can be more diversified. Teachers can use the corresponding mobile APP to take photos of the students’ answer papers. The photos will be uploaded to the cloud and the system will recognize the answer boxes. And judge the questions with a single letter or symbol as the answer, and finally display the question number of the student's wrong answer in the APP. The teacher can manually cross the question paper according to these question numbers, which saves the teacher "correct answer" "In the process of judging questions, there is no need for a printer to print the correction results.

[0120] Such as Picture 12 As shown, the teacher can ask students to enclose the answer of each question with a red line on their homework book with a red pen and a ruler, and draw a red rectangle in a corner of the enclosed area. This rectangle contains three solid centers. Dots are used for positioning. Students neatly write number and letter question numbers in the rectangle. The answering area on the workbook is captured by the device and uploaded to the cloud in image format. The system uses image recognition to associate the student answering area with the question number. , So teachers can make horizontal corrections for each topic.

[0121] The scanning and correction printing client is the front-end input and output device, which can be selected according to the actual situation. Scanning customer answer sheets can be divided into paper answer sheets and electronic answer sheets according to their attributes. The paper answer sheet is the paper needed for students to actually answer the questions. The format is based on the electronic version. The electronic version of the answer sheet is stored in a cloud database. Persons with relevant authority can create or modify according to the actual situation, and can print and convert them into paper answer sheets.

[0122] The system of the present invention may also include a parent notification system.

[0123] The software client is integrated into the app based on the content of the web system and arranged in the web page and major online shopping malls. According to the current mainstream mobile platforms, apps are divided into IOS version and Android version for download. According to the current mainstream system platform, it is divided into (Windows, Mac, Linux) apps for download.

[0124] The general functions of the online test question login system are divided into three functions: test question entry query, test result query, and online practice. Function permissions are based on account permissions (account permissions are configured by the system administrator). Trigger the test question query function on the homepage of the web system, and an account with relevant permissions enters the query interface. Enter the test paper number, which is stored in the cloud database as the keyword and index of the entire test paper. In the background, the relevant test papers are displayed from the database according to the test paper number. Online test questions log in to the system homepage to set the test question entry function, and an account with relevant permissions can enter the entry interface. First enter the test paper number (or automatically generate the serial number). Then enter the test question number and test content, and enter the standard answer corresponding to the test question. The number of the test question will be used as the key word and index of the whole question. The online test question login system will also provide insert and delete buttons to add or delete questions. After entering all the questions in the list, click Save to save the entire set of entered test papers to the cloud database. Provide printing function for the entered test paper. Set up the test result query window on the home page of the online test question login system, enter the test paper number, and the class, name and student number of the person being queried. The system background will obtain the matched standard answers and student answer information from the database according to the selection criteria, and perform immediate correction analysis, and display the correction results on the page. The result provides printing function to facilitate offline analysis or processing. The home page of the online test question login system is also equipped with an online practice function. You can choose the type of practice (complete test paper, multiple-choice questions, fill-in-the-blank questions, etc.), and choose to redo the original test paper or practice the new test paper online. The web system retrieves from the database according to the selection conditions The original test paper or the historical answer of the login account is analyzed, and a set of test papers that meet the selection conditions are automatically analyzed and summarized for online answering.

[0125] The test question database module is based on the cloud database, and all the entered test questions, online answers, and answer results from image recognition are stored here.

[0126] As an input and output device, the correction machine can be a combination of a common scanner and a common printer, or a special all-in-one machine for correction. The correction machine combined with commonly used equipment uses a scanner at the front end to scan the student's special answer sheet into the computer (can be scanned into the web version or pc software version of the system). The system obtains the data in the answer sheet through the image recognition module, compares it with the correct answer stored in the cloud, and judges whether the answer is correct or not. And store the correction results and scanned copies of student answer sheets in the cloud. At the same time, overwrite the correction results into the electronic version of the answer sheet and print it through a printer. (The printer can also print answer sheet templates, online test questions, etc.). The dedicated all-in-one machine can complete the above work in an integrated manner, and directly overlay and print the correction results on the original answer sheet.

[0127] The teacher's online grading system can be divided into multiple-choice questions and subjective questions according to the type of questions during operation. You can click the relevant function on the homepage of the teacher's online grading system to enter. For both question types, teachers can enter the question number and student number, retrieve the same questions from the cloud database for different students who meet the selection criteria, list them on the screen, and make horizontal comparisons while marking them. Due to the size of the display screen, the horizontally listed questions have a magnification function. Teachers can click to zoom in on any student's any question for more detailed corrections. Teachers can also input the test paper number and student number separately to make corrections for a single test paper. Both types of questions are equipped with a remark function. Teachers can add remarks through an electronic pen or touch screen. For the personal computer version of the system, the keyboard can also be selected for remark entry. The main correction work of multiple-choice questions is automatically calculated and compared by the system, and teachers only need to make notes for questions with specific needs. Teachers of subjective questions can divide each question into several standard scoring steps and save them before marking. The information in the captured image is compared with the step keywords set by the teacher during image recognition correction to realize the automatic correction function. Teachers can also manually select the clauses that meet the points added or deducted, according to the actual situation to manually correct students' answers or correct the results of automatic corrections. Due to the accuracy of image recognition technology, teachers can manually modify the scores of automatically corrected questions while viewing the system's correction results in order to obtain student scores that are more in line with the actual situation. After the correction, all the above information is stored in the cloud database, and the manual results are compared with the results of image recognition, so that the image recognition system can perform deep learning and improve the accuracy of image recognition. Students can make remarks for the teacher's remarks when querying the results and store them in the cloud database. Teachers can also perform the same operation to achieve the function of interacting with students. When the teacher enters the selection criteria to retrieve the relevant answer information, the system automatically stores the data in the cache area, and all operations are performed on the data in the cache area. When the save button is clicked, the data is synchronized to the cloud database. For the mobile terminal, the last operation will continue when the prompt is opened again after closing the app. For the personal computer, it will prompt whether to save before exiting the app. This design can avoid being able to keep working without a network environment.

[0128] The student test analysis system can be divided into two parts according to different login accounts (teacher and student). You can click the relevant function on the homepage of the intelligent correction system to enter. After the teacher account is logged in, select the class (multiple choice), student number (multiple choice), test paper number (multiple choice, optional), (additional options such as the difficulty of the question, etc.) according to the selection criteria to retrieve relevant information in the database for analysis , Analyze the students' overall (class, school) scores and lost points in terms of question types and knowledge points. And the results and analysis results are presented in the form of graphs or lists. At the same time, the system will compare the selected information horizontally and present similar results in the form of a list. Several student numbers can be selected in the list. After confirmation, the answers of the selected students can be retrieved from the database for horizontal comparison. To judge whether there is plagiarism, and store the judgment result in the cloud database. If the teacher account selects the single student option or the student account selection, you can track individual students’ wrong questions, analyze the individual’s strengths and weaknesses, and conduct a comprehensive evaluation of the individual’s knowledge structure and mastery of knowledge points. The scoring rate, the loss rate, the difficulty of the test, the discrimination of the level of the answerer, the reliability of the test, the validity of the test and other data are tracked and analyzed, and the results and analysis results are presented in the form of graphs or lists.

[0129] Teachers can notify parents or students online in the notification system. If the parents or students are not online, the online message will be saved in the system and prompted after the parents or students go online. Teachers can also send corrections or analysis results to relevant parents or students in the form of emails, SMS or WeChat. Parents can use the same operation to report back to the teacher based on relevant information and use the parent account to log in to the system at the same time (the permissions of the parent account are basically equivalent to the student account) to view, analyze, and issue questions.

[0130] There is a permission setting module in the correction system, and the permissions of all accounts can be customized by accounts with administrator permissions. The same account can have multiple permission objects at the same time. Each authority object can be subdivided into the data level (for example: the score viewing authority object can be subdivided into viewing class scores and viewing grade scores).

[0131] The database contains two parts: test question database and student achievement database. The architecture is basically the same, the difference lies in the type of stored data.

[0132] Although the principles of the present invention have been described in detail above in conjunction with the preferred embodiments of the present invention, those skilled in the art should understand that the above-mentioned embodiments are merely illustrative implementations of the present invention, and do not limit the scope of the present invention. The details in the embodiments do not constitute a limitation on the scope of the present invention. Without departing from the spirit and scope of the present invention, any obvious changes such as equivalent changes or simple replacements based on the technical solutions of the present invention fall into the present invention. Within the scope of protection.