Information processing device and program

The information processing device addresses the issue of overlapping scoring symbols and answers by moving or reducing them to create an overlap avoidance image, enhancing the review process for both learners and graders.

JP2024170035APending Publication Date: 2024-12-06DAI NIPPON PRINTING CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023086954
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-26
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

Scoring symbols on paper-based answer sheets often overlap with answers, making it difficult for learners to review and study, and for graders to verify scores accurately.

Method used

An information processing device that acquires scored answer data, determines overlaps between scoring symbols and answers, and moves or reduces symbols to avoid overlap, creating an overlap avoidance image.

Benefits of technology

Reduces the burden on learners and graders by preventing scoring symbols from obscuring answers, facilitating easier review and study.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024170035000001_ABST
    Figure 2024170035000001_ABST
Patent Text Reader

Abstract

To reduce the burden of review learning on a learner and the burden of grading review on a grader by ensuring that grading marks and answers do not overlap.SOLUTION: An information processing device acquires graded answer data in which answers by a learner and grading marks by a grader are entered. The information processing device acquires the grading marks and answer texts, which are texts indicating the answers, from the acquired graded answer data, and determines whether or not the grading marks and the answer texts overlap. When it is determined that the grading marks and the answer texts overlap, the information processing device moves the grading marks to positions where they do not overlap with the answer texts.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a scoring support technique. [Background technology]

[0002] Conventionally, there has been known a system for grading tests administered on paper on a screen of a terminal device. Patent Document 1 discloses a system in which a large number of answer sheet images are created from a large number of test answer sheets, and a grader downloads certain answer sheet images using a terminal device to grade the test. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2010-152480 A Summary of the Invention [Problem to be solved by the invention]

[0004] Typically, graders mark answers by marking answers written by learners on paper answer sheets or digital answer images with marking symbols such as circles or crosses. As a result, marking symbols often overlap with the numbers or letters of the answers. However, if marking symbols overlap with the answers, it becomes difficult for learners to see the answers when reviewing their answers, which increases the burden of studying. In addition, it becomes difficult for graders to see the answers when reviewing the answers, which increases the burden of reviewing the answers.

[0005] The present invention has been made to solve, for example, the problems described above, and aims to provide an information processing device that reduces the burden on learners of reviewing and on graders of reviewing marks by preventing overlapping of marking symbols and answers. [Means for solving the problem]

[0006] In one aspect of the present invention, the information processing device includes a graded answer data acquisition unit that acquires graded answer data in which an answer by a learner and a marking mark by a grader are entered, a marking mark acquisition unit that acquires the marking mark from the graded answer data, an answer text acquisition unit that acquires an answer text that is a text showing the answer from the graded answer data, an overlap determination unit that determines whether the marking mark and the answer text overlap, and a movement unit that moves the marking mark to a position where it does not overlap with the answer text when the overlap determination unit determines that they overlap. According to this aspect, the information processing device can avoid overlapping between the marking mark and the answer text by moving the marking mark based on the graded answer data.

[0007] In one aspect of the above information processing device, the graded answer data is an answer sheet image having a plurality of answer columns, in which the learner has written answers in each answer column and the grader has written a marking symbol for each answer in each answer column, the marking symbol acquisition unit acquires the marking symbol written in each answer column, the answer text acquisition unit acquires the text written in each answer column as an answer text, the overlap determination unit determines whether the marking symbol and the answer text overlap for each answer column, and when the overlap determination unit determines that the marking symbol and the answer text overlap, the movement unit moves the marking symbol to a position that fits within the area of ​​the answer column and does not overlap with the answer text. According to this aspect, the graded answer data is an answer sheet image, and the information processing device can avoid overlapping between the marking symbol and the answer text by moving the answer marking symbol within the area of ​​the answer column based on the answer sheet image.

[0008] In one aspect of the above information processing device, if there is no position where the marking symbol fits within the answer column and does not overlap with the answer text, a reduction unit is provided that reduces the marking symbol, and the movement unit moves the marking symbol reduced by the reduction unit to a position where the marking symbol fits within the answer column and does not overlap with the answer text. According to this aspect, the information processing device reduces and moves the marking symbol until a position is found that fits within the answer column and does not overlap with the answer text. This allows the information processing device to avoid overlapping of the marking symbol with the answer text.

[0009] In one aspect of the information processing device, the overlap determination unit determines that the marking mark moved by the moving unit does not overlap the answer text if it fits within the answer column area and does not overlap the answer text. According to this aspect, the information processing device determines that the marking mark and the answer text overlap if the marking mark does not fit within the answer column area even if it does not overlap the answer text. This makes it possible to grasp the marking mark only within the answer column area, without considering areas outside the answer column area.

[0010] In one aspect of the above information processing device, the marking symbol acquisition unit acquires symbol coordinate information relating to the position coordinates of the marking symbols in the answer sheet image, the answer text acquisition unit acquires text coordinate information relating to the position coordinates of the answer text in the answer sheet image, and the overlap determination unit determines whether or not there is overlap based on the symbol coordinate information and the text coordinate information within the area of ​​each answer column. According to this aspect, the information processing device determines whether or not the marking symbols fit within the area of ​​the answer column and do not overlap with the answer text based on the position coordinates of the marking symbols and the position coordinates of the answer text.

[0011] In one aspect of the above information processing device, when the overlap determination unit determines that there is an overlap, the information processing device includes a rectangle determination unit that determines a circumscribing rectangle of the marking symbol and a center position of the circumscribing rectangle based on the symbol coordinate information, and the movement unit moves the center position of the circumscribing rectangle within the answer column. According to this aspect, the information processing device moves the center position of the circumscribing rectangle within the answer column, thereby moving the marking symbol to a position that fits within the answer column and does not overlap with the answer text.

[0012] In one aspect of the above information processing device, the device includes a position determination unit that determines the position of the marking symbol so that the marking symbol does not overlap with the answer text, an overlap avoidance data creation unit that creates overlap avoidance data by moving the marking symbol to the position determined by the position determination unit based on the graded answer data, and an output unit that outputs the overlap avoidance data. According to this aspect, the information processing device can create and output overlap avoidance data that avoids overlap between the marking symbol and the answer text by moving the marking symbol based on the graded answer data. This allows the marking symbol and the learner's answer to be displayed so that they do not overlap, reducing the burden on the grader, such as difficulty in visually determining the marking and time required when checking or reviewing the marking, which occurs when the marking symbol and the answer text overlap. In addition, it is possible to reduce the burden on the learner, such as difficulty in seeing the marking symbol when reviewing the marking.

[0013] In one aspect of the above information processing device, an interpolation unit is provided that, based on the scored answer data, interpolates missing answer text by moving a marking symbol to a position determined by the position determination unit in the overlap avoidance data. According to this aspect, the information processing device allows a grader or a learner to check the marking or review the learning without worrying about missing answer text that accompanies moving the marking symbol.

[0014] In another aspect of the present invention, there is provided a program executed by an information processing device having a computer, the program causing the computer to function as a graded answer data acquisition unit that acquires graded answer data in which an answer by a learner and a marking mark by a grader are entered, a marking mark acquisition unit that acquires the marking mark from the graded answer data, an answer text acquisition unit that acquires an answer text that is a text showing the answer from the graded answer data, an overlap determination unit that determines whether the marking mark and the answer text overlap, and a movement unit that moves the marking mark to a position where it does not overlap with the answer text when the overlap determination unit determines that they overlap. By installing this program on a computer and causing it to execute, it is possible to configure the information processing device according to the present invention. Effect of the Invention

[0015] According to the information processing device of the present invention, by preventing the overlap of marking symbols and answers, it is possible to reduce the burden on learners of reviewing and on graders of reviewing marks. [Brief description of the drawings]

[0016] [Figure 1] 1 shows a configuration of a learning support system in an embodiment. [Diagram 2] 1 is an example of an image of an answer sheet. [Diagram 3] FIG. 2 is a block diagram showing a hardware configuration of a server. [Figure 4] FIG. 2 is a block diagram showing a functional configuration of a server. [Diagram 5] 13 is an example of a score confirmation screen. [Figure 6] FIG. 13 is a diagram illustrating a method for obtaining a mark symbol. [Figure 7] 13 is an example of an answer box area detection result and an answer text acquisition result. [Figure 8] 13 is a diagram illustrating an overlap determination between marking symbols and answer texts. FIG. [Figure 9] FIG. 13 is a diagram illustrating the movement of marking symbols. [Figure 10] FIG. 13 is a diagram for explaining the interpolation of missing parts using marking symbols. [Figure 11] 13 is a flowchart of an overlap avoidance process. [Figure 12] 13 is a flowchart of a movement process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. <Embodiment> [Overall configuration] 1 shows the configuration of a learning support system to which the server of the present invention is applied. In an embodiment, the learning support system 100 is a system that prevents the scoring symbols from overlapping in part or in whole with the text of the answer, such as numbers and letters, by moving or shrinking the scoring symbols based on the answers by the learners and the graded answer data in which the scoring symbols are entered by the grader. In this embodiment, the text of the answer, such as numbers and letters, is called the "answer text."

[0018] For ease of explanation, the learners are students and the graders are teachers. In this embodiment, an example of graded answer data is an image of an answer sheet (hereinafter also referred to as an "answer sheet image") that has multiple answer columns, in which the students write their answers and in which the teacher writes the answer markings in each answer column. "The marking marks and the answer text overlap" means that the marking marks and the answer text overlap on the surface of the answer sheet or on the answer sheet image.

[0019] The learning support system 100 is configured such that a server 10 and a plurality of teacher terminals 20 can communicate with each other via a network 5 such as the Internet. The server 10 is an information processing device that processes, stores, transmits and receives various information, and is, for example, a server device, a personal computer (PC), or a general-purpose tablet. The server 10 is an example of the information processing device of the present invention.

[0020] The teacher terminal 20 is used by a teacher and is, for example, an information processing device such as a tablet or PC. Specifically, the teacher terminal 20, which will be described in detail later, is a terminal device that transmits answer sheet images to the server 10 and obtains and outputs screen information related to the marking confirmation screen from the server 10. In addition, the teacher terminal 20 is connected to a scanner, and scans answer sheets with the scanner to convert them into images.

[0021] Here, an answer sheet image will be described. FIG. 2 is an example of an answer sheet image. The answer sheet image 30 is an image of an answer sheet, which is an example of a test, and has a plurality of questions and answer columns, as shown in FIG. 2, in which the students write their answers in the answer columns, and the teachers write marking symbols for the answers in the answer columns. Specifically, the answer sheet image 30 has a test content area 52 that displays the test implementation time, the target grade, the subject, the required time, etc., a student identification information area 53 in which the grade, class, number, and name, which are the identification information of the students, are written, and a question answer column area 54 that is composed of a plurality of questions, answer columns, and diagrams.

[0022] The types of questions and the layout of the answer sheet are examples and can be set as desired. The shape of the answer column on the answer sheet is also examples and can be set as desired, such as underscores or parentheses.

[0023] [Server hardware configuration] 3 is a block diagram showing a hardware configuration of the server 10. The server 10 includes a communication unit 11, a control unit 12, a storage unit 13, a recording medium 14, a display unit 15, and an input unit 16.

[0024] The server 10 may be executed by a single computer, or may be executed in a distributed manner on a plurality of computers, or may be executed in a distributed manner on virtual machines.

[0025] The communication unit 11 is a communication unit for communicating with the teacher terminal 20 through the network 5. Specifically, the communication unit 11 receives answer sheet images from the teacher terminal 20 and transmits screen information related to the marking confirmation screen to the teacher terminal 20.

[0026] The control unit 12 includes an arithmetic processing device such as a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), and a GPU (Graphics Processing Unit), and performs various information processing, control processing, and the like related to the server 10 by reading and executing programs stored in the storage unit 13. The programs can be deployed so as to be executed on a single computer, or on a single site, or distributed across multiple sites and on multiple computers interconnected by a communication network. Although the control unit 12 is described in FIG. 3 as being a single processor, it may be a multiprocessor.

[0027] The storage unit 13 includes memory elements such as a RAM (Random Access Memory) and a ROM (Read Only Memory), and stores programs or data required for the control unit 12 to execute processing. The storage unit 13 also temporarily stores data required for the control unit 12 to execute arithmetic processing.

[0028] The recording medium 14 is a non-volatile and non-temporary recording medium such as a disk-shaped recording medium or a semiconductor memory, and is configured to be detachable from the server 10. The recording medium 14 records various programs executed by the control unit 12. When the server 10 executes the overlap avoidance process or the movement process, the programs recorded on the recording medium 14 are loaded into the memory unit 13 and executed by the control unit 12.

[0029] The display unit 15 is a liquid crystal display or an organic EL (electroluminescence) display, etc., and displays various information according to instructions from the control unit 12. The input unit 16 is an input device such as a mouse, a keyboard, a touch panel, a button, etc., and outputs received operation information to the control unit 12.

[0030] [Server Functionality Configuration] 4 is a block diagram showing the functional configuration of the server 10. The server 10 functionally includes a screen output unit 40, an answer sheet image acquisition unit 41, a mark symbol acquisition unit 42, an answer column area detection unit 43, an answer text acquisition unit 44, an overlap determination unit 45, a position determination unit 46, a rectangle specification unit 47, a movement unit 48, a reduction unit 49, an overlap avoidance image creation unit 50, and an interpolation unit 51.

[0031] The screen output unit 40, answer sheet image acquisition unit 41, mark symbol acquisition unit 42, answer column area detection unit 43, answer text acquisition unit 44, overlap determination unit 45, position determination unit 46, rectangle identification unit 47, movement unit 48, reduction unit 49, overlap avoidance image creation unit 50, and interpolation unit 51 are realized by the control unit 12 executing a program.

[0032] In response to the screen request, the screen output unit 40 transmits screen information regarding the marking confirmation screen to the teacher terminal 20 to display it. For example, the teacher uses the teacher terminal 20 to log in to a specific site or launch a specific application, and the screen output unit 40 acquires a screen request for the marking confirmation screen. In response, the screen output unit 40 transmits screen information regarding the marking confirmation screen to the teacher terminal 20. The screen output unit 40 also transmits the overlap avoidance image and marking results created by the overlap avoidance image creation unit 50 (described later) to the teacher terminal 20 to display them on the marking confirmation screen.

[0033] Fig. 5 is an example of a marking confirmation screen. The marking confirmation screen is displayed on the teacher's terminal 20, and is a screen where the teacher uploads an answer sheet image and checks the marking results for the answer sheet. The student who has written the answer on the answer sheet that is the subject of the marking confirmation or review is called the target student.

[0034] As shown in Figure 5, the grading confirmation screen has a grade display area 61, a group display area 62, a name display area 63, a subject display area 64, a teacher display area 65, an image display area 70, an enlarge button 71, a reduce button 72, a save button 73, a grading result display area 74, and a correction button 75.

[0035] The grade display area 61, the group display area 62, and the name display area 63 are areas that display the grade, group, and name of the target student. The subject display area 64 is an area that displays the subject of the answer sheet. The teacher display area 65 is an area that displays the teacher's name and identification information. The grade, group, name, and subject of the target student displayed in the grade display area 61, the group display area 62, the name display area 63, and the subject display area 64 may be displayed based on the teacher's input, or may be obtained from the uploaded answer sheet image using an OCR (Optical Character Reader) or the like and then displayed. The dotted lines surrounding the grade display area 61, the group display area 62, the name display area 63, and the subject display area 64 are drawn for the convenience of explanation and do not actually exist.

[0036] The image display area 70 is an area that displays the answer sheet image uploaded by the teacher through a predetermined operation, and an overlap avoidance image in which the marking symbols and the answer text do not overlap, as will be described in detail later. The enlarge button 71, the reduce button 72, and the save button 73 are buttons that can be clicked to save, enlarge, or reduce the displayed image. The marking result display area 74 is an area that displays the marking results consisting of the question number that identifies each question in the answer sheet image, the answer, and the marking symbol for the answer. The answer displayed in the marking result display area 74 is an image of the answer column corresponding to the question number, and the marking symbol and the answer text do not overlap, making it easy for the teacher to see. By pressing the correction button 75 and performing a predetermined operation, the teacher can correct the marking symbol displayed in the marking result display area 74.

[0037] The answer sheet image acquisition unit 41 acquires an answer sheet image, which is an image of an answer sheet on which the target students have written their answers and the teacher has written their marks, by a scanner, from the teacher terminal 20. Specifically, the teacher uses the teacher terminal 20 to upload the answer sheet image by performing a predetermined operation on the marking confirmation screen. This allows the answer sheet image acquisition unit 41 to acquire the answer sheet image from the teacher terminal 20.

[0038] It is also possible to store the answer sheet images in a predetermined DB in advance, and the answer sheet image acquiring unit 41 acquires the answer sheet images of the target students from the predetermined DB.

[0039] The marking symbol acquisition unit 42 acquires marking symbols such as a circle, a cross, and a triangle from the answer sheet image 30. FIG. 6 is a diagram for explaining a method of acquiring marking symbols. Specifically, as shown in FIG. 6, the marking symbol acquisition unit 42 extracts marking symbols from the answer sheet image 30 using, for example, an instance segmentation method. In the instance segmentation method, even if objects belong to the same class, the position of each individual object can be detected. Therefore, the marking symbol acquisition unit 42 acquires symbol coordinate information regarding the position coordinates of each marking symbol in the answer sheet image 30.

[0040] The answer box area detection unit 43 detects the area of ​​each answer box from the answer sheet image 30. FIG. 7 is an example of an answer box area detection result. Specifically, as shown in FIG. 7, the answer box area detection unit 43 detects the answer box area of ​​each question from the answer sheet image 30. For example, a method of detecting an object in an image as a rectangular area using deep learning, such as R-CNN (Rich feature hierarchies for accurate object detection and semantic segmentation), can be applied as the area detection method. The area surrounded by a dotted line in the answer sheet image 30 shown in FIG. 7 is the answer box area of ​​each question. At this time, the answer box area detection unit 43 may calculate the number of the detected answer box area from the top and the left in the answer sheet image 30, and identify and label the corresponding question number.

[0041] The area detection method is not limited to a method using deep learning such as R-CNN, and any method can be applied as long as it is an algorithm that detects an object included in an image. Also, the method of identifying the question number corresponding to the answer box area is not limited to a method based on the order of the answer box areas in the answer sheet image 30, and any method can be applied, such as identifying the question number written in parentheses by performing character recognition by OCR for each area.

[0042] The answer text acquisition unit 44 acquires the text entered in each answer column as the answer text from the answer sheet image 30. FIG. 7 is an example of an answer text acquisition result. As shown in FIG. 7, the answer text acquisition unit 44 acquires the answer text in each answer column area from the answer sheet image 30 using a text area acquisition model from an image. An example of a text area acquisition model from an image is the paper "OCR-free Document Understanding Transformer [Geewook Kim, 2021]". Specifically, the answer text acquisition unit 44 acquires text coordinate information regarding the position coordinates of the answer text entered in each answer column in the answer sheet image 30.

[0043] The overlap determination unit 45 determines whether the marking symbols and the answer text overlap. FIG. 8 is a diagram for explaining the overlap determination of the marking symbols and the answer text. As shown in FIG. 8, the overlap determination unit 45 overlaps the marking symbols and the answer text based on the symbol coordinate information acquired by the marking symbol acquisition unit 42 and the text coordinate information acquired by the answer text acquisition unit 44, and determines whether they overlap for each answer column. Specifically, in the example of FIG. 8, the overlap determination unit 45 determines that the marking symbols and the answer texts entered in the answer columns of the questions with question numbers 1, 3, 4, and 5 overlap. On the other hand, the overlap determination unit 45 determines that the marking symbols and the answer texts entered in the answer columns of the questions with question numbers 2, 6, 7, and 8 do not overlap.

[0044] Moreover, each time the moving unit 48, which will be described later, moves a marking symbol, the overlap determination unit 45 determines whether the moved marking symbol overlaps with the answer text. At this time, the overlap determination unit 45 determines that the moved marking symbol does not overlap with the answer text, and also that it fits within the answer column area as a determination condition. According to this, if the marking symbol does not fit within the answer column area even if it does not overlap with the answer text, the overlap determination unit 45 determines that the marking symbol overlaps with the answer text. This makes it possible to grasp the marking symbol only within the answer column area, without considering the area outside the answer column area.

[0045] If the overlap determination unit 45 determines that there is no overlap, the position determination unit 46 determines the position of the marking symbol and stores it in the storage unit 13 or a specified DB. Specifically, the position determination unit 46 determines the position of the marking symbol that does not overlap with the answer text for each answer column, and stores the position coordinates indicating the determined position in association with the question number corresponding to the answer column. At this time, if the moving unit 48 described later moves the marking symbol or the reducing unit 49 reduces the marking symbol, the position determination unit 46 also determines and stores the center position and the reduction rate of the circumscribing rectangle of the marking symbol.

[0046] 9 is a diagram for explaining the movement of a marking symbol. The rectangle specifying unit 47 specifies the circumscribing rectangle of a marking symbol determined by the overlap determining unit 45 to overlap with an answer text and the center position of the circumscribing rectangle. Specifically, the rectangle specifying unit 47 specifies the circumscribing rectangle of the marking symbol and the center position of the circumscribing rectangle based on the symbol coordinate information of the marking symbol determined by the overlap determining unit 45 to overlap, as shown in FIG. 9(a).

[0047] The moving unit 48 moves the marking symbol that is determined by the overlap determining unit 45 to overlap with the answer text to a position where it does not overlap with the answer text. Specifically, as shown in Fig. 9(b), the moving unit 48 moves the center position of the circumscribing rectangle identified by the rectangle identifying unit 47 in order from the upper left coordinates within the answer column area. In this way, the moving unit 48 searches for a position where the marking symbol fits within the answer column area and does not overlap with the answer text.

[0048] The overlap determination unit 45 performs overlap determination every time the moving unit 48 moves a marking symbol. At this time, the overlap determination unit 45 determines that the marking symbol and the answer text do not overlap when the marking symbol moved by the moving unit 48 fits within the answer column area and does not overlap with the answer text. Specifically, FIG. 9(c) is an example of a marking symbol 80 that does not fit within the answer column area and a marking symbol 81 that fits within the answer column area. Also, FIG. 9(d) is an example of a marking symbol 82 that overlaps with the answer text and a marking symbol 83 that does not overlap with the answer text. In the examples of FIGS. 9(c) and (d), when the moving unit 48 moves a marking symbol, the overlap determination unit 45 determines that only the marking symbol 83 that fits within the answer column area and does not overlap with the answer text does not overlap.

[0049] The reduction unit 49 reduces the marking mark when there is no position where the marking mark fits within the answer column area and does not overlap with the answer text. The reduction ratio can be set arbitrarily. Each time the reduction unit 49 reduces the marking mark, the movement unit 48 moves the reduced marking mark to a position within the answer column area where the marking mark does not overlap with the answer text. Specifically, the movement unit 48 identifies a circumscribing rectangle of the reduced marking mark, and moves the center position in order from the top left coordinates within the answer column area.

[0050] When the position of the marking marks in all answer columns is determined by the position determination unit 46, the overlap avoidance image creation unit 50 creates an overlap avoidance image in which the marking marks are moved to the determined positions based on the answer sheet image 30. At this time, if the marking marks are reduced by the reduction unit 49, the overlap avoidance image creation unit 50 similarly reduces the marking marks. Specifically, the overlap avoidance image is an image in which the marking marks are moved to the determined positions in the answer columns of questions 1, 3, 4, and 5 of the answer sheet image 30 to avoid overlap with the answer text, as shown in the image display area 70 of Fig. 5.

[0051] The overlap avoidance image creation unit 50 also recognizes the marking symbols (circle, cross, triangle, etc.) present in each answer column area of ​​the answer sheet image 30 by pattern matching and automatically assigns them to obtain the question number of each question and the marking symbol entered in the answer column of each question.The overlap avoidance image creation unit 50 then creates a marking result consisting of the question number, the answer which is the image of the answer column acquired from the overlap avoidance image, and the automatically assigned marking symbol, as shown in the marking result display area 74 of FIG.

[0052] The screen output unit 40 displays the overlap avoidance image and the marking result created by the overlap avoidance image creation unit 50 on the marking confirmation screen. The teacher can visually check whether the automatically assigned marking symbol is correct or not by looking at the overlap avoidance image and the marking result displayed on the marking confirmation screen. If there is an error, the teacher can press the correction button 75 on the marking confirmation screen and correct the marking symbol by a predetermined operation. The teacher can also obtain the overlap avoidance image from the marking confirmation screen and print it using a printer or the like. By distributing the printed overlap avoidance image to the target students, the target students can review and study without feeling the disadvantage of the marking symbol and the answer being difficult to see due to overlapping.

[0053] The interpolation unit 51 interpolates the missing answer text due to the movement of the marking result by the moving unit 48 or the reduction of the marking result by the reducing unit 49. FIG. 10 is a diagram for explaining the interpolation of the answer text. The screen output unit 40 creates an overlap avoidance image that does not overlap with the answer text by moving or reducing the marking symbol, but the overlap avoidance image causes a missing part in the answer text due to the movement or reduction of the marking symbol, as shown in FIG. 10(a). Therefore, the interpolation unit 51 uses, for example, an image interpolation method that reconstructs a specified image area seamlessly based on information such as surrounding pixel values, to interpolate the missing part in the marking symbol as shown in FIG. 10(b). An example of an image interpolation method is the paper "MAT: Mask-Aware Transformer for Large Hole Image Inpainting [Wenbo Li, 2022]". According to this, the teacher can check and review the marking without worrying about the missing part in the answer text due to the movement of the marking symbol. It should be noted that the interpolation of missing parts of the answer text by the interpolation unit 51 is not necessarily required, and whether or not it is necessary to perform the interpolation can be set arbitrarily.

[0054] In the above configuration, the screen output unit 40, the answer sheet image acquisition unit 41, the marking symbol acquisition unit 42, the answer text acquisition unit 44, the overlap judgment unit 45, the position determination unit 46, the rectangle specification unit 47, the movement unit 48, the reduction unit 49, the overlap avoidance image creation unit 50, and the interpolation unit 51 of the server 10 are examples of the output unit, the marked answer data acquisition unit, the marking symbol acquisition unit, the answer text acquisition unit, the overlap judgment unit, the position determination unit, the rectangle specification unit, the movement unit, the reduction unit, the overlap avoidance data creation unit, and the interpolation unit, respectively, of the present invention. Also, the answer sheet image and the overlap avoidance image are examples of the marked answer data and the overlap avoidance data of the present invention.

[0055] [Overlap avoidance processing] Next, we will explain the overlap avoidance process, which avoids overlapping of the marking marks and the answer text by moving or reducing the marking marks based on the answer sheet image on which the student's answer and the teacher's marking marks are written. Figure 11 is a flowchart of the overlap avoidance process. This process is realized by the server 10 executing a program prepared in advance.

[0056] When a teacher uses the teacher terminal 20 to log in to a specific site or launch a specific application, the server 10 acquires a screen request for the marking confirmation screen. The server 10 then transmits screen information for the marking confirmation screen to the teacher terminal 20, causing the teacher terminal 20 to display the marking confirmation screen (step S10).

[0057] The teacher uploads the answer sheet image 30 on the marking confirmation screen by performing a predetermined operation using the teacher terminal 20. As a result, the server 10 acquires the answer sheet image 30 (step S11). Then, the server 10 acquires the marking symbols from the answer sheet image 30 (step S12). Specifically, the server 10 acquires the symbol coordinate information of each marking symbol. Also, the server 10 detects the answer column area from the answer sheet image 30 and acquires the answer text entered in each answer column (step S13). Specifically, the server 10 acquires the text coordinate information of the answer text entered in each answer column. Then, the server 10 determines whether the marking symbols and the answer text overlap for each answer column based on the symbol coordinate information and the text coordinate information (step S14).

[0058] If the marking symbols and the answer text do not overlap (step S14; No), the server 10 confirms the position of the marking symbols in the answer column and proceeds to the process of step S16. Then, the server 10 judges whether the overlap judgment with the answer text has been performed for the marking symbols of all answer columns (step S16). If the overlap judgment has not been performed for the marking symbols of all answer columns (step S16; No), the server 10 returns to the process of step S14 for the marking symbols of the answer columns for which the overlap judgment has not yet been performed. On the other hand, if the overlap judgment has been performed for the marking symbols of all answer columns (step S16; Yes), the server 10 creates an overlap avoidance image and a marking result, and displays them on the marking confirmation screen (step S17). This ends the overlap avoidance process.

[0059] On the other hand, if the mark symbol and the answer text overlap (step S14; Yes), the server 10 proceeds to a movement process (step S15).

[0060] [Movement Processing] Next, the moving process for moving or reducing the marking symbols so that they do not overlap with the answer text within the answer column area will be described. Fig. 12 is a flowchart of the moving process. This process is realized by the server 10 executing a program prepared in advance.

[0061] First, the server 10 identifies the circumscribing rectangle of the marking symbol and the center position of the circumscribing rectangle based on the symbol coordinate information of the marking symbol that overlaps with the answer text in a specific answer column (step S21). The server 10 searches for the position of the marking symbol that does not overlap with the answer text by moving the center position of the circumscribing rectangle of the marking symbol from the top left coordinate in the answer column area in order. Then, the server 10 determines whether the center position has moved all over the answer column area (step S22).

[0062] If it is determined that not all of the marks have been moved yet (step S22; No), the server 10 moves the marking symbol within the answer column area (step S23). Each time the marking symbol is moved, the server 10 determines whether the marking symbol fits within the answer column area (step S24). If the marking symbol does not fit within the answer column area (step S24; No), the server 10 returns to the process of step S22. On the other hand, if the marking symbol fits within the answer column area (step S24; Yes), the server 10 determines whether the marking symbol overlaps with the answer text (step S25). If the marking symbol overlaps with the answer text (step S25; Yes), the server 10 returns to the process of step S22. On the other hand, if the mark symbol does not overlap with the answer text (step S25; No), the server 10 confirms the position of the mark symbol (step S27) and proceeds to the process of step S16 of the overlap avoidance process shown in Fig. 11. This ends the movement process.

[0063] On the other hand, if it is determined in step S22 that the entire answer column area has been moved (step S22; Yes), this means that there is no position of the marking symbol that does not overlap with the answer text in the answer column area, so the server 10 reduces the marking symbol (step S26) and proceeds to the process of step S23. Thus, in the movement process, the server 10 repeatedly moves and reduces the marking symbol until it finds a position in the answer column area that does not overlap with the answer text.

[0064] In this embodiment, the graded answer data is an answer sheet image on which the student's answer and the teacher's marking symbols are written on a paper answer sheet, but the present invention is not limited to this, and it is also possible to apply an answer sheet image on which the student's answer is written on a paper answer sheet and the teacher has graded it on the teacher's terminal 20 using a digital pen or the like.

[0065] Also, instead of using paper answer sheets, a digital test may be used in which the student displays the test on his / her own tablet or PC and writes the answers using a keyboard or digital pen. In this case, the data of the digital test that the teacher grades on the teacher terminal 20 using a digital pen or the like can be applied as graded answer data. Since the data written with the digital pen includes the position coordinates of the strokes on the digital test, the server 10 can obtain the graded coordinate information and the text coordinate information from the data written with the digital pen.

[0066] The learning support system 100 of this embodiment can create and output overlap avoidance data that avoids overlap between the scoring symbols and the answer text by moving or reducing the scoring symbols based on the answers by the learners and the graded answer data in which the graders have entered the scoring symbols. This allows the learning support system 100 to display the scoring symbols and the answers by the learners so that they do not overlap. This can reduce the burden on teachers, such as the difficulty and time required to visually judge when checking or reviewing the marks, which occurs when the scoring symbols and the answer text overlap.

[0067] <First Modification> In the above embodiment, the teacher uses the teacher terminal 20, but the present invention is not limited to this, and the teacher may use a teacher terminal having the functions of the server 10. In other words, the functions of the server 10 may be incorporated in the teacher terminal. The teacher terminal having the functions of the server 10 is, for example, a PC or a general-purpose tablet, just like the server 10. In this case, the teacher terminal having the functions of the server 10 executes the overlap determination process and movement process that the server 10 performed, and moves or reduces the marking marks based on the answer sheet image, thereby preventing the marking marks from overlapping with the answer text.

[0068] <Second Modification> The overlap avoidance image and the marking results in the above embodiment may be stored in a specified DB in association with the student identification information. In the above embodiment, the teacher uses the teacher terminal 20 to log in to the marking confirmation screen and performs a specified operation, and the server 10 displays the overlap avoidance image and the marking results on the marking confirmation screen. However, the present invention is not limited to this. The student uses the student terminal to log in to the marking confirmation screen and performs a specified operation, and the server 10 may extract the overlap avoidance image and the marking results from the specified DB based on the student identification information of the student and display them on the marking confirmation screen. In this case, the student terminal is a tablet or PC similar to the teacher terminal 20, and is connected to the server 10. In addition, the student cannot modify the marking results using the student terminal. According to this, the student can easily check the overlap avoidance image and the marking results using the student terminal. Therefore, it is possible to reduce the burden on the student, such as difficulty in visually judging and time-consuming during review learning. [Explanation of symbols]

[0069] 5. Network 10 Server 20 Teacher's terminal 40 Screen output section 41 Answer sheet image acquisition section 42 Score symbol acquisition section 43 Answer column area detection section 44 Answer text acquisition section 45 Overlap Judgment Section 46 Position determination part 47 Rectangle specific part 48 Mobile Section 49 Reduction section 50 Overlap avoidance image creation section 51 Interpolation section 100 Learning Support System

Claims

1. a graded answer data acquiring unit for acquiring graded answer data in which answers by learners and marking marks by a grader are entered; a mark acquisition unit for acquiring the mark from the marked answer data; an answer text acquisition unit that acquires an answer text, which is a text indicating the answer, from the graded answer data; an overlap determination unit that determines whether the marking symbol and the answer text overlap; a moving unit that moves the marking symbol to a position where the marking symbol does not overlap with the answer text when the overlap determination unit determines that the marking symbol overlaps with the answer text; An information processing device comprising:

2. The graded answer data is an answer sheet image having a plurality of answer columns, in which the learner has entered an answer in each answer column, and the grader has entered a marking symbol for the answer in each answer column, The mark acquisition unit acquires the marking marks entered in each answer column, The answer text acquisition unit acquires the text entered in each answer column as an answer text, The overlap determination unit determines whether or not the mark symbol and the answer text overlap for each answer column; The information processing device according to claim 1 , wherein the movement unit, when the overlap determination unit determines that there is an overlap, moves the marking symbol to a position that fits within the area of ​​the answer column and does not overlap the answer text.

3. a reduction unit that reduces the marking mark when there is no position where the marking mark fits within the area of ​​the answer column and does not overlap with the answer text; The information processing device according to claim 2 , wherein the moving unit moves the marking symbol reduced by the reducing unit to a position that fits within the area of ​​the answer column and does not overlap with the answer text.

4. The information processing device according to claim 2 , wherein the overlap determination unit determines that the mark symbol moved by the movement unit does not overlap when the mark symbol fits within an area of ​​the answer column and does not overlap with the answer text.

5. the mark symbol acquisition unit acquires mark coordinate information relating to position coordinates of the mark symbols in the answer sheet image; the answer text acquisition unit acquires text coordinate information relating to position coordinates of the answer text in the answer sheet image; The information processing device according to claim 2 , wherein the overlap determination unit determines whether or not there is an overlap based on the symbol coordinate information and the text coordinate information within the area of ​​each answer column.

6. a rectangle specifying unit that specifies a circumscribing rectangle of the marking symbol and a center position of the circumscribing rectangle based on the symbol coordinate information when the overlap determining unit determines that the marking symbol overlaps, The information processing device according to claim 5 , wherein the movement unit moves a center position of the circumscribing rectangle within the area of ​​the answer column.

7. a position determination unit that determines a position that does not overlap with the answer text as a position of the mark symbol; an overlap avoidance data creation unit that creates overlap avoidance data by moving the marking symbol to the position determined by the position determination unit based on the scored answer data; an output unit that outputs the overlap avoidance data; The information processing device according to claim 1 .

8. The information processing device according to claim 7 , further comprising an interpolation unit that interpolates missing answer text by moving a marking symbol to a position determined by the position determination unit in the overlap avoidance data based on the marked answer data.

9. A program executed by an information processing device having a computer, a graded answer data acquisition unit for acquiring graded answer data in which answers by learners and marking marks by a grader are entered; a marking symbol acquiring unit for acquiring the marking symbols from the marked answer data; an answer text acquisition unit that acquires an answer text, which is a text indicating the answer, from the graded answer data; an overlap determination unit that determines whether the marking symbol and the answer text overlap; a moving unit that moves the marking symbol to a position where the marking symbol does not overlap with the answer text when the overlap determination unit determines that the marking symbol overlaps with the answer text; A program for causing the computer to function as a

Citation Information

Patent Citations

  • Digital marking system

    JP2010152480A