Image processing device, scoring system, image forming system, image processing method, and program

Abstract

This invention provides an image processing device, a scoring system, an image forming system, an image processing method, and a program that can contribute to improving the efficiency of scoring operations. [Solution] In the scoring system 1, the image forming apparatus 20 includes a reading unit that reads an answer sheet on which an additional image for recognizing the area of ​​the answer field is printed and the answer to the question is written in the answer field, and generates completed image data, and a recognition unit that recognizes the area of ​​the answer field on the completed image data based on the additional image.

Description

Technical Field

[0001] The present disclosure relates to an image processing apparatus, a scoring system, an image forming system, an image processing method, and a program.

Background Art

[0002] Conventionally, an automatic scoring technique using an image forming apparatus such as a copying machine or a multifunction peripheral (MFP) has been known (see, for example, Patent Document 1 and Non-Patent Document 1). Non-Patent Document 1 discloses a technique for automatically scoring answers by a scorer scanning an answer sheet on which answers are written and presetting scoring locations by designating answer columns on the image data of the scanned answer sheet.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Non-Patent Documents

[0004]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the conventional technology as disclosed in Non-Patent Document 1, in order to perform automatic scoring, it is necessary to manually preset the scoring locations, so there is room for improvement in enhancing the efficiency of the scoring operation.

[0006] This disclosure is made in view of the above circumstances and aims to provide an image processing device, a scoring system, an image forming system, an image processing method, and a program that can contribute to improving the efficiency of scoring operations. [Means for solving the problem]

[0007] One embodiment of the image processing apparatus of the present disclosure comprises a reading unit that reads an answer sheet on which an additional image for recognizing the region of the answer field is printed and the answer to the question is written in the answer field, and generates completed image data; and a recognition unit that recognizes the region of the answer field on the completed image data based on the additional image.

[0008] One aspect of the scoring system of this disclosure comprises the image processing device and a scoring device for scoring the answers contained in the area of ​​the answer field on the recognized completed image data.

[0009] One aspect of the image forming system of the present disclosure includes an image forming unit that generates an answer sheet by performing image formation on a recording medium based on answer image data including answer fields for a question and an additional image for recognizing the area of ​​the answer fields.

[0010] One aspect of the image processing method of the present disclosure includes a reading step in which a reading unit reads an answer sheet on which an additional image for recognizing the area of ​​the answer field is printed and the answer to the question is written in the answer field, and generates completed image data; and a recognition step in which a recognition unit recognizes the area of ​​the answer field on the completed image data based on the additional image.

[0011] One aspect of the program of this disclosure causes a computer to perform the following steps: an acquisition step of acquiring completed image data obtained by reading an answer sheet in which an additional image for recognizing the area of ​​the answer field is printed and the answer to the question is written in the answer field; and a recognition step of recognizing the area of ​​the answer field on the completed image data based on the additional image. [Effects of the Invention]

[0012] This disclosure provides an image processing device, a scoring system, an image forming system, an image processing method, and a program that can contribute to improving the efficiency of scoring operations. [Brief explanation of the drawing]

[0013] [Figure 1] Figure 1 is a system configuration diagram showing an example of the scoring system configuration of this embodiment. [Figure 2] Figure 2 is a block diagram showing an example of the hardware configuration of the information processing device of this embodiment. [Figure 3] Figure 3 is a block diagram showing an example of the hardware configuration of the image forming apparatus according to this embodiment. [Figure 4] Figure 4 is a block diagram showing an example of the functional configuration of the scoring system of this embodiment. [Figure 5] Figure 5 shows an example of image data for the answer in this embodiment. [Figure 6] Figure 6 shows an example of answer image data to which the additional image of this embodiment has been added. [Figure 7] Figure 7 shows an example of an answer sheet with the answers to this embodiment filled in. [Figure 8] Figure 8 shows an example of the solved image data of this embodiment. [Figure 9] Figure 9 shows an example of the analysis results of the periodicity of the added image portion in the solved image data of this embodiment. [Figure 10] Figure 10 shows an example of the solved image data of this embodiment. [Figure 11] Figure 11 shows an example of the analysis results of the periodicity of the added image portion in the solved image data of this embodiment. [Figure 12] Figure 12 is a sequence diagram showing an example of the answer sheet generation process performed in the information processing apparatus and image forming apparatus of this embodiment. [Figure 13]FIG. 13 is a sequence diagram showing an example of a process for generating answer-completed image data for automatic scoring performed by the information processing apparatus and the image forming apparatus of the present embodiment. [Figure 14] FIG. 14 is a flowchart showing an example of a process for recognizing a region of an answer column performed by the image forming apparatus of the present embodiment. [Figure 15] FIG. 15 is a diagram showing an example of a color scheme pattern of an additional image according to Modification 1. [Figure 16] FIG. 16 is a diagram showing an example of answer image data to which an additional image according to Modification 2 is added. [Figure 17] FIG. 17 is an enlarged view of the periphery of the answer column according to Modification 2. [Figure 18] FIG. 18 is an enlarged view of the periphery of the answer column according to Modification 3. [Figure 19] FIG. 19 is an enlarged view of the periphery of the answer column according to Modification 3.

Mode for Carrying Out the Invention

[0014] Hereinafter, embodiments of the present disclosure (hereinafter simply referred to as "the present embodiment") will be described in detail with reference to the drawings. Note that the present disclosure is not limited to the following embodiments. Also, the following embodiments and modifications can be combined as appropriate.

[0015] Hereinafter, the present disclosure will be described by taking a scholastic aptitude test conducted for verifying academic ability at school or the like as an example. However, the present disclosure is not limited to this, and can be applied to scoring operations and tabulation operations in all fields.

[0016] First, the configuration of the scoring system of the present embodiment will be described.

[0017] Figure 1 is a system configuration diagram showing an example of the configuration of the scoring system 1 of this embodiment. As shown in Figure 1, the scoring system 1 (an example of an image forming system) comprises an information processing device 10 (an example of a scoring device) and an image forming device 20 (an example of an image processing device). The information processing device 10 and the image forming device 20 are connected via a network 2. Network 2 can be implemented by, for example, the Internet and a LAN (Local Area Network), or at least one of the above. Network 2 may be a wired network, a wireless network, or a mixture of wired and wireless networks.

[0018] The information processing device 10 generates print data (print jobs) for generating (printing) answer sheets from answer image data, and also performs automatic scoring using completed answer image data. Examples of answer image data include image data that serves as the basis for answer sheets for academic ability tests. Examples of completed answer image data include image data obtained by reading (scanning) an answer sheet with answers filled in.

[0019] Examples of information processing devices 10 include, but are not limited to, PCs (Personal Computers), tablet devices, or smartphones. Furthermore, multiple information processing devices 10 may be used, with separate devices performing tasks such as generating print data and automatic scoring.

[0020] The image forming apparatus 20 generates (prints) answer sheets based on print data (print jobs) generated by the information processing apparatus 10, and generates completed image data by reading answer sheets with answers filled in. In particular, the image forming apparatus 20 of this embodiment automatically recognizes the area of ​​the answer column where answers have been filled in when reading the answer sheet and generates completed image data. Therefore, according to this embodiment, the scoring locations can be automatically registered in advance, which contributes to improving the efficiency of scoring work.

[0021] The image forming apparatus 20 may include, but is not limited to, at least one of the following: a printer, a copier, a multifunction peripheral (MFP), a scanner, and a facsimile machine. A multifunction peripheral has at least two of the following functions: copying, printing, scanning, and facsimile. It is also possible to use multiple image forming apparatuses 20, with separate image forming apparatuses for printing and reading answer sheets.

[0022] Figure 2 is a block diagram showing an example of the hardware configuration of the information processing device 10 of this embodiment. As shown in Figure 2, the information processing device 10 comprises a control device 11, a main memory 12, an auxiliary storage device 13, a communication device 14, an input device 15, a display device 16, and various buses 19. The control device 11, main memory 12, auxiliary storage device 13, communication device 14, input device 15, and display device 16 are connected via various buses 19. Thus, the information processing device 10 of this embodiment has a general hardware configuration using a normal computer.

[0023] The control device 11 controls the overall operation of the information processing device 10. The control device 11 may be, for example, at least one of a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit), but is not limited to these. There may be one or more CPUs or GPUs, and they may be single-core or multi-core.

[0024] Examples of main memory 12 include, but are not limited to, ROM (Read Only Memory) and RAM (Random Access Memory). ROM stores various programs, such as programs for controlling the information processing device 10, printer driver programs, and programs for automatic scoring applications. RAM is used as a workspace for the control device 11 to perform various controls based on the programs stored in ROM.

[0025] The auxiliary storage device 13 stores the various programs described above, as well as various data used for automatic scoring. The various programs described above only need to be stored in at least one of the main storage device 12 and the auxiliary storage device 13. Examples of the auxiliary storage device 13 include, but are not limited to, at least one of existing storage devices capable of magnetic, electrical, or optical storage, such as an HDD (Hard Disk Drive), SSD (Solid State Drive), and DVD (Digital Versatile Disc). The auxiliary storage device 13 may be built into the information processing device 10, or it may be externally connected to the information processing device 10 via an interface such as USB (Universal Serial Bus). Furthermore, the auxiliary storage device 13 may be a NAS (Network Attached Storage) connected via a network such as a LAN or WAN (Wide Area Network).

[0026] The communication device 14 is used to communicate with the image forming apparatus 20 and the like via the network 2. Examples of the communication device 14 include, but are not limited to, a communication device for a wired LAN or a wireless communication device for a wireless LAN.

[0027] The input device 15 is used by the user for various inputs, selections, and specifications, and serves as a user interface between the user and the system. Examples of input devices 15 include, but are not limited to, keyboards, mice, and touch panels. The input device 15 may be built into the information processing device 10 or connected externally to the information processing device 10 via an interface such as USB.

[0028] The display device 16 displays various screens and serves as a user interface between the user and the device. Examples of the display device 16 include, but are not limited to, liquid crystal displays, organic electro-luminescence (OLED) displays, and touch panel displays. The display device 16 may be an internal display built into the information processing device 10, or an external display connected to the information processing device 10 via a display interface such as HDMI®.

[0029] In addition to the above configuration, the information processing device 10 may also be equipped with hardwired circuits such as ICs (Integrated Circuits), ASICs (Application Specific Integrated Circuits), and FPGAs (Field-Programmable Gate Arrays) that are specific to the information processing device 10.

[0030] Figure 3 is a block diagram showing an example of the hardware configuration of the image forming apparatus 20 of this embodiment. As shown in Figure 3, the image forming apparatus 20 includes a scanner engine 21, a scanner image processing circuit 23, a communication device 25, a control device 27, a main memory 29, an auxiliary memory 31, a printer image processing circuit 33, a printer engine 35, an input device 37A, a display device 37B, and various buses 39. In this embodiment, the case in which the input device 37A and the display device 37B constitute a touch panel display 37 will be described as an example. However, it is not limited to this, and the input device 37A and the display device 37B may be separate devices.

[0031] The scanner image processing circuit 23, communication device 25, control device 27, main memory 29, auxiliary memory 31, printer image processing circuit 33, input device 37A, and display device 37B are connected via various buses 39. The scanner engine 21 is connected to the scanner image processing circuit 23 via various buses 39. The printer engine 35 is connected to the printer image processing circuit 33 via various buses 39.

[0032] The scanner engine 21 is a mechanism that optically reads an answer sheet with answers written on it and generates completed image data, which is image data of the answer sheet. The scanner engine 21 is composed of an image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor). The answer sheet may be automatically fed to the scanner engine 21 using an ADF (Automatic Document Feeder).

[0033] The scanner image processing circuit 23 performs various image processing operations, such as density conversion and color correction, on the scanned image data generated by the scanner engine 21. Examples of the scanner image processing circuit 23 include image processing circuits such as ASICs.

[0034] The communication device 25 is used to communicate with the information processing device 10 via the network 2. Since the implementation method of the communication device 25 is the same as that of the communication device 14, a detailed explanation is omitted.

[0035] The control device 27 controls the overall operation of the image forming apparatus 20. The implementation method for the control device 27 is the same as that for the control device 11.

[0036] For example, when the control device 27 reads an answer sheet with answers written on it and generates completed image data, it controls the scanner engine 21 and the scanner image processing circuit 23. The control device 27 applies the recognition processing described later to the completed image data output from the scanner image processing circuit 23, and controls the communication device 25 to transmit the recognized completed image data to the information processing device 10.

[0037] For example, when the control device 27 prints an answer sheet from answer image data, it receives print data (print job) of the answer image data from the information processing device 10 via the communication device 25. The control device 27 generates a print image for printing by applying RIP (Raster Image Processor) processing to the image of the answer image data included in the print data. The control device 27 controls the printer image processing circuit 33 and the printer engine 35 to perform printing using the generated print image.

[0038] Image data for answers included in print data may be in formats such as PostScript (PDL - Page Description Language) or TIFF (Tag Image File Format), but are not limited to these. Similarly, printable images may be in formats such as CMYK, but are not limited to these.

[0039] The implementation method for the main memory 29 is the same as that for the main memory 12, so a detailed explanation will be omitted. The ROM of the main memory 29 stores various programs for controlling the image forming apparatus 20, such as programs for print control and programs for scanner control.

[0040] The auxiliary storage device 31 stores the various programs and data mentioned above. Note that the various programs mentioned above only need to be stored in at least one of the main memory device 29 and the auxiliary storage device 31. The implementation method for the auxiliary storage device 31 is the same as that for the auxiliary storage device 13, so a detailed explanation is omitted.

[0041] The printer image processing circuit 33 performs various image processing operations on the print image output from the control device 27 and outputs it to the printer engine 35. Examples of the printer image processing circuit 33 include image processing circuits such as ASICs.

[0042] The printer engine 35 generates the answer sheet by forming (printing) the printable image output from the printer image processing circuit 33 onto a recording medium. The printing method of the printer engine 35 may be either an inkjet method or a laser method. Therefore, the printer engine 35 may be implemented with an inkjet mechanism or a laser mechanism. The recording medium may be, for example, recording paper or roll paper, but is not limited to these, and may be any medium on which a printable image can be printed.

[0043] The input device 37A is used for various operation inputs to the image forming apparatus 20, such as scanner operation, and serves as a user interface between the user and the apparatus. The display device 37B displays various screens, such as the scanner operation screen generated by the control device 27, and also serves as a user interface between the user and the apparatus.

[0044] In this embodiment, the example of implementing the scanner image processing circuit 23 and the printer image processing circuit 33 using hardware such as an ASIC was described. However, the embodiment is not limited to these, and the scanner image processing circuit 23 and the printer image processing circuit 33 may also be implemented as software using a control device 27 (GPU) or the like.

[0045] Figure 4 is a block diagram showing an example of the functional configuration of the scoring system 1 of this embodiment. Specifically, Figure 4 shows an example of the functional configuration of the information processing device 10 and the image forming apparatus 20.

[0046] As shown in Figure 4, the information processing device 10 includes an answer image data acquisition unit 101, a print data generation unit 103, a print instruction unit 105, an answer image data receiving unit 111, and a scoring unit 113. The answer image data acquisition unit 101, the print data generation unit 103, the print instruction unit 105, the answer image data receiving unit 111, and the scoring unit 113 can be implemented, for example, by the control device 11, main memory 12, and communication device 14 described in Figure 2.

[0047] For example, the control device 11 reads the printer driver program stored in the main memory 12 (ROM) or auxiliary memory 13 and loads it into the main memory 12 (RAM). The control device 11 executes various processes according to the loaded program to realize the above-mentioned answer image data acquisition unit 101, print data generation unit 103, and print instruction unit 105 as functions of the printer driver. Alternatively, for example, the control device 11 reads the program for the automatic scoring application stored in the main memory 12 (ROM) or auxiliary memory 13 and loads it into the main memory 12 (RAM). The control device 11 executes various processes according to the loaded program to realize the above-mentioned completed image data receiving unit 111 and scoring unit 113 as functions of the automatic scoring application.

[0048] Here, we have explained the case where each of the above-mentioned functional units is implemented as software, but at least a part of each of the above-mentioned functional units may be implemented as hardware. In this case, the functional unit to be implemented as hardware can be implemented, for example, by the hardwired circuit described above. Alternatively, any of the above-mentioned functional units may be implemented through the cooperation of software and hardware.

[0049] Furthermore, as shown in Figure 4, the image forming apparatus 20 includes a print instruction receiving unit 201, a print image generation unit 203, an image forming unit 205, a reading unit 211, a decoded image data acquisition unit 213, a recognition unit 215, and a decoded image data transmission unit 217. The print instruction receiving unit 201, the print image generation unit 203, the decoded image data acquisition unit 213, the recognition unit 215, and the decoded image data transmission unit 217 can be realized, for example, by the control device 27, main memory 29, and communication device 25 described in Figure 3.

[0050] For example, the control device 27 reads the print control program stored in the main memory 29 (ROM) or auxiliary memory 31 and loads it into the main memory 29 (RAM). The control device 27 then executes various processes according to the loaded program to realize the print instruction receiving unit 201 and the print image generation unit 203 described above.

[0051] For example, the control device 27 reads the scanner control program stored in the main memory 29 (ROM) or auxiliary memory 31 and loads it into the main memory 29 (RAM). The control device 27 then executes various processes according to the loaded program to realize the above-mentioned solved image data acquisition unit 213, recognition unit 215, and solved image data transmission unit 217.

[0052] Here, we have explained the case where each of the above-mentioned functional units is implemented as software, but at least a part of each of the above-mentioned functional units may be implemented as hardware. In this case, the functional unit to be implemented as hardware can be implemented, for example, by the hardwired circuit described above. Alternatively, any of the above-mentioned functional units may be implemented through the cooperation of software and hardware.

[0053] The image forming unit 205 can be realized, for example, by the printer image processing circuit 33 and printer engine 35 described in Figure 3. The reading unit 211 can be realized, for example, by the scanner engine 21 and scanner image processing circuit 23 described in Figure 3.

[0054] It should be noted that the information processing apparatus 10 and image forming apparatus 20 of this embodiment do not necessarily require all of the above-described functional units to be part of the essential configuration, and at least some of the functional units can be omitted.

[0055] The following will provide a detailed explanation of the functional units of the information processing device 10 and the image forming apparatus 20. First, we will describe the answer image data acquisition unit 101, the print data generation unit 103, the print instruction unit 105, the print instruction receiving unit 201, the print image generation unit 203, and the image forming unit 205, all of which are used to generate answer sheets.

[0056] The answer image data acquisition unit 101 acquires answer image data, including the answer fields for each question. The answer image data may be, but is not limited to, image data in PDF (Portable Document Format) format, which is the source of answer sheets for tests and questionnaires. The answer image data may be in a format in which the question and answer fields are described together, or in a format in which question identification information that identifies the question and the answer fields are described together. Examples of question identification information include the question number of the question.

[0057] Figure 5 shows an example of the answer image data 301 of this embodiment. The answer image data 301 shown in Figure 5 is the image data that forms the basis of the answer sheet for a Japanese language quiz. In the answer image data 301, the answer spaces 311 and 313 for the kanji writing questions are indicated in parentheses.

[0058] The print data generation unit 103 generates print data by adding an additional image to the answer image data acquired by the answer image data acquisition unit 101 to recognize the area of ​​the answer field. For example, the answer image data acquisition unit 101 displays the acquired answer image data on the display device 16 and accepts a print instruction made by the user using the input device 15. When a print instruction is accepted, the print data generation unit 103 adds the additional image to the answer image data, converts it to a format such as PDL or TIFF, and generates print data.

[0059] Examples of additional images include images of periodic patterns such as background patterns. In this embodiment, the print data generation unit 103 adds an additional image to one side (the entire surface) of the answer image data using a digital watermarking method. However, the range to which the additional image is added is not limited to this; it is sufficient if it is added to an area that includes at least the answer fields. Furthermore, by adding an additional image to one side of the answer image data as in this embodiment, it is not necessary to specify the area of ​​the answer fields on the answer image data in advance, which contributes to improving the efficiency of answer sheet generation (in a broad sense, grading work).

[0060] Furthermore, in the print data of this embodiment, the print color of the added image portion is specified as a first color with low visibility. The first color is, for example, Y (yellow) in CMYK, but is not limited to this.

[0061] Figure 6 shows an example of answer image data 321 with the additional image of this embodiment added. In the answer image data 321 shown in Figure 6, an additional image 331 of a periodic yellow dot pattern is added to one side of the answer image data 301 shown in Figure 5.

[0062] The print instruction unit 105 transmits the print data generated by the print data generation unit 103 to the image forming apparatus 20 and instructs the image forming apparatus 20 to print based on the print data.

[0063] The print instruction receiving unit 201 receives print data transmitted from the information processing device 10 and accepts a print instruction based on said print data.

[0064] The print image generation unit 203 generates a print image for printing from the print data received by the print instruction receiving unit 201. For example, the print image generation unit 203 processes the print data (image data of the answer with added images) using a RIP (Raster Image Processor) to generate RIP images (bitmap images) for each of the CMYK colors as the print image.

[0065] The image forming unit 205 generates an answer sheet by forming an image on a recording medium based on the answer image data and the additional image. Specifically, the image forming unit 205 generates an answer sheet by forming an image on a recording medium based on the print data received by the print instruction receiving unit 201. In this embodiment, the image forming unit 205 generates an answer sheet by forming (printing) the print image generated by the print image generation unit 203 onto the recording medium.

[0066] This results in an answer sheet in which an additional image with a periodic pattern is printed in at least the area containing the answer space. Specifically, an answer sheet is obtained in which an additional image with a periodic pattern is printed on one side (the entire sheet). As mentioned above, the additional image is printed in the first color, which has low visibility, specifically in yellow in CMYK.

[0067] Next, we will describe the reading unit 211, the answered image data acquisition unit 213, the recognition unit 215, the answered image data transmission unit 217, the answered image data reception unit 111, and the scoring unit 113, which are used to generate completed image data for automatic scoring. In the following, it will be assumed that a short test is conducted using an answer sheet generated by the image forming unit 205, and that the answer fields on the answer sheet are filled in by the test takers, such as students.

[0068] Figure 7 shows an example of an answer sheet 401 with the answers for this embodiment filled in. The answer sheet 401 shown in Figure 7 was generated by printing the answer image data 421 shown in Figure 6. The answer sheet 401 shown in Figure 7 is used for a short test, and the answers "calm" and "specialized" are written in the answer spaces 411 and 413, respectively.

[0069] The reading unit 211 reads an answer sheet on which an additional image for recognizing the answer field area has been printed and the answer to the question has been written in the answer field, and generates completed image data. In this embodiment, the completed image data is assumed to be RGB image data, but is not limited to this.

[0070] The completed image data acquisition unit 213 acquires the completed image data generated by the reading unit 211.

[0071] The recognition unit 215 recognizes the area of ​​the answer field on the completed image data based on the additional image included in the completed image data acquired by the completed image data acquisition unit 213. Specifically, the recognition unit 215 recognizes the area of ​​the answer field on the completed image data based on the periodicity disturbance of the additional image.

[0072] As mentioned above, in this embodiment, the added image is printed in yellow in CMYK. Incidentally, it is known that the Y (yellow) in CMYK can be analyzed with high sensitivity by using the B (blue) channel of RGB. For this reason, in this embodiment, the periodicity disturbance of the added image is analyzed on the solved image data of the B channel.

[0073] FIG. 8 is a diagram showing an example of the answered image data 501 of the present embodiment. Specifically, FIG. 8 shows an enlarged view of the additional image portion in the answered image data 501 obtained by reading the answer sheet 401 shown in FIG. 7. In the present embodiment, the recognition unit 215 analyzes the periodic disturbance of the additional image on the answered image data 501 line by line. Specifically, the recognition unit 215 analyzes the periodic disturbance of the additional image for one line in the main scanning direction, advances in the sub-scanning direction when the analysis is completed, and repeats the process of analyzing the next line in the main scanning direction.

[0074] FIG. 9 is a diagram showing an example of the analysis result of the periodicity of the additional image portion in the answered image data 501 of the present embodiment. In the example shown in FIG. 9, the gradation values of a part of one line of the analysis target in the answered image data 501 of the B (blue) channel are shown. In the example shown in FIG. 9, the gradation value of the non-pattern part is the maximum value (bright blue), and the gradation value of the pattern part is an intermediate value (dark blue). Note that in the example shown in FIG. 9, no answer has been entered by the answerer in the additional image portion. Therefore, according to the pattern of the additional image portion, the maximum value and the intermediate value of the gradation value appear alternately, and the periodicity of the pattern of the additional image portion is not disturbed.

[0075] FIG. 10 is a diagram showing an example of the answered image data 501 of the present embodiment. Specifically, FIG. 10 shows an enlarged view of the portion where the answer appears in the answered image data 501. More specifically, FIG. 10 shows an enlarged view of the portion corresponding to the character (Chinese character) "Wen" entered in the answer column 411 of the answer sheet.

[0076] FIG. 11 is a diagram showing an example of the analysis result of the periodicity of the additional image portion in the answered image data 501 of the present embodiment. Specifically, FIG. 11 shows the analysis result of the periodicity of the additional image portion in which a part of the Chinese character "Wen" shown in FIG. 10 is captured. In the example shown in FIG. 11, similar to the example shown in FIG. 9, it shows the gradation values of a part of one line of the analysis target in the answered image data 501 of the B (blue) channel. However, in the example shown in FIG. 11, the answer by the answerer is captured in the additional image portion, and the gradation value of this answer portion (character portion) is the minimum value (black). Therefore, the regularity in which the maximum value and the medium-level values of the gradation values appear alternately is disrupted, and the periodicity of the pattern of the additional image portion is disrupted.

[0077] By performing the above-described analysis, the recognition unit 215 specifies, on a pixel-by-pixel basis, the portions where the periodicity of the pattern of the additional image portion is disrupted and the portions where it is not disrupted in the answered image data. The recognition unit 215 recognizes the region (coordinate region on the answered image data) composed of (and continuous) pixels in the portion where the periodicity is disrupted as the region of the answer column. Note that the recognition unit 215 may not only recognize the region of the answer column on the answered image data, but also recognize the answer entered in the answer column by means of character recognition (OCR: Optical Character Recognition) or the like.

[0078] Also, in the above-described recognition method, since the portions where the question text and the question number are captured also disrupt the periodicity of the pattern of the additional image portion, it is preferable to specify in advance that these portions are the regions of the question text and the question number rather than the region of the answer column.

[0079] For example, the recognition unit 215 may apply the above-described recognition method to multiple completed image data from different respondents, and pre-identify regions that exhibit the same periodic disturbance in all of the completed image data as regions of the question text and question number. Alternatively, the recognition unit 215 may pre-identify regions of the question text and question number by applying the above-described recognition method to image data generated when the reading unit 211 reads an answer sheet that has not been answered. The recognition unit 215 may not only recognize regions of the question text and question number on the completed image data, but may also recognize the question text and question number using optical character recognition (OCR) or the like. Furthermore, the recognition unit 215 associates regions of the question text and question number with regions of the answer fields.

[0080] The completed image data transmission unit 217 transmits the completed image data, which has been processed by the recognition unit 215, to the information processing device 10.

[0081] The solved image data receiving unit 111 receives the solved image data that has undergone recognition processing from the image forming apparatus 20.

[0082] The scoring unit 113 scores the answers contained in the answer fields on the completed image data recognized by the image forming apparatus 20. For example, the scoring unit 113 displays the completed image data that has undergone recognition processing on the display device 16 and receives scoring instructions from the user using the input device 15. Upon receiving the scoring instructions, the scoring unit 113 automatically scores the answers contained in each answer field on the completed image data by referring to correct answer data that is pre-stored in, for example, an auxiliary storage device 13. Examples of correct answer data include data that sets the question text or question number with the correct answer. Specifically, the scoring unit 113 identifies the area on the completed image data where the question text or question number of the correct answer data is displayed, and scores the answers based on whether the answers displayed in the answer field area associated with that area match the correct answers in the correct answer data.

[0083] Next, the operation of the scoring system of this embodiment will be described.

[0084] Figure 12 is a sequence diagram showing an example of the answer sheet generation process performed in the information processing device 10 and image forming apparatus 20 of this embodiment.

[0085] First, the answer image data acquisition unit 101 acquires answer image data, including the answer fields for the question (step S101).

[0086] Next, the print data generation unit 103 generates print data by adding an additional image with a periodic pattern to the answer image data acquired by the answer image data acquisition unit 101 (step S103).

[0087] Next, the print instruction unit 105 transmits the print data generated by the print data generation unit 103 to the image forming apparatus 20, and the print instruction receiving unit 201 receives the print data transmitted from the information processing device 10 (step S105).

[0088] Next, the print image generation unit 203 generates a print image in which an additional image is printed with yellow toner, based on the print data received by the print instruction receiving unit 201 (step S107).

[0089] Next, the image forming unit 205 forms (prints) the print image generated by the print image generation unit 203 onto the recording medium to generate the answer sheet (step S109).

[0090] Figure 13 is a sequence diagram showing an example of the process for generating completed image data for automatic scoring performed in the information processing device 10 and image forming apparatus 20 of this embodiment.

[0091] First, the completed image data acquisition unit 213 reads the answer sheet, on which an additional image for recognizing the answer fields has been printed and the answers to the questions have been written in those answer fields, into the reading unit 211, and acquires the completed image data generated by the reading unit 211 (step S201).

[0092] Next, the recognition unit 215 performs recognition processing to recognize the area of ​​the answer field on the completed image data based on the additional image included in the completed image data acquired by the completed image data acquisition unit 213 (step S203).

[0093] Next, the solved image data transmission unit 217 transmits the solved image data, which has been processed by the recognition unit 215, to the information processing device 10, and the solved image data receiving unit 111 receives the processed solved image data from the image forming apparatus 20 (step S205).

[0094] Next, the scoring unit 113 scores the answers that are included in the answer fields on the completed image data recognized by the image forming apparatus 20 (step S207).

[0095] Figure 14 is a flowchart showing an example of the recognition process of the answer field area performed in the image forming apparatus 20 of this embodiment.

[0096] First, the recognition unit 215 analyzes the periodicity disturbance of the pattern of the added image in the unprocessed line in the main scanning direction and identifies the presence or absence of periodicity disturbance in the pattern on a pixel-by-pixel basis (step S301).

[0097] Next, the recognition unit 215 repeats the process of step S301 until all lines have been processed (resulting in No in step S303).

[0098] Next, the recognition unit 215 processes all lines (Yes in step S303) and identifies a region on the solved image data consisting of pixels where the periodicity of the pattern is disrupted (step S305).

[0099] Next, the recognition unit 215 checks whether the identified unprocessed area matches the area of ​​the problem statement that was identified in advance (step S307).

[0100] If a match is found (Yes in step S307), the recognition unit 215 recognizes the unprocessed area as the area of ​​the question text (step S309). On the other hand, if a match is not found (No in step S307), the recognition unit 215 recognizes the unprocessed area as the area of ​​the answer field (step S311).

[0101] Next, the recognition unit 215 repeats the processes in steps S307 to S309 until all areas have been processed (No in step S313), and when all areas have been processed (Yes in step S313), it terminates the recognition process.

[0102] As described above, in this embodiment, an additional image with a periodic pattern is printed on the answer sheet, and the area of ​​the answer field is identified by detecting a disturbance in the periodicity of the pattern on the completed answer image data read from the answer sheet. Therefore, according to this embodiment, the scoring locations can be automatically registered in advance, which contributes to improving the efficiency of the scoring work.

[0103] Furthermore, according to this embodiment, since an additional image is added to one side of the answer image data, it is not necessary to pre-determine the area of ​​the answer field on the answer image data, which can contribute to improving the efficiency of answer sheet generation (in a broad sense, grading work).

[0104] (modified version) Next, modifications of the above embodiment will be described. In each of the following modifications, the parts that differ from the above embodiment will be mainly described, and the parts that are the same as the above embodiment will not be described.

[0105] (Variation 1) In the above embodiment, the orientation of the completed image data may be corrected using a periodic pattern. In this way, even if the answer sheet is read by the reading unit 211 from a direction different from a predetermined direction, such as upside down, and the completed image data is generated, the orientation of the completed image data can be corrected to the correct orientation by rotation correction.

[0106] Specifically, in Modification 1, the print data generation unit 103 specifies in the print data that the print color of the added image portion is a first color with low visibility and a second color different from the first color. The first color is, as in the above embodiment, Y (yellow) in CMYK, but is not limited to this. For the second color, any print color other than Y (yellow) may be used.

[0107] In the modified example 1, the print data generation unit 103 specifies the print color in the print data so that the same color is used for printing in the main scanning direction, and specifies a second color in the sub-scanning direction so that the color scheme pattern of the additional image is not symmetrical (more specifically, point-symmetrical).

[0108] Figure 15 shows an example of the color scheme pattern of the additional image 601 in Modification Example 1. In the example shown in Figure 15, dots indicated by light shading, such as dot 611, indicate that printing is specified in the first color (yellow), and dots indicated by dark shading, such as dot 613, indicate that printing is specified in the second color (a color other than yellow). As is clear from Figure 15, in the additional image 601, the printing color is specified so that the same color is used for printing in the main scanning direction. Furthermore, in the sub-scanning direction, the second color is specified so that the color scheme pattern does not match before and after rotation, even when the additional image is rotated by 90, 180, or 270 degrees, and the color scheme pattern is not point-symmetrical.

[0109] As a result, in the answer sheet of Modification 1, the additional image is printed in a first color and a second color different from the first color. The same color is used for printing in the main scanning direction, and in the sub-scanning direction, the second color is used so that the color pattern of the additional image is not symmetrical.

[0110] In Modification 1, the recognition unit 215 corrects the orientation of the completed image data based on the color scheme pattern of the added image on the completed image data. For example, the color scheme pattern of the added image when the answer sheet is read from the correct direction by the reading unit 211 is stored in the auxiliary storage device 31 or the like. The recognition unit 215 compares the color scheme pattern of the added image on the completed image data with the color scheme pattern of the added image stored in the auxiliary storage device 31, and if the two color scheme patterns are different, it rotates the completed image data by 90 degrees, 180 degrees, or 270 degrees, etc., so that the two color scheme patterns match.

[0111] The timing of the recognition unit 215 performing rotation correction on the completed image data may be before or after the recognition processing of the answer field area.

[0112] Therefore, according to Modification 1, even if the reading unit 211 reads the answer sheet from a direction different from a predetermined direction, such as upside down, and generates completed image data, the orientation of the completed image data can be corrected to the correct orientation by rotation correction based on the color scheme pattern of the added image.

[0113] (Modification 2) In Modification 2, instead of adding an additional image to one side of the answer image data as in the above embodiment, an additional image is added to each answer field, and the additional images indicate the start and end positions of the answer field area. In this way, even if the answer field is blank and no answer is written in it, the answer field area can be recognized with high accuracy.

[0114] In Modification 2, the print data generation unit 103 adds supplemental images to the answer image data using a trained model. The trained model is for adding supplemental images at positions where the answer field area can be identified. The trained model is generated by machine learning using various types of answer image data as a dataset, where the coordinate values ​​of the answer field area (e.g., the coordinate values ​​of the start and end positions of the answer field area) are given as labels (correct answers). In this case, when the trained model receives answer image data as input, it adds supplemental images to positions on the answer image data where the answer field area can be identified (e.g., the start and end positions of the answer field area) and outputs them.

[0115] In other words, in Modification 2, the print data generation unit 103 generates print data by inputting the answer image data into a trained model for adding additional images to specific locations within the answer fields. Specifically, in Modification 2, the print data generation unit 103 inputs the answer image data into a trained model to obtain answer image data in which a first additional image is added to the starting position of the answer field area and a second additional image is added to the ending position of the answer field area. The print data generation unit 103 converts the answer image data with the first and second additional images added into a format such as PDL or TIFF to generate print data. In Modification 2, the first additional image and the second additional image are described as having different patterns. However, the explanation is not limited to this, and the first additional image and the second additional image may have the same pattern.

[0116] Figure 16 shows an example of answer image data 721 with additional images added as in Modification 2. In the answer image data 721 shown in Figure 16, the first additional image is added to the starting position of each answer field area of ​​the answer image data 301 shown in Figure 5, and the second additional image is added to the ending position. For example, the first additional image 741 is added to the starting position of the answer field 311 area, and the second additional image 751 is added to the ending position.

[0117] Figure 17 is an enlarged view of the area around the answer field 311 in Modification 2, showing details of the first additional image 741 and the second additional image 751. The first additional image 741 consists of a marker pattern 743 that serves as a marker for the area of ​​the answer field 311, and a start pattern 745 that indicates the starting position of the area of ​​the answer field 311. The second additional image 751 consists of a marker pattern 753 that serves as a marker for the area of ​​the answer field 311, and an end pattern 755 that indicates the starting position of the area of ​​the answer field 311. Note that the marker patterns 743 and 753 are the same pattern, but the start pattern 745 and the end pattern 755 are different patterns.

[0118] As a result, the additional image printed on the answer sheet of Modification 2 includes a first additional image printed at the beginning of the answer field area and a second additional image printed at the end of the answer field area.

[0119] In modified example 2, the recognition unit 215 recognizes the area of ​​the answer field on the completed image data from the first additional image and the second additional image on the completed image data.

[0120] Therefore, according to Modification 2, even if the answer field is left blank and no answer is written in it, the start and end positions of the answer field area can be identified, and the answer field area can be recognized with high accuracy.

[0121] Furthermore, according to Modification 2, since the patterns of the first additional image and the second additional image are different, the correct orientation of the completed image data can be determined from the positional relationship between the first additional image and the second additional image. Therefore, even in Modification 2, if the answer sheet is read by the reading unit 211 from a direction different from a predetermined direction, such as upside down, and the completed image data is generated, the orientation of the completed image data can be corrected to the correct orientation by rotation correction based on the positional relationship between the first additional image and the second additional image.

[0122] (Variation 3) In Modification 3, as in Modification 2 described above, the answer field area is recognized if either the first additional image or the second additional image can be detected.

[0123] Figure 18 is an enlarged view of the area around the answer field 311 of Modification 3, showing details of the first additional image 841 and the second additional image 851. The first additional image 841 is composed of a marker pattern 743 that serves as a marker for the area of ​​the answer field 311, a start pattern 745 that indicates the starting position of the area of ​​the answer field 311, and an area pattern 847 that indicates the area of ​​the answer field 311 relative to the start position. The area pattern 847 indicates, for example, that the area of ​​the answer field 311 extends 50 mm from the start position. The second additional image 851 is composed of a marker pattern 753 that serves as a marker for the area of ​​the answer field 311, an end pattern 755 that indicates the starting position of the area of ​​the answer field 311, and an area pattern 857 that indicates the area of ​​the answer field 311 relative to the end position. The area pattern 857 indicates, for example, that the area of ​​the answer field 311 extends 50 mm from the end position.

[0124] According to Modification 3, if either the first additional image or the second additional image can be detected, the area of ​​the answer field can be identified. Therefore, for example, as shown in Figure 19, even if the respondent has vandalized the first additional image 841 by coloring it in, the area of ​​the answer field can still be recognized if the second additional image 851 can be detected.

[0125] (program) The programs executed in the above embodiments and each of the above modified devices are provided as installable or executable files stored on a computer-readable storage medium such as a CD-ROM, CD-R, memory card, DVD, or flexible disk (FD).

[0126] Furthermore, the programs executed in each of the above embodiments and modified devices may be stored on a computer connected to a network such as the Internet and provided by allowing download via the network. Alternatively, the programs executed in each of the above embodiments and modified devices may be provided or distributed via a network such as the Internet. Furthermore, the programs executed in each of the above embodiments and modified devices may be pre-installed in ROM or the like and provided.

[0127] The programs executed in the above embodiments and each of the above modified devices are configured as modules for realizing the above-described parts on a computer. In actual hardware, for example, the CPU reads the learning program from the HDD into RAM and executes it, thereby realizing the above-described parts on the computer.

[0128] The above embodiments and their respective modifications are merely examples of how this disclosure may be implemented, and they do not restrict the technical scope of this disclosure. Therefore, this disclosure can be implemented in various ways without departing from its essence or its main features. For example, the above embodiments and their respective modifications may be combined as appropriate on a component basis. Also, for example, some components may be removed from the total components in the above embodiments and their respective modifications. [Explanation of symbols]

[0129] 1. Scoring System 2 Network 10 Information Processing Devices 20 Image forming apparatus 101 Image data acquisition unit for answer 103 Print Data Generation Unit 105 Print instruction section 111 Answered Image Data Receiving Unit 113 Grading Department 201 Print command receiving unit 203 Print Image Generation Unit 205 Image forming unit 211 Reading Unit 213 Answered Image Data Acquisition Unit 215 Recognition part 217 Answered Image Data Transmission Unit

Claims

1. A reading unit reads an answer sheet in which an additional image is printed to recognize the area of ​​the answer field, and generates completed image data by reading the answer sheet in which the answer to the question is written. A recognition unit that recognizes the area of ​​the answer field on the completed image data based on the additional image, An image processing device equipped with the following features.

2. The aforementioned additional image is an image of a periodic pattern, and is printed in an area of ​​the answer sheet that includes at least the answer space. The image processing apparatus according to claim 1.

3. The recognition unit recognizes the region of the answer field on the completed image data based on the periodicity disturbance of the added image. The image processing apparatus according to claim 2.

4. The aforementioned additional image is printed on one side of the answer sheet. The image processing apparatus according to claim 2 or 3.

5. The aforementioned additional image is printed in a first color with low visibility. The image processing apparatus according to any one of claims 1 to 3.

6. The first color mentioned above is yellow. The image processing apparatus according to claim 5.

7. The aforementioned additional image is printed in the first color and a second color different from the first color. The same color is used for printing in the main scanning direction. In the sub-scanning direction, the second color is used such that the color scheme pattern of the additional image is not symmetrical. The image processing apparatus according to claim 5.

8. The recognition unit corrects the orientation of the solved image data based on the color scheme pattern of the added image. The image processing apparatus according to claim 7.

9. The aforementioned additional image includes a first additional image printed at the starting position of the answer field area and a second additional image printed at the ending position of the answer field area. The image processing apparatus according to claim 1.

10. The first additional image and the second additional image are images with different patterns. The image processing apparatus according to claim 9.

11. An image processing apparatus according to any one of claims 1 to 3, A scoring device that scores the answers contained in the area of ​​the answer field on the recognized completed image data, A scoring system equipped with [features / features].

12. An image forming unit generates an answer sheet by performing image formation on a recording medium based on answer data including answer fields for the questions and an additional image for recognizing the area of ​​said answer fields. An image forming system comprising the following features.

13. The answer image data acquisition unit acquires the aforementioned answer image data, The system further comprises a print data generation unit that generates print data by adding the additional image to the answer image data, The image forming unit generates the answer sheet by performing image formation based on the print data on the recording medium. The image forming system according to claim 12.

14. The aforementioned additional image is an image of a periodic pattern, and is printed in an area of ​​the answer sheet that includes at least the answer space. The image forming system according to claim 12 or 13.

15. The aforementioned additional image is printed on one side of the answer sheet. The image forming system according to claim 14.

16. The aforementioned additional image is printed in a first color with low visibility. The image forming system according to claim 14.

17. The first color mentioned above is yellow. The image forming system according to claim 16.

18. The aforementioned additional image is printed in the first color and a second color different from the first color. The same color is used for printing in the main scanning direction. In the sub-scanning direction, the second color is used such that the color scheme pattern of the additional image is not symmetrical. The image forming system according to claim 16.

19. The print data generation unit generates the print data by inputting the answer image data into a trained model for adding additional images to specific locations within the answer field. The image forming system according to claim 13.

20. The aforementioned additional image includes a first additional image indicating the starting position of the answer field area and a second additional image indicating the ending position of the answer field area. The image forming system according to claim 12, 13, or 19.

21. The first additional image and the second additional image are images with different patterns. The image forming system according to claim 20.

22. A reading unit reads the answer sheet in which the answers to the questions are written in the answer fields and generates completed image data, The system further includes a recognition unit that recognizes the region of the answer field on the completed image data based on the additional image, The image forming system according to claim 12 or 13.

23. The system further includes a scoring unit that scores the answers contained in the area of ​​the answer field on the recognized completed image data. The image forming system according to claim 22.

24. The reading unit reads an answer sheet in which an additional image is printed to recognize the area of ​​the answer field, and the answer to the question is written in the answer field, and generates completed image data. The recognition unit performs a recognition step of recognizing the area of ​​the answer field on the completed image data based on the additional image, Image processing methods including [specific details omitted].

25. An acquisition step involves obtaining completed image data by reading an answer sheet in which an additional image is printed to recognize the area of ​​the answer field, and the answer to the question is written in the answer field. A recognition step in which the region of the answer field is recognized on the completed image data based on the additional image, A program that causes a computer to execute something.

Images