Information processing system and program

Abstract

To provide an information processing system and a program that, when a defect that is estimated to affect the evaluation results occurs in a scanned image, can make a user aware that the defect may be affecting the evaluation results.SOLUTION: An information processing system includes a processor that compares the original print image with a scanned image obtained by scanning a printed matter printed by a printing device to evaluate the quality of the printed matter, and notifies a user of the occurrence of a defect in the scanned image that is estimated to affect the evaluation result.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present disclosure relates to an information processing system and a program. [Background technology]

[0002] Patent Document 1 describes a prediction method that can accurately predict the overall color image quality score by comprehensively taking into account a plurality of image quality physical and psychological factors that contribute to the overall color image quality score.

[0003] Patent Document 2 describes an image editing device that warns the operator when reducing or enlarging a document read by a scanner, if the characters become illegible or the image deteriorates due to excessive enlargement, and prevents unnecessary output. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 09-218956 [Patent Document 2] Japanese Patent Application Publication No. 05-110833 Summary of the Invention [Problem to be solved by the invention]

[0005] It is conceivable to evaluate the quality of a printed matter by scanning a printed matter produced by a printing device and comparing the original printed image with the scanned image. The quality of a printed matter can be evaluated, for example, by indexing how faithfully the shape and / or density of the scanned image is reproduced relative to the shape and / or density of the original printed image.

[0006] Here, if defects such as colored dots, white dots, colored lines, or white lines occur in the scanned image, this may affect the evaluation results of the quality of the printed matter.

[0007] The object of the present invention is to provide an information processing system and program that can make a user aware that a defect that is estimated to affect the evaluation results has occurred in a scanned image may affect the evaluation results. [Means for solving the problem]

[0008] The information processing system of the first aspect includes a processor that compares an original print image with a scanned image obtained by scanning a printed matter printed by a printing device to evaluate the quality of the printed matter, and if a defect that is estimated to affect the evaluation result occurs in the scanned image, notifies the user of the occurrence of the defect.

[0009] In the information processing system of the second aspect, in the information processing system of the first aspect, the processor also displays defect positions on the scanned image.

[0010] The information processing system of the third aspect is the information processing system of the second aspect, in which the processor displays, for each defect, whether it is a one-off defect that occurred on only one printed item, or a defect that may occur continuously across multiple printed items.

[0011] The information processing system of the fourth aspect is the information processing system of the third aspect, wherein the processor displays a defect that occurs in only one scanned image among multiple scanned images corresponding to the same original printed image as a defect that occurred singly in only one printed item, and displays a defect that occurs continuously across multiple scanned images as a defect that may occur continuously across multiple printed items.

[0012] An information processing system of a fifth aspect is the information processing system of the first aspect, wherein the processor detects defects from a newly acquired scan image by inputting the newly acquired scan image into a machine learning model that has been trained using the scan image and defects contained in the scan image as training data.

[0013] In a sixth aspect of the information processing system, in the information processing system of the first aspect, the processor also notifies the degree of influence of the defect on the evaluation result.

[0014] In a seventh aspect of the information processing system, in the sixth aspect, the processor acquires information on the degree of influence of defects using a scanned image from which defects have been removed by interpolation processing.

[0015] The program of the eighth aspect causes a computer to execute the steps of comparing an original print image with a scanned image obtained by scanning a printed matter printed by a printing device to evaluate the quality of the printed matter, and notifying a user of the presence of a defect in the scanned image if the defect is estimated to affect the evaluation result. [Effects of the Invention]

[0016] According to the information processing system of the first aspect, when a defect that is estimated to affect the evaluation results occurs in a scanned image, the user can be made aware that the defect may be affecting the evaluation results.

[0017] According to the information processing system of the second aspect, it is possible to make the user aware of which defects on the scanned image will affect the evaluation results.

[0018] According to the information processing system of the third aspect, it is possible to make the user aware of whether or not the quality degradation due to a defect is a one-off occurrence of only one printed sheet.

[0019] According to the information processing system of the fourth aspect, it is possible to distinguish between a single defect and a continuous defect.

[0020] According to the information processing system of the fifth aspect, defects can be automatically detected based on the training data.

[0021] According to the information processing system of the sixth aspect, it is possible to make the user aware of the extent of the influence of the defect.

[0022] According to the information processing system of the seventh aspect, it is possible to make the user aware of the evaluation result when there is no defect.

[0023] According to the program of the eighth aspect, when a defect that is estimated to affect the evaluation results occurs in a scanned image, the user can be made aware that the defect may be affecting the evaluation results. [Brief explanation of the drawings]

[0024] [Figure 1] 1 is a diagram illustrating a system configuration of a printing system according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a block diagram illustrating a hardware configuration of the printing system. [Figure 3] FIG. 2 is a block diagram illustrating the functional configuration of the printing system. [Figure 4] FIG. 10 is a diagram showing an example of an original print image for evaluation. [Figure 5] FIG. 10 is a diagram showing an example of a display screen showing the results of quality evaluation of a scanned image. [Figure 6] FIG. 10 is a diagram showing an example of a display screen showing the results of quality evaluation of a scanned image. [Figure 7] FIG. 10 is a diagram showing an example of a display screen showing the results of quality evaluation of a scanned image. [Figure 8] FIG. 1 is a diagram for explaining an AI model in a printing system. [Figure 9] FIG. 10 is a diagram showing an example of a display screen showing the results of quality evaluation of a scanned image. [Figure 10] FIG. 10 is a diagram showing an example of a display screen showing the results of quality evaluation of a scanned image. [Figure 11] FIG. 10 is a diagram showing an example of a display screen showing the results of quality evaluation of a scanned image. DETAILED DESCRIPTION OF THE INVENTION

[0025] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present disclosure will now be described in detail with reference to the accompanying drawings, in which: Fig. 1 is a diagram showing the system configuration of a printing system 10, which is an embodiment of an information processing system according to the present disclosure;

[0026] As shown in FIG. 1, the printing system 10 includes a printing device 10a and an inspection device 10b for inspecting the quality of a printed matter printed by the printing device 10a.

[0027] In the printing system 10, a printed matter printed by the printing device 10a is transported to the inspection device 10b and scanned by the inspection device 10b.

[0028] The printing system 10 can evaluate the quality of the printed matter by comparing the original print image with a scanned image obtained by scanning the printed matter printed by the printing device 10a with the inspection device 10b.

[0029] Next, a description will be given of the hardware configuration of the printing system 10 of this embodiment.

[0030] 2, the printing system 10 includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, a storage device 13 such as a hard disk drive, a communication interface (abbreviated as IF) 14, a user interface (abbreviated as UI) device 15 including a touch panel or liquid crystal display and a keyboard, a print engine 16, and a scanner 17. These components are connected to each other via a control bus 18.

[0031] The CPU 11 is a processor that controls the operation of the printing system 10 by executing predetermined processes based on a control program stored in the RAM 12 or the storage device 13. While the present embodiment has been described as the CPU 11 reading and executing the control program stored in the RAM 12 or the storage device 13, this is not limiting. The control program may be provided in a form recorded on a computer-readable recording medium. For example, the program may be provided in a form recorded on an optical disc such as a CD (Compact Disc)-ROM (Read Only Memory) or a DVD (Digital Versatile Disc)-ROM, or in a semiconductor memory such as a USB (Universal Serial Bus) memory or a memory card. The control program may also be acquired from an external device via a communication line connected to the communication IF 14.

[0032] The communication IF 14 transmits and receives data to and from external devices, etc. The UI device 15 accepts instruction input from the user. The print engine 16 is built into the printing device 10a and prints an image on a recording medium such as printing paper through processes such as charging, exposure, development, transfer, and fixing. The scanner 17 is built into the inspection device 10b and reads the printed matter printed by the printing device 10a as image data.

[0033] Next, the functional configuration of the printing system 10 of this embodiment will be described.

[0034] As shown in FIG. 3, the printing system 10 of this embodiment includes a control unit 21, an operation input unit 22, a display unit 23, a data transmission / reception unit 24, an authentication unit 25, a memory unit 26, an image printing unit 27, and an image reading unit 28.

[0035] The control unit 21 controls the overall operation of the printing system 10. The operation input unit 22 inputs information on various operations performed by the user. The display unit 23 is controlled by the control unit 21 and displays various information to the user. The data transmission / reception unit 24 transmits and receives data to and from external devices via fax communication or internet communication. The authentication unit 25 performs authentication processing for users who wish to use the printing system 10.

[0036] The storage unit 26 stores various data such as a control program for controlling the operation of the printing system 10, an original image to be printed, and a scanned image. The image printing unit 27 prints an image on a recording medium such as printing paper. The image reading unit 28 reads the printed matter as image data.

[0037] In the printing system 10 of this embodiment, a printed matter printed by the printing device 10a is scanned by the inspection device 10b to obtain a scanned image, and the original printed image is compared with the scanned image to evaluate the quality of the printed matter. The quality of the printed matter is evaluated, for example, by scoring how faithfully the shape and / or density of the scanned image is reproduced relative to the shape and / or density of the original printed image.

[0038] Here, if defects such as colored dots, white dots, colored lines, or white lines occur in the scanned image, this may affect the evaluation results of the quality of the printed matter.

[0039] Therefore, in the printing system 10 of this embodiment, the control unit 21 evaluates the quality of the printed matter by comparing the original printed image with the scanned image, and if a defect that is estimated to affect the evaluation result occurs in the scanned image, the control unit 21 notifies the user of the defect, making the user aware that the defect may affect the evaluation result.

[0040] The quality evaluation of the printed matter in the printing system 10 of this embodiment will be described in detail below.

[0041] When evaluating the quality of a printed matter, the original print image may be an image for evaluation or a normal image. Here, a case where an original print image for evaluation is used will be described. FIG. 4 is a diagram showing an example of an original print image 31 for evaluation. FIG. 5 is a diagram showing an example of a display screen 40 showing the results of a quality evaluation of a scanned image 41. For convenience, the example of the display screen 40 in FIG. 5 omits the shading of the scanned image 41. The same applies to the display screens 40 in FIG. 6 and subsequent figures.

[0042] As shown in Figure 4, the original print image 31 for evaluation is a four-color test pattern consisting of the three primary colors cyan, magenta, and yellow, plus black, which is the key plate, and each color has areas with 100%, 80%, 60%, 40%, and 20% density.

[0043] The control unit 21 causes the image printing unit 27 to print a printout based on the original print image 31, and then causes the image reading unit 28 to scan the printout to obtain a scanned image 41 (see FIG. 5).

[0044] The control unit 21 compares the original print image 31 with the scanned image 41 to evaluate the quality of the printout, and displays a display screen 40 on the display unit 23 showing the results of the quality evaluation of the scanned image 41, as shown in FIG.

[0045] Display screen 40 displays scanned image 41, identification information 42 for identifying scanned image 41, and image quality score 43, which is the result of evaluating the quality of scanned image 41.

[0046] The image quality score 43 is a score that indicates how faithfully the scanned image 41 is reproduced relative to the original print image 31, with perfect reproduction being given a score of 100.

[0047] 6, defects such as color dots 41a and color lines 41b may affect the quality evaluation results if they occur in scanned image 41. Therefore, if defects such as color dots 41a and color lines 41b occur in scanned image 41, control unit 21 notifies the user that a defect has occurred.

[0048] The control unit 21 may notify the user in any manner, but in FIG. 6, as an example, the control unit 21 notifies the user by displaying comment boxes 44a and 44b for each defect on the display screen 40.

[0049] Specifically, if a color spot 41a occurs in the scanned image 41, a comment box 44a is displayed that displays the comment "The color spot may have lowered the image quality score."

[0050] Furthermore, if a color line 41b occurs in the scanned image 41, a comment box 44a is displayed that displays the comment "The color line may be causing a decrease in the image quality score."

[0051] At this time, the control unit 21 may also display the defect position on the scanned image 41 as shown in FIG.

[0052] Furthermore, as shown in FIG. 7, the control unit 21 may display each defect by distinguishing whether it is a one-off defect that occurred on only one printed item, or whether it is a defect that may occur continuously across multiple printed items.

[0053] In Figure 7, as an example, for color point 41a, the comment "(This defect is a single occurrence.)" is added in comment box 44a, indicating that color point 41a is a single defect that occurred only on one printed sheet.

[0054] In addition, for color line 41b, the comment "(This defect may occur continuously.)" is added in comment box 44b, indicating that color line 41b is a defect that may occur continuously across multiple printed sheets.

[0055] In addition, when distinguishing whether a defect occurring on the scanned image 41 is a one-off defect occurring on only one printed item or a defect that may occur continuously across multiple printed items, the distinction may be made based on one printed item or multiple printed items.

[0056] When distinguishing based on a single printed item, the characteristics of a defect that occurs singly and the characteristics of a defect that occurs continuously are acquired in advance, and by comparing these characteristics with the characteristics of the defect that occurs on the scanned image 41, it is possible to distinguish whether the defect is a singly occurring defect on only one printed item or a defect that may occur continuously across multiple printed items.

[0057] Furthermore, when distinguishing based on multiple printed materials, the control unit 21 may display a defect that occurs in only one scanned image among multiple scanned images corresponding to the same original printed image as a defect that occurred singly in only one printed material.

[0058] Furthermore, the control unit 21 may display defects that occur continuously across multiple scanned images corresponding to the same original printed image as defects that may occur continuously across multiple printed materials.

[0059] In addition, as shown in FIG. 8, the control unit 21 may detect defects from a newly acquired scan image by inputting the newly acquired scan image into a machine learning model that has been trained using the scan image and defects contained in the scan image as training data.

[0060] In detail, in the AI ​​model in the printing system 10, first, in the learning part, a scanned image and defects contained in the scanned image are input into the input layer, and in the learning layer, a machine learning model is generated that is trained using the data input into the input layer as training data.

[0061] In the prediction part of the AI ​​model in the printing system 10, the input layer inputs the scanned image 41, the calculation layer uses the learning model generated in the learning part to extract defects contained in the scanned image 41, and the output layer outputs the extracted defects.

[0062] The AI ​​model may not only extract defects but also identify the type of defect. In this case, the input layer of the learning part may input a scanned image, the defects contained in the scanned image, and the type of the defects, and the learning layer may generate a machine learning model trained using the data input to the input layer as training data.

[0063] Here, the defect type may be a type based on the color and shape of the defect, such as a colored dot, a white dot, a colored line, or a white line. The defect type may also be a type based on the frequency of occurrence, such as a defect that occurs singly on only one printed item, or a defect that may occur continuously across multiple printed items. The defect type may also be a combination of a type based on the color and shape of the defect and a type based on the frequency of occurrence.

[0064] The control unit 21 may also notify the degree of influence of the defect on the evaluation result.

[0065] In this case, the control unit 21 can obtain information on the degree of influence of the defect by using the scan image 41 from which the defect has been removed by the interpolation process. In particular, the information on the degree of influence can be obtained by comparing the image quality score of the scan image 41 with the image quality score of the scan image 41 from which the defect has been removed by the interpolation process.

[0066] If there are multiple defects in the scanned image 41, the information on the degree of influence may be acquired for each defect, or the information on the degree of influence of multiple defects may be acquired all at once.

[0067] Regarding notification of the degree of influence of defects, the degree of influence that each defect has on the image quality score may be displayed as shown in FIG.

[0068] 9, for example, the comment box 44a for color point 41a is marked with a comment "(deduction: -9 points)" to indicate the degree of influence that color point 41a had on the image quality score. Also, the comment box 44b for color line 41b is marked with a comment "(deduction: -10 points)" to indicate the degree of influence that color line 41b had on the image quality score.

[0069] Furthermore, in order to notify the degree of the effect of the defect, the image quality score 45 in the case where there is no defect may be displayed, as shown in FIG.

[0070] Furthermore, when notifying the degree of impact of defects, as shown in FIG. 11, both the degree of impact each defect has on the image quality score and the image quality score 45 in the absence of defects may be displayed.

[0071] [Variations] The printing system 10, which is one embodiment of the information processing system of the present disclosure, has been described above, but the technology of the present disclosure is not limited to the above embodiment and can be modified as appropriate.

[0072] In the above embodiment, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0073] Furthermore, the operations of the processors in the above embodiments may not only be performed by a single processor, but may also be performed by multiple processors located at physically separate locations working together. Furthermore, the order of the operations of the processors is not limited to the order described in the above embodiments, and may be changed as appropriate.

[0074] [Note] The following additional notes are provided regarding the above-described embodiment.

[0075] (((1))) a processor; The processor: Evaluating the quality of the print by comparing the original print image with a scanned image obtained by scanning the printout printed by the printing device; If a defect that is estimated to affect the evaluation results is found in the scanned image, the user is notified of the defect. Information processing system.

[0076] (((2))) The processor: Display defect locations on the scanned image The information processing system according to (((1))).

[0077] (((3))) The processor: For each defect, it is displayed to distinguish whether it is a single defect that occurred on only one printout or a defect that may occur continuously across multiple printouts. The information processing system according to (((2))).

[0078] (((4))) The processor: When multiple scans of the same original print are used, defects that appear in only one scan are displayed as defects that occur only on one print, and defects that appear consecutively across multiple scans are displayed as defects that may occur consecutively across multiple prints. The information processing system according to (((3))).

[0079] (((5))) The processor: Defects are detected from newly acquired scan images by inputting the newly acquired scan images into a machine learning model that has been trained using scan images and defects contained in the scan images as training data. 1. An information processing system according to any one of ((1))) to (((4))).

[0080] (((6))) The processor: The extent of the impact of the defect on the evaluation results will also be notified. 1. An information processing system according to any one of ((1))) to (((5))).

[0081] (((7))) The processor: Using the scanned image from which defects have been removed through interpolation processing, information on the extent of the defect's impact is obtained. The information processing system according to (((6))).

[0082] (((8))) A step of comparing the original print image with a scanned image obtained by scanning the printout printed by the printing device to evaluate the quality of the printout; a step of notifying a user of the occurrence of a defect when the defect is found in the scanned image and is estimated to affect the evaluation result; A program that causes a computer to execute the following.

[0083] The effects of the configuration described above will be described below.

[0084] According to the information processing system (((1))), when a defect that is estimated to affect the evaluation results occurs in a scanned image, the user can be made aware that the defect may be affecting the evaluation results.

[0085] According to the information processing system (((2))), the user can be made aware of which defects on the scanned image will affect the evaluation results.

[0086] According to the information processing system (((3))), the user can be made aware of whether or not the quality degradation due to a defect is a one-off occurrence of only one printed sheet.

[0087] The information processing system of (((4))) can distinguish between single defects and continuous defects.

[0088] According to the information processing system of (((5))), defects can be automatically detected based on the training data.

[0089] According to the information processing system (((6))), the extent of the impact of the defect can be made known to the user.

[0090] According to the information processing system (((7))), the evaluation result when there is no defect can be made known to the user.

[0091] According to the program (((8))), when a defect that is estimated to affect the evaluation results occurs in the scanned image, the user can be made aware that the defect may be affecting the evaluation results. [Explanation of symbols]

[0092] 10 Printing System 10a Printing device 10b Inspection equipment 11 CPU 12 RAM 13 Storage device 14 Communication Interface 15 User Interface Device 16 Print Engine 17. Scanner 18 Control Bus 21 Control Unit 22 Operation input section 23 Display section 24 Data transmission and reception unit 25 Authentication Section 26 Memory section 27 Image Printing Department 28 Image reading unit 31 Original print image 40 display screen 41 scanned images 41a color point 41b Color line 42 Identification Information 43 Image Quality Score 44a, 44b Comment box 45 Image Quality Score

Claims

1. a processor; The processor: Evaluating the quality of the print by comparing the original print image with a scanned image obtained by scanning the printout printed by the printing device; If a defect that is estimated to affect the evaluation results is found in the scanned image, the user is notified of the defect. Information processing system.

2. The processor: Display defect locations on the scanned image The information processing system according to claim 1 .

3. The processor: For each defect, it is displayed to distinguish whether it is a single defect that occurred on only one printed item or a defect that may occur continuously across multiple printed items. The information processing system according to claim 2 .

4. The processor: When multiple scanned images correspond to the same original print image, defects that occur in only one scanned image are displayed as defects that occur only on one print, and defects that occur continuously across multiple scanned images are displayed as defects that may occur continuously across multiple prints. The information processing system according to claim 3 .

5. The processor: Defects are detected from newly acquired scan images by inputting the newly acquired scan images into a machine learning model that has been trained using scan images and defects contained in the scan images as training data. The information processing system according to claim 1 .

6. The processor: The extent of the impact of the defect on the evaluation results will also be notified. The information processing system according to claim 1 .

7. The processor: Using the scanned image from which defects have been removed through interpolation processing, information on the extent of the defect's impact is obtained. The information processing system according to claim 6.

8. a step of comparing the original print image with a scanned image obtained by scanning the printout printed by the printing device to evaluate the quality of the printout; a step of notifying a user of the occurrence of a defect when the defect is found in the scanned image and is estimated to affect the evaluation result; A program that causes a computer to execute the following.

Images