Information processing apparatus, recording medium, and information processing system

Abstract

An information processing apparatus includes: a plurality of evaluation units configured to evaluate an image generated by a printer simulator; a setting unit configured to receive a setting of one or more evaluation units of the plurality of evaluation units from a user, the setting being for evaluating the image; a control unit configured to cause the one or more evaluation units for which the setting is received to evaluate the image; and a display control unit configured to display an evaluation result acquired by the one or more evaluation units.

Description

Technical Field

[0001] This disclosure relates to information processing equipment, recording media, and information processing systems. Background Technology

[0002] There are situations where it's desirable to determine whether two images are identical. For example, in the realm of commercial printing, where high-quality output is required, users might want to assess whether the same image quality can be achieved even after a printer driver upgrade. Similarly, there are situations where the printer description language (PDL) module, which performs rendering on the printer's image-forming device, is also upgraded. In these cases, users might again want to assess whether the same image quality can be obtained.

[0003] Such evaluation tasks are typically performed through visual inspection; however, technologies are being designed to automate these tasks (see, for example, Patent Document 1). Patent Document 1 describes the evaluation of an image forming apparatus as the evaluation target. A host computer sends a print job and setting values ​​to the image forming apparatus as the evaluation target. The image forming apparatus then creates image data based on the print job and setting values ​​and sends the created image data to the host computer. In the host computer, the image forming apparatus as the evaluation target is evaluated by comparing the image data created by the image forming apparatus as the evaluation target with stored image data created using a previous version of the printer.

[0004] Reference List

[0005] Patent documents

[0006] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2008-33472 Summary of the Invention

[0007] Technical issues

[0008] For traditional techniques, when multiple determination methods exist that can evaluate an image, the problem lies in the difficulty of evaluating and comparing the evaluation results obtained by each determination method.

[0009] One embodiment of this disclosure aims to provide an information processing device capable of comparing evaluation results obtained through various determination methods that can evaluate images.

[0010] Technical solutions to the problem

[0011] To achieve the above objectives, claim 1 of this disclosure includes: a plurality of evaluation units configured to evaluate an image generated by a printer simulator; a setting unit configured to receive settings from one or more of the plurality of evaluation units from a user, the settings being used to evaluate the image; a control unit configured to cause the one or more evaluation units that received the settings to evaluate the image; and a display control unit configured to display the evaluation results obtained by the one or more evaluation units.

[0012] Beneficial effects of the invention

[0013] According to one aspect of this disclosure, comparison results obtained by various evaluation methods capable of evaluating images can be compared. Attached Figure Description

[0014] Figure 1 This is a diagram showing an overview of the processing by the information processing system 100;

[0015] Figure 2A This is a configuration diagram illustrating an example of an information processing system 100 according to one embodiment;

[0016] Figure 2B This is a configuration diagram illustrating an example of a terminal device 30 according to one embodiment;

[0017] Figure 3 This is a hardware configuration diagram of terminal device 30 or information processing device 50;

[0018] Figure 4 This is an example of a functional block diagram used to describe the functions of terminal device 30 in block diagram form;

[0019] Figure 5 This is a configuration diagram of examples of virtual machines 61A and 61B built by terminal device 30;

[0020] Figure 6 It is a diagram used to describe the process flow performed by the terminal device 30;

[0021] Figure 7 This is an example image of the setup screen 400 to be displayed by the terminal device 30;

[0022] Figure 8 This is an example image of the method selected on screen 550;

[0023] Figure 9 This is an example image of the evaluation result screen 600;

[0024] Figure 10This is an example image of a detailed evaluation result screen (700).

[0025] Figure 11 This is a diagram illustrating an example of the processing flow that occurs when an evaluation begins to be performed by the terminal device 30;

[0026] Figure 12 An example of initial value information containing registered initial values ​​is shown on the settings screen 400;

[0027] Figure 13 This is a diagram showing an example of the details of the document illustrating the evaluation results;

[0028] Figure 14 This is a diagram illustrating the details of a document showing detailed evaluation results; and

[0029] Figure 15 This is an example of a functional block diagram used to describe the functions of terminal device 30 and information processing device 50 in block diagram form. Detailed Implementation

[0030] In the following description, embodiments of the present disclosure are illustrated with reference to the accompanying drawings.

[0031] <Operation Overview>

[0032] In this embodiment, an information processing device that receives a user's request from a terminal device capable of communicating via a network, or an information processing device that receives a user's request via a keyboard or the like, executes a printer simulator to create a print processing image typically created by an image forming device. In this embodiment, multiple print processing images can be created by the information processing device even without an actual image forming device, and evaluation results obtained through various methods for evaluating the images can be compared.

[0033] Figure 1 This is a diagram showing an overview of the processing of the information processing system 100.

[0034] (1) On the settings screen displayed by the terminal device 30, the user enters settings regarding image consistency determination and then presses the start button. Image consistency determination is an example of image evaluation. The terminal device 30 sends the settings regarding consistency determination to the information processing device 50. By performing image consistency determination, the information processing device 50 can evaluate the impact of modifications to the printer driver, printer emulator, OS (operating system), etc.

[0035] (2) After the printer driver, set by the user from the setup screen, is installed on the information processing device 50 and the printing application invokes the printer driver for the evaluation file (the file used as the original source for image generation), the printer driver creates a file for printing written in Printer Description Language (PDL). The OS and printer simulator are set by the user on the setup screen. Furthermore, printing conditions and the evaluation file may affect image quality.

[0036] (3) Typically, a document intended for printing is sent to an image forming device, whereby a PDL module operated by the image forming device performs rendering and prints it onto paper. In this embodiment, the printer simulator (PDL module) activated within the information processing device 50 performs rendering processing, and nothing is sent to the image forming device. Therefore, in this embodiment, an image for printing processing, i.e., a printing processing image, is created within the information processing device 50.

[0037] (4) The information processing device 50 stores the created print processing image in its storage unit. The stored print processing image is compared with a print processing image of a comparison target or comparison source, which is described further below and created in the same manner, and then an evaluation result is generated by one or more determination methods.

[0038] As described, by using this embodiment, since evaluation results of multiple determination methods for evaluating images can be generated without using an image forming device to evaluate the impact of printer driver differences, PDL module differences or OS differences on images, the configuration of the information processing system 100 can be simplified, thereby reducing evaluation costs.

[0039] Terminology

[0040] A printer simulator is software used to recreate image processing performed by an image forming device on an information processing device. The printer simulator in this embodiment has at least a PDL module and rendering capabilities.

[0041] Image evaluation refers to the check used to determine whether an image meets a predetermined quality level. Image evaluation includes, for example, comparing a target image with a source image and evaluating the degree of difference based on that comparison. Therefore, as an example of image evaluation, there is a determination of consistency between two images.

[0042] The evaluation results include information about the image quality level, and may include, for example, the degree of difference. Methods for evaluating images can include exact match methods and fuzzy match methods. Exact match methods systematically determine image mismatches when the difference is greater than or equal to a predetermined threshold, while fuzzy match methods determine whether differences exist that are imperceptible to the human eye. The term "match" can be used to refer to similarity. The term "mismatch" can be used to refer to dissimilarity. Furthermore, methods for evaluating images can include methods for evaluating images based on whether granularity (coarseness and fineness) is ignored or enabled, and whether priority is given to color gamut or brightness.

[0043] Figure 2A and Figure 2B This is a configuration diagram showing an example of an information processing system 100 and a terminal device 30 according to this embodiment. Figure 2A This is an example of an information processing system 100 according to this embodiment, and is a system configuration in which an information processing device 50, equivalent to a client-server type server, determines the consistency of two images.

[0044] In the information processing system 100, terminal device 30 and information processing device 50 can communicate via network N. Information processing device 50, also referred to as a server or server device, is primarily used to perform information processing on network N and responds with information or processing results in response to requests received via network N. Information processing device 50 can reside on the Internet or internally. In any implementation, information processing system 100 can be referred to as a cloud system. A cloud system refers to a system that uses resources on network N without considering specific hardware resources.

[0045] As a so-called web server, the information processing device 50 generates web page screen information (information written in HTML, XML, scripting languages, Cascading Style Sheets (CSS), etc., and primarily interpreted and displayed by a web browser) for processing, and provides the generated information to the terminal device 30. The terminal device 30 launches a web browser and displays the web page by receiving the screen information. On a single web page, there is an interface for determining the consistency of two images. The user specifies (sets) one or more of the OS, printer driver, PDL module, etc., and requests the information processing device 50 to perform consistency determination processing.

[0046] Web pages can be served by web applications. Web applications operate through collaboration between programs written in programming languages ​​such as JavaScript (registered trademark), which operates in a browser, and programs provided by a web server. Furthermore, the web application refers to the mechanism that implements such software. Web pages can be dynamically modified by web applications.

[0047] Terminal device 30 receives screen information from information processing device 50 and displays the received information on a web browser. Then, terminal device 30 receives an operation (selection operation) from the user, including settings for determining the consistency of two images. The web browser implemented by terminal device 30 sends the settings for determining consistency to information processing device 50 and requests processing for determining consistency.

[0048] Regarding terminal device 30, application software dedicated to information processing system 100 can be operated via terminal device 30 instead of a web browser. Furthermore, the evaluation results obtained through consistency determination can be displayed on terminal device 30, or sent by information processing device 50 or stored on network N.

[0049] Figure 2B This is an example of a terminal device 30 according to this embodiment, and the terminal device 30 performs consistency determination on two images separately. Examples of terminal devices 30 include personal computers (PCs), tablet terminals, PDAs, smartphones, interactive whiteboards, video conferencing terminals, etc.

[0050] <Hardware Configuration>

[0051] Figure 3 This is a hardware configuration diagram of the terminal device 30 or the information processing device 50. Here, it is assumed that the hardware configuration of the information processing device 50 is the hardware configuration being described.

[0052] Information processing device 50 is a computer and includes a central processing unit (CPU) 501, a read-only memory (ROM) 502, a random access memory (RAM) 503, a hard disk drive (HDD) 504, an HDD controller 505, a display 506, an external device connection interface (I / F) 508, a network I / F 509, a bus 510, a keyboard 511, an indicating device 512, a digital universal disk rewritable (DVD-RW) drive 514, and a media I / F 516.

[0053] CPU 501 controls the overall operation of information processing device 50. ROM 502 stores programs used to drive CPU 501, such as the Initial Program Loader (IPL). RAM 503 is used as the working area of ​​CPU 501. HDD 504 stores various types of data, such as programs. HDD controller 505 controls the reading of various types of data from or writing to HDD 504 according to the control of CPU 501.

[0054] Display 506 displays various types of information, such as cursors, menus, windows, characters, and images. External device connection I / F 508 is an interface for connecting various types of external devices. In this case, the external device is, for example, a Universal Serial Bus (USB) memory or a printer. Network I / F 509 is an interface for performing data communication using a communication network. Bus 510 is, for example, an address bus, data bus, etc., for electrically connecting components such as the CPU 501.

[0055] Keyboard 511 is an input device having multiple keys for inputting characters, numbers, various instructions, etc. Indicator device 512 is an input device for selecting and executing various instructions, selecting processing targets, moving the cursor, etc. DVD-RW drive 514 controls the reading or writing of various types of data from or to a DVD-RW 513, which is an example of a removable recording medium. It should be noted that removable recording media are not limited to DVD-RW and can also be DVD-R, etc. Media I / F 516 controls the reading of data from or the writing (storage) of data to (or to) a recording medium 515 such as flash memory.

[0056] <Function Configuration>

[0057] First of all, Figure 2B The functional blocks of the terminal device 30 under the following circumstances are described. Figure 4 This is an example of a function block diagram used to describe the functions of terminal device 30 in block diagram form.

[0058] Terminal Equipment

[0059] Terminal device 30 includes a control unit 31, a printing application 32, one or more printer drivers 33, one or more printer simulators 34, one or more evaluation units 35, one or more setting units 36, a management unit 37, a communication unit 38, a storage unit 39, a display control unit 40, and an operation receiving unit 41. These functional units of terminal device 30 operate in cooperation with instructions from CPU 501 according to a program read from HDD 504 into RAM 503. Figure 3 Any element shown that enables or enables the function or apparatus to function.

[0060] Communication unit 38 is used for external communication and for sending and receiving various types of information. For example, communication unit 38 sends the evaluation results of an image via email. Control unit 31 controls the overall processing regarding consistency determination. For example, control unit 31 manages the processing flow based on the consistency determination settings received from the user and invokes any necessary user functions from printing application 32 to operation receiving unit 41. Control tools such as Jenkins are known as control units 31. Furthermore, control unit 31 can be used for Robotic Process Automation (RPA). RPA is a concept of a software-based robot in a personal computer that replaces and automates desktop work (primarily fixed-form work).

[0061] Printing application 32 is application software that runs on the OS installed in terminal device 30. Printing application 32 can open the evaluation file, invoke printer driver 33, and begin printing the evaluation file. Examples of printing applications 32 include word processing software, web browser software, illustration software, painting software, etc. Alternatively, there may be two or more printing applications 32. In the presence of multiple printing applications 32, terminal device 30 performs consistency determination using different evaluation files.

[0062] Printer driver 33 is software that runs on the OS installed in terminal device 30. Printer driver 33 is software that allows users to easily use the image forming device by connecting the computer and the image forming device. Printer driver 33 has the function of displaying a user interface screen for receiving print settings (also called print conditions) and generating print data described in a PDL. Examples of PDLs include PostScript (registered trademark), Printer Control Language (PCL), etc. In addition, there are many different types of formats in PDLs, varying depending on the manufacturer of the image forming device. In the image forming device, PDL modules corresponding to each PDL run.

[0063] The printer simulator 34 is software that runs on the OS installed in the terminal device 30. The printer simulator 34 performs rendering, which is performed by the image forming device. Rendering is also known as a raster image processor (RIP), drawing processing, etc. The software that performs rendering is also known as a PDL module or drawing processing unit. The printer simulator 34 has one or more PDL modules. It should be noted that, in addition to residing in the terminal device 30, the printer simulator 34 can also reside on a network accessible to the terminal device 30.

[0064] The PDL module performs color matching and filtering processes, and generates images for printing processing for each of the cyan (C), magenta (M), yellow (Y), and black (K) colors to be used by the image forming device for printing. For example, color matching processing is used to convert the image data of the input colors (monochrome is also acceptable) at the optimal conversion ratio so that the image forming device can print using the four color toners C, M, Y, and K. Print data input from the printing application 32 can be represented in the RGB color space or in the CMYK color space. In the case of a conventional printing application 32, the RGB color space is used.

[0065] After converting the print data in the RGP color space to a device-independent color space through color matching processing, the printer simulator 34 then performs a conversion to a device color space suitable for the characteristics of the image forming device, thus converting the print data to the CMYK color space. Well-known RGB to CMYK conversion techniques can be used, or conversion techniques optimized for image forming devices can be used.

[0066] Filtering is a process used to represent differences in shadows through optical illusion by changing the size or density of halftone dots using pseudo-grayscale representation methods such as dithering. It is also used to convert bitmap data into a printable image that can be printed by an image forming device. In the printable image, each pixel corresponding to a pixel rendered as a dot by laser or ink is set to 1 (ON: render) or 0 (OFF: do not render).

[0067] The evaluation unit 35 is an application module running on the terminal device 30. For example, the evaluation unit 35 compares two print-processed images of interest and evaluates whether the images can be considered identical. Furthermore, the evaluation unit 35 generates difference information between the two print-processed images. For example, the evaluation unit 35 compares whether the pixels (CMYK) are identical for each pixel position defined by the image resolution, and then generates the difference information.

[0068] The setting unit 36 ​​is a module that runs on the terminal device 30. The setting unit 36 ​​generates a screen for receiving settings such as consistency determination of conditions used for image comparison. The management unit 37 uses the consistency determination settings received from the user by the setting unit 36 ​​to control the overall processing of consistency determination.

[0069] The management unit 37 manages the consistency settings received from the user by the setting unit 36, and manages the evaluation results of the two printed images. Furthermore, the management unit 37 can be configured to manage the processing for sending the image evaluation results to the user via email or via a chat system.

[0070] The display control unit 40 displays various screens on the display 506. For example, the display control unit 40 displays a screen for receiving settings such as consistency determination of conditions for image comparison, and a screen for displaying the evaluation results of the images. The operation receiving unit 41 receives various types of operations related to the screens displayed by the display control unit 40.

[0071] Furthermore, storage unit 39 is an HDD 504, RAM 503, or both, such as Figure 3 As shown. Printed images, difference information, evaluation results, etc., are stored in storage unit 39.

[0072] Virtual Machine

[0073] The print processing image generated by terminal device 30 is affected by various factors such as the OS, printer driver 33, PDL module, printing conditions, and evaluation documents. At least regarding the OS, the user needs time to perform the task of changing the OS of terminal device 30. Therefore, if terminal device 30 uses a virtual machine, any guest OS can be installed on terminal device 30 while the host OS running on terminal device 30 remains unchanged. Furthermore, since multiple virtual machines can be constructed on the host OS, the burden of installing a guest OS can be reduced. Therefore, in this embodiment, terminal device 30 generates and evaluates the print processing image on a virtual machine.

[0074] Figure 5 This is a configuration diagram of example virtual machines 61A and 61B built by terminal device 30. Virtual machines 61A and 61B are independently running information processing devices and are built on a terminal device 30 using virtualization technology. Figure 5 The physical machine 65 shown is equivalent to Figure 3 The terminal device 30 shown is made of conventional hardware. The host OS 64 is the OS that runs directly on the terminal device 30. Virtualization software 63 runs on the host OS 64. Virtualization software 63 uses virtualization technology and is software that emulates the hardware of virtual machines 61A and 61B. Examples of virtualization software 63 include VMware (registered trademark), Microsoft VirtualPC (registered trademark), etc.

[0075] The guest OS 62 is a typical OS and is a factor that can influence the printing of images in this embodiment. For the guest OS 62, the virtualization software 63 only acts as an information processing device. Therefore, virtual machines 61A and 61B run independently of other virtual machines or the host OS 64. Therefore, the printing application 32, the PDL module, and the printer driver 33 can use the same components as ordinary components. Although Figure 5The virtual machine shown is called a host type, but a hypervisor type virtual machine can be used.

[0076] <Overall Processing Flow>

[0077] Next, refer to Figure 6 Describe the overall process flow performed by terminal device 30. Figure 6 This is a diagram used to describe the flow of processing performed by terminal device 30. For example... Figure 6 As shown, terminal device 30 generates a printed processed image of the comparison source and a printed processed image of the comparison target based on specified evaluation conditions, and then evaluates the images. It should be noted that... Figure 6 All processing need not be completed in a single consistency determination. For example, if the print processing images of the comparison source or comparison target have already been generated, image generation is not required, so if the printer driver 33 is already installed, it does not need to be installed.

[0078] In step S10, the user specifies evaluation conditions for the setup screen displayed on the terminal device 30. The setup screen is further described below. Examples of evaluation conditions to be specified in step S10 include printer driver 33, printing conditions, OS, evaluation file, PDL module, printer model, determination method, result notification method, etc. The control unit 31 of the terminal device 30 begins image evaluation based on the evaluation conditions specified in step S10.

[0079] In step S12, the control unit 31 starts the OS (the OS of the comparison source and the OS of the comparison target) specified in step S10 as the evaluation condition on the virtual machine that serves as the guest OS 62. If the OS has already been started, the startup process can be skipped.

[0080] In step S14, the control unit 31 installs the printer driver 33 of the comparison source into the corresponding guest OS 62 of the comparison source, or installs the printer driver 33 of the comparison target into the corresponding guest OS 62 of the comparison target, based on the evaluation conditions specified in step S10. At this time, the storage unit 39 is specified in the port of the print destination. If the printer driver 33 has already been installed, the installation can be skipped.

[0081] In step S16, the control unit 31 initiates the printing application 32 for the comparison source or comparison target of the evaluation file, which was specified as the evaluation condition in step S10. In step S18, the printing application 32 for the comparison source or comparison target prints the evaluation file stored in the storage unit 39 using the printing conditions specified in step S10, and saves the generated printing data of the comparison source or comparison target in the storage unit 39. Thus, the printing application 32 for the comparison source or comparison target generates the printing data of the comparison source or comparison target based on the evaluation conditions specified in step S10.

[0082] In step S20, control unit 31 activates the printer simulator 34 of the PDL module, which was designated as the evaluation condition in step S10, for the comparison source or comparison target. In step S22, the printer simulator 34 performs RIP processing (drawing processing) on ​​the print data of the comparison source or comparison target generated in step S18, and then saves the image data of the comparison source or comparison target (the image used for print processing, i.e., the print processing image) in storage unit 39. For example, the print processing image is created in PNG format. The user can modify the initial settings file, which will be further described below, to allow the creation of print processing images in other formats such as JPEG, TIFF, etc.

[0083] For example, in the first iteration steps S14 to S22, the control unit 31 generates a print processing image of the comparison source, and in the second iteration steps S14 to S22, it generates a print processing image of the comparison target. In step S24, the control unit 31 checks whether the print processing image of the comparison target is stored in the storage unit 39.

[0084] If the printed processing image of the comparison target is not saved, the control unit 31 returns the processing to steps S14 to S22 of the second iteration to generate the printed processing image of the comparison target. If the printed processing image of the comparison object is saved, in step S26, the control unit 31 selects the determination method specified as the evaluation condition in step S10.

[0085] In this embodiment, the user can specify multiple methods (image comparison methods) for determining the printed processed images (image data) that can evaluate the comparison source and the comparison target. Figure 6 The flowchart is an example of specifying determination method A, determination method B, and determination method C as evaluation conditions. In this case, the three types of determination methods are used to compare the printed processed images of the comparison source and the comparison target, and to create an evaluation result.

[0086] For example, in step S28, the control unit 31 uses determination method A to compare the printed processed images of the comparison source and the comparison target, and creates an evaluation result. In step S30, the control unit 31 uses determination method B to compare the printed processed images of the comparison source and the comparison target, and creates an evaluation result. Further, in step S32, the control unit 31 uses determination method C to compare the printed processed images of the comparison source and the comparison target, and creates an evaluation result.

[0087] In step S34, the control unit 31 notifies the management unit 37 of the evaluation results created in steps S28, S30, and S32. The management unit 37 lists the evaluation results created in steps S28, S30, and S32 and saves the list of evaluation results to the storage unit 39.

[0088] In step S36, management unit 37 notifies the user to complete the evaluation by comparing the printed processed images of the comparison source and the comparison target, and provides the evaluation results by displaying them on display 506 or by sending an email. For example, the email sent to the user may list the evaluation results or indicate the URL of the saved evaluation results.

[0089] exist Figure 6 In this process, the generation of the source print processing image and the generation of the target print processing image are executed sequentially, but they can also be executed in parallel to reduce the required time.

[0090] <Setup Screen>

[0091] Figure 7 This is an example image of the setup screen 400 to be displayed by the terminal device 30. The initial values ​​displayed on the setup screen 400 are saved by the control unit 31. Figure 12 This shows an example of initial value information containing registered initial values ​​displayed on the settings screen 400. For example, Figure 12 The initial values ​​are stored in the file "c: / setting.ini". "#Image Comparison Tool Default Settings": This is the name of this file. "Image Format": This is the format (file extension) for the printed image. "Output Folder": This is the address of the output destination for the printed images. "Working Folder": This is the folder where print data or evaluation files are temporarily stored. "Comparison": This sets the comparison method to either exact match (ALL) or fuzzy match. "Email": This is the email address to which the evaluation results will be sent.

[0092] Control unit 31 will Figure 12 The initial value information is notified to the setting unit 36, so the setting unit 36 ​​can generate the setting screen 400 for setting the initial value.

[0093] Return to reference Figure 7 Continue the description. Figure 7 The settings screen 400 includes a comparison source section 401, a comparison target section 405, and sections for other settings. The comparison source section 401 and the comparison target section 405 have the same items. The guest OS is set in OS 402 and OS 406. The printer driver 33 is set in Printer Driver 403 and Printer Driver 407. The PDL module (Graphics Processing Unit) is set in PDL 404 and PDL 408. It should be noted that once the PDL module is set, the printer simulator 34 is also set.

[0094] exist Figure 7 In the OS 402 section of the comparison source 401, the setting uses "64-bit version of Windows 10 (registered trademark)". In the Printer Driver 403, the setting uses the "C:Driver / x64 / postscript_1.00" package. Furthermore, in PDL 404, the setting uses the PDL module "C: / PDL / Postscript_1.00".

[0095] exist Figure 7 In the comparison target section 405, OS 406 is set to use "32-bit version of Windows 10 (registered trademark)". In Printer Driver 407, the package "C:Driver / x64 / postscript.1.00" is set to be used. Furthermore, in PDL 408, "C: / PDL / Postscript_1.00" is set to be used.

[0096] Next, the items for the other settings will be described. The Evaluation File field 409 is a field for setting the filename of the evaluation file used to evaluate the image. Users can set multiple evaluation files. Additionally, users can set files such as PRN files or PDF files, which can be sent directly to the image forming device without using the print application 32. Furthermore, users can directly specify image data in file formats such as PNG, JPEG, TIFF, and BMP. The Result Save Destination field 410 is a field for setting the save destination of the evaluation results. Evaluation results can be, for example, CSV files, text files, XML files, or other formats. It should be noted that the printed processed images of the comparison source and comparison target, along with the difference information between the two images, are sent to the evaluation result save destination along with the evaluation results. Regarding the evaluation results, the image RIP processed under the conditions set in the Comparison Source section 401 and the Comparison Target section 405, as well as the image evaluation (comparison), are saved.

[0097] Regarding Figure 7 The conditions set in the comparison source section 401 and the comparison target section 405 allow for an evaluation of whether any differences exist between images on the different OSes. Furthermore, if the OS and printer driver 33 are set to be the same in both the comparison source section 401 and the comparison target section 405, and the PDL is changed to be different from each other, the PDL module can also be evaluated. Additionally, if the OS and PDL module are set to be the same in both the comparison source section 401 and the comparison target section 405, and the printer driver 33 is changed to be different from each other, the printer driver 33 can also be evaluated.

[0098] Although Figure 7 The examples of conditions set in the comparison source section 401 and comparison target section 405 on the settings screen 400 use the OS, printer driver 33, and PDL module, but the conditions can be expanded to include settings for the printing application to be used. The print conditions field 411 is a field for setting a settings file containing specified print conditions for the printer driver 33. Thus, settings such as those for printing multiple pages on a single sheet of paper, and settings for color management, can be included in the print conditions field 411. The notification destination field 412 is, for example, setting the email address for the destination of the evaluation result notification. The email address for the evaluation result notification destination can also be used in case of problems. Multiple email addresses can be set. Furthermore, a user account for the chat system can be set in the notification destination field 412. Thus, the terminal device 30 can send evaluation results using the chat system.

[0099] In addition, by pressing the confirmation method selection button 413, the user can display on the monitor 506. Figure 8 The selection method is shown on screen 550, where the selection method is chosen. Evaluation of the source and target images begins when the user presses the start button 420. Furthermore, when the user presses the cancel button 421, any settings on the settings screen 400 are canceled, and a transition occurs from the settings screen 400 to the portal screen, etc. It should be noted that... Figure 7 The settings screen 400 shown is an example, and conditions other than those mentioned can be set, such as the evaluation start (scheduled) time, evaluation priority level, etc.

[0100] <Select Screen to Determine Method>

[0101] Figure 8 This is an example of selecting screen 550 using the method of selection. Screen 550 is selected by pressing... Figure 7The screen displayed by the selection button 413 is a user interface that allows the user to select the selection method (image selection method) for use based on the user contract (contract details) and conditions. Figure 8 On screen 550, the selection of the determination method includes a complete match determination method (A to D) for determining whether all pixels are perfectly matched, and an image determination method (A to D) that allows for a certain degree of difference. In the complete match determination method and the image determination methods A to D, the image data of the comparison source and the image data of the comparison target are compared.

[0102] Section 551, the Free Course section, is for setting up the free course determination method and indicates the free course determination method that anyone can use. Checkbox 552 is used to set the exact match determination method to be used for image data evaluation. Checkbox 553 is used to set image determination method A to be used for image data evaluation. Figure 8 The free course section 551 in the document represents an example of setting the exact match determination method and image determination method A as determination methods used in image data evaluation.

[0103] Section 554 of Paid Course 1 is a section for setting up a method for determining the contract for users who have already signed a contract for Paid Course 1, and instructs users who have already signed a contract for Paid Course 1 on the methods for determining the contract for Paid Course 1 that can be used. For example, the contract can be determined by a login ID, etc. Figure 8 This is an example of a user who has already signed a contract for Paid Course 1, so the image determination method B and image determination method C displayed in Paid Course 1 section 554 can be set via checkboxes 555 and 556 respectively. Figure 8 The paid course 1, section 554, indicates an example where image determination method B is set as the determination method to be used for image data evaluation, and image data determination method C is not set.

[0104] Section 557 of Paid Course 2 is a section for setting up a method for determining users who have already signed a contract for Paid Course 2, and instructs on a method for determining the Paid Course 2 that users who have already signed a contract for Paid Course 2 can use. Figure 8 This is an example where the user has not entered into a contract for Paid Course 2, therefore the image detection method D displayed in Paid Course 2 section 557 is grayed out, and the image detection method D in checkbox 558 cannot be set.

[0105] The selection method set on the selection method screen 550 is saved when the user presses the OK button 560. When the user presses the Cancel button 561, any settings on the selection method screen 550 are canceled, and a transition to the settings screen 400 occurs.

[0106] <Example of evaluation results>

[0107] Figure 9 This is an example image of the evaluation result screen 600. The evaluation result screen 600 displays a label 601 indicating the evaluation result of the determination method for a perfect match, a label 602 indicating the evaluation result of the determination method for image determination method A, and a label 603 indicating the evaluation result of the determination method for image determination method B. All these labels are set... Figure 8 The determination method selection screen 550 is displayed. Furthermore, the evaluation result screen 600 includes gray-out labels, namely, label 604 indicating the evaluation result of image determination method C and label 605 indicating the evaluation result of image determination method D. These labels are not set on the screen. Figure 8 The selection method is shown on screen 550. Users can select label 601 to refer to the evaluation results of the exact match determination method. Additionally, users can select label 602 to refer to the evaluation results of image determination method A. Furthermore, users can select label 603 to refer to the evaluation results of image determination method B.

[0108] In addition, the evaluation results screen 600 includes an evaluation file display field 606, a page specification field 607, and an evaluation file selection field 608. The evaluation file selection field 608 is where the user selects which file number to open from the evaluation files used for the evaluation. Figure 9 The first of two evaluation files is shown.

[0109] The evaluation file display field 606 is used to indicate the filename of the currently selected evaluation file. The page specification field 607 is used by the user to select which page of the currently selected evaluation file's image to display.

[0110] In addition, the evaluation result screen 600 has a comparison source image field 609, a comparison target image field 610, and a difference information field 611. The comparison source image field 609 displays the printed image of the comparison source (image data) on the page specified in the page specification field 607 within the evaluation file selected in the evaluation file selection field 608. The comparison target image field 610 displays the image data of the comparison target on the page specified in the page specification field 607 within the evaluation file selected in the evaluation file selection field 608.

[0111] In the difference information field 611, the differences between the image data of the comparison source and the image data of the comparison target are displayed as difference information. For example, in the difference information field 611, the parts of the image data of the comparison source and the image data of the comparison target that have differences are highlighted in red. It should be noted that the coloring can be changed according to the differences in the difference information field 611. For example, minor differences that do not achieve a perfect match are displayed in black, and vague mismatches are displayed in red. Images for each color can be displayed in CMYK in the comparison source image field 609, the comparison target image field 610, and the difference information field 611.

[0112] The evaluation results screen 600 also includes three zoom buttons 612, 613, and 614. These buttons are used to zoom in on the image data of the comparison source, the image data of the comparison target, and the difference information, respectively. When the user presses the corresponding button, each image can be displayed as a zoomed-in image independently.

[0113] The evaluation results screen 600 also includes an evaluation results field 615, a details button 616, and an end button 617. The evaluation results field 615 displays the evaluation results as either a perfect match or a non-match. The details button 616 displays details of the evaluation results. The end button 617 closes the evaluation results screen 600.

[0114] Figure 10 This is an example image of the detailed evaluation results screen 700. The detailed evaluation results screen 700 displays the evaluation results details. Content 701 indicates the evaluation date, evaluation start time, evaluation executor, evaluation file, comparison source data (the filename of the generated printable image of the comparison source), comparison target data (the filename of the generated printable image of the comparison target), difference data (the filename of the difference information), evaluation results (the filename of the evaluation results), evaluation method, results, and difference details.

[0115] The comparison source data (the filename of the printed processed image of the comparison source) includes the evaluation target filename (J9.doc), the comparison source (org), and the page number (1). This also applies to the comparison target data and the difference data.

[0116] In addition, the evaluation results document includes page-by-page evaluation results for all evaluation documents. Figure 13 The middle shows Figure 10 The contents of the evaluation results file “Result_201909112200.csv” shown below will be described further.

[0117] Represent the differences in details using numerical values. For example... Figure 10As shown, the difference details include the number of locations with differences, surface area, frame occupancy, and coordinates (x and y coordinates). The number of locations with differences is the number of instances where consecutive pixels are identified as having differences (difference locations), the surface area is the number of pixels at the difference location, the frame occupancy of the difference location is the surface area divided by the total number of pixels, and the coordinates are the top-left coordinates of the difference location.

[0118] The copy button 702 is used to copy the detailed evaluation results to the clipboard. The end button 703 is used by the user to close the detailed evaluation results screen 700.

[0119] Figure 10 The content shown is just an example. Other details of the evaluation results created by evaluation unit 35 can be displayed as needed.

[0120] <Processing flow after assessment begins>

[0121] Next, refer to Figure 11 Describes the processing after the evaluation performed by terminal device 30 begins. Figure 11 This is a diagram illustrating an example of the processing flow after the evaluation performed by terminal device 30 begins.

[0122] In step S100, the terminal device 30 receives an evaluation start command from a management tool or similar source. In step S102, the terminal device 30 starts the OS specified on the setup screen 400 as a guest OS 62 on a virtual machine and installs the printer driver 33 specified on the setup screen 400. Furthermore, the terminal device 30 starts the evaluation file printing application 32 specified on the setup screen 400. The printing application 32 performs the printing of the evaluation file (generating print data for the comparison source or comparison target) based on the printing conditions specified in step S10.

[0123] Terminal device 30 starts printer simulator 34 of the PDL module specified on the setup screen 400. Printer simulator 34 performs RIP processing (drawing processing) on ​​the print data of the comparison source and comparison target. In step S104, terminal device 30 saves the image data (print processing image) of the comparison source and comparison target to storage unit 39.

[0124] Once the image data for the comparison source and the comparison target are prepared, the terminal device 30 begins the evaluation (image determination) of the image data for the comparison source and the comparison object in step S106. In step S108, the terminal device 30 selects the determination method (image determination method) specified as the evaluation condition on the setting screen 400.

[0125] In steps S110, S112, and S114, terminal device 30 performs an evaluation of the image data of the comparison source and comparison target for each determination method selected in step S108, and saves the evaluation results to storage unit 39. In step S116, terminal device 30 notifies the user, for example by email or by displaying the information on display 506, that the evaluation of the image data of the comparison source and comparison target has been completed along with the evaluation results. It should be noted that the notification provided to the user may include information about any unsuccessful processing that occurred along the way.

[0126] Page-by-page evaluation results

[0127] Figure 13 This is a diagram illustrating an example of the contents of an evaluation file. The evaluation result file is saved with a unique name to the save destination (folder) set in the result save destination field 410. For example, in Figure 10 In the example of content 701, the file is saved with the following CSV filename: "Result_201909112200.csv".

[0128] The contents of the file "Result_201909112200.csv", which contains the evaluation results of the 5-page evaluation file "J9.doc" and the 8-page evaluation file "J11.ppt", set in field 409 of the evaluation file, are as follows: Figure 13 As shown.

[0129] Figure 13 The contents of the evaluation results document, from left to right, are: evaluation date, evaluation start time, evaluation executor, evaluation document, page number, image corresponding to the page in the comparison source setting, image corresponding to the page in the evaluation target setting, difference image corresponding to the page, complete match determination result, determination result of image determination method A, determination result of image determination method B, determination result of image determination method C, determination result of image determination method D, and comprehensive evaluation result of the complete match determination result of image determination method D.

[0130] according to Figure 13The evaluation results document, "J9.doc", was evaluated starting at 22:00 on September 11, 2019. The first page is not a complete match; it matches both determination method A and determination method B, thus representing a match within the overall determination results. It should be noted that since determination methods C and D were not set, there are no results for determination methods C and D. The second page is not a complete match; it matches determination result A but not determination result B, therefore not representing a match within the overall determination results. It should be noted that since determination methods C and D were not set, there are no results for determination methods C and D. Furthermore, the image data of the output results created by each evaluation method during the evaluation process is saved as a file in the description of the evaluation results.

[0131] To display Figure 10 The detailed evaluation results screen 700 shows the detailed results of each evaluation document, as follows: Figure 14 The result is saved as shown. Figure 14 This is a diagram illustrating an example of the content of the detailed evaluation results. The detailed evaluation results file is saved with a unique name to the save destination set in the results save destination field 410. For example, in Figure 10 In the example of content 701, the evaluation results of the evaluation file "C: / Sample / J9.doc" are saved as the file name "C:Output / J9.doc.log.xml".

[0132] The content of the evaluation results document is as follows: Figure 14 As shown. Figure 14 The evaluation results shown are saved as a file based on the evaluation results for each determined method. It should be noted that although XML format was used in the example above, any format can be used as long as it is separated by filename and page, and other items can be added.

[0133] Furthermore, in this embodiment, the determination method based on machine learning can be included in the user-configurable determination method. For the determination method based on machine learning, a trained model can be created using neural networks (deep learning) and similar technologies by employing a sufficient number of matching and non-matching human-based evaluation results. Once training is complete, the trained model can output matching or non-matching results that closely approximate human evaluation results.

[0134] Machine learning is a technology used to acquire the ability to learn on a computer like a human. It involves autonomously generating algorithms for data recognition and other functions based on pre-acquired learning data, and then applying these algorithms to predict new data. Learning methods used in machine learning can be supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, or deep learning. Furthermore, any combination of these learning methods can be used. Examples of machine learning techniques include perceptrons, deep learning, support vector machines, logistic regression, decision trees, random forests, etc., but the techniques described in this embodiment are not limited to these.

[0135] Other Function Configurations

[0136] The above text describes Figure 2B Functional blocks of terminal device 30 under the following circumstances. Figure 2A Functional blocks in the following cases Figure 15 As shown in the diagram. Figure 15 This is an example of a functional block diagram used to describe the functions of terminal device 30 and information processing device 50 in block diagram form.

[0137] Information Processing Equipment

[0138] The information processing device 50 includes a control unit 51, a printing application 52, one or more printer drivers 53, one or more printer simulators 54, one or more evaluation units 55, a screen information generation unit 56, a management unit 57, a first communication unit 58, and a storage unit 59. These functional units of the information processing device 50 operate in cooperation with instructions from the CPU 501 according to a program read from the HDD 504 into the RAM 503. Figure 3 Any element shown that enables or enables the function or apparatus to function.

[0139] The first communication unit 58 communicates with the terminal device 30 and sends and receives various types of information. For example, the first communication unit 58 receives settings regarding consistency determination from the terminal device 30 and sends evaluation results. The first communication unit 58 can send the evaluation results via email. The control unit 51 controls the overall processing regarding consistency determination. For example, the control unit 51 manages the processing flow based on the consistency determination settings received from the user and invokes any necessary user functions from the printing application 52 to the first communication unit 58. Control tools such as Jenkins are known as control units 51. Furthermore, the control unit 51 can be used for Robotic Process Automation (RPA).

[0140] The printing application 52 is an application software that runs on the OS installed in the information processing device 50. The printing application 52 can open the evaluation file, invoke the printer driver 53, and start printing the evaluation file.

[0141] Printer driver 53 is software that runs on the OS installed in information processing device 50. Printer simulator 54 is software that runs on the OS installed in information processing device 50. Printer simulator 54 performs rendering that has already been performed by the image forming device. It should be noted that, in addition to residing in information processing device 50, printer simulator 54 may also reside on network N that information processing device 50 can access.

[0142] The evaluation unit 55 is an application module running on the information processing device 50. For example, the evaluation unit 55 compares two printed images of interest and evaluates whether the images can be considered identical. Furthermore, the evaluation unit 55 generates difference information between the two printed images.

[0143] The screen information generation unit 56 generates screen information for the screen to be displayed by the terminal device 30, which acts as a network server. In this embodiment, it primarily generates screen information for receiving settings regarding consistency determination from the user. The control unit 51 uses the consistency determination settings received from the user by the screen information generation unit 56 to control the overall processing regarding consistency determination. The management unit 57 manages the evaluation results of the consistency determination settings received from the user by the screen information generation unit 56 and the two printed processing images. Furthermore, the management unit 57 can be configured to manage the processing for sending the evaluation results of the images to the user via email or for sending the evaluation results of the images to the user via a chat system.

[0144] Furthermore, storage unit 59 is an HDD 504, RAM 503, or both, such as Figure 3 As shown. Printed images, difference information, evaluation results, etc., are stored in storage unit 59.

[0145] Terminal Equipment

[0146] Terminal device 30 includes a second communication unit 71, a display control unit 72, and an operation receiving unit 73. These units of terminal device 30 operate in cooperation with instructions from CPU 501 according to a program for terminal device 30 read from HDD 504 into RAM 503. Figure 3 Any element shown that performs or enables a function or apparatus to function. For example, suppose the program for such a terminal device 30 is a web browser.

[0147] The second communication unit 71 receives or sends various types of information to the information processing device 50. For example, it requests various types of web pages via HTTP communication, and various types of operation content for the web pages are sent to the information processing device 50.

[0148] The display control unit 72 interprets various types of screen information received from the information processing device 50 and displays the screen information on the display 506. The display control unit 72 displays a screen for receiving settings such as consistency determination of image comparison conditions, and displays the image evaluation results. The operation receiving unit 73 receives various types of operations related to the screens displayed by the display control unit 72.

[0149] <Main Effects>

[0150] As described above, since the evaluation of the impact of printer driver differences, PDL module differences, or OS differences on images can be performed entirely through simulation, the terminal device 30 or information processing system 100 of this embodiment can be provided at low cost in multiple evaluation environments, thus eliminating the need for an image forming device.

[0151] Therefore, according to this embodiment, an evaluation environment capable of performing multiple determination methods for image evaluation can be provided at low cost, and evaluation results obtained by performing multiple determination methods in the evaluation environment can be compared.

[0152] Other Application Examples

[0153] As described above, although embodiments have been described with respect to exemplary modes for implementing embodiments of the present disclosure, embodiments of the present disclosure are not limited to these embodiments, and embodiments may be modified and substituted in various ways without departing from the scope of the invention.

[0154] For example, in Figure 4 , Figure 15 In the configuration examples, to facilitate the explanation of the processing of the terminal device 30 or the information processing device 50, the functional blocks are divided according to their main functions. The embodiments of this disclosure are not limited to how the processing is divided into processing units or unit names. The processing of the terminal device 30 or the information processing device 50 can also be divided into a greater number of processing units based on the processing content. Such a division can be made so that a single processing unit includes a large amount of processing.

[0155] The device group described in this embodiment represents only one of a plurality of computing environments used to implement the embodiments described herein. In one embodiment, terminal device 30 or information processing device 50 includes, for example, a plurality of computing devices, such as a server cluster. The plurality of computing devices are configured to communicate with each other via any type of communication link, including a network or shared memory, to perform the processing disclosed herein. Similarly, terminal device 30 may include a plurality of computing devices configured to communicate with each other.

[0156] Each function of the above embodiments can be implemented by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to perform the corresponding function by software, such as a processor implemented by electronic circuits; or a device such as an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a field-programmable gate array (FPGA), or a conventional circuit module designed to perform the corresponding functions described above.

[0157] This application is based on and claims priority to Japanese priority application No. 2020-143263, filed on August 27, 2020, the contents of which are incorporated herein by reference.

[0158] List of reference numerals

[0159] 30 terminal devices

[0160] 31, 51 control units

[0161] 32, 52 Printing Applications

[0162] Printer drivers for models 33 and 53

[0163] 34, 54 Printer Simulator

[0164] Evaluation Units 35 and 55

[0165] 36 Setting Units

[0166] Management Units 37 and 57

[0167] 38 Communication Units

[0168] 39 storage units

[0169] 40, 72 Display control unit

[0170] 41, 73 Operation Receiving Unit

[0171] 50 Information processing equipment

[0172] 56 Image Information Generation Unit

[0173] 58 First Communication Unit

[0174] 71 Second Communication Unit

[0175] 100 Information Processing System

[0176] 506 monitor

Claims

1. An information processing device, the information processing device comprising: Multiple evaluation units are configured to evaluate images generated by a printer simulator; A setting unit is configured to receive settings from a user for one or more of the plurality of evaluation units, the settings being used to evaluate the image; Control unit, configured to cause one or more evaluation units receiving the settings to evaluate the image; as well as The display control unit is configured to display the evaluation results obtained by the one or more evaluation units; The image generated by the printer simulator and another image generated by another printer simulator are compared and evaluated using one or more evaluation units. The settings for the OS, printer driver, and printer simulator to be used for the image and another image to be compared and evaluated by the one or more evaluation units are received by the setting unit based on each image. The control unit causes the virtual machine to execute the OS, the printer driver, and the printer simulator based on settings for each image for the image to be compared and evaluated by the one or more evaluation units and the other image; The display control unit displays for each of the one or more evaluation units, including the evaluation results of the image and another image compared and evaluated by the one or more evaluation units, the differences between the image and the other image, and the evaluation results of the comparison.

2. The information processing device according to claim 1, wherein, The setting unit changes one or more evaluation units that receive settings from the user based on the user's contract details.

3. The information processing device according to claim 1, further comprising: A communication unit configured to send evaluation results obtained by the one or more evaluation units via email.

4. A non-transitory computer-readable recording medium having a computer program stored thereon for a computer to perform the following steps: The image generated by the printer simulator is evaluated using multiple evaluation units; The setting unit receives settings from the user for one or more of the plurality of evaluation units, the settings being used to evaluate the image; The control unit causes one or more evaluation units that have received the settings to evaluate the image; as well as The evaluation results obtained by the one or more evaluation units are displayed by the display control unit; The image generated by the printer simulator and another image generated by another printer simulator are compared and evaluated using one or more evaluation units. The settings for the OS, printer driver, and printer simulator to be used for the image and another image to be compared and evaluated by the one or more evaluation units are received by the setting unit based on each image. The control unit causes the virtual machine to execute the OS, the printer driver, and the printer simulator based on settings for each image for the image to be compared and evaluated by the one or more evaluation units and the other image; The display control unit displays for each of the one or more evaluation units, including the evaluation results of the image and another image compared and evaluated by the one or more evaluation units, the differences between the image and the other image, and the evaluation results of the comparison.

5. An information processing system, the information processing system comprising: A terminal device and an information processing device, wherein the terminal device and the information processing device are configured to communicate with each other. The information processing device includes: Multiple evaluation units are configured to evaluate images generated by a printer simulator; A control unit configured to, in response to a request from the terminal device, cause one or more of the plurality of evaluation units to evaluate the image; A first communication unit is configured to send evaluation results acquired by the one or more evaluation units to the terminal device, and The terminal device includes: An operation receiving unit is configured to receive selection operations from a user from one or more evaluation units, the selection operations being used for the evaluation of the image; A second communication unit, configured to: request the information processing device to evaluate the image by receiving the one or more evaluation units of the selection operation, and receive from the information processing device the evaluation results obtained by the one or more evaluation units; and The display control unit is configured to display the evaluation results obtained by the one or more evaluation units; The image generated by the printer simulator and another image generated by another printer simulator are compared and evaluated using one or more evaluation units. The settings for the OS, printer driver, and printer simulator to be used for the image and another image to be compared and evaluated by one or more evaluation units are received by the setting unit based on each image. The control unit causes the virtual machine to execute the OS, the printer driver, and the printer simulator based on settings for each image for the image to be compared and evaluated by the one or more evaluation units and the other image; The display control unit displays for each of the one or more evaluation units, including the evaluation results of the image and another image compared and evaluated by the one or more evaluation units, the differences between the image and the other image, and the evaluation results of the comparison.

6. The information processing system according to claim 5, wherein, The setting unit changes one or more evaluation units that receive settings from the user based on the user's contract details.

7. The information processing system according to claim 5, wherein, The first communication unit sends the evaluation results obtained by the one or more evaluation units via email.

Images