Information processing apparatus, information processing system and control method of information processing apparatus

Abstract

To enable performing image quality adjustment not so as to generate downtime of an image formation device and to make image quality intended by a user.SOLUTION: An information processing apparatus that can communicate with an image formation system having reading means to read a printed image generates a preset value of image quality adjustment associated with the image formation system on the basis of image data of an image printed after starting printing; generates the image data after the image quality adjustment on the basis of the preset value of the generated image quality adjustment; and transmits the image data of the image printed before printing which image is previously stored and the generated image data after the image quality adjustment to a terminal device that displays the image data.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing system, a control method for an information processing device, and a program. [Background technology]

[0002] With the spread of IoT (Internet of Things), a technology called digital twin, which builds a virtual model of an environment on a server that is identical to an actual one in the real world, is becoming widespread. For example, in the control device of an energy system such as wind power generation, a technology is known that uses monitoring data such as sensing data and operation data to derive settings that maximize power generation in the digital twin environment and control the system.

[0003] Furthermore, high-quality printing is being demanded of image forming systems. The quality of images printed in an image forming system varies depending on temperature, humidity, engine characteristics, the condition of the printing paper, etc. Therefore, even if the settings of the image forming system are adjusted before printing to achieve the image quality intended by the user, the environment, etc. may change as printing progresses, causing the quality of the printed image to change.

[0004] Patent document 1 proposes a system that, after printing has started, determines the time to adjust the image quality of the image forming system, prints a specified adjustment pattern, reads the printed adjustment pattern with a scanner, and calculates an image quality adjustment value based on the image data of the read adjustment pattern. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2008-277999 A Summary of the Invention [Problem to be solved by the invention]

[0006] In the image quality adjustment method of the image forming system of Patent Document 1, when it is time to adjust the image quality, a predetermined adjustment pattern is printed, and an image quality adjustment value is calculated based on the image data of the predetermined adjustment pattern read from the printing, thereby adjusting the image quality. However, in this method, printing the predetermined adjustment pattern causes downtime in which the image forming system cannot be used to print the desired image after printing has started. In addition, calculating the image quality adjustment value based on the image data of the predetermined adjustment pattern makes it impossible for the user to check in advance the image quality of the image to be printed after adjustment. The present invention has been made in consideration of such circumstances, and aims to make it possible to adjust the image quality to achieve the image quality intended by the user without causing downtime of the image forming system. [Means for solving the problem]

[0007] The information processing device of the present invention is an information processing device capable of communicating with an image forming system having a reading means for reading a printed image, and is characterized in that it has a first generation means for generating image quality adjustment setting values ​​for the image forming system based on image data read by the reading means of an image printed after printing has started, a second generation means for generating image data after image quality adjustment based on the image quality adjustment setting values ​​generated by the first generation means, and a communication means for transmitting image data read by the reading means of an image printed before printing has started, which has been previously stored, and the image data after image quality adjustment generated by the second generation means to a terminal device that displays the image data. Effect of the Invention

[0008] According to the present invention, it is possible to perform image quality adjustment so as to achieve the image quality intended by the user, without causing downtime of the image forming system. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 illustrates an example of the configuration of a print system. [Diagram 2]FIG. 2 illustrates an example of a hardware configuration of a management server. [Diagram 3] FIG. 2 illustrates an example of a software configuration of a management server. [Figure 4] FIG. 1 is a diagram illustrating an example of the hardware configuration of a VR headset. [Diagram 5] FIG. 2 is a diagram illustrating an example of the software configuration of a VR headset. [Figure 6] FIG. 1 illustrates an example of the configuration of an image forming system. [Figure 7] FIG. 2 illustrates an example of the configuration of a controller of the image forming system. [Figure 8] FIG. 2 is a diagram illustrating an example of the configuration of a main controller. [Figure 9] 11 is a diagram illustrating a flow of image quality adjustment processing in the image forming system. [Figure 10] FIG. 2 is a diagram illustrating a display example of an operation panel of the image forming system. [Figure 11] FIG. 13 is a diagram illustrating a display example when comparing images on a VR headset. [Figure 12] 13A to 13C are diagrams illustrating examples of displays when confirming changes to setting values ​​on a VR headset. [Figure 13] 11 is a flowchart illustrating a process for confirming a change in a setting value. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. 1 is a diagram showing an example of the configuration of a print system to which an information processing system according to this embodiment is applied. In the print system according to this embodiment, an image forming system 101, a management server 102, and a user terminal 103 are communicably connected to a network 104 such as the Internet or a LAN (Local Area Network).

[0011] The image forming system 101 is a system having a function (printing function) of forming an image on a sheet, which is a recording medium, and is, for example, a print-on-demand (POD) system having an image forming apparatus. Note that the image forming system 101 is not limited to a POD system, as long as it is a system having a function of forming an image on a sheet. Here, the sheet is not limited to paper, so long as it is a recording medium on which an image is printed, and includes paper such as paper and envelopes, plastic film, cloth, and the like. In this way, the sheet generally refers to sheets including sheets other than paper.

[0012] The management server 102 is a server that manages the print system. The management server 102 performs control related to image quality adjustment of an image printed by the image forming system 101, for example. The management server 102 generates setting values ​​(image quality adjustment values) for adjusting image quality based on various information from the image forming system 101 and transmits the same to the image forming system 101. The management server 102 also creates image data after image quality adjustment (image to be printed after image quality adjustment) based on the setting values ​​(image quality adjustment values) for adjusting image quality and transmits the same to the user terminal 103. The management server 102 is an example of an information processing device.

[0013] The user terminal 103 is an information processing device that executes a virtual space application program or the like. The user terminal 103 may be, for example, a PC (personal computer), a smartphone, a tablet terminal, or the like that can execute a virtual space application program. The VR headset (VR goggles) 105 is hardware such as a head-mounted display that supports drawing of a virtual space including virtual objects. The VR headset 105 is connected to the user terminal 103 via a communication network 106 realized by Bluetooth (registered trademark), wireless LAN, or the like. The user can check the image after image quality adjustment by the image displayed on the VR headset 105 based on the image data after image quality adjustment created by the management server 102, and can input various operations via an input unit of the VR headset 105 or the like. The user terminal 103 and the VR headset 105 are examples of terminal devices.

[0014] 2 is a diagram showing an example of the hardware configuration of the management server 102. The management server 102 includes a CPU 201, a ROM 202, a RAM 203, a network communication unit 204, a storage 205, and a bus 206. The CPU 201, the ROM 202, the RAM 203, the network communication unit 204, and the storage 205 are connected via the bus 206 so as to be able to communicate with each other.

[0015] The CPU (Central Processing Unit) 201 is a central processing unit that controls the entire management server 102. The CPU 201 controls the operation of each unit connected via, for example, a bus 206. The ROM (Read Only Memory) 202 is a read-only memory for storing a boot program and the like required for system startup. The RAM (Random Access Memory) 203 serves as a working memory required when the CPU 201 executes a program.

[0016] The network communication unit 204 is connected to a network such as the Internet and performs various communications. The storage 205 is a device for storing various information and programs executed by the CPU 201. The CPU 201 executes processes based on programs stored in the ROM 202, the storage 205, etc., thereby realizing each component of the management server 102 shown in Fig. 3.

[0017] Fig. 3 is a diagram showing an example of the software configuration of the management server 102. The management server 102 has a control unit 301, a communication unit 302, an arithmetic processing unit 303, and a data storage unit 304. Fig. 3 shows the configuration related to control related to image quality adjustment in the management server 102, and the management server 102 may have a configuration other than the configuration shown in Fig. 3.

[0018] The control unit 301 controls the arithmetic processing unit 303 to generate setting values ​​for image quality adjustment (image quality adjustment values) based on data acquired via the communication unit 302. The control unit 301 also controls the communication unit 302 to transmit the setting values ​​(image quality adjustment values) and image data generated by the arithmetic processing unit 303 to the user terminal 103 and the image forming system 101. The communication unit 302 communicates with the user terminal 103 and the image forming system 101 (image forming device 600) and transmits and receives various processing requests and various data.

[0019] The arithmetic processing unit 303 generates a setting value (image quality adjustment value) for image quality adjustment based on the image data and setting value before the start of printing (at the time of pre-printing) sent from the image forming system 101 (image forming device 600) and the image data at the time when it is determined that it is time to adjust the image quality after the start of printing. In addition, the arithmetic processing unit 303 creates image data after image quality adjustment (image image after image quality adjustment) based on the generated setting value (image quality adjustment value) for image quality adjustment. The arithmetic processing unit 303 generates the setting value (image quality adjustment value) for image quality adjustment and the image data after image quality adjustment (image image after image quality adjustment) using, for example, digital twin technology. That is, the arithmetic processing unit 303 generates the setting value and image data using a virtual model that imitates the current image forming system 101 reproduced in a digital space (virtual space) based on data related to the image forming system 101. The arithmetic processing unit 303 is an example of a first generating means and a second generating means.

[0020] The data storage unit 304 stores programs for calculations, data sent from the image forming system 101 (image forming apparatus 600), etc. The data storage unit 304 is an example of a storage unit.

[0021] 4 is a diagram showing an example of the hardware configuration of the VR headset 105. The VR headset 105 has a CPU 401, a GPU 402, a RAM 403, a ROM 404, a storage 405, a wireless communication unit 406, a camera 407, a display 408, an input unit 409, and a bus 410. The CPU 401, the GPU 402, the RAM 403, the ROM 404, the storage 405, the wireless communication unit 406, the camera 407, the display 408, and the input unit 409 are connected via the bus 410 so as to be able to communicate with each other.

[0022] The CPU 401 controls the entire device, and controls the operation of each part connected via a bus 410, for example. The CPU 401 executes application programs, an OS, etc. stored in a storage 405, etc., and controls temporary storage of information, files, etc. required for executing the programs in a RAM 403. A GPU (Graphics Processing Unit) 402 performs arithmetic processing required for drawing a virtual space such as a metaverse space in real time, for example. The RAM 403 functions as a main memory, a work area, etc. for the CPU 401 and the GPU 402. The ROM 404 stores various data such as a basic I / O program.

[0023] The storage 405 functions as a large-capacity memory and stores application programs, an OS, and the like. The storage 405 is configured, for example, with a flash memory such as a solid-state drive (SSD) or an embedded multimedia card (eMMC). The wireless communication unit 406 performs various communications with the user terminal 103 via a communication network such as Bluetooth or wireless LAN. The wireless communication unit 406 may perform various communications via a network such as the Internet. The camera 407 captures an image of the surroundings in the VR headset 105.

[0024] The display 408 displays a virtual space such as the metaverse space and information necessary for operation. The display 408 includes a left-eye display and a right-eye display (not shown). In the virtual space, the display content of the left-eye display is perceived by the left eye, and the display content of the right-eye display is perceived by the right eye, and the user's brain synthesizes these display contents, allowing the user to recognize the display content three-dimensionally. In addition, the user can recognize the display content three-dimensionally by projecting an image onto a half mirror (not shown) provided in the display 408 and the user looking at a virtual screen beyond the half mirror. In addition, the user can recognize the display content three-dimensionally by projecting a laser from a laser irradiation device (not shown) provided in the display 408 onto the retina. The input unit 409 includes, for example, a microphone and an attached controller used for operation in a virtual space such as the metaverse space, an acceleration sensor for handling position and movement, a touch sensor, and an infrared camera sensor.

[0025] Fig. 5 is a diagram showing an example of the software configuration of the VR headset 105. The VR headset 105 has a communication unit 501, a storage unit 502, a camera control unit 503, a display unit 504, an operation unit 505, an application unit 506, and an image recognition unit 507. Note that the VR headset 105 may have a configuration other than the configuration shown in Fig. 5.

[0026] The communication unit 501 controls the wireless communication unit 406, and transmits and receives data to and from the user terminal 103 and the management server 102 via the network. The communication unit 501 also acquires peripheral device information through local communication with the peripheral devices, and transmits and receives data to and from the peripheral devices. When wireless communication is performed from an application, the communication unit 501 cooperates with the application unit 506 to transmit and receive data.

[0027] The storage unit 502 controls the storage of the OS, web browser, installed application data, etc., that are activated by the VR headset 105 in the ROM 404. The camera control unit 503 accepts and controls image data acquired from the camera 407. The display unit 504 displays the results of the OS, web browser, and application on the display 408. The display unit 504 controls the display of menus and the like for operating the OS, and controls the display of images and confirmation screens and the like based on image data in image quality adjustment related to the image forming system 101, for example.

[0028] The operation unit 505 accepts and controls operations of the VR headset 105 itself via the input unit 409, gestures made by the user, and operations using an attached controller, microphone, etc. For example, the operation unit 505 accepts and controls operations such as displaying a web browser or closing an application by physically double-tapping the VR headset 105 itself. In addition, the operation unit 505 accepts and controls operations such as projecting a menu display onto an image of the real world acquired by the camera control unit 503 using technology such as AR (Augmented Reality) and tapping the projected menu with the user's hand to open it.

[0029] The application unit 506 controls applications installed on the OS of the VR headset 105. The application unit 506 also stores, in the ROM 404, user information handled by the application, code information for identifying data, etc. in cooperation with the storage unit 502. The image recognition unit 507 performs recognition processing on the image captured by the camera 407. The image recognition unit 507 recognizes machine information of the image forming system 101 (image forming device 600) from, for example, the shape of the image forming system 101 (image forming device 600) in the image captured by the camera 407, written character strings, a QR code (registered trademark), a barcode, etc.

[0030] Fig. 6 is a diagram showing an example of the configuration of an image forming system 101. Fig. 6 shows an example of an image forming system 101 having an image forming apparatus 600 and one or more post-processing apparatuses. In the example shown in Fig. 6, a cooling apparatus 610 is connected to the rear stage of the image forming apparatus 600. An image reading apparatus 620 is connected to the rear stage of the cooling apparatus 610. A finisher 630 is connected to the rear stage of the image reading apparatus 620.

[0031] The image forming apparatus 600 includes a sheet feeder 601 that feeds a sheet, a conveying apparatus 602 that conveys the sheet, and a printer 603 that forms an image on the sheet. The conveying apparatus 602 includes a plurality of conveying roller pairs 605 that convey the sheet on the conveying path, and a plurality of sheet sensors 606 that detect the position and passing timing of the sheet on the conveying path. Of the plurality of conveying roller pairs 605, the conveying roller pair disposed at the discharge port of the image forming apparatus 600 may be called discharge rollers 607. The image forming apparatus 600 can detect a sheet jam based on the passing timing of the sheet acquired by the sheet sensor 606. For example, even when the timing when the leading edge of the sheet should arrive at the sheet sensor 606 arrives, the sheet sensor 606 may not be able to detect the leading edge of the sheet. In this case, the image forming apparatus 600 determines that the sheet is jammed. Similarly, even when the timing when the trailing edge of the sheet should leave the sheet sensor 606 arrives, the sheet sensor 606 may not be able to detect the trailing edge of the sheet. In this case, the image forming apparatus 600 judges the sheet to be jammed. The printer 603 forms a test image or a user image on the sheet. The user image is an image prepared by a user, such as an image of an original scanned by an image scanner or an image sent from a host computer. The test image includes a plurality of test patches for color management. The test image may include a test patch used to adjust the image forming conditions (transfer voltage, charging voltage, developing voltage, etc.) of the printer 603. The sheet on which the test image is formed may be called a test chart. The number of test charts may be one or more. Although the example shown in FIG. 6 shows the printer 603 of an electrophotographic type, the image forming apparatus may adopt other image forming methods such as an inkjet type. The printer 603 includes a charger for charging a photosensitive drum, an exposure device for irradiating a laser beam onto the photosensitive drum to form an electrostatic latent image, a developer for developing the electrostatic latent image with toner, a transfer device for transferring a toner image to a sheet, and a fixing device for fixing the toner image to the sheet. The transfer device may include an intermediate transfer belt.In order to form images on the first and second sides of the sheet, the conveying device 602 may have an inversion mechanism (inversion conveying path) that inverts the sheet. The conveying device 602 may also invert the sheet so that the image forming surface faces vertically (downward) and then discharge the sheet (face-down discharge). The cooling fan 604 is a cooling mechanism that cools the sheet on which an image has been formed. The color measurement results are temperature dependent. The cooling fan 604 cools the sheet to obtain highly accurate color measurement results.

[0032] The cooling device 610 is a post-processing device that cools a sheet on which an image has been formed by the image forming device 600. The cooling device 610 has a cooling fan 614 that cools a sheet discharged from the image forming device 600. The cooling device 610 has a plurality of conveyor roller pairs 615 that convey the sheet, and one or more sheet sensors 616 that detect a sheet jam. The cooling device 610 discharges the sheet for which the cooling process has been completed to the image reading device 620.

[0033] The image reading device 620 is a post-processing device having a function of measuring the color of an image formed on a sheet and a function of reading an image. The image reading device 620 has a color measurement sensor 623 that measures the color of an image formed on a sheet by the image forming device 600, and a reading unit 621 that reads the image formed on the sheet. The color measurement result of the color measurement sensor 623 is used to create, correct, or update a device profile for color management. The reading unit 621 includes an image sensor 622a that reads an image formed on a first surface of the sheet, and an image sensor 622b that reads an image formed on a second surface of the sheet. The reading results of the image sensors 622a and 622b are used, for example, to correct image forming conditions such as image quality adjustment, and to determine whether the image formed on the sheet meets a predetermined pass standard.

[0034] The image reading device 620 has a conveying path P1 that receives and conveys a sheet conveyed from a post-processing device at a previous stage, and conveying paths P2 and P3 connected to the conveying path P1. The conveying paths P1, P2, and P3 have a plurality of conveying roller pairs 625 that convey the sheet and one or more sheet sensors 626 for detecting a jam of the sheet. A reading unit 621 is provided on the conveying path P1. A sheet that has passed through the conveying path P1 is guided to either the conveying path P2 or P3 by a flapper F1. For example, the flapper F1 guides a sheet formed with a user image that meets the pass criteria to the conveying path P2. The flapper F1 guides a sheet formed with a user image that does not meet the pass criteria and a sheet formed with a test image to the conveying path P3. A colorimetric sensor 623 is provided on the conveying path P3. An ejection section 629, which may be called an escape tray, is provided at the end of the conveying path P3. A sheet formed with a user image that does not meet the pass criteria and a sheet formed with a test image are ejected to the ejection section 629.

[0035] The finisher 630 is a post-processing device that sorts and staples a plurality of sheets, for example. The finisher 630 has one or more post-processing mechanisms 638 that apply predetermined post-processing (e.g., sorting, stapling, bookbinding, punching, etc.) to the sheets discharged from the image reading device 620 and discharge the sheets to a discharge tray 639. The finisher 630 has a plurality of conveyor roller pairs 635 that convey the sheets and one or more sheet sensors 636 that detect sheet jams.

[0036] FIG. 7 shows the controller of the image forming system 101. The printer controller 700 has a CPU 701, a ROM 702, a RAM 703, and an ASIC 704. The CPU 701 is a processor circuit that controls the paper feeder 601, the conveyer 602, the printer 603, and the cooling fan 604 via the ASIC 704 by executing a control program stored in the ROM 702. ASIC is an abbreviation of an application specific integrated circuit. The ASIC 704 drives the paper feeder 601, the conveyer 602, the printer 603, and the cooling fan 604 according to instructions from the CPU 701. The CPU 701 communicates with a control unit 751 of a main controller 750. The control unit 751 transmits instructions inputted to an operation unit 752 to the CPU 701, and transmits a print job inputted from a host computer or an image scanner to the CPU 701. The RAM 703 stores image data, variables, and the like. The communication interface 706 is a communication circuit that communicates with a controller mounted on a post-processing device included in the image forming system 101. The communication interface 706 may be connected to a parallel signal line for transmitting a serial signal and a power remote signal. The serial signal may be divided into a transmission signal including a command and a reception signal including a response corresponding to the command. The power remote signal is a signal for starting the post-processing device. The CPU 701 detects the occurrence of a sheet jam and where the jam occurred in the conveying path based on the detection results of the multiple sheet sensors 606. When a jam occurs, the CPU 701 basically stops the printer 603 and the conveying device 602. When the CPU 701 detects an error such as a jam, the CPU 701 may transmit information indicating the occurrence of the error and the type of the error to the post-processing device via the communication interface 706.

[0037] The cooling controller 710 may be a control board mounted on the cooling device 610. The cooling controller 710 includes a CPU 711, a ROM 712, a RAM 713, and an ASIC 714. The CPU 711 executes a control program stored in the ROM 712 to control loads of the pair of conveying rollers 615 and the cooling fan 614 via the ASIC 714. The ASIC 714 drives the pair of conveying rollers 615 and the cooling fan 614 according to an instruction from the CPU 711. The communication interface 716 is a communication circuit that communicates with the printer controller 700 and controllers mounted on other post-processing devices. The communication interface 716 is also connected to a parallel signal line. The communication interface 716 transmits the detection result of the sheet sensor 616 to the printer controller 700. This allows the CPU 701 of the printer controller 700 to determine whether a sheet jam has occurred in the cooling device 610.

[0038] The reading controller 720 may be a control board mounted on the image reading device 620. The reading controller 720 includes a CPU 721, a ROM 722, a RAM 723, and an ASIC 724. The CPU 721 executes a control program stored in the ROM 722 to transmit an instruction to the ASIC 724. The ASIC 724 drives a load (the pair of conveying rollers 625, the reading unit 621, and the colorimetric sensor 623) according to an instruction from the CPU 721. The communication interface 726 is a communication circuit that communicates with the printer controller 700 and controllers mounted on other post-processing devices. The communication interface 726 is also connected to a parallel signal line. The communication interface 726 transmits the detection result of the sheet sensor 626 to the printer controller 700. This allows the CPU 701 of the printer controller 700 to determine whether a sheet jam has occurred in the image reading device 620. The communication interface 726 transmits the reading result of the reading unit 621 and the color measurement result of the color measurement sensor 623 to the printer controller 700 .

[0039] The finisher controller 730 is a control board mounted on the finisher 630. The finisher controller 730 includes a CPU 731, a ROM 732, a RAM 733, and an ASIC 734. The CPU 731 executes a control program stored in the ROM 732 and transmits commands to the ASIC 734. The ASIC 734 drives the pair of conveying rollers 635 and the post-processing mechanism (sorting mechanism, punching mechanism, stapling mechanism, bookbinding mechanism, etc.) 638 in accordance with the commands. The communication interface 736 is a communication circuit that communicates with the printer controller 700 and controllers mounted on other post-processing devices. The communication interface 736 is also connected to the parallel signal line. The CPU 231 receives commands from the CPU 701 and transmits responses to the CPU 701 through the communication interface 736. The commands include, for example, commands to execute post-processing. The responses include the detection results of the sheet sensor 636 and the execution results of the post-processing mechanism 638.

[0040] 8 is a diagram showing an example of the configuration of the main controller 750 of the image forming apparatus 600. The main controller 750 has a control unit 751 that controls the operation of the image forming apparatus 600, an operation panel 802 that is a user interface, and a reading unit 803 that reads an original and generates image data. The main controller 750 also has a print processing unit 804 that executes a print process based on image data, a card reader unit 805 that reads a card for performing personal authentication of a user, and a storage device 806 that stores various information. The control unit 751, the operation panel 802, the reading unit 803, the print processing unit 804, the card reader unit 805, and the storage device 806 are connected to each other so as to be able to communicate with each other via a bus 809. The main controller 750 also has a LAN-I / F unit 807 that connects to a wired network and communicates with an external device, and a WLAN-I / F unit 808 that connects to a wireless network and communicates with an external device.

[0041] The control unit 751 includes a CPU 751a and a memory 751b, and controls the operation of each unit. The CPU 751a reads and executes a program stored in the storage device 806. This program is a program for making the control unit 751 function as various processing units described later. The memory 751b stores temporary data and the like associated with the execution of the program by the CPU 751a. The operation panel 802 includes a configuration for inputting an operation instruction by a user. That is, the operation panel 802 includes a display unit 802a that is configured, for example, with a liquid crystal panel or the like and displays various information, and an operation input unit 802b that inputs an operation instruction by a user by detecting an operation on the display unit 802a.

[0042] FIG. 9 is a sequence diagram for explaining the flow of image quality adjustment processing related to the image forming system 101 (image forming apparatus 600) in the print system in this embodiment.

[0043] In S901, the image forming apparatus 600 performs pre-printing in accordance with a user operation. This pre-printing is a printing process for determining setting values ​​and the like related to image quality in the image forming apparatus 600. Pre-printing is repeatedly performed before the start of printing so that the image quality printed by the image forming apparatus 600 matches the image quality intended by the user, and the setting values ​​in the image forming apparatus 600 are determined.

[0044] In S902, when the control unit 751 of the image forming apparatus 600 receives an instruction to link the image forming apparatus 600 and the management server 102 by a user operation, the control unit 751 performs link setting for data communication between the image forming apparatus 600 and the management server 102. The link instruction is given, for example, when the image forming apparatus 600 displays an operation screen as shown in Fig. 10(a) on the operation panel 802, and the user presses, touches, or otherwise selects a button (icon) 1001 instructing a link.

[0045] In S903, when the control unit 751 of the image forming apparatus 600 receives an instruction to transmit the initial setting value by a user operation, the control unit 751 transmits data of the setting value related to the final image quality in the pre-printing as the initial setting value related to the image quality to the management server 102. Also, the image forming apparatus 600 transmits image data obtained by reading the image printed in the pre-printing with the setting value set as the initial setting value by the reading unit 621 of the image reading device 620 to the management server 102. That is, in S903, the control unit 751 of the image forming apparatus 600 transmits the setting value related to the final image quality in the pre-printing before the start of printing and the image data of the image printed with the setting value to the management server 102. The instruction to transmit the initial setting value is instructed, for example, by the image forming apparatus 600 displaying an operation screen as shown in FIG. 10(b) on the operation panel 802 and the user selecting the OK button (icon) 1011 by pressing, touching, or the like. Note that, for example, if the cancel button (icon) 1012 is selected, the process is not performed.

[0046] In S904, the management server 102 stores in the storage 205 the data (setting values ​​and image data) transmitted from the image forming apparatus 600 in S903. In S905, the image forming apparatus 600 starts printing in accordance with a user operation.

[0047] In S906 after the start of printing, the control unit 751 of the image forming apparatus 600 determines whether it is time for image quality adjustment in the image forming system 101. The control unit 751 of the image forming apparatus 600 determines whether it is time for image quality adjustment based on image data obtained by reading an image (printed matter) printed from the image forming apparatus 600 with the reading unit 621 of the image reading apparatus 620. Note that the image quality adjustment time may be determined to be a certain time after the start of printing or after image quality adjustment, or a timing when the environment such as toner and printing paper changes.

[0048] If it is determined that it is time for image quality adjustment, in S907, the control unit 751 of the image forming device 600 transmits to the management server 102 the image data obtained by reading the printed image at the time when it was determined that it is time for image quality adjustment using the reading unit 621.

[0049] In S908, the control unit 301 of the management server 102 instructs the arithmetic processing unit 303 to generate a setting value (image quality adjustment value) such that the image data from the image forming apparatus 600 acquired in S907 becomes the image data from the image forming apparatus 600 acquired in S903. The control unit 301 also instructs the arithmetic processing unit 303 to create image data after image quality adjustment (image after image quality adjustment) based on the generated setting value (image quality adjustment value) for image quality adjustment. The arithmetic processing unit 303 that has received the instruction performs calculation based on the setting value and image data related to image quality transmitted from the image forming apparatus 600 in S903 and the image data transmitted from the image forming apparatus 600 in S907, and generates the setting value for image quality adjustment (image quality adjustment value). The arithmetic processing unit 303 also performs calculation based on the generated setting value for image quality adjustment (image quality adjustment value) and creates image data after image quality adjustment. The calculation processing unit 303 uses a virtual model that mimics the current image forming system 101 reproduced in a digital space (virtual space) to generate image quality adjustment setting values ​​(image quality adjustment values) and image data after image quality adjustment that will become the image data acquired in S903.

[0050] In S909, the control unit 301 of the management server 102 transmits the image data after image quality adjustment obtained by the calculation in S908 (image after image quality adjustment) and the image data transmitted from the image forming apparatus 600 in S903 to the user terminal 103. In other words, the control unit 301 transmits to the user terminal 103 the image data after image quality adjustment created based on the generated image quality adjustment setting values ​​(image quality adjustment values) and the image data of the image printed before printing starts.

[0051] In S910, the user terminal 103 sends the image data transmitted from the management server 102 in S909 to the application unit 506 in the VR headset 105, and causes the display unit 504 to display the image data as shown in an example in Fig. 11. Fig. 11 is a diagram for explaining a display example when comparing images in the VR headset 105. In the example shown in Fig. 11, image data 1101 transmitted from the image forming apparatus 600 in S903 is displayed as a base image on one screen, and image data 1102 transmitted from the management server 102 in S909 is displayed as a post-adjustment image. In addition to the image data 1101 and 1102, a confirmation icon 1103 that is operated when the user confirms the image data is also displayed.

[0052] In S911, the user checks the image data displayed on the display unit 504. The user checks the image data 1101 and 1102 displayed on the display unit 504, and when the user has finished checking, presses the check icon 1103 displayed on the display unit 504 to check the image.

[0053] In S912, when the application unit 506 of the VR headset 105 confirms that the confirmation icon 1103 has been pressed by a user operation, the application unit 506 displays a screen such as an example shown in FIG. 12 on the display unit 504, and prompts the user to confirm whether to change the setting value. FIG. 12 is a diagram for explaining a display example when confirming the change of the setting value in the VR headset 105, and confirms whether to change to the setting value of the image quality adjustment (image quality adjustment value) generated by the calculation. In the example shown in FIG. 12, an OK icon 1202 for changing to the setting value of the image quality adjustment (image quality adjustment value) generated by the calculation and a cancel icon 1203 for not changing the setting value are displayed on the setting change confirmation screen 1201. When the change (OK icon 1202) is selected on this setting change confirmation screen 1201, the process of S913 is executed. On the other hand, when the change (cancel icon 1203) is selected, the process of the flowchart shown in FIG. 13 described later is executed.

[0054] In S913, in response to a user operation to press OK icon 1202 for changing the setting value displayed on display unit 504, application unit 506 of VR headset 105 notifies user terminal 103 that the setting value (image quality adjustment value) will be changed. In S914, upon receiving a notification from the VR headset 105, the user terminal 103 notifies the control unit 301 of the management server 102 to change the setting values ​​related to image quality in the image forming system 101 to the generated image quality adjustment setting values ​​(image quality adjustment values).

[0055] In S915, the control unit 301 of the management server 102 receives the notification from the user terminal 103 and transmits the image quality adjustment setting values ​​(image quality adjustment values) generated by the arithmetic processing unit 303 to the control unit 751 of the image forming apparatus 600. In S916, the control unit 751 of the image forming apparatus 600 transmits the image quality adjustment setting values ​​(image quality adjustment values) transmitted from the management server 102 in S915 to the CPUs 701, 711, 721, and 731, and changes the setting values. After the process of S916, the process returns to S906 and the above-described processes are repeated until printing is completed.

[0056] Fig. 13 is a flowchart for explaining the setting value change confirmation process in S912 of the image quality adjustment process shown in Fig. 9. The process of the flowchart shown in Fig. 13 starts after the process of S911 in Fig. 9 ends.

[0057] In S1301, the application unit 506 of the VR headset 105 determines whether or not to change the setting value for image quality adjustment (image quality adjustment value). If the application unit 506 determines that the setting value for image quality adjustment (image quality adjustment value) is to be changed (YES), the processing of the flowchart shown in FIG. 13 is terminated, and the processing of S913 shown in FIG. 9 is executed. On the other hand, if the application unit 506 determines that the setting value for image quality adjustment (image quality adjustment value) is not to be changed (NO), the processing of S1302 is executed. Through the processing from S1302 onwards, the setting value for image quality adjustment (image quality adjustment value) is corrected in response to a request from the user, etc.

[0058] In S1302, the application unit 506 of the VR headset 105 accepts an input of correction contents (portion to be corrected, shade, size, etc.) by the user via the operation unit 505 or the like. In S1303, the application unit 506 of the VR headset 105 transmits the correction content input in S1302 to the management server 102 via the user terminal 103.

[0059] In S1304, the control unit 301 of the management server 102 causes the calculation processing unit 303 to execute a calculation to generate a setting value for image quality adjustment (image quality adjustment value) so that the correction content input in S1302 is reflected. The control unit 301 also causes the calculation processing unit 303 to create image data after image quality adjustment using the setting value for image quality adjustment (image quality adjustment value) generated by the calculation (image quality adjusted image). In S1305, the control unit 301 of the management server 102 transmits the image data after image quality adjustment created in S1304 to the VR headset 105 via the user terminal 103.

[0060] In S1306, the application unit 506 of the VR headset 105 displays the image data transmitted in S903 and the image data transmitted in S1305 in Fig. 9 on the display unit 504. The application unit 506 causes the display unit 504 to display the image data, for example, in a manner similar to the example shown in Fig. 11. In S1307, the user checks the image data displayed on the display unit 504. The user checks the image data displayed on the display unit 504, and when the user has finished checking, presses a check icon displayed on the display unit 504 to check the image. Thereafter, the process returns to S1301, and the above-described processes from S1301 onwards are executed.

[0061] According to this embodiment, when it is time to adjust the image quality of the image forming system 101, the management server 102 uses a virtual model of the image forming system 101 reproduced in a digital space (virtual space) to generate image quality adjustment settings (image quality adjustment values) and image data at those settings. In detail, the management server 102 generates image quality adjustment settings (image quality adjustment values) that will result in the image quality at the start of printing, based on the image data of the image printed at the time it is determined that it is time for image quality adjustment. Therefore, it is possible to adjust the image quality of the image forming system 101 without causing downtime of the image forming system 101.

[0062] Furthermore, the management server 102 generates image data after image quality adjustment (image image after image quality adjustment) based on the generated image quality adjustment setting values ​​(image quality adjustment values) and provides it to the user. This allows the user to check the image quality after image quality adjustment in advance by checking the displayed image data. Therefore, it becomes possible to adjust the image quality of the image forming system 101 so as to achieve the image quality intended by the user.

[0063] In this way, by generating image quality adjustment settings (image quality adjustment values) and checking the image data after image quality adjustment on the management server and user terminal, it is possible to adjust the image quality to achieve the image quality intended by the user without incurring downtime for the image forming system 101.

[0064] (Another embodiment of the present invention) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiment is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) for implementing one or more of the functions.

[0065] It should be noted that the above-mentioned embodiments are merely examples of the implementation of the present invention, and the technical scope of the present invention should not be interpreted as being limited by these. In other words, the present invention can be implemented in various forms without departing from its technical concept or main features.

[0066] The disclosure of the present embodiment includes the following configurations, methods, etc. (Configuration 1) An information processing apparatus capable of communicating with an image forming system having a reading means for reading a printed image, a first generating means for generating image quality adjustment setting values ​​for the image forming system based on image data obtained by reading an image printed after printing has started using the reading means; a second generating means for generating image data after image quality adjustment based on the image quality adjustment setting value generated by the first generating means; An information processing device characterized by having a communication means for transmitting image data read by the reading means of an image printed before the start of printing that has been stored in advance to a terminal device that displays the image data, and image data after image quality adjustment generated by the second generation means. (Configuration 2) The information processing device described in configuration 1, characterized in that the first generation means and the second generation means generate setting values ​​for the image quality adjustment and image data after the image quality adjustment using a virtual model of the image forming system reproduced in a virtual space. (Configuration 3) a storage unit for storing image data of the printed image and setting values ​​when the image was printed before the start of printing; The information processing device according to configuration 1 or 2, characterized in that the first generation means generates the setting values ​​for the image quality adjustment based on the image data and setting values ​​stored in the storage means and the image data of the image printed after the printing starts. (Configuration 4) The information processing device according to any one of configurations 1 to 3, wherein the first generation means generates a setting value for the image quality adjustment such that the image quality of the image to be printed will be the image quality of the image printed before the printing starts. (Configuration 5) 5. The information processing device according to any one of configurations 1 to 4, further comprising a setting unit that sets the generated setting value for image quality adjustment in the image forming system in response to a notification from the terminal device. (Configuration 6) 6. The information processing device according to any one of configurations 1 to 5, wherein the first generating means modifies a setting value of the image quality adjustment in response to a request from the terminal device. (Configuration 7) an information processing device capable of communicating with an image forming system having a reading means for reading a printed image; A terminal device that displays image data, The information processing device includes: a first generating means for generating image quality adjustment setting values ​​for the image forming system based on image data obtained by reading an image printed after printing has started using the reading means; a second generating means for generating image data after image quality adjustment based on the image quality adjustment setting value generated by the first generating means; a communication means for transmitting image data obtained by reading an image printed before the start of printing and stored in advance by the reading means and image data after image quality adjustment generated by the second generation means to the terminal device, The information processing system is characterized in that the terminal device displays, on one screen, the image data of the image printed before the start of printing transmitted from the information processing device and the image data after the image quality adjustment. (Method 1) A method for controlling an information processing device capable of communicating with an image forming system having a reading unit for reading a printed image, comprising the steps of: a first generation step of generating image quality adjustment setting values ​​for the image forming system based on image data read by the reading means after the start of printing; a second generation step of generating image data after image quality adjustment based on the image quality adjustment setting values ​​generated in the first generation step; A method for controlling an information processing device, comprising a communication step of transmitting to a terminal device which displays image data, image data obtained by reading an image printed before the start of printing, which has been stored in advance, using the reading means, and image data after image quality adjustment, which has been generated in the second generation step. (Program 1) A computer of an information processing device capable of communicating with an image forming system having a reading means for reading a printed image, a first generation step of generating image quality adjustment setting values ​​for the image forming system based on image data obtained by reading an image printed after printing has started using the reading means; a second generation step of generating image data after image quality adjustment based on the image quality adjustment setting value generated in the first generation step; A program for executing a communication step of transmitting to a terminal device which displays image data image data read by the reading means of an image printed before the start of printing which has been stored in advance, and image data after image quality adjustment generated in the second generation step. [Explanation of symbols]

[0067] 101: Image forming system 102: Management server 103: User terminal 104: Network 105: VR headset 201: CPU 202: ROM 203: RAM 204: Network communication unit 205: Storage 301: Control unit 302: Communication unit 303: Arithmetic processing unit 304: Data storage unit

Claims

1. An information processing apparatus capable of communicating with an image forming system having a reading means for reading a printed image, a first generating unit configured to generate image quality adjustment setting values ​​for the image forming system based on image data obtained by reading an image printed by the reading unit after printing has started; a second generating means for generating image data after image quality adjustment based on the image quality adjustment setting value generated by the first generating means; An information processing device characterized by having a communication means for transmitting image data read by the reading means of an image printed before the start of printing that has been stored in advance to a terminal device that displays the image data, and image data after image quality adjustment generated by the second generation means.

2. 2. The information processing apparatus according to claim 1, wherein the first generation means and the second generation means generate the setting values ​​of the image quality adjustment and the image data after the image quality adjustment using a virtual model of the image forming system reproduced in a virtual space.

3. a storage unit for storing image data of the printed image and setting values ​​when the image was printed before the start of printing; 2 . The information processing apparatus according to claim 1 , wherein the first generating means generates the setting values ​​for the image quality adjustment based on the image data and setting values ​​stored in the storage means and the image data of the image printed after the printing has started.

4. 2 . The information processing apparatus according to claim 1 , wherein the first generating unit generates the setting value for the image quality adjustment such that the image quality of the image to be printed will be the same as the image quality of the image printed before the start of printing.

5. 2. The information processing apparatus according to claim 1, further comprising a setting unit that sets the generated setting value for image quality adjustment in the image forming system in response to a notification from the terminal device.

6. 2 . The information processing apparatus according to claim 1 , wherein the first generating means modifies a setting value of the image quality adjustment in response to a request from the terminal device.

7. an information processing device capable of communicating with an image forming system having a reading means for reading a printed image; A terminal device that displays image data, The information processing device includes: a first generating unit configured to generate image quality adjustment setting values ​​for the image forming system based on image data obtained by reading an image printed by the reading unit after printing has started; a second generating means for generating image data after image quality adjustment based on the image quality adjustment setting value generated by the first generating means; a communication means for transmitting image data obtained by reading an image printed before the start of printing and stored in advance by the reading means and image data after image quality adjustment generated by the second generation means to the terminal device, The information processing system is characterized in that the terminal device displays, on one screen, the image data of the printed image transmitted from the information processing device before the start of printing and the image data after the image quality adjustment.

8. A method for controlling an information processing device capable of communicating with an image forming system having a reading unit for reading a printed image, comprising the steps of: a first generation step of generating image quality adjustment setting values ​​for the image forming system based on image data obtained by reading an image printed after printing has started using the reading means; a second generation step of generating image data after image quality adjustment based on the image quality adjustment setting values ​​generated in the first generation step; A method for controlling an information processing device, comprising a communication step of transmitting to a terminal device which displays image data, image data obtained by reading an image printed before the start of printing, which has been stored in advance, using the reading means, and image data after image quality adjustment, which has been generated in the second generation step.

9. A computer of an information processing device capable of communicating with an image forming system having a reading means for reading a printed image, a first generation step of generating image quality adjustment setting values ​​for the image forming system based on image data obtained by reading an image printed after printing has started using the reading means; a second generation step of generating image data after image quality adjustment based on the image quality adjustment setting value generated in the first generation step; A program for executing a communication step of transmitting to a terminal device which displays image data image data read by the reading means of an image printed before the start of printing which has been previously stored, and image data after image quality adjustment generated in the second generation step.

Images