Image processing system, image processing method

Abstract

To enable the confirmation of post-processing results without actually performing post-processing on the sheet in which the image has been formed. [Solution] The image processing system 100 comprises a first acquisition unit 155a, a second acquisition unit 155b, and an image processing unit 156. The first acquisition unit 155a acquires image data showing an image of a document. The second acquisition unit 155b acquires first parameters including the type of post-processing to process the sheet on which the image is formed. The image processing unit 156 generates a first image that simulates the output result of the sheet based on the image data and displays it on the display unit (operation display unit 14). Then, if the image processing unit 156 acquires the first parameters while the first image is being displayed, it generates a second image that reflects the first parameters in the first image and displays it on the display unit.

Description

Technical Field

[0001] The present invention relates to an image processing system and an image processing method.

Background Art

[0002] As a related technique, there is known an image forming apparatus that displays a scanned image of a document on a preview screen and reflects the instruction on the preview screen when a masking area to be blacked out in the document is indicated (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in an image forming apparatus, for example, post-processing for processing a sheet on which an image is formed, such as binding processing for binding a plurality of sheets on which a plurality of pages of a document are printed respectively, or folding processing for adding one or more folds to one or more sheets, may be executed. And when executing post-processing on a sheet on which an image is formed, the user needs to specify the type of post-processing.

[0005] However, with the aforementioned related technologies, while it is possible to reflect a specified masking area on the preview screen while the scanned image of the certificate document (original) is displayed on the preview screen, it is not possible to reflect the results of the specified post-processing on the preview screen. Therefore, there is a problem in that users cannot check the results of post-processing performed on the sheet in which the image has been formed by looking at the preview screen. Furthermore, since users can only check the results by actually performing post-processing on the sheet in which the image has been formed, there is a problem in terms of user convenience.

[0006] The object of the present invention is to provide an image processing system and an image processing method that allow the results of post-processing to be confirmed without actually performing post-processing on a sheet on which an image has been formed. [Means for solving the problem]

[0007] An image processing apparatus according to one aspect of the present invention comprises a first acquisition unit, a second acquisition unit, and an image processing unit. The first acquisition unit acquires image data showing an image of a document. The second acquisition unit acquires a first parameter including the type of post-processing to process the sheet on which the image is formed. The image processing unit generates a first image simulating the output result of the sheet based on the image data and displays it on a display unit. Furthermore, if the first parameter is acquired while the first image is being displayed, the image processing unit generates a second image reflecting the first parameter in the first image and displays it on the display unit.

[0008] An image processing method according to another aspect of the present invention is an image processing method performed by one or more processors, and includes a first acquisition step, a second acquisition step, and an image processing step. In the first acquisition step, image data showing an image of a document is acquired. In the second acquisition step, a first parameter is acquired, which includes the type of post-processing to process the sheet on which the image is formed. In the image processing step, a first image simulating the output result of the sheet is generated based on the image data and displayed on the display unit. Furthermore, in the image processing step, if the first parameter is acquired while the first image is being displayed, a second image reflecting the first parameter is generated in the first image and displayed on the display unit. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide an image processing system and an image processing method that allow the results of post-processing to be confirmed without actually performing post-processing on the sheet on which the image has been formed. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1 is a front view of the image processing system according to the embodiment. [Figure 2] Figure 2 is a block diagram showing the configuration of the image processing system according to the embodiment. [Figure 3] Figure 3 is a schematic diagram showing the configuration of an image forming apparatus and a relay transport apparatus in an image processing system according to an embodiment. [Figure 4] Figure 4 is a schematic diagram showing the configuration of the post-processing device in the image processing system according to the embodiment. [Figure 5] Figure 5 shows an example of a settings screen displayed in the image processing system according to the present invention. [Figure 6] Figure 6 shows an example of a detailed preview image displayed by the image processing system according to the embodiment. [Figure 7] Figure 7 shows an example of a second image displayed by the image processing system according to the present invention. [Figure 8] Figure 8 shows another example of a second image displayed by the image processing system according to the embodiment. [Figure 9] Figure 9 shows yet another example of a second image displayed by the image processing system according to the embodiment. [Figure 10] Figure 10 shows an example of a third image displayed by the image processing system according to the embodiment. [Figure 11] Figure 11 is a flowchart showing an example of the operation of the image processing system according to the embodiment. [Modes for carrying out the invention]

[0011] The embodiments of the present invention will be described below with reference to the attached drawings. The following embodiments are examples that embody the present invention and are not intended to limit the technical scope of the present invention.

[0012] [Configuration of Image Processing System 100] First, the image processing system 100 according to this embodiment will be described with reference to Figures 1 to 4.

[0013] As shown in Figures 1 and 2, the image processing system 100 according to this embodiment includes an image forming apparatus 10, an image reading apparatus 20, a relay transport apparatus 30, and a post-processing apparatus 40, etc. The image processing system 100 according to this embodiment is a multifunction device system having multiple functions such as a printer, copier, scanner, and facsimile machine.

[0014] For example, in the image processing system 100, image data is read by the image reading device 20, and the image forming device 10 performs a copy process, etc., in which an image is formed on the sheet 9 based on the image data. The sheet 9 after image formation is transported to the post-processing device 40 via the relay transport device 30. In the post-processing device 40, post-processing such as binding or folding is performed on the sheet 9, and the sheet 9 is discharged into the discharge tray 41 or discharge tray 42 of the post-processing device 40.

[0015] [Configuration of Image Forming Apparatus 10] As shown in FIGS. 2 and 3, the image forming apparatus 10 includes a sheet storage unit 11, a sheet conveyance unit 12, an image forming unit 13, an operation display unit 14, a control unit 15, and the like.

[0016] The sheet storage unit 11 can store a plurality of sheets 9. The sheets 9 stored in the sheet storage unit 11 are supplied to the sheet conveyance unit 12 by the paper feed units 111 provided in each of the sheet storage units 11. The sheet 9 is a sheet-like image forming medium such as paper or a resin film.

[0017] The sheet conveyance unit 12 includes a plurality of conveyance rollers 121, and conveys the sheet 9 supplied from the sheet storage unit 11 toward the in-body discharge unit 10a by each of the conveyance rollers 121. Specifically, conveyance paths 121a and 122a to 122c through which the sheet 9 is conveyed are formed in the sheet conveyance unit 12. Further, the sheet conveyance unit 12 is also provided with switching units 123a, 123b, etc. for switching the conveyance destination of the sheet 9 conveyed by the conveyance path 121a. The switching units 123a, 123b are both driven by a drive source (not shown) such as a solenoid. The drive source is controlled by the control unit 15.

[0018] In the transport path 121a, the sheet 9 supplied from the sheet storage section 11 is transported toward the image forming section 13. In the transport path 122a, the sheet 9 after image formation by the image forming section 13 is transported toward the discharge roller 124a, and the sheet 9 is discharged into the cylinder discharge section 10a by the discharge roller 124a. In the transport path 122b, the sheet 9 after image formation by the image forming section 13 is transported toward the discharge roller 124b, and the sheet 9 is discharged into the cylinder discharge section 10a by the discharge roller 124b. The transport path 122c is used to transport the sheet 9, which has had an image formed on one side by the image forming section 13 and has been transported to the discharge roller 124b, back to the image forming section 13. Note that the sheet 9 transported back to the image forming section 13 in the transport path 122c has its front and back sides reversed compared to when the sheet 9 was first transported to the image forming section 13 and an image was formed on one side. As a result, the image forming unit 13 can form an image on the other side of the sheet 9 that has been transported to the image forming unit 13 again via the transport path 122c.

[0019] [Operation of sheet transport unit 12: Single-sided printing, no post-processing] Here, we will describe the operation of the sheet transport unit 12 when a single-sided printing process is performed in the image forming apparatus 10 in which an image is formed on one side of the sheet 9, and no post-processing is performed by the post-processing device 40. In this case, the control unit 15 controls the switching units 123a and 123b to connect the transport path 121a and the transport path 122a, and connect the transport path 122a to the cylinder discharge unit 10a. As a result, the sheet 9 after image formation in the image forming unit 13 is discharged to the cylinder discharge unit 10a by the discharge roller 124a via the transport path 121a and the transport path 122a.

[0020] [Operation of sheet transport unit 12: double-sided printing, no post-processing] Next, the operation of the sheet transport unit 12 when a double-sided printing process is performed in the image forming apparatus 10 in which an image is formed on both sides of the sheet 9 and no post-processing is performed by the post-processing device 40 will be described. In this case, the control unit 15 first controls the switching units 123a and 123b to connect the transport path 121a and the transport path 122a, and connect the transport path 122a to the cylinder discharge unit 10a. As a result, the sheet 9, after an image has been formed on one side by the image forming unit 13, is transported via the transport paths 121a and 122a towards the cylinder discharge unit 10a by the discharge roller 124a. Subsequently, when the rear end of the sheet 9 approaches the discharge roller 124a, the control unit 15 stops driving the discharge roller 124a and controls the switching unit 123b to connect the cylinder discharge unit 10a to the transport path 122c. Then, the control unit 15 reverses the discharge roller 124a, thereby transporting the sheet 9, on which an image has been formed on one side, back to the image forming unit 13 via the transport path 122c, and forming an image on the other side of the sheet 9. Next, when the rear end of the sheet 9 passes the switching unit 123b, the control unit 15 controls the switching unit 123b to connect the transport path 122a and the internal discharge unit 10a. As a result, the sheet 9, on which images have been formed on both sides, is discharged into the internal discharge unit 10a by the discharge roller 124a.

[0021] [Operation of sheet transport unit 12: Post-processing performed] Next, the operation of the sheet transport unit 12 when post-processing is performed by the post-processing device 40 after the single-sided or double-sided printing process described above has been performed in the image forming apparatus 10 will be explained. In this case, when the control unit 15 discharges the sheet 9, on which an image has been formed on one or both sides by the image forming unit 13, to the cylinder discharge unit 10a, it controls the switching unit 123a to connect the transport path 121a and the transport path 122b. In particular, in this embodiment, when folding is performed by the post-processing device 40, the sheet 9, on which the image has been formed by the image forming unit 13, is transported in the same order as in the case of double-sided printing, via the transport paths 121a, 122a, and 122c. As a result, the sheet 9 is discharged to the cylinder discharge unit 10a via the transport path 122b with its front and back sides reversed. As a result, the sheet 9 after image formation is transported via the transport path 122b by the discharge roller 124b towards the relay transport device 30 mounted on the cylinder discharge unit 10a. The sheet 9 is then transported to the post-processing device 40 by the relay transport device 30, where it undergoes post-processing.

[0022] The image forming unit 13 performs a printing process to form an image on the sheet 9 transported by the sheet transport unit 12 based on the image data to be printed. Specifically, the image forming unit 13 includes a photosensitive drum, charging rollers, a light scanning device, a developing device, a transfer roller, a cleaning device, and a fixing device, and forms the image using an electrophotographic method. For example, in the printing process, the image forming unit 13 forms an image on the sheet 9 based on image data read by the image reading device 20 or image data received from an external computer or the like. The image forming unit 13 may also be configured to form images using other methods such as an inkjet method.

[0023] The operation display unit 14 is the user interface for the image processing system 100. The operation display unit 14 includes a display unit such as a liquid crystal display that displays various information in response to control instructions from the control unit 15, and an operation unit such as operation keys and a touch panel that input various information to the control unit 15 in response to user operations.

[0024] The control unit 15 is a computer that comprehensively controls the image processing system 100, which includes the image forming apparatus 10 and the post-processing device 40. Therefore, in the image processing system 100, the image reading device 20, the relay transport device 30, and the post-processing device 40, which are connected to the image forming apparatus 10, are electrically connected to the control unit 15. The control unit 15 then controls the operation of the image reading device 20, the relay transport device 30, and the post-processing device 40.

[0025] The control unit 15 comprises a CPU (Central Processing Unit) 151, a ROM (Read Only Memory) 152, a RAM (Random Access Memory) 153, and a secondary storage device 154. The CPU 151 has one or more processors that execute various arithmetic processes. The ROM 152 is a non-volatile storage device in which information such as control programs for causing the CPU 151 to execute various processes is pre-stored. The RAM 153 is a volatile or non-volatile storage device used as temporary storage memory (work area) for various processes executed by the CPU 151. The secondary storage device 154 pre-stores information such as control programs for causing the CPU 151 to execute various processes. The secondary storage device 154 is a computer-readable non-volatile storage device such as flash memory or a hard disk drive. The control unit 15 can also record various data in the secondary storage device 154 and update control programs, etc.

[0026] [Configuration of the image reading device 20] As shown in Figure 3, the image reading device 20 includes an automatic document transport unit 21 and a contact glass 22, etc. The image reading device 20 also includes a reading unit, a mirror, an optical lens, and a CCD (Charge Coupled Device), etc. The image reading device 20 is controlled by the control unit 15 to perform an image reading process that reads image data from a document set in the automatic document transport unit 21 or a document placed on the contact glass 22. The automatic document transport unit 21 can be opened and closed relative to the contact glass 22 of the image reading device 20. In the automatic document transport unit 21, each of the transport rollers (not shown) rotates by receiving rotational driving force supplied from a drive motor (not shown). As a result, the document set in the automatic document transport unit 21 is transported along the document transport path inside the automatic document transport unit 21, passing through the reading position on the contact glass 22.

[0027] [Configuration of the relay transport device 30] As shown in Figures 1 and 3, the relay transport device 30 is mounted on the internal discharge section 10a of the image forming apparatus 10. The relay transport device 30 is controlled by the control unit 15 to perform a relay transport operation that relays the transport of the sheet 9 between the image forming apparatus 10 and the post-processing device 40. Specifically, the relay transport device 30 is equipped with a plurality of transport rollers 31 that transport the image-formed sheet 9, which is discharged from the transport path 122b by the discharge roller 124b of the image forming apparatus 10, toward the post-processing device 40. The upper surface 32 of the relay transport device 30 is used as a discharge tray on which the image-formed sheet 9, which is discharged from the transport path 122a to the internal discharge section 10a by the discharge roller 124a of the image forming apparatus 10, is placed. In another embodiment, the image processing system 100 may not be equipped with the relay transport device 30, and the sheet 9 may be directly transported from the image forming apparatus 10 to the post-processing device 40.

[0028] [Configuration of the post-processing device 40] The post-processing device 40 performs post-processing, such as stapling or folding, on the sheets 9 supplied from the image forming apparatus 10 via the relay transport device 30, according to user operation. In particular, as shown in Figure 4, the post-processing device 40 includes a stapling device 43 that performs stapling to bind multiple sheets 9 together, and a sheet folding device 44 that performs folding to create one or more folds in each of the one or more sheets 9. Although not shown, in this embodiment, the post-processing device 40 is configured to perform perforation to form holes in the sheets 9. In addition, the post-processing device 40 may be configured to perform other post-processing, such as sorting to selectively discharge the sheets 9 into multiple trays.

[0029] The post-processing device 40 is equipped with a plurality of transport rollers 45 for transporting the sheets 9 supplied to the post-processing device 40, transport paths 46a to 46c on which the sheets 9 are transported, and a switching unit 47 for switching the destination of the sheets 9 transported by each of the transport rollers 45. The post-processing device 40 is controlled by the control unit 15 to perform binding or folding on the sheets 9, and then discharges the sheets 9 to the discharge tray 41 or discharge tray 42.

[0030] Specifically, in the post-processing device 40, the switching unit 47 is controlled so that transport paths 46a and 46b are connected, causing the sheets 9 to be discharged to the discharge tray 41 via transport paths 46a and 46b. Furthermore, in the post-processing device 40, the switching unit 47 is controlled so that transport paths 46a and 46c are connected, causing the sheets 9 to be transported via transport paths 46a and 46c towards the stapling device 43 or the sheet folding device 44. The stapling device 43 then staples the sheets 9, and the sheet folding device 44 folds them. The sheet folding device 44 can fold a single sheet 9 that has not been stapled by the stapling device 43, but it can also fold a bundle of sheets 9 that have been stapled by the stapling device 43. Afterward, the sheets 9 that have undergone post-processing by the stapling device 43 or the sheet folding device 44 are discharged to the discharge tray 42. Furthermore, the stapling device 43 and sheet folding device 44 provided in the post-processing device 40 are well-known technologies disclosed in publications such as Japanese Patent Application Publication No. 2019-73356, so a detailed explanation is omitted here.

[0031] Incidentally, in image forming apparatuses, post-processing operations such as binding, folding, or perforation may be performed on the image-formed sheet. When performing post-processing on an image-formed sheet, the user needs to specify the type of post-processing.

[0032] In this context, a related technology is known in which an image forming apparatus displays a scanned image of a certificate (original document) on a preview screen, and when a masking area to be blacked out in the original document is indicated, the apparatus reflects that indication on the preview screen. However, while the above related technology can reflect the specified masking area on the preview screen while the scanned image of the original document is displayed, it cannot reflect the results of the specified post-processing on the preview screen.

[0033] Therefore, there is a problem in that users cannot check the results of post-processing performed on a sheet with an image created by looking at the preview screen. For example, when performing binding as a post-processing step, the above-mentioned related technology cannot reflect the binding position of the sheet on the preview screen. Furthermore, since users can only check the results by actually performing the post-processing on the sheet with the image created, there is a problem in terms of user convenience. For example, when performing binding as a post-processing step, users can only check the binding position of the sheet by actually performing the binding process on the sheet. Therefore, if the binding position of the sheet is not where the user wants it, the user has to specify the binding position and perform the binding process again, which is a problem in terms of user effort.

[0034] In contrast, in this embodiment, the image processing system 100 described below performs a process that allows the results of post-processing to be confirmed without actually performing post-processing on the sheet 9 on which the image has been formed. This enables the realization of an image processing system 100 and an image processing method.

[0035] [Processing by the control unit 15] As shown in Figure 2, the control unit 15 provided in the image processing system 100 includes various processing units such as a reception processing unit 155, an image processing unit 156, an output processing unit 157, and a determination processing unit 158. Specifically, the secondary storage device 154 of the control unit 15 has control programs pre-stored in it that cause the CPU 51 to function as each of the above-mentioned processing units. The CPU 51 then functions as each of the above-mentioned processing units by executing the control programs stored in the secondary storage device 154. Note that each of the above-mentioned processing units may be composed of electronic circuits.

[0036] The reception processing unit 155 receives the selection of one or more image data to be printed in the printing process performed by the image processing system 100, and the input of printing conditions for the printing process, in accordance with user operations on the operation display unit 14. The reception processing unit 155 may also receive image data and printing conditions from a personal computer (not shown). The printing conditions include, for example, the content of various conditions such as sheet size, color / monochrome, enlargement / reduction, double-sided printing, page collation, or post-processing.

[0037] Here, we will explain the settings screen P1 with reference to Figure 5. The settings screen P1 is a screen displayed on the operation display unit 14 when the reception processing unit 155 accepts input of print conditions for the print process in response to user operation on the operation display unit 14. In particular, we will explain using the example of when print conditions are input when a print process is executed as a print process in which an image is formed on sheet 9 based on image data stored in a storage unit such as the secondary storage device 154.

[0038] Specifically, when the reception processing unit 155 receives a selection operation for one or more image data to be printed from the image data stored in the secondary storage device 154, it displays a setting screen P1 (see Figure 5) on the operation display unit 14 for receiving settings for the printing process. The image data includes documents or images of one or more pages. Therefore, if multiple image data are selected as the target for printing, or if image data containing multiple pages is selected, the image processing system 100 will print the multi-page document on one or more sheets 9. Note that the reception processing unit 155 may also receive the selection operation for the image data to be printed after receiving the printing conditions first.

[0039] As shown in Figure 5, the reception processing unit 155 sets printing conditions such as paper size, double-sided printing, folding, page aggregation, binding, and punching, according to user operations on the settings screen P1. For example, the left-hand area of ​​the settings screen P1 displays operation keys K1, K2, K3, K4, and K5, which correspond to "double-sided printing," "fold," "page aggregation," "stapling," and "punch holes," respectively.

[0040] Operation key K1 is an operation unit that accepts settings regarding whether or not to perform a double-sided printing process, which prints the document on both sides of sheet 9 based on the image data to be printed. Specifically, when operation key K0 is pressed, the reception processing unit 155 displays options such as "none" and "yes" on the operation display unit 14 as candidates for the "double-sided printing" setting, and accepts the user's selection of one of these candidates.

[0041] Operation key K2 is an operation unit for receiving settings for whether or not to perform folding processing in the post-processing device 40, and the type of folding processing. Specifically, when operation key K2 is operated, the reception processing unit 155 displays "none," "fold in half," "fold in thirds," etc., as candidates for the setting of the "fold" on the operation display unit 14, and accepts the user's selection of one of the candidates.

[0042] Operation key K3 is an operation unit for receiving settings regarding the mode of page consolidation processing, which prints a multi-page document on a single sheet 9 based on the image data to be printed. Specifically, when operation key K3 is operated, the reception processing unit 155 displays options such as "none," "2in1," and "3in1" on the operation display unit 14 as candidates for the "page consolidation" setting, and accepts the user's selection of one of these candidates. Operation key K3 may only be operable when the image data to be printed consists of multiple pages.

[0043] Operation key K4 is an operation unit for receiving settings for whether or not to perform a stapling process in the post-processing device 40, and for the manner of said stapling process. Specifically, when operation key K4 is operated, the reception processing unit 155 displays options such as "none," "top edge," and "left edge" on the operation display unit 14 as candidates for the "staple" setting, and accepts the user's selection of one of these candidates. Here, "top edge" is the candidate selected when setting the stapling position to the top edge of sheet 9, and "left edge" is the candidate selected when setting the stapling position to the left edge of sheet 9. Note that operation key K4 may only be operable when the image data to be printed consists of multiple pages.

[0044] Operation key K5 is an operation unit for receiving settings for whether or not to perform punching in the post-processing device 40 and the manner of said punching. Specifically, when operation key K5 is operated, the reception processing unit 155 displays "none," "top edge," "left edge," etc., as candidates for the setting of the "punch hole" on the operation display unit 14 and accepts the operation to select one of the candidates. Here, "top edge" is the candidate selected when setting the binding position to the top edge of sheet 9, and "left edge" is the candidate selected when setting the binding position to the left edge of sheet 9. Note that operation key K5 may only be operable when the image data to be printed consists of multiple pages.

[0045] Furthermore, the right-hand area of ​​the settings screen P1 displays the operation key K6, which corresponds to "Preview." Operation key K6 is an operation unit that receives instructions to display a preview image, which is an image simulating the execution result when the printing process (including post-processing if set) is executed with the set printing conditions. Specifically, when operation key K6 is pressed, the reception processing unit 155 receives an instruction to display a preview image. Then, the image processing unit 156 generates a preview image based on the set printing conditions and displays the generated preview image on the settings screen P1.

[0046] In the example shown in Figure 5, the first image P11, which will be described later, is displayed as a preview image in the area enclosed by a rectangular frame to the right of the settings screen P1 and above the operation key K6. In this embodiment, this preview image also functions as an operation unit for receiving instructions to display a detailed preview image. Specifically, when an operation to select a preview image is performed, the reception processing unit 155 receives an instruction to display a detailed preview image. Then, the image processing unit 156 generates a detailed preview image and displays the generated detailed preview image on the operation display unit 14.

[0047] Figure 6 shows an example of a detailed preview image displayed on the operation display unit 14. In the example shown in Figure 6, the operation display unit 14 displays an enlarged version of the first image P11, which will be described later, as a detailed preview image. When the detailed preview image is displayed, the operation keys K1 to K6 are not displayed on the operation display unit 14, and the detailed preview image is displayed in the center of the operation display unit 14.

[0048] To the right of the detailed preview image, an operation key K7 is provided that slides vertically for selecting the page to be displayed on the operation display unit 14 when the image data to be printed consists of multiple pages. When the operation key K7 is operated, the reception processing unit 155 accepts the page selection operation according to the vertical position of the operation key K7. The image processing unit 156 then displays the page selected by the selection operation on the operation display unit 14. Also, to the right of the operation key K7, a page area P0 is displayed that shows the number of the selected page, i.e., the page displayed on the operation display unit 14. In the example shown in Figure 6, page area P0 indicates that the first page of the 10-page document to be printed is displayed on the operation display unit 14.

[0049] Furthermore, the reception processing unit 155 receives an instruction to end the display of the detailed preview image when, for example, the user operates an area other than the rectangular frame area where the detailed preview image is displayed, or when the user operates an exit key (not shown), etc. The image processing unit 156 then displays the original settings screen P1, as shown in Figure 5, on the operation display unit 14.

[0050] The reception processing unit 155 receives a print execution instruction when a user operates a start key (not shown) or the like provided on the operation display unit 14 for receiving requests to start various processes. The output processing unit 157 then executes the print process using the various settings selected using the setting screen P1 of the operation display unit 14 as the print conditions. Note that the method for setting print conditions may be performed similarly on an information processing device such as a personal computer (not shown).

[0051] In this embodiment, the reception processing unit 155 has three functions: a first acquisition unit 155a, a second acquisition unit 155b, and a third acquisition unit 155c.

[0052] The first acquisition unit 155a acquires image data representing the image of the original document. Specifically, the first acquisition unit 155a acquires image data read by the image reading process from an original document set in the automatic document transport unit 21 or placed on the contact glass 22 in the image reading device 20. Alternatively, the first acquisition unit 155a acquires image data by communicating with an external computer or the like and receiving image data from said external computer or the like. The image data includes one-page or multi-page documents or images. The image data acquired by the first acquisition unit 155a is stored in, for example, the secondary storage device 154.

[0053] The second acquisition unit 155b acquires a first parameter including the type of post-processing to be performed on the sheet 9 on which the image has been formed. Here, the type of post-processing includes, for example, binding, folding, or perforation. Specifically, the second acquisition unit 155b acquires the first parameter including the type of post-processing when, for example, the user selects the type of post-processing on the setting screen P1.

[0054] In this embodiment, the first parameter further includes the execution location of the post-processing on the sheet 9. Specifically, for example, if the post-processing is folding, the position of the fold on the sheet 9 corresponds to the execution location of the post-processing. Also, for example, if the post-processing is binding, the position of the staples on the sheet 9 corresponds to the execution location of the post-processing. Also, for example, if the post-processing is punching, the position of the punch holes on the sheet 9 corresponds to the execution location of the post-processing.

[0055] The second acquisition unit 155b, for example, when the operation key K2 is operated on the setting screen P1 and a selection operation such as "fold in half" or "fold in thirds" is received, acquires a first parameter indicating that the type of post-processing is folding and the position of the fold. For example, when the selection operation for "fold in half" is received, the second acquisition unit 155b acquires a first parameter that sets the fold position to the position that divides sheet 9 in half vertically. Also, for example, when the selection operation for "fold in thirds" is received, the second acquisition unit 155b acquires a first parameter that sets the fold position to the position that divides sheet 9 in thirds vertically.

[0056] Furthermore, when the operation key K4 is operated on the setting screen P1, for example, and a selection operation such as "top edge" or "left edge" is received, the second acquisition unit 155b acquires a first parameter indicating that the type of post-processing is binding and the position of the staples. For example, when the selection operation "top edge" is received, the second acquisition unit 155b acquires a first parameter indicating that the top edge of sheet 9 is the position of the staples. Also, when the selection operation "left edge" is received, for example, the second acquisition unit 155b acquires a first parameter indicating that the left edge of sheet 9 is the position of the staples.

[0057] Furthermore, when the operation key K5 is operated on the setting screen P1, for example, and a selection operation such as "top edge" or "left edge" is received, the second acquisition unit 155b acquires a first parameter indicating that the type of post-processing is punching and the position of the punch hole. For example, when the selection operation "top edge" is received, the second acquisition unit 155b acquires a first parameter that sets the top edge of sheet 9 as the position of the punch hole. Also, for example, when the selection operation "left edge" is received, the second acquisition unit 155b acquires a first parameter that sets the left edge of sheet 9 as the position of the punch hole.

[0058] The third acquisition unit 155c acquires a second parameter, including the layout when sheet 9 is output. Here, the layout includes, for example, a double-sided printing process in which the document is printed on both sides of sheet 9, or a page-aggregation process in which multiple pages of the document are printed on a single sheet 9. Specifically, the third acquisition unit 155c acquires a second parameter, including the layout, when, for example, the user selects a layout on the settings screen P1.

[0059] The third acquisition unit 155c acquires a second parameter indicating that printing will occur on both sides of sheet 9, for example, when operation key K1 is operated on the settings screen P1 and the "Yes" selection operation is accepted.

[0060] Furthermore, the third acquisition unit 155c acquires a second parameter indicating that multiple pages of a document will be printed on a single sheet 9, for example, when the operation key K3 is operated on the setting screen P1 and a selection operation such as "2in1" or "3in1" is accepted. For example, when the selection operation "2in1" is accepted, the third acquisition unit 155c acquires a second parameter indicating that two pages of a document will be printed on a single sheet 9. Also, for example, when the selection operation "3in1" is accepted, the third acquisition unit 155c acquires a second parameter indicating that three pages of a document will be printed on a single sheet 9.

[0061] The image processing unit 156 generates a first image P11 (see Figure 5) that simulates the output result of sheet 9 based on the image data and displays it on the operation display unit 14 (display unit). Furthermore, if the first parameter is acquired while the first image P11 is being displayed, the image processing unit 156 generates a second image P12 (see Figure 7, etc.) that reflects the first parameter in the first image P11 and displays it on the operation display unit 14.

[0062] In this embodiment, the image processing unit 156 generates a first image P11 as a preview image based on the printing conditions set on the setting screen P1, and displays the generated first image P11 on the setting screen P1. Specifically, the image processing unit 156 reads the image data acquired by the first acquisition unit 155a and stored in the secondary storage device 154 from the secondary storage device 154, and generates the first image P11 based on the read image data. In the example shown in Figure 5, the printing condition is set to "A4" for the paper size, so the image processing unit 156 generates a first image P11 that simulates the output result when printing one or more pages of a document on an "A4" size sheet 9.

[0063] Here, for example, when a preview image (first image P11) is displayed on the settings screen P1, if the user operates the operation key K4 as shown in Figure 7 (see the dashed circle), the second acquisition unit 155b will acquire the first parameter. In the example shown in Figure 7, the second acquisition unit 155b acquires the first parameter indicating that the type of post-processing is binding and that the staple position is the top edge of sheet 9.

[0064] Then, the image processing unit 156 generates the second image P12 by superimposing a pair of images P121, each representing a pair of staples, onto the upper edge of the sheet 9 in the first image P11, based on the acquired first parameter, and displays it on the operation display unit 14. As a result, as shown in Figure 7, the first image P11, which was displayed in the area where the preview image is displayed on the setting screen P1, changes to the second image P12. Note that the callout in Figure 7 represents a detailed preview image (detailed second image P12).

[0065] In the example shown in Figure 7, the pair of images P121 in the second image P12 are displayed more prominently than other parts of sheet 9, for example, by being represented in a different color from the color of the document printed on sheet 9. In other words, the image processing unit 156 generates a second image P12 that highlights the area reflecting the first parameter (i.e., the post-processing execution location) more than other parts, and displays it on the operation display unit 14 (display unit). This has the advantage that the post-processing execution location is highlighted while the preview image is displayed, making it easier for the user to understand how the preview image has changed as a result of their operations. Note that the mode of highlighting is not limited to changing the color; for example, the post-processing execution location may be surrounded by a frame, or the post-processing execution location may be made to blink.

[0066] Furthermore, for example, when a preview image (first image P11) is displayed on the settings screen P1, if the user operates the operation key K2 as shown in Figure 8 (see the dashed circle), the second acquisition unit 155b will acquire the first parameter. In the example shown in Figure 8, the second acquisition unit 155b acquires the first parameter indicating that the type of post-processing is folding and that the position of the fold is a position that divides the sheet 9 in half vertically.

[0067] Then, the image processing unit 156 generates the second image P12 by superimposing an image P122 indicating a fold line at a position that divides the sheet 9 in the first image P11 vertically into two equal parts, based on the acquired first parameter, and displays it on the operation display unit 14. As a result, as shown in Figure 8, the first image P11 that was displayed in the area where the preview image is displayed on the setting screen P1 changes to the second image P12. Note that the callout in Figure 8 represents a detailed preview image (detailed second image P12).

[0068] Furthermore, if the image processing unit 156 acquires a second parameter while either the first image P11 or the second image P12 is being displayed, it generates a third image P13 (see Figure 9) that reflects the second parameter in the image and displays it on the operation display unit 14 (display unit). For example, when a preview image (in this case, the second image P12) is displayed on the settings screen P1, if the user operates the operation key K3 as shown in Figure 9 (see the dashed circle), the third acquisition unit 155c will acquire the second parameter. In the example shown in Figure 9, the third acquisition unit 155c acquires a second parameter indicating that a three-page document will be printed on one sheet 9.

[0069] Then, the image processing unit 156 generates a third image P13, which displays the two-page document on sheet 9 in the second image P12, based on the acquired second parameter, and displays it on the operation display unit 14. As a result, as shown in Figure 9, the second image P12, which was displayed in the area where the preview image is displayed on the setting screen P1, changes to the third image P13. The callout in Figure 9 represents a detailed preview image (detailed third image P13). In the example shown in Figure 9, the page area P0 indicates that the operation display unit 14 is displaying the first and second pages of the 10-page document to be printed, which are consolidated onto one sheet 9.

[0070] Although not shown in the diagram, for example, when a preview image (in this case, the second image P12) is displayed on the settings screen P1, if the user operates the operation key K1, the third acquisition unit 155c will acquire the second parameter. Specifically, the third acquisition unit 155c acquires the second parameter indicating that the document should be printed on both sides of sheet 9.

[0071] Then, the image processing unit 156 generates a third image P13, which simulates the situation when the document is printed on both sides of sheet 9 in the second image P12, based on the acquired second parameter, and displays it on the operation display unit 14. As a result, the second image P12, which was displayed in the area where the preview image is displayed on the setting screen P1, changes to the third image P13.

[0072] In this embodiment, for example, as shown in Figures 7 and 8, when a page selection operation is performed according to the vertical position of the operation key K7 while a detailed preview image is being displayed, the image processing unit 156 displays the page selected by the selection operation on the operation display unit 14. In other words, when a sheet 9 of one of the multiple sheets 9 is selected by the user, the image processing unit 156 displays the second image P12 of that sheet 9 on the operation display unit 14 (display unit). This allows the user to freely view the preview image of a desired sheet 9 from among all the sheets 9 of the pages to be printed.

[0073] Furthermore, in this embodiment, as shown in Figure 10, for example, while a detailed preview image is being displayed, it may be possible to view a preview image of sheet 9 in the state where it has been turned at the post-processing execution position. In other words, when a sheet 9 of one of the multiple sheets 9 is selected by user operation, the image processing unit 156 may display an image of that sheet 9 and an image showing the state of sheet 9a, the page immediately preceding sheet 9, in the state where it has been turned at the post-processing execution position, on the operation display unit 14 (display unit).

[0074] The example shown in Figure 10 illustrates the case where sheet 9 on the second page is selected. In this case, the image of the selected sheet 9 and the image of sheet 9a on the previous page, which is turned by a pair of images P121 indicating the positions of the pair of staples (the positions where post-processing is performed), are displayed as a preview image (second image P12). Note that the positions where post-processing is performed are not limited to the positions of the pair of staples in the binding process, but may also be the positions of the folds in the folding process, or the positions of the pair of punch holes in the perforation process, etc.

[0075] This allows users to view images that simulate the process of flipping through multiple printed pages of Sheet 9, making it easier to understand the results of post-processing. For example, users can determine whether the document on the previous page of Sheet 9 is printed from top to bottom or bottom to top, or in any other way desired, without actually printing it.

[0076] When a user operates a start key (not shown) or the like provided on the operation display unit 14, the output processing unit 157 uses the various settings selected using the setting screen P1 as print conditions and executes a printing process to print one or more pages of the document onto sheet 9. The output processing unit 157 may also execute a transmission process to send the one or more pages of the document as image data to an external information processing device such as a personal computer (not shown). The output processing unit 157 may also execute a storage process to store the one or more pages of the document as image data in a storage device such as a secondary storage device 154.

[0077] The determination processing unit 158 ​​determines whether or not post-processing can be performed based on the first parameter acquired by the second acquisition unit 155b. If the determination processing unit 158 ​​determines that post-processing cannot be performed, it notifies that post-processing cannot be performed. This determination is performed automatically when the second acquisition unit 155b acquires the first parameter.

[0078] Specifically, the determination processing unit 158 ​​determines whether the execution location of the post-processing indicated by the first parameter overlaps with the location on sheet 9 where the document or image is printed. For example, if the post-processing is binding or punching, the determination processing unit 158 ​​determines whether the positions of a pair of staples or a pair of punch holes overlap with the location on sheet 9 where the document or image is printed.

[0079] If the execution location for post-processing does not overlap with the area on Sheet 9 where the document or image will be printed, the determination processing unit 158 ​​determines that post-processing can be performed. On the other hand, if the execution location for post-processing overlaps with the area on Sheet 9 where the document or image will be printed, the determination processing unit 158 ​​determines that post-processing cannot be performed. In this case, the determination processing unit 158 ​​notifies the user that post-processing cannot be performed, for example, by displaying a message such as "Binding process cannot be performed" on the settings screen P1, or by outputting the message audibly through the speaker. The determination processing unit 158 ​​may also notify the user that post-processing can be performed by changing the position of the document or image on Sheet 9, or by changing the execution location of the post-processing, in addition to the fact that post-processing cannot be performed.

[0080] [Example of operation of image processing system 100] Hereinafter, with reference to Figure 11, an example of an image processing method of this embodiment will be described along with an example of a processing procedure performed by the image processing system 100. Here, steps S11, S12, ... represent the numbers of processing procedures (steps) performed by the image processing system 100. This processing is started, for example, when a user inputs an instruction to display a preview image by operating the operation key K6 on the setting screen P1. This processing may also be started when image data is transmitted to the image processing system 100 from an information processing device such as an external personal computer (not shown).

[0081] <Step S11> First, the first acquisition unit 155a of the image processing system 100 acquires image data. Specifically, the first acquisition unit 155a acquires image data read by image reading processing from, for example, a document set in the automatic document transport unit 21 or a document placed on the contact glass 22 in the image reading device 20. Alternatively, the first acquisition unit 155a can acquire image data by receiving it from an external computer or the like through communication with the external computer or the like.

[0082] <Step S12> Next, the image processing unit 156 of the image processing system 100 generates a first image P11 that simulates the output result of sheet 9 based on the acquired image data, and displays the generated first image P11 as a preview image on the operation display unit 14 (display unit).

[0083] <Step S13> If the second acquisition unit 155b acquires the first parameter while the preview image (in this case, the first image P11) is being displayed (step S13: Yes), the image processing system 100 executes step S14. Specifically, the second acquisition unit 155b acquires the first parameter, including the type of post-processing, when, for example, the user selects the type of post-processing on the settings screen P1. On the other hand, if the second acquisition unit 155b does not acquire the first parameter, the preview image remains displayed.

[0084] <Step S14> The determination processing unit 158 ​​of the image processing system 100 determines whether post-processing is possible based on the first parameter acquired by the second acquisition unit 155b. Specifically, the determination processing unit 158 ​​determines whether the execution position of the post-processing indicated by the first parameter overlaps with the area on sheet 9 where the document or image is printed. If it is determined that post-processing is possible, the image processing system 100 executes step S15. On the other hand, if it is determined that post-processing is not possible, the image processing system 100 executes step S16.

[0085] <Step S15> The image processing unit 156 generates a second image P12 that reflects the first parameter acquired by the second acquisition unit 155b to the first image P11, and displays the generated second image P12 as a preview image on the operation display unit 14 in place of the first image P11.

[0086] <Step S16> The judgment processing unit 158 ​​executes a notification process to notify that post-processing cannot be performed. Specifically, the judgment processing unit 158 ​​notifies that post-processing cannot be performed by, for example, displaying a message such as "Binding process cannot be performed" on the settings screen P1, or by outputting the message audibly from the speaker.

[0087] <Step S17> If the third acquisition unit 155c acquires the second parameter while the preview image (here, the first image P11 or the second image P12) is being displayed (step S17: Yes), the image processing system 100 executes step S18. Specifically, for example, if the user selects the layout of sheet 9 on the settings screen P1, the third acquisition unit 155c acquires the second parameter, including the layout. On the other hand, if the third acquisition unit 155c does not acquire the second parameter, the preview image remains displayed.

[0088] <Step S18> The image processing unit 156 generates a third image P13 that reflects the second parameter in the first image P11 or second image P12, based on the second parameter acquired by the third acquisition unit 155c. The image processing unit 156 then displays the generated third image P13 as a preview image on the operation display unit 14 in place of the first image P11 or second image P12.

[0089] <Step S19> Subsequently, when the user operates, for example, a start key (not shown) provided on the operation display unit 14, the output processing unit 157 executes the output process. For example, the output processing unit 157 uses the various settings selected using the setting screen P1 as print conditions and executes a print process to print one or more pages of the document onto sheet 9 as the output process.

[0090] As described above, in the image processing system 100 according to this embodiment, when a first parameter including the type of post-processing is acquired while the first image P11 is being displayed, a second image P12 reflecting the first parameter is displayed on the operation display unit 14 (display unit). In other words, in the image processing system 100 according to this embodiment, when a user decides to perform post-processing such as binding while a preview image is being displayed, it is possible to display a preview image reflecting the result of the post-processing on the operation display unit 14.

[0091] Therefore, the image processing system 100 according to this embodiment has the advantage that the user can check the results of post-processing performed on the sheet 9 on which the image has been formed by viewing a preview image. In other words, the image processing system 100 according to this embodiment has the advantage that the results of post-processing can be checked without actually performing post-processing on the sheet 9 on which the image has been formed. Consequently, the user's effort, such as repeatedly printing the sheet 9 until the desired result is obtained, is reduced, making it easier to shorten working time. Furthermore, since the operating time of the image processing system 100 is also reduced by shortening working time, a reduction in carbon dioxide emissions can also be expected.

[0092] [Differentiation] In this embodiment, the first parameter acquired by the second acquisition unit 155b includes the execution position of post-processing, but it does not necessarily have to include the execution position of post-processing. For example, if the execution position of post-processing is set as an initial value in advance, the second acquisition unit 155b does not need to acquire the execution position of post-processing.

[0093] In this embodiment, the image processing system 100 includes a third acquisition unit 155c, but it does not need to include a third acquisition unit 155c. In other words, the image processing system 100 only needs to be able to generate a second image P12 that reflects the first parameter and display it on the operation display unit 14, and does not need to generate a third image P13 that reflects the second parameter and display it on the operation display unit 14.

[0094] In this embodiment, the image processing system 100 emphasizes the areas that reflect the first parameter more than other areas, but is not limited to this. For example, the image processing system 100 may display the areas that reflect the first parameter on the operation display unit 14 in the same way as other areas.

[0095] In this embodiment, the image processing system 100 includes a determination processing unit 158, but it does not have to include a determination processing unit 158. In other words, the image processing system 100 does not have to have a function to automatically determine whether or not post-processing is possible.

[0096] In this embodiment, the image processing system 100 includes an image forming apparatus 10, an image reading apparatus 20, a relay transport apparatus 30, and a post-processing apparatus 40, but is not limited to these. The image processing system 100 only needs to include at least a first acquisition unit 155a, a second acquisition unit 155b, and an image processing unit 156 of the control unit 15.

[0097] In this embodiment, the image processing system 100 is configured such that its components, such as the first acquisition unit 155a, the second acquisition unit 155b, and the image processing unit 156, are housed in a single housing; however, it may be configured so that these components are housed in multiple separate housings.

[0098] [Notes on the invention] The following is an overview of the invention extracted from the above-described embodiments. Note that each configuration and processing function described below can be selected and combined as desired.

[0099] <Note 1> A first acquisition unit acquires image data showing the image of the document, A second acquisition unit acquires a first parameter including the type of post-processing applied to the sheet on which the aforementioned image is formed, The system includes an image processing unit that generates a first image simulating the output result of the sheet based on the image data and displays it on the display unit, and if the first parameter is acquired while the first image is being displayed, generates a second image reflecting the first parameter in the first image and displays it on the display unit. Image processing system.

[0100] <Note 2> The first parameter further includes the execution location of the post-processing in the sheet, The image processing system described in Appendix 1.

[0101] <Note 3> The aforementioned sheet is a multi-page sheet, The image processing unit, when a sheet from among the multiple sheets is selected by user operation, displays the second image of that sheet on the display unit. The image processing system described in Appendix 1 or 2.

[0102] <Note 4> The aforementioned sheet is a multi-page sheet, When a user selects one of the multiple pages, the image processing unit displays on the display unit an image of that page and an image showing the state of the page immediately preceding the selected page, as if it had been turned at the point where the post-processing was being executed. The image processing system described in Appendix 2.

[0103] <Note 5> The system further includes a third acquisition unit that acquires a second parameter, including the layout of the sheet when it is output, When the image processing unit obtains the second parameter while displaying either the first image or the second image, it generates a third image that reflects the second parameter in the image and displays it on the display unit. An image processing system described in any one of the appendices 1 to 4.

[0104] <Note 6> The image processing unit generates a second image in which the area reflecting the first parameter is emphasized more than other areas, and displays it on the display unit. An image processing system described in any one of the appendices 1 to 5.

[0105] <Note 7> The system further includes a determination processing unit that determines whether the post-processing can be performed based on the first parameter acquired by the second acquisition unit, and, if it determines that the post-processing cannot be performed, notifies that the post-processing cannot be performed. An image processing system described in any one of the appendices 1 to 6.

[0106] <Note 8> An image processing method performed by one or more processors, The first acquisition step involves obtaining image data showing the image of the document, A second acquisition step involves obtaining a first parameter including the type of post-processing applied to the sheet on which the aforementioned image is formed, The image processing step includes generating a first image that simulates the output result of the sheet based on the image data and displaying it on the display unit, and if the first parameter is acquired while the first image is being displayed, generating a second image that reflects the first parameter in the first image and displaying it on the display unit, Image processing methods. [Explanation of Symbols]

[0107] 9 sheets 14 Operation display section (display section) 100 Image Processing Systems 155a 1st acquisition part 155b 2nd acquisition part 155c 3rd acquisition part 156 Image Processing Unit 158 Determination Processing Unit P11 Image 1 P12 Image 2 P13 Third Image

Claims

1. A first acquisition unit that acquires image data showing the image of the document, A second acquisition unit acquires a first parameter including the type of post-processing applied to the sheet on which the aforementioned image is formed, The system includes an image processing unit that generates a first image simulating the output result of the sheet based on the image data and displays it on the display unit, and if the first parameter is acquired while the first image is being displayed, generates a second image reflecting the first parameter in the first image and displays it on the display unit. Image processing system.

2. The first parameter further includes the execution position of the post-processing in the sheet, The image processing system according to claim 1.

3. The aforementioned sheet is a multi-page sheet, The image processing unit, when a sheet from among the multiple sheets is selected by user operation, displays the second image of that sheet on the display unit. The image processing system according to claim 1 or 2.

4. The aforementioned sheet is a multi-page sheet, When a user selects one of the multiple pages, the image processing unit displays on the display unit an image of that page and an image showing the state of the page immediately preceding the selected page, as if it had been turned at the point where the post-processing was being executed. The image processing system according to claim 2.

5. The system further includes a third acquisition unit that acquires a second parameter, including the layout of the sheet when it is output, The image processing unit, when it obtains the second parameter while displaying either the first image or the second image, generates a third image that reflects the second parameter in the image and displays it on the display unit. The image processing system according to claim 1 or 2.

6. The image processing unit generates a second image in which the area reflecting the first parameter is emphasized more than other areas, and displays it on the display unit. The image processing system according to claim 1 or 2.

7. The system further includes a determination processing unit that determines whether the post-processing can be performed based on the first parameter acquired by the second acquisition unit, and, if it determines that the post-processing cannot be performed, notifies that the post-processing cannot be performed. The image processing system according to claim 1 or 2.

8. An image processing method performed by one or more processors, The first acquisition step involves obtaining image data showing the image of the document, A second acquisition step involves obtaining a first parameter including the type of post-processing applied to the sheet on which the aforementioned image is formed, The image processing step includes generating a first image that simulates the output result of the sheet based on the image data and displaying it on the display unit, and if the first parameter is acquired while the first image is being displayed, generating a second image that reflects the first parameter in the first image and displaying it on the display unit, Image processing methods.

Images