Information processing device, recording medium, and information processing method

Abstract

An information processing device, a recording medium and an information processing method, characterized in that they are provided with: an acquisition unit, which acquires a processed image obtained by image processing; and a generation unit, which generates a composite image by synthesizing an evidence image and a reduced image, wherein the evidence image is an evidence image that has undergone the image processing and is an image that at least includes information on the cost required for the image processing, and the reduced image is obtained by reducing the processed image.

Description

Technical Field

[0001] The present invention relates to an information processing device, a recording medium and an information processing method. Background Art

[0002] A printing device is known, which includes: a private key generation unit, which generates a private key corresponding to the printing device; a public key generation unit, which generates a public key corresponding to the private key; a private key storage unit, which stores the private key; and a sending unit, which sends the public key, wherein the printing device encrypts settlement information according to the private key to generate encrypted settlement information, and prints the settlement information and the encrypted settlement information on a receipt (for example, refer to patent document 1).

[0003] There is also known a sales management device comprising: an input unit for inputting product data of sold products and product price data for each transaction; a transaction detail data storage unit for adding a transaction number to each transaction and storing transaction detail data consisting of product data and price data; and an output unit comprising a display unit for retrieving transaction detail data and displaying it, an invoice issuing unit for issuing an invoice for each transaction with reference to the transaction detail data, and a receipt invoice issuing unit for issuing a receipt invoice based on the transaction detail data, wherein the sales management device issues a receipt invoice involving specific transaction detail data selected from the transaction detail data displayed on the display unit (for example, refer to patent document 2).

[0004] Patent Document 1: Japanese Patent Application Publication No. 2013-218545

[0005] Patent Document 2: Japanese Patent Application Publication No. 2003-022479

[0006] If the evidence image only includes the data name of the data that is the object of image processing, it is not necessarily possible to grasp the content of the data that is the object of image processing based on the evidence image. The evidence image is an image that serves as evidence of image processing and is an image that at least includes information on the cost required for image processing. Summary of the invention

[0007] The purpose of the present invention is to make it easier to grasp the content of data that is the object of image processing, compared with a situation where the evidence image only includes the data name of the data that is the object of image processing. The evidence image is an image that serves as evidence that image processing has been performed and is an image that at least includes information on the cost required for image processing.

[0008] The invention described in Option 1 is an information processing device, characterized in that it comprises: an acquisition unit, which acquires a processed image obtained by image processing; and a generation unit, which generates a composite image by synthesizing an evidence image and a reduced image, wherein the evidence image is an image that serves as evidence that the image processing has been performed, and is an image that at least includes information on the cost required for the image processing, and the reduced image is obtained by reducing the processed image.

[0009] The invention described in Scheme 2 is further provided with a processing unit in the information processing device described in Scheme 1, which, when the amount of the reduced image exceeds the amount of the image that can be synthesized with the evidence image, i.e., the amount of the first image, performs processing to reduce the amount of the reduced image to less than the amount of the first image.

[0010] The invention described in claim 3 is the information processing device described in claim 2, wherein the processing unit selects a portion at a predetermined position from the reduced image, thereby performing processing to reduce the amount of the reduced image to less than the amount of the first image.

[0011] The invention described in claim 4 is the information processing device described in claim 2, wherein the processing unit selects a portion of a randomly determined position from the reduced image, thereby performing processing to reduce the amount of the reduced image to less than the amount of the first image.

[0012] The invention described in Scheme 5 is that in the information processing device described in Scheme 2, the processing unit selects a portion that satisfies predetermined conditions related to the characteristics of the image from the reduced image, thereby reducing the amount of the reduced image to less than the amount of the first image.

[0013] The invention described in claim 6 is the information processing device described in claim 5, wherein the predetermined condition is a condition that the image includes a portion other than characters.

[0014] The invention described in claim 7 is the information processing device described in claim 5, wherein the predetermined condition is a condition that the image includes a portion other than characters at a predetermined ratio or more.

[0015] The invention described in Scheme 8 is, in the information processing device described in Scheme 2, wherein in the case of a document having a font size of a first size, the processing unit further increases the reduction ratio to generate the reduced image compared to the case of a document having a font size of a second size smaller than the first size, thereby performing processing to reduce the amount of the reduced image to less than the amount of the first image.

[0016] The invention described in Scheme 9 is that in the information processing device described in Scheme 2, in the case of a document that does not include characters in the image, the processing unit further increases the reduction ratio to generate the reduced image compared to the case of a document that includes characters in the image, thereby performing processing to reduce the amount of the reduced image to less than the amount of the first image.

[0017] In the invention described in Scheme 10, in the information processing device described in Scheme 1, when the amount of the reduced image exceeds the amount of images that can be synthesized with the evidence image, that is, the amount of the first image, the generation unit generates a plurality of synthesized images, each of the plurality of synthesized images being an image that synthesizes the evidence image and a portion of the amount of the first image of the reduced image.

[0018] The invention described in Scheme 11 is an information processing device described in Scheme 10, wherein when the amount of the reduced image is less than the amount of the second image that can be synthesized with the evidence image among the multiple synthesized images, the generation unit generates the multiple synthesized images.

[0019] The invention described in claim 12 is the information processing device described in claim 1, wherein the evidence image also includes processing conditions for the image processing.

[0020] The invention described in Scheme 13 is, in the information processing device described in Scheme 12, wherein the generation unit generates the composite image that is a composite of the evidence image and the image in which the reduced image is converted into black and white, and the evidence image also includes the processing condition indicating that the image processing is a processing of a color output image.

[0021] The invention described in Scheme 14 is a recording medium, which records a program for enabling a computer to implement the following functions: obtaining a processed image obtained by image processing; and generating a composite image that is a composite of an evidence image and a reduced image, wherein the evidence image is an image that serves as evidence that the image processing has been performed and is an image that at least includes information on the cost required for the image processing, and the reduced image is obtained by reducing the processed image.

[0022] The invention described in claim 15 is an information processing method, characterized in that it comprises the following steps:

[0023] Acquire a processed image obtained by image processing; and generate a composite image, which is a composite image that synthesizes an evidence image and a reduced image of the processed image, wherein the evidence image is an evidence image that has undergone the image processing and is an image that at least includes information on the cost required for the image processing.

[0024] Effects of the Invention

[0025] According to the first scheme of the present invention, it is easier to grasp the content of the data that becomes the object of image processing compared to the case where the evidence image only includes the data name of the data that becomes the object of image processing. The evidence image is an image that serves as evidence that image processing has been performed and is an image that includes at least information on the cost required for image processing.

[0026] According to the second aspect of the present invention, when the amount of data to be subjected to image processing is large, the content of the data can be grasped from the evidence images without increasing the amount of evidence images.

[0027] According to the third aspect of the present invention, it is possible to simplify the process of selecting a portion to be synthesized with an evidence image from among data to be subjected to image processing.

[0028] According to the fourth aspect of the present invention, it is possible to conceal a portion of the data to be processed that is to be synthesized into an evidence image.

[0029] According to the fifth aspect of the present invention, it is possible to select a portion to be synthesized into an evidence image among data to be processed by taking into account the characteristics of the image.

[0030] According to the sixth aspect of the present invention, compared with a case where only the character portion of the data to be processed is synthesized in the evidence image, it is easier to grasp the content of the data from the evidence image.

[0031] According to the seventh aspect of the present invention, compared with a case where a portion other than characters in the data to be processed is synthesized into the evidence image at a smaller ratio than a predetermined ratio, it is easier to grasp the content of the data from the evidence image.

[0032] According to the eighth aspect of the present invention, it is possible to increase the number of reduced images while suppressing the influence on the ease of differentiation of reduced images obtained by reducing data to be the target of image processing.

[0033] According to the ninth aspect of the present invention, it is possible to increase the number of reduced images while suppressing the influence on the ease of differentiation of reduced images obtained by reducing data to be the target of image processing.

[0034] According to the tenth aspect of the present invention, when the amount of data to be subjected to image processing is large, the possibility that a portion necessary for understanding the content of the data can be acquired from the evidence image increases.

[0035] According to the eleventh aspect of the present invention, when the amount of data to be processed is large, the possibility of acquiring the portion necessary to understand the content of the data from the evidence image is increased without significantly increasing the amount of difficult evidence images.

[0036] According to the twelfth aspect of the present invention, it is possible to understand the processing conditions of the image processing of the data to be image acquired based on the evidence image.

[0037] According to the thirteenth aspect of the present invention, even when the data to be imaged is output in color, the data can be synthesized in black and white in the evidence image.

[0038] According to the 14th scheme of the present invention, it is easier to grasp the content of the data that becomes the object of image processing than in the case where the data name of the data that becomes the object of image processing is included in the evidence image, and the evidence image is an image that becomes evidence of image processing and is an image that includes at least information on the cost required for image processing.

[0039] According to the 15th scheme of the present invention, it is easier to grasp the content of the data that becomes the object of image processing compared to the case where the evidence image only includes the data name of the data that becomes the object of image processing. The evidence image is an image that serves as evidence that image processing has been performed and is an image that includes at least information on the cost required for image processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Embodiments of the present invention will be described in detail with reference to the following drawings.

[0041] Figure 1 is a diagram showing an example of a hardware configuration of an image processing device in an embodiment of the present invention;

[0042] Figure 2 is a block diagram showing an example of a functional configuration of an image processing device in an embodiment of the present invention;

[0043] Figure 3 is a flowchart showing a first operation example of the image processing device in the embodiment of the present invention;

[0044] Figure 4 is a flowchart showing a processing example of thumbnail image edit selection processing in a first operation example of the image processing device according to an embodiment of the present invention;

[0045] Figure 5 FIG. 1 is a diagram showing an example of a receipt output in a first operation example of the image processing device according to an embodiment of the present invention;

[0046] Figure 6 is an enlarged view of a thumbnail image included in a receipt output in the first operation example of the image processing device according to the embodiment of the present invention;

[0047] Figure 7 is a flowchart showing a second operation example of the image processing device in the embodiment of the present invention;

[0048] Figure 8 This is a flowchart showing a processing example of thumbnail image edit selection processing in the second operation example of the image processing device according to the embodiment of the present invention.

[0049] Explanation of symbols

[0050] 10- Image processing device, 21- Image processing control unit, 22- Processed image storage unit, 23- Thumbnail image generation unit, 24- Thumbnail image storage unit, 25- Thumbnail image processing unit, 26- UI control unit, 27- Receipt image storage unit, 28- Image synthesis unit. DETAILED DESCRIPTION

[0051] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0052] [Hardware Structure of Image Processing Device]

[0053] Figure 1 1 is a diagram showing an example of the hardware configuration of the image processing device 10 in the present embodiment. As shown in the figure, the image processing device 10 includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, a HDD (Hard Disk Drive) 14, an operation panel 15, an image reading unit 16, an image forming unit 17, and a communication interface (hereinafter referred to as "communication I / F") 18.

[0054] The CPU 11 loads various programs stored in the ROM 13 and the like into the RAM 12 and executes the programs, thereby realizing various functions described below.

[0055] The RAM 12 is a memory used as an operation memory for the CPU 11. The ROM 13 is a memory storing various programs executed by the CPU 11. The HDD 14 is, for example, a magnetic disk device, and stores image data read by the image reading unit 16, image data used for image formation in the image forming unit 17, and the like.

[0056] The operation panel 15 is, for example, a touch panel, which displays various information or receives operation input from the user. Here, the operation panel 15 is composed of a display that displays various information and a position detection sheet that detects the position indicated by an indicating unit such as a finger or a stylus. Alternatively, a display and a keyboard may be used instead of a touch panel.

[0057] The image reading unit 16 reads an image recorded on a recording medium such as paper. Here, the image reading unit 16 is, for example, a scanner, and can use: a CCD method, in which the reflected light relative to the light irradiated from the light source to the original is reduced by a lens, and the light is received by the CCD (Charge Coupled Devices); and a CIS method, in which the reflected light relative to the light irradiated from the LED light source to the original is received by the CIS (Contact Image Sensor).

[0058] The image forming unit 17 forms an image on a recording medium such as paper. Here, the image forming unit 17 is, for example, a printer, and can use: an electrophotographic method to transfer a toner attached to a photosensitive body to a recording medium to form an image; or an inkjet method to eject ink onto a recording medium to form an image.

[0059] The communication I / F 18 transmits and receives various information to and from other devices via a communication line.

[0060] [Overview of this embodiment]

[0061] In this embodiment, the image processing device 10 generates a composite image by synthesizing an evidence image and a reduced image, wherein the evidence image is an image that serves as evidence that the image processing has been performed and is an image that at least includes information on the cost required for the image processing, and the reduced image is a processed image obtained by image processing.

[0062] Hereinafter, as an evidence image, a receipt image that is a source of a receipt is described as an example. The receipt in this embodiment refers to, for example, a document proving that a store or the like having the image processing device 10 installed has received the fee required for image processing from a customer who has undergone image processing by the image processing device 10. Generally, the receipt may include content such as a receipt slip or an invoice.

[0063] The reduced image refers to an image that allows people to easily understand the content of the processed image when viewing it, and does not include a barcode, QR code (registered trademark), etc. Hereinafter, a thumbnail image will be described as an example of a reduced image.

[0064] When creating a composite image by combining a receipt image and thumbnail images in this way, if there are too many thumbnail images, not all of the thumbnail images can be printed within the space of one receipt.

[0065] Therefore, in this embodiment, when the amount of thumbnail images exceeds the amount of images that can be synthesized with the receipt image, that is, the amount of the first image, an operation is performed to reduce the amount of thumbnail images to less than the amount of the first image. Furthermore, when the amount of thumbnail images exceeds the amount of the first image, an operation is performed to generate a plurality of synthesized images, each of which is an image synthesized by the receipt image and a portion of the first image of the thumbnail images. The former is described in detail below as a first operation example, and the latter is described in detail as a second operation example. In addition, although the description is focused on the amount of thumbnail images, one page of thumbnail images is usually generated from one page of processed images, and therefore the description is focused on the page of thumbnail images.

[0066] [Functional Structure of Image Processing Device]

[0067] Figure 2 1 is a block diagram showing an example of the functional configuration of the image processing device 10 in the present embodiment. The image processing device 10 in the present embodiment is an example of an information processing device, and as shown in the figure, includes an image processing control unit 21, a processed image storage unit 22, a thumbnail image generation unit 23, a thumbnail image storage unit 24, a thumbnail image processing unit 25, a UI control unit 26, a receipt image storage unit 27, and an image synthesis unit 28.

[0068] The image processing control unit 21 controls the execution of image processing, which includes the image reading unit 16 (refer to Figure 1 ) reads the image, and the image forming unit 17 (reference Figure 1 ) to form an image. In addition, a processed image such as an image read by the image reading unit 16 and an image formed by the image forming unit 17 is acquired. In this embodiment, an image processing control unit 21 is provided as an example of an acquisition unit that acquires a processed image obtained by image processing. In addition, as described later, in particular, when a composite image of a receipt image and a thumbnail image is acquired by the image synthesis unit 28, the image forming unit 17 is controlled to form the composite image.

[0069] The processed image storage unit 22 stores the processed image acquired by the image processing control unit 21. Here, the processed image storage unit 22 only needs to have a capacity required for temporarily storing the processed image for each image processing instruction.

[0070] The thumbnail image generating unit 23 generates a thumbnail image from the processed image stored in the processed image storing unit 22 .

[0071] The thumbnail image storage unit 24 stores the thumbnail images generated by the thumbnail image generating unit 23 .

[0072] The thumbnail image processing unit 25 processes the thumbnail images stored in the thumbnail image storage unit 24. Specifically, the thumbnail image processing unit 25 performs at least one of editing processing of the thumbnail images and selecting processing of the thumbnail images.

[0073] First, the thumbnail image processing unit 25 performs a process of deleting a deletion target portion of a thumbnail image within an editing target range of the thumbnail image as a thumbnail image editing process.

[0074] Here, the editing object range may be a range specified in page units. The range specified in page units may be, for example, all pages or a portion of pages. In the latter case, the user may specify the portion of pages. Alternatively, the editing object range may be a range specified without any association with the page. The range specified without any association with the page may be, for example, a range within the page. In this case, the user may select the range displayed on the operation panel 15 (refer to Figure 1 ) on the thumbnail image, and specify the range by dragging or entering coordinates.

[0075] Furthermore, the deletion object portion may be a characteristic portion specified by the user. The characteristic portion may be, for example, a character portion or an image portion. In this case, the thumbnail image processing unit 25 is configured to have a function of identifying these portions. Alternatively, the characteristic portion may be, for example, a character portion including personal information such as a name or an address. In this case, the thumbnail image processing unit 25 is configured to have a function of recognizing the character portion including personal information through learning. Alternatively, the characteristic portion may be, for example, a person image portion. In this case, the thumbnail image processing unit 25 is configured to have a function of recognizing the person image portion through learning. Furthermore, the deletion object portion may not be directly specified by the user, but may be determined by the thumbnail image processing unit 25 based on the document format. For example, regarding an area where characters including personal information in a document format are known to exist, the area is configured to be a deletion object portion, etc. In addition, in this specification, "character" refers to a symbol formed using lines or dots, and is configured to include characters of marks.

[0076] In addition, the deletion process may be a concealment process in which the deletion object portion is painted white or black or blurred. In this case, the area where the deletion object portion exists remains on the thumbnail image, so the number of pages of the thumbnail image does not decrease. Alternatively, the deletion process may be an area deletion process in which the area where the deletion object portion exists is deleted. In this case, the deleted area is filled because the characters or images following the area are moved forward, so the number of pages of the thumbnail image may be reduced. In addition, when the area deletion process is performed as the deletion process, the area deletion process is an example of selecting a portion that satisfies a predetermined condition related to the characteristics of the image from the reduced image.

[0077] The thumbnail image processing unit 25 may also perform a process of reducing the thumbnail image according to the receipt size as the thumbnail image editing process. For example, the thumbnail image may be reduced by cutting off a portion of the page (such as the title and its surrounding area).

[0078] Then, the thumbnail image processing unit 25 performs the next process as thumbnail image selection process.

[0079] In the first operation example, when the number of pages of the thumbnail image exceeds the first threshold value, which is the number of pages that can be combined with the receipt image, the thumbnail image processing unit 25 performs processing to reduce the number of pages of the thumbnail image to less than the first threshold value. Specifically, when the number of pages of the thumbnail image is small, that is, when the number of pages that can be combined with the receipt image is less than the first threshold value, all the pages of the thumbnail image are set as the objects to be combined with the receipt image. On the other hand, when the number of pages of the thumbnail image is large, that is, when the number of pages exceeds the first threshold value, a part of the pages are selected from all the pages of the thumbnail image and are set as the objects to be combined with the receipt image. In the embodiment, the thumbnail image processing unit 25 is provided as an example of a processing unit that performs processing to reduce the amount of reduced images to less than the amount of the first image, using the first threshold value as an example of the amount of images that can be combined with the evidence image, that is, the amount of the first image.

[0080] In the second operation example, when the number of pages of the thumbnail image exceeds the second threshold value, which is the number of pages that can be combined with a plurality of receipt images, the thumbnail image processing unit 25 performs processing to reduce the number of pages of the thumbnail image to less than the second threshold value. Specifically, when the number of pages of the thumbnail image is less than the second threshold value, which is the number of pages that can be combined with N (N is an integer greater than or equal to 2) receipt images, all pages of the thumbnail image are set as objects to be combined with the N receipt images. On the other hand, when the number of pages of the thumbnail image is greater than the second threshold value, a part of the pages of the thumbnail image is selected from all the pages of the thumbnail image and is set as the object to be combined with the N receipt images. Here, the second threshold value may be set to a value obtained by multiplying the first threshold value by N. In this embodiment, the second threshold value is used as an example of the amount of images that can be combined with the evidence image, that is, the amount of second images among the plurality of combined images.

[0081] Here, as a method of selecting a part of pages from all pages of thumbnail images, there is a method of selecting predetermined pages from all pages of thumbnail images. For example, there is a method of selecting thumbnail images every 10 pages. This is an example of selecting a part of a predetermined position from a reduced image. In addition, as a method of selecting a part of pages from all pages of thumbnail images, there is a method of selecting randomly determined pages from all pages of thumbnail images. For example, there is a method of selecting pages of thumbnail images based on random numbers generated by a random number generator. This is an example of selecting a part of a randomly determined position from a reduced image. In addition, as a method of selecting a part of pages from all pages of thumbnail images, there is a method of selecting characteristic pages from all pages of thumbnail images. For example, there is a method of selecting pages including parts other than characters, or a method of selecting pages including parts other than characters at a predetermined ratio or more. This is an example of selecting a part that satisfies a predetermined condition related to the characteristics of the image from a reduced image.

[0082] In addition, if it is known from the outset that the number of pages of the thumbnail image is the number of pages that can be combined with the receipt image, the user can press the end button to end the processing of the thumbnail image processing unit 25. In other words, when the thumbnail image processing unit 25 detects the user operation of pressing the end button, the image combining unit 28 can combine the receipt image with the thumbnail image.

[0083] The UI control unit 26 controls to display thumbnail images stored in the thumbnail image storage unit 24 or thumbnail images being edited by the thumbnail image processing unit 25 on the operation panel 15. The UI control unit 26 also controls to detect options displayed on the operation panel 15 or user operations on thumbnail images.

[0084] The receipt image storage unit 27 stores receipt images. The receipt image is generated based on the cost of image processing, the number of sheets that have been image processed, etc. The image processing includes the image reading unit 16 (refer to Figure 1 ) reads the image, and the image forming unit 17 (reference Figure 1 ) to form an image, etc. Among them, the cost required for image processing can be calculated according to the settlement function (not shown) possessed by the image processing device 10. In addition, the receipt image can include information that further improves the reliability of the receipt image, such as the device installation location, processing date and time, etc.

[0085] The image synthesis unit 28 generates a synthesized image by synthesizing the receipt image stored in the receipt image storage unit 27 and the thumbnail image stored in the thumbnail image storage unit 24 and subjected to at least one of thumbnail image selection processing and thumbnail image editing processing by the thumbnail image processing unit 25. Specifically, the image synthesis unit 28 performs the next processing.

[0086] In the first operation example, the thumbnail image processing unit 25 performs processing to reduce the number of pages of thumbnail images to less than the first threshold value, so the image synthesis unit 28 synthesizes all pages of thumbnail images on one receipt image.

[0087] In the second operation example, when the number of pages of thumbnail images exceeds the first threshold value, which is the number of pages that can be combined with the receipt image, the image combining unit 28 generates a plurality of combined images, each of which is an image in which the evidence image and the first image of the reduced image are combined. Specifically, when the number of pages of thumbnail images is small, that is, when the number of pages that can be combined with the receipt image is less than the first threshold value, all pages of thumbnail images are combined with one receipt image. On the other hand, when the number of pages of thumbnail images is large, that is, when the number of pages is greater than the first threshold value, the pages of thumbnail images that can be combined with one receipt image are combined, and all pages of thumbnail images that have been reduced to less than the second threshold value by the thumbnail image processing unit 25 are combined with N receipt images.

[0088] In the present embodiment, the image synthesis unit 28 is provided as an example of a generating unit that generates a synthesized image by synthesizing the evidence image and the reduced image.

[0089] Then, the image synthesis unit 28 outputs the synthesized image to the image processing control unit 21 .

[0090] [Operation of the Image Processing Device]

[0091] (First action example)

[0092] Figure 3 This is a flowchart showing a first operation example of the image processing device 10 in this embodiment.

[0093] As shown in the figure, in the image processing device 10, first, the image processing control unit 21 controls the execution of image processing, and the image processing includes the image reading unit 16 (refer to Figure 1 ) reads the image, and the image forming unit 17 (reference Figure 1 ) forms an image, etc. (step S101). Then, the result of the image processing, that is, the processed image is stored in the processed image storage unit 22 (step S102).

[0094] Next, the thumbnail image generating unit 23 generates a thumbnail image from the processed image stored in the processed image storage unit 22 in step S102 (step S103 ). Then, the thumbnail image is stored in the thumbnail image storage unit 24 (step S104 ).

[0095] Next, the UI control unit 26 performs control so that the thumbnail images stored in the thumbnail image storage unit 24 in step S104 are displayed on the operation panel 15 (step S105 ).

[0096] Next, the thumbnail image processing unit 25 performs a thumbnail image editing and selection process (step S106). Here, the thumbnail image editing and selection process is a process in which the thumbnail image stored in the thumbnail image storage unit 24 in step S104 is edited and selected according to the user operation on the thumbnail image displayed on the operation panel 15 in step S105. The details of the thumbnail image editing and selection process will be described later. The thumbnail image edited and selected by the thumbnail image editing and selection process is re-entered into the thumbnail image storage unit 24.

[0097] Next, the image synthesis unit 28 generates a synthesized image by synthesizing the receipt image stored in the receipt image storage unit 27 with the edited and selected thumbnail image stored in the thumbnail image storage unit 24 in step S106 (step S107).

[0098] Finally, the image processing control unit 21 controls the image forming unit 17 to form the composite image generated in step S107 (step S108 ).

[0099] Next, Figure 3 The thumbnail image editing and selecting process of step S106 will be described in detail.

[0100] Figure 4 This is a flowchart showing a processing example of thumbnail image edit selection processing in the first operation example of the image processing device 10 according to the present embodiment.

[0101] As shown in the figure, the thumbnail image processing unit 25 first determines whether an instruction to edit a thumbnail image has been given (step S121 ). Specifically, the UI control unit 26 receives a user operation to edit the content of a thumbnail image on the operation panel 15 , and the thumbnail image processing unit 25 determines whether the content has been received from the UI control unit 26 .

[0102] Here, a case where the thumbnail image processing unit 25 determines that an instruction to edit a thumbnail image has been given will be described.

[0103] In this case, the thumbnail image processing unit 25 first determines the editing target range of the thumbnail image (step S122). Specifically, the UI control unit 26 receives a user operation for designating any editing target range of the thumbnail image on the operation panel 15, and the thumbnail image processing unit 25 determines whether any information on the editing target range is received from the UI control unit 26. Here, the editing target range of the thumbnail image includes all pages, a part of the page designated by the user, a range designated by the user within the page designated by the user, and the like.

[0104] As a result, if it is determined that the editing target range of the thumbnail image is all pages or a part of the pages, the thumbnail image processing unit 25 receives the selection of the deletion target portion through the operation of selecting an option (step S123). Specifically, the UI control unit 26 receives the user operation of selecting an option from the plurality of options displayed on the operation panel 15, and the thumbnail image processing unit 25 receives the information of the selected option. Here, as a plurality of options, there are "deletion of character portion", "deletion of image portion", "deletion of personal information character portion", "deletion of person image portion", "deletion in document format", etc.

[0105] On the other hand, if it is determined that the edit target range of the thumbnail image is the range within the page, the thumbnail image processing unit 25 receives the selection of the deletion target portion through the operation on the thumbnail image (step S124). Specifically, the UI control unit 26 receives the user operation of designating a range by dragging or inputting coordinates on the thumbnail image displayed on the operation panel 15, and the thumbnail image processing unit 25 receives information on the designated range. Here, the range designated by dragging or inputting coordinates refers to, for example, the range of a portion where personal information that is not desired to be printed on a receipt is recorded.

[0106] Next, the thumbnail image processing unit 25 deletes the deletion target portion selected in step S123 or step S124 (step S125). Here, the deletion of the deletion target portion is a concealment process of painting the deletion target portion black or white or blurring it. Alternatively, it can also be an area deletion process of deleting the area where the deletion target portion exists and filling the area with subsequent characters, images, etc.

[0107] Then, the thumbnail image processing section 25 returns the process to step S121.

[0108] Furthermore, a case where the thumbnail image processing unit 25 does not determine that an instruction to edit a thumbnail image has been given will be described.

[0109] In this case, the thumbnail image processing unit 25 first determines whether the number of pages of thumbnail images is equal to or smaller than the first threshold value (step S126 ).

[0110] As a result, if it is not determined that the number of pages of the thumbnail image is less than the first threshold value, the thumbnail image processing unit 25 receives the selection of the deletion target page (step S127). Specifically, the UI control unit 26 receives the user operation of selecting the deletion target page or the printing target page on the thumbnail image displayed on the operation panel 15. Moreover, when the thumbnail image processing unit 25 receives the information of the deletion target page or the printing target page, and receives the information of the deletion target page, the page is set as the deletion target page, and when the information of the printing target page is received, the pages other than the page are set as the deletion target page. Alternatively, the UI control unit 26 receives the user operation of specifying the method of selecting the deletion target page on the operation panel 15, and the thumbnail image processing unit 25 searches for the page from the pages of the thumbnail image by the specified method, and sets the searched page as the deletion target page. Here, as a method of selecting the deletion target page, there is a method of selecting a predetermined page, a method of selecting a randomly determined page, and a method of selecting a characteristic page.

[0111] Next, the thumbnail image processing unit 25 deletes the page to be deleted whose selection is received in step S127 (step S128 ).

[0112] Then, the thumbnail image processing section 25 returns the process to step S121.

[0113] On the other hand, if it is determined that the number of pages of thumbnail images is less than the first threshold value, the thumbnail image processing unit 25 returns the processing to Figure 3 Flowchart of the process.

[0114] In addition, although the reduction ratio of the thumbnail image is not mentioned in the above-mentioned operation example, the thumbnail image processing unit 25 may adjust the reduction ratio when generating the thumbnail image.

[0115] For example, in the case of a document with a large font size, the thumbnail image processing unit 25 may increase the reduction ratio to increase the number of reduced images. This is an example in which, in the case of a document with a font size of a first size, the thumbnail image is generated by further increasing the reduction ratio compared to the case of a document with a font size of a second size smaller than the first size.

[0116] Alternatively, in the case of a document having only an image, the thumbnail image processing unit 25 may increase the reduction ratio to increase the number of reduced images. More generally, in the case of a document not including characters in the image, the reduction ratio may be increased to increase the number of reduced images. This is an example in which, in the case of a document not including characters in the image, a reduced image is generated by further increasing the reduction ratio compared to the case of a document including characters in the image.

[0117] Furthermore, the above operation example does not mention the case where a plurality of files are output. However, in this case, the image synthesis unit 28 can synthesize the receipt image with a plurality of thumbnail images obtained from the plurality of files.

[0118] For example, when multiple files are output, if the total number of pages of the multiple files is equal to or less than the first threshold value, which is the number of pages that can be combined with the receipt image, the image combining unit 28 may directly combine the receipt image with the multiple thumbnail images obtained from the multiple files.

[0119] Alternatively, when a plurality of files have been output, if the total number of pages of the plurality of files exceeds the first threshold value, which is the number of pages that can be combined with the receipt image, the image combining unit 28 can combine the receipt image with thumbnail images obtained from each characteristic page of the plurality of files. In addition, each characteristic page of the plurality of files is selected by the thumbnail image processing unit 25, but the method of processing when there is a page to be deleted by the thumbnail image processing unit 25 or selecting the characteristic page can use the method described above.

[0120] (Output example in the first operation example)

[0121] Figure 5 FIG. 1 is a diagram showing an example of a receipt output in the first operation example of the image processing device 10 of this embodiment. Figure 3 In step S108, the composite image is formed in the image forming unit 17 (reference Figure 1 ) is formed and the result is controlled and output.

[0122] As shown in the figure, receipt 500 includes output number description 501 , thumbnail image number description 502 , output store address description 503 , output date and time description 504 , and fee description 505 .

[0123] The output number description 501 is a description indicating the number of output documents for which the receipt 500 is used to prove the expense, and the thumbnail number description 502 is a description indicating the number of thumbnail images of the output documents included in the receipt 500. In this example, the number of output documents is 4, and the receipt 500 includes all thumbnail images of the output documents. The output number description 501 and the thumbnail number description 502 each include information on whether the image of the output document and the thumbnail image are formed in color or in black and white as an example of processing conditions for image processing. In this example, the image of the output document is formed in color, but the thumbnail image of the receipt 500 is converted to black and white.

[0124] The output store address description 503 is a description indicating the store address where the output document has been output, and the output date and time description 504 is a description indicating the date and time when the output document has been output.

[0125] The fee description 505 is a description indicating the fee required when outputting the output document. Here, the output document image is formed in color on four sheets, and it is assumed that the cost of forming the image in color is 50 yen per sheet, so the fee is 200 yen.

[0126] As shown in the figure, receipt 500 also includes thumbnail image 510 of page 1 of the output document, thumbnail image 520 of page 2 of the output document, thumbnail image 530 of page 3 of the output document, and thumbnail image 540 of page 4 of the output document. That is, receipt 500 includes four thumbnail images 510 to 540, and is therefore an example when the first threshold is 4.

[0127] Figure 6 FIG. 5 is an enlarged view of a thumbnail image 530 included in a receipt 500 output in the first operation example of the image processing device 10 of this embodiment. Figure 5 The thumbnail image 530 is not smeared or blurred, however, by Figure 4 In step S123, select "Delete character part", Figure 6 The characters of the thumbnail image 530 are filled in black. Specifically, the text character parts 531a to 531g and the chart character parts 532a to 532d are filled in black.

[0128] (Second action example)

[0129] Figure 7 This is a flowchart showing a second operation example of the image processing device 10 in this embodiment.

[0130] As shown in the figure, the image processing device 10 first performs Figure 3 The same processing as steps S101 to S105 is performed (steps S151 to S155).

[0131] Next, in the image processing device 10, the thumbnail image processing unit 25 performs a thumbnail image editing and selection process (step S156). Here, the thumbnail image editing and selection process is a process in which the thumbnail image stored in the thumbnail image storage unit 24 in step S154 is edited and selected according to the user operation on the thumbnail image displayed on the operation panel 15 in step S155. The details of the thumbnail image editing and selection process will be described later. The thumbnail image edited and selected by the thumbnail image editing and selection process is re-entered into the thumbnail image storage unit 24.

[0132] Then, the image synthesis unit 28 determines whether the number of pages of thumbnail images that have been edited and selected and stored in the thumbnail image storage unit 24 in step S156 is equal to or smaller than the first threshold value (step S157 ).

[0133] If it is determined that the number of pages of edited and selected thumbnail images is less than the first threshold, the image synthesis unit 28 generates a synthesized image by synthesizing the receipt image stored in the receipt image storage unit 27 with the edited and selected thumbnail images (step S158).

[0134] On the other hand, if the number of pages of thumbnail images that have been edited and selected is not determined to be less than the first threshold, the image synthesis unit 28 copies the receipt images stored in the receipt image storage unit 27 to generate N receipt images (step S159). Here, N can be set to the smallest integer that is greater than the quotient of the number of pages of thumbnail images that have been edited and selected divided by the first threshold. Next, the image synthesis unit 28 divides the thumbnail images that have been edited and selected into N groups (step S160). Specifically, thumbnail images of the first threshold number are sequentially taken from the beginning of the thumbnail images that have been edited and selected, and are sequentially assigned to the N groups from the beginning. At this time, the number of thumbnail images assigned to the Nth group may not meet the first threshold. Next, the image synthesis unit 28 generates N synthesized images by synthesizing each of the N receipt images generated in step S159 with the thumbnail images assigned to the corresponding group in the N groups divided in step S160 (step S161).

[0135] Finally, the image processing control unit 21 controls the image forming unit 17 to form the composite image generated in step S158 or step S161 (step S162 ).

[0136] Next, Figure 7 The thumbnail image editing and selection processing of step S156 is described in detail.

[0137] Figure 8 This is a flowchart showing a processing example of thumbnail image edit selection processing in the second operation example of the image processing device 10 according to the present embodiment.

[0138] As shown in the figure, the thumbnail image processing unit 25 first determines whether an instruction to edit a thumbnail image has been given (step S171 ). Specifically, the UI control unit 26 receives a user operation to edit a thumbnail image on the operation panel 15 , and the thumbnail image processing unit 25 determines whether the instruction has been received from the UI control unit 26 .

[0139] Here, a case where the thumbnail image processing unit 25 determines that an instruction to edit a thumbnail image has been given will be described.

[0140] In this case, the thumbnail image processing unit 25 performs Figure 4 The same processing as steps S122 to S125 is performed (steps S172 to S175).

[0141] Furthermore, a case where the thumbnail image processing unit 25 does not determine that an instruction to edit a thumbnail image has been given will be described.

[0142] In this case, the thumbnail image processing unit 25 first determines whether the number of pages of the thumbnail image is less than the second threshold value (step S176). For example, if the first threshold value is 4, it is not practical to combine 100 pages of thumbnail images into a receipt image and output 25 receipts, so an upper limit is set for the number of pages of the thumbnail image.

[0143] As a result, if it is not determined that the number of pages of the thumbnail image is less than the second threshold value, the thumbnail image processing unit 25 receives the selection of the deletion target page (step S177). Specifically, the UI control unit 26 receives the user operation of selecting the deletion target page or the printing target page on the thumbnail image displayed on the operation panel 15. Moreover, when the thumbnail image processing unit 25 receives the information of the deletion target page or the printing target page, and receives the information of the deletion target page, the page is set as the deletion target page, and when the information of the printing target page is received, the pages other than the page are set as the deletion target page. Alternatively, the UI control unit 26 receives the user operation of specifying the method of selecting the deletion target page on the operation panel 15, and the thumbnail image processing unit 25 searches for the page from the pages of the thumbnail image by the specified method, and sets the searched page as the deletion target page. Here, as a method of selecting the deletion target page, there is a method of selecting a predetermined page, a method of selecting a randomly determined page, and a method of selecting a characteristic page.

[0144] Next, the thumbnail image processing unit 25 deletes the page to be deleted whose selection is received in step S127 (step S178 ).

[0145] Then, the thumbnail image processing section 25 returns the process to step S171.

[0146] On the other hand, if it is determined that the number of pages of thumbnail images is less than the second threshold value, the thumbnail image processing unit 25 returns the processing to Figure 7 Flowchart of the process.

[0147] [program]

[0148] The processing performed by the image processing device 10 in the present embodiment is prepared as a program such as application software, for example.

[0149] That is, the program for implementing the present embodiment can be understood as a program for enabling a computer to implement the following functions: obtaining a processed image obtained through image processing; and generating a composite image that is a composite image that is a composite of an evidence image and a reduced image, wherein the evidence image is an image that serves as evidence of image processing and is an image that includes at least information on the cost required for image processing, and the reduced image is obtained by reducing the processed image.

[0150] Furthermore, the program for realizing the present embodiment is provided by the communication unit, but can also be provided by being stored in a recording medium such as a CD-ROM.

[0151] The above-mentioned embodiments of the present invention are provided for the purpose of illustration and description. In addition, the embodiments of the present invention do not fully and exhaustively include the present invention, and do not limit the present invention to the disclosed methods. Obviously, various modifications and changes are self-evident to those skilled in the art to which the present invention belongs. The present embodiment is selected and described in order to most easily understand the principles and applications of the present invention. Thus, other technicians in the art can understand the present invention through various variations optimized for specific uses assumed to be various embodiments. The scope of the present invention is defined by the above claims and their equivalents.

Claims

1. An information processing device, characterized in that: have: an acquisition unit, which acquires a processed image obtained through image processing; and a generating unit for generating a composite image synthesized by synthesizing an evidence image, the evidence image being an image that serves as evidence of the image processing and at least including information on the cost required for the image processing, and a reduced image obtained by reducing the processed image; wherein the generating unit determines whether the number of pages of the edited and selected reduced images stored in the reduced image storage unit is less than a first threshold value, wherein when the number of pages of the reduced images that have not been determined to have been edited and selected is below the first threshold, the generation unit copies the evidence image to generate N copied evidence images, wherein each of the N copied evidences is synthesized with the reduced image in the corresponding group classified into the N groups, The thumbnail image processing unit determines whether the thumbnail image for which editing has been instructed is below a second threshold value. When the number of pages not determined as thumbnail images is below the second threshold, a selection of a page to be deleted is received, wherein the selection of the page to be deleted includes: a method of selecting a predetermined page, a method of selecting a randomly determined page, and a method of selecting a characteristic page.

2. The information processing device according to claim 1, characterized in that Also available: The processing unit performs processing to reduce the amount of the reduced image to be less than the amount of the first image when the amount of the reduced image exceeds the amount of the first image which is the amount of images that can be combined with the evidence image.

3. The information processing device according to claim 2, characterized in that: The processing unit selects a portion at a predetermined position from the reduced image, thereby performing processing to reduce the amount of the reduced image to less than the amount of the first image.

4. The information processing device according to claim 2, characterized in that The processing unit selects a portion at a randomly determined position from the reduced image, thereby performing processing to reduce the amount of the reduced image to less than the amount of the first image.

5. The information processing device according to claim 2, characterized in that: The processing unit selects a portion satisfying a predetermined condition related to a feature of the image from the reduced image, thereby performing processing to reduce the amount of the reduced image to less than the amount of the first image.

6. The information processing device according to claim 5, characterized in that: The predetermined condition is a condition that a portion other than characters is included in the image.

7. The information processing device according to claim 5, characterized in that The predetermined condition is a condition that a portion other than characters is included in the image at a predetermined ratio or more.

8. The information processing device according to claim 2, characterized in that: In the case of a document having a first size of font size, the processing unit further increases the reduction ratio to generate the reduced image, compared to the case of a document having a second size of font size smaller than the first size, thereby performing processing to reduce the amount of the reduced image to less than the amount of the first image.

9. The information processing device according to claim 2, characterized in that: In the case of a document whose image does not include characters, the processing unit further increases the reduction ratio to generate the reduced image compared to the case of a document whose image includes characters, thereby performing processing to reduce the amount of the reduced image to less than the amount of the first image.

10. The information processing device according to claim 1, characterized in that: When the amount of the reduced image exceeds the amount of the image that can be synthesized with the evidence image, that is, the amount of the first image, the generation unit generates a plurality of synthesized images, each of which is an image synthesized by combining the evidence image and a portion of the amount of the first image of the reduced image.

11. The information processing device according to claim 10, characterized in that: The generating unit generates the plurality of synthesized images when the number of the reduced images is equal to or smaller than the number of second images, which is the number of images that can be synthesized with the evidence image among the plurality of synthesized images.

12. The information processing device according to claim 1, characterized in that: The evidence image also includes processing conditions for the image processing.

13. The information processing device according to claim 12, characterized in that: The generation unit generates the composite image in which the evidence image and the image obtained by converting the reduced image into black and white are composited, and the evidence image further includes the processing condition indicating that the image processing is processing to output the image in color.

14. A recording medium having recorded thereon a program for causing a computer to implement the following functions: acquiring a processed image obtained through image processing; and generating a composite image synthesized by synthesizing an evidence image and a reduced image, wherein the evidence image is an image that serves as evidence that the image processing has been performed and is an image that includes at least information on the cost required for the image processing, and the reduced image is obtained by reducing the processed image, The generating unit determines whether the number of pages of the edited and selected reduced images stored in the reduced image storage unit is less than a first threshold value. wherein when the number of pages of the reduced images that have not been determined to have been edited and selected is below the first threshold, the generation unit copies the evidence image to generate N copied evidence images, wherein each of the N copied evidences is synthesized with the reduced image in the corresponding group classified into the N groups, The thumbnail image processing unit determines whether the thumbnail image instructed to be edited is below a second threshold value. When the number of pages that are not determined to be thumbnail images is below the second threshold, a selection of a page to be deleted is received, wherein the selection of the page to be deleted includes: A method of selecting a predetermined page, a method of selecting a randomly determined page, and a method of selecting a characteristic page.

15. An information processing method, characterized in that: The steps include: acquiring a processed image obtained through image processing; and generating a composite image synthesized by synthesizing an evidence image and a reduced image, wherein the evidence image is an evidence image that has been subjected to the image processing and is an image that includes at least information on the cost required for the image processing, and the reduced image is obtained by reducing the processed image, The generating unit determines whether the number of pages of the edited and selected reduced images stored in the reduced image storage unit is less than a first threshold value. wherein when the number of pages of the reduced images that have not been determined to have been edited and selected is below the first threshold, the generation unit copies the evidence image to generate N copied evidence images, wherein each of the N copied evidences is synthesized with the reduced image in the corresponding group classified into the N groups, The thumbnail image processing unit determines whether the thumbnail image instructed to be edited is below a second threshold value. When the number of pages not determined as thumbnail images is below the second threshold, a selection of a page to be deleted is received, wherein the selection of the page to be deleted includes: a method of selecting a predetermined page, a method of selecting a randomly determined page, and a method of selecting a characteristic page.

16. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to claim 15 are implemented.

Images