Image processing device and program

Abstract

To provide an image processing device and a program that enable a user to grasp the position where each set of documents is placed when there are a plurality of sets of a plurality of documents and the plurality of documents containing one document from each set are simultaneously photographed.SOLUTION: In the case where there are a plurality of sets of a plurality of manuscripts and a plurality of documents including at least one document from each of all or some of the plurality of sets are simultaneously photographed by a photographing unit that photographs the documents, when photographing at second and subsequent times, guidance information for guiding the placement position of each set of documents is displayed on a display unit in a superimposed manner with an image representing the current state photographed by the photographing unit, by using information about the document obtained during past photographing.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present invention relates to an image processing apparatus and a program.

Background Art

[0002] Patent Document 1 describes an image forming apparatus that enables the front and back images of each of a plurality of small originals to be superimposed on the front and back of a single sheet of recording paper after aligning the front and back image positions.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In an image processing apparatus such as a multifunction device, it is conceivable to provide a photographing unit such as a camera and acquire an image of an original photographed by the photographing unit.

[0005] In this case, for example, for the front and back of a business card, by photographing a plurality of related originals one by one in order and associating the acquired images of the plurality of originals, the images of the plurality of related originals can be managed as a single set.

[0006] When there are a plurality of sets of related originals and a plurality of originals each containing one original from each set are photographed simultaneously, if the originals of each set are not placed within a range where they can be regarded as the same set of originals for each photographing, the association of the images of the originals of each set cannot be performed.

[0007] The object of the present invention is to provide an image processing device and program that allows the user to understand the position in which to place each set of documents when there are multiple sets of documents, and multiple documents, each containing one document from each set, are photographed simultaneously. [Means for solving the problem]

[0008] The first embodiment of the image processing apparatus includes a processor, and when there are multiple sets of multiple documents, and multiple documents including at least one document from each of all or some of the sets are simultaneously photographed by a document-taking unit, for the second and subsequent photographs, the processor uses information about the documents acquired during previous photographs to display guidance information for guiding the placement position of each set of documents on a display unit, superimposed on an image representing the current state captured by the document-taking unit.

[0009] In the second embodiment, the image processing apparatus is the same as the image processing apparatus of the first embodiment, wherein the guidance information is an image of a document acquired during a past photograph.

[0010] The third embodiment of the image processing apparatus is an image of the second embodiment in which the guidance information is an image of a document acquired during past photography, with the transparency of which is set to a predetermined level.

[0011] The image processing apparatus of the fourth embodiment is an image processing apparatus of the first embodiment in which the guidance information is an image of a frame representing the outline of each document acquired during past photography.

[0012] The fifth image processing apparatus, in the fourth image processing apparatus, includes an image indicating at least one of the up, down, left, or right directions of each document as the guide information.

[0013] The sixth image processing apparatus, in the first image processing apparatus, allows the processor to change the transparency when displaying the guidance information based on user operation.

[0014] In the seventh embodiment of the image processing apparatus, the processor switches between displaying and hiding the guidance information based on user operation, as in the first embodiment of the image processing apparatus.

[0015] The image processing apparatus of the eighth embodiment is an image processing apparatus of the first embodiment in which the multiple originals constituting each set are a front original and a back original of a single medium.

[0016] The program of the ninth embodiment has multiple sets of multiple documents, and when multiple documents, including at least one document from each of all or some of the sets, are simultaneously photographed by a document-photographing unit, the program causes the computer to perform the step of displaying guidance information on the display unit, overlaid on an image representing the current state as captured by the document-photographing unit, using information about the documents acquired during previous photography, to guide the placement of the documents in each set. [Effects of the Invention]

[0017] According to the image processing apparatus of the first embodiment, when there are multiple sets of related documents, and multiple documents, each containing one document from each set, are to be photographed simultaneously, the user can be made aware of the position in which each set of documents is placed.

[0018] According to the image processing apparatus of the second embodiment, it is possible to guide the user to the placement position while allowing them to confirm the content of images taken in the past.

[0019] According to the image processing apparatus of the third embodiment, even when guidance information and an image of a newly shot document overlap in a video representing the current state, the contents of both images can be made visible.

[0020] According to the image processing apparatus of the fourth embodiment, the content of the guidance information can be displayed in a simplified manner using only a frame.

[0021] According to the image processing apparatus of the fifth embodiment, it is possible to align and associate related documents in the vertical, horizontal, and vertical directions.

[0022] According to the image processing apparatus of the sixth aspect, the density when displaying the guidance information can be adjusted according to the user's preference.

[0023] According to the image processing apparatus of the seventh aspect, it is possible to make it easier for the user to confirm the image of the document to be newly photographed as compared with the case where the guidance information is always displayed.

[0024] According to the image processing apparatus of the eighth aspect, for a medium having a front document and a back document, the image of the front document and the image of the back document can be associated.

[0025] According to the program of the ninth aspect, when a plurality of sets each consisting of a plurality of related documents are simultaneously photographed, and a plurality of documents each containing one document of each set are photographed at the same time, the user can grasp the positions where the documents of each set are placed.

Brief Description of the Drawings

[0026] [Figure 1] It is a diagram showing the appearance of an image forming apparatus according to an embodiment of the present invention, where (A) is a side view of the image forming apparatus and (B) is a front view of the image forming apparatus. [Figure 2] It is a block diagram showing the hardware configuration of the image forming apparatus. [Figure 3] It is a block diagram showing the functional configuration of the image forming apparatus. [Figure 4] It is a diagram showing an example of each document of a plurality of sets to be photographed at the same time. [Figure 5] It is a diagram showing an example of the display state of the live view at the time of the first photographing for two sets. [Figure 6] It is a diagram showing an example of the overall image obtained in the first photographing. [Figure 7] It is a diagram showing an example of the display state of the live view at the time of the second photographing for two sets, and shows the state before a new document is placed. [Figure 8]This figure shows an example of the live view display state during the second shot for two sets of documents, specifically the state after a new document has been placed. [Figure 9] This diagram shows an example of the live view display state during the second shot for two sets of documents, specifically the state after a new document has been placed and alignment has been performed. [Figure 10] This figure shows an example of an overall image obtained during the second shooting session. [Figure 11] This figure shows another example of the live view display state during the second shot for two sets of images. [Figure 12] This figure shows another example of the live view display state during the second shot for two sets of images. [Figure 13] This figure shows another example of the live view display state during the second shot for two sets of images. [Figure 14] This figure shows another example of the live view display state during the second shot for two sets of images. [Figure 15] This is a flowchart showing the processing flow during document acquisition in an image forming apparatus. [Modes for carrying out the invention]

[0027] Embodiments of the present invention will now be described in detail with reference to the drawings. Figure 1 shows the external appearance of an image forming apparatus 10 as an example of an image processing apparatus according to an embodiment of the present invention, where (A) is a side view of the image forming apparatus 10 and (B) is a front view of the image forming apparatus 10. The image forming apparatus 10 is a device installed in an office, such as a multifunction printer.

[0028] As shown in Figure 1, the image forming apparatus 10 consists of the apparatus body 12, an discharge tray 14 as a medium discharge section, a mounting section 16, an imaging device 18, an illumination device 20 composed of four light sources 20a, 20b, 20c, and 20d, and an operation panel 22, etc.

[0029] The output tray 14 is where paper, an example of a media, is ejected. The output tray 14 is also positioned so that the media can be removed by a standing user.

[0030] The mounting section 16, as will be described in detail later, is located on the top surface of the device body 12, specifically at the top of the device body 12. Furthermore, the mounting section 16 is positioned vertically above the output tray 14. The mounting section 16 is configured to accommodate documents such as paper, business cards, and receipts.

[0031] The imaging device 18 is equipped with an image sensor such as a CCD (Charge Coupled Device) and captures images of a subject such as a document to acquire image data. The imaging device 18 is installed above the mounting section 16 and is configured to photograph the document placed on the mounting section 16 from above. Here, "above the mounting section 16" means that, when the upper surface of the mounting section 16 is used as a reference plane, it is not limited to being vertically above the reference plane, but is above in the vertical direction and is at a position higher than the reference plane.

[0032] Furthermore, a support column 24 is provided on the top surface of the main body 12, on the rear side of the upper surface of the mounting section 16. The support column 24 extends upward in a substantially perpendicular direction relative to the upper surface of the mounting section 16, and its end is bent upwards toward the mounting section 16. An imaging device 18 is attached to the end of the support column 24.

[0033] Between the output tray 14 and the placement section 16, there is an image forming unit that forms an image of the subject placed on the placement section 16. In other words, above the output tray 14, there is an image forming unit that forms an image on the paper that is ejected into the output tray 14.

[0034] The illumination device 20 is composed of one or more light sources, such as LEDs (Light Emitting Diodes), and is composed of, for example, light sources 20a, 20b, 20c, and 20d. The light sources 20a, 20b, 20c, and 20d are provided on the support column 24. In other words, the light sources 20a, 20b, 20c, and 20d are provided above the mounting section 16.

[0035] Specifically, the light sources 20a and 20b are located near the imaging device 18 and are positioned downward on both sides of the imaging device 18 on the support column 24. The light sources 20c and 20d are located near the operation panel 22 and are positioned diagonally downward on both sides of the support column 24 at the lower end of the operation panel 22.

[0036] In other words, the light sources 20a, 20b and 20c, 20d are positioned at different heights from the mounting section 16. That is, the light sources 20a, 20b, 20c, and 20d are positioned at different angles of light hitting the subject, and are configured to illuminate the document from different directions. This improves the ability to distinguish between the document and the mounting section 16.

[0037] The control panel 22 is equipped with a display screen and is configured for setting the image forming apparatus 10. This control panel 22 is installed on the support column 24 between the mounting section 16 and the imaging device 18, at the rear of the main body of the apparatus 12.

[0038] A document feeder with simultaneous double-sided scanning functionality is provided inside the main body 12 of the device located below the top plate of the mounting section 16. The document feeder can be used by sliding a portion of the top plate of the mounting section 16 in a planar direction.

[0039] Next, the hardware configuration of the image forming apparatus 10 of this embodiment will be described. Figure 2 is a block diagram showing the hardware configuration of the image forming apparatus 10.

[0040] As shown in Figure 2, the image forming apparatus 10 includes a CPU 31, memory 32, storage device 33 such as a hard disk drive, a communication interface (IF) 34 for transmitting and receiving data to and from external devices via a network, a user interface (UI) device 35 including a touch panel or liquid crystal display and keyboard, a scanner 36, a print engine 37, a shooting device 18, and an illumination device 20. These components are connected to each other via a control bus 40.

[0041] The communication interface 34 transmits and receives data to and from external devices. The user interface 35 receives user input. The scanner 36 reads the original document loaded into the image forming apparatus 10 as image data. The print engine 37 prints the image onto a recording medium such as printing paper through processes such as charging, exposure, development, transfer, and fixing.

[0042] The CPU 31 is a processor that controls the operation of the image forming apparatus 10 by executing predetermined processes based on a control program stored in the memory 32 or storage device 33. In this embodiment, the CPU 31 is described as reading and executing a control program stored in the memory 32 or storage device 33, but it is not limited to this. This control program may be provided in the form of a computer-readable recording medium. For example, this program may be provided in the form of a CD (Compact Disc)-ROM (Read Only Memory) or DVD (Digital Versatile Disc)-ROM recorded on an optical disc, or in the form of a USB (Universal Serial Bus) memory or memory card recorded on a semiconductor memory. Alternatively, this control program may be acquired from an external device via a communication line connected to the communication IF 34.

[0043] Next, the functional configuration of the image forming apparatus 10 of this embodiment will be described. Figure 3 is a block diagram showing the functional configuration of the image forming apparatus 10.

[0044] As shown in Figure 3, the image forming apparatus 10 includes a control unit 41, a communication unit 42, a display input unit 43, a storage unit 44, an image reading unit 45, an image forming unit 46, an image output unit 47, an imaging unit 48, and an illumination unit 49.

[0045] The control unit 41 controls the overall operation of the image forming apparatus 10, and for example, based on user input, it controls the shooting unit 48 to take a picture of the original document, and controls the image output unit 47 to output print data such as the original document image.

[0046] The communication unit 42 transmits and receives data with external devices. The display input unit 43 displays various information on the display screen of the operation panel 22 based on control by the control unit 41. The display input unit 43 also inputs various operation information performed by the user on the operation panel 22. The display input unit 43 is an example of a display unit in the technology disclosed herein. The storage unit 44 stores various data, such as image data generated by the control unit 41, in addition to the control program.

[0047] The image reading unit 45 performs scanning operations to read various documents based on control by the control unit 41. The image forming unit 46 forms an image for output from the image output unit 47 based on control by the control unit 41. The image output unit 47 outputs the image formed in the image forming unit 46 onto a recording medium such as printing paper, based on control by the control unit 41.

[0048] The imaging unit 48 photographs the document placed on the placement unit 16 based on control by the control unit 41. The illumination unit 49 irradiates light onto the document placed on the placement unit 16 based on control by the control unit 41.

[0049] The image forming apparatus 10 of this embodiment photographs multiple related documents one by one in sequence, such as the front and back of a business card, and associates the images of the multiple documents obtained, thereby managing the images of multiple related documents as a set.

[0050] Furthermore, if there are multiple sets of documents, it is possible to simultaneously photograph multiple documents, each containing one document from a set. In this case, unless the documents from each set are placed within a range that allows them to be considered as belonging to the same set in each photograph, it will not be possible to associate the images of the documents from each set.

[0051] Therefore, in this embodiment, when there are multiple sets of multiple documents, and the imaging unit 48 simultaneously photographs multiple documents, including at least one document from each of all or some of the sets, the control unit 41, for the second and subsequent photographs, uses information about the documents acquired during previous photographs to display guidance information for guiding the placement position of each set of documents on the display input unit 43, superimposed on an image representing the current state captured by the imaging unit 48.

[0052] Here, "multiple manuscripts constituting each set" may refer to, for example, the front and back manuscripts of a single medium such as a business card, or to manuscripts of multiple media. Furthermore, a set may contain manuscripts of multiple media, with some of these media having both the front and back manuscripts.

[0053] Furthermore, regarding sets of images to be photographed simultaneously, at least two types of sets may be mixed together, including sets consisting of a front and back original of one medium, sets consisting of originals from multiple media, and sets having originals from multiple media, with some of the media having both the front and back originals.

[0054] In this embodiment, as an example, two sets of documents consisting of the front and back sides of a single medium are photographed simultaneously.

[0055] Furthermore, the "image representing the current state captured by the shooting unit 48" may be a still image or a video. In this embodiment, as an example, a video representing the current state is displayed on the display input unit 43. The video representing the current state is also called a live view. In the following description, the video representing the current state will be referred to as a live view.

[0056] The processing in the image forming apparatus 10 of this embodiment will be described in detail below. First, each of the multiple sets of originals that are photographed simultaneously will be described. Figure 4 is a diagram showing an example of each of the multiple sets of originals that are photographed simultaneously.

[0057] As shown in Figure 4, in this embodiment, as an example, the case in which two sets of documents, G1 and G2, are photographed simultaneously will be described. Set G1 consists of the front document and the back document of medium 1. Set G2 consists of the front document and the back document of medium 2.

[0058] In the first shooting session, the front-side original of media 1 in set G1 and the front-side original of media 2 in set G2 are photographed simultaneously. In the second shooting session, the back-side original of media 1 in set G1 and the back-side original of media 2 in set G2 are photographed simultaneously.

[0059] Figure 5 shows an example of the live view display state during the first shooting for two sets of G1 and G2. Figure 6 shows an example of the overall image IE acquired during the first shooting.

[0060] When photographing a document, the control unit 41 displays the live view LE captured by the shooting unit 48 on the display input unit 43.

[0061] In the first shooting session, the user places the front original of media 1 in set G1 and the front original of media 2 in set G2 onto the mounting unit 16.

[0062] When the original document is placed on the placement unit 16, as shown in Figure 5, the live view image L1a of the front surface of the original document on medium 1 and the live view image L2a of the front surface of the original document on medium 2 are displayed in the live view LE.

[0063] The user checks the Live View LE displayed on the display input unit 43 and inputs a shooting instruction to the image forming apparatus 10.

[0064] The control unit 41 receives a shooting instruction from the user, performs the first shooting, and acquires an overall image IE showing the surface of the original document on medium 1 and the surface of the original document on medium 2, as shown in Figure 6. Next, the control unit 41 extracts image I1a of the surface of the original document on medium 1 and image I2a of the surface of the original document on medium 2 from the overall image IE.

[0065] Figure 7 shows an example of the live view display state during the second exposure for two sets of documents G1 and G2, before a new document is placed. Figure 8 shows an example of the live view display state during the second exposure for two sets of documents G1 and G2, after a new document has been placed. Figure 9 shows an example of the live view display state during the second exposure for two sets of documents G1 and G2, after a new document has been placed and alignment has been performed. Figure 10 shows an example of the overall image IE acquired during the second exposure.

[0066] During the second shooting, as shown in Figure 7, the control unit 41 displays the image I1a of the surface original of medium 1 and the image I2a of the surface original of medium 2, which were acquired during the first shooting, superimposed on the Live View LE at the same position as during the first shooting, as guidance information.

[0067] The images I1a of the front document of medium 1 and I2a of the front document of medium 2, which are displayed as information for guidance, may be displayed as they were acquired, or their brightness or saturation may be adjusted to make them easier to distinguish from the document to be photographed a second time. Here, as an example, an example is shown in which the brightness of images I1a of the front document of medium 1 and I2a of the front document of medium 2 is reduced.

[0068] In the second shooting session, the user places the reverse side document of media 1 for set G1 and the reverse side document of media 2 for set G2 onto the placement unit 16.

[0069] When the document is placed on the placement unit 16, as shown in Figure 8, the live view image L1b of the back side of the document on medium 1 and the live view image L2b of the back side of the document on medium 2 are displayed in the live view LE.

[0070] The user checks the Live View LE and guidance information (image I1a of the front surface of medium 1 and image I2a of the front surface of medium 2, acquired during the first shooting) displayed on the display input unit 43, and aligns the document to be photographed for the second time.

[0071] In detail, as shown in Figure 9, the user aligns the back-side document of medium 1 so that the image I1a of the front-side document of medium 1 overlaps with the live view image L1b of the back-side document of medium 1. Similarly, the user aligns the back-side document of medium 2 so that the image I2a of the front-side document of medium 2 overlaps with the live view image L2b of the back-side document of medium 2.

[0072] The user checks the Live View LE displayed on the display input unit 43 and inputs a shooting instruction to the image forming apparatus 10.

[0073] The control unit 41 receives a shooting instruction from the user, performs a second shooting, and acquires an overall image IE showing the back side of the original document on medium 1 and the back side of the original document on medium 2, as shown in Figure 10. Next, the control unit 41 extracts image I1b of the back side of the original document on medium 1 and image I2b of the back side of the original document on medium 2 from the overall image IE.

[0074] In this way, by overlaying guidance information on the Live View LE during the second shot, the user can position the front and back of each document in the same way during both the first and second shots.

[0075] Therefore, the control unit 41 associates and manages the image I1a of the front document of medium 1, acquired during the first shooting, and the image I1b of the back document of medium 1, which is captured in the second shooting at a position overlapping with the image I1a of the front document of medium 1, as documents for set G1. Similarly, the control unit 41 associates and manages the image I2a of the front document of medium 2, acquired during the first shooting, and the image I2b of the back document of medium 2, which is captured in the second shooting at a position overlapping with the image I2a of the front document of medium 2, as documents for set G2.

[0076] Furthermore, "an image of the back-side document that appears in a position overlapping with the image of the front-side document" is not limited to a configuration where the images of the front-side document and the back-side document are completely overlapping, but may also refer to a configuration where the image of the back-side document is partially overlapping with the image of the front-side document.

[0077] There are no particular limitations on the method for determining whether the image on the front of the document and the image on the back of the document overlap; any method may be used. For example, the two images may be determined to overlap if the area of ​​overlap between the front image and the back image exceeds a set threshold, and not overlap if it is less than the threshold. In this case, the threshold can be, for example, 50% or more.

[0078] For each set of document images, for example, one document file may be created for each set, and a job such as file transfer, fax, or print may be performed on this document file based on the user's instructions.

[0079] Furthermore, in addition to using images of original documents obtained during past shoots as described above, the information provided for guidance may also be an image of an original document obtained during a past shoot with transparency adjusted to a predetermined level, as shown in Figure 11.

[0080] By adopting this configuration, even if the document for the second shot overlaps with the guidance information when the user aligns the document for the second shot, the user will still be able to see the document for the second shot.

[0081] Furthermore, the information used for guidance may be framed images IF1 and IF2, representing the outlines of each document obtained during past photography sessions, as shown in Figure 12.

[0082] In this case, the guidance information may include an image showing at least one of the up, down, left, or right directions for each document, as shown in Figure 13. Figure 13 shows an example where arrows IA1 and IA2 indicating the upward direction for each document are displayed.

[0083] Furthermore, the control unit 41 may be configured to allow the user to change the transparency when displaying guidance information.

[0084] Furthermore, the control unit 41 may be configured to allow the user to switch between displaying and hiding the guidance information.

[0085] Furthermore, when taking a second or subsequent photograph, if the document is placed in a position where it does not overlap with the guidance information, the control unit 41 may overlay a notification display image IN, which contains a message such as "Please place the document on top of the other document," on the live view LE, as shown in Figure 14.

[0086] There are no particular limitations on the method for determining whether the manuscript and the informational materials overlap; any method is acceptable. For example, the method could be set so that the manuscript and the informational materials overlap if the area overlapping the display area of ​​the informational materials exceeds a set threshold, and not overlap if it is less than the threshold. In this case, the threshold could be, for example, 50% or more.

[0087] Next, the processing during document acquisition in the image forming apparatus 10 will be explained with reference to the flowchart in Figure 15.

[0088] First, in step S11, if the user selects double-sided shooting, the control unit 41 starts displaying the live view in step S12. Here, "double-sided shooting" means shooting both sides of the front and back of each of the multiple media, as explained above. In the first shooting, the front of each of the multiple media is shot, and in the second shooting, the back of each of the multiple media is shot.

[0089] Next, in step S13, the control unit 41 determines whether to photograph the front or back side of the document.

[0090] In step S13, if it is determined that surface imaging is performed, i.e., the first imaging, the control unit 41 performs imaging of each surface original of the multiple media in step S14, records the original position of each surface original of the multiple media in the surface imaging image in step S15, and proceeds to step S12.

[0091] If it is determined in step S13 that it is a back-side photograph, i.e., a second photograph, the control unit 41 displays guidance information in step S16 using the front-side originals of each of the multiple media acquired in the first photograph, and in step S17, it photographs the back-side originals of each of the multiple media.

[0092] Next, in step S18, the control unit 41 performs matching of the front and back documents for each medium and manages the documents in sets. Here, matching refers to the process of combining the front and back documents of the same medium.

[0093] Finally, in step S19, the control unit 41 executes a job such as file transfer, fax, or print for each set of document images based on the user's instructions, and then proceeds to step S11.

[0094] [Differentiation] Although an image forming apparatus according to one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment and can be modified as appropriate.

[0095] In each of the embodiments described above, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0096] Furthermore, the processor operations in each of the above embodiments may not be performed by a single processor, but may also be performed by multiple processors located in physically separate locations working together. Also, the order of the processor operations is not limited to the order described in each of the above embodiments, and may be changed as appropriate.

[0097] Furthermore, although the above embodiment described the application of the present invention to an image forming apparatus, the present invention is not limited to this and can be applied to various image processing devices such as mobile phones, tablets, or personal computers.

[0098] [Note] The following are preferred forms of this disclosure.

[0099] (((1))) Equipped with a processor, The aforementioned processor, When there are multiple sets of multiple manuscripts, and multiple manuscripts, including at least one manuscript from each of all or some of the sets, are simultaneously photographed by the photography unit that photographs the manuscripts, During subsequent shoots, information about the manuscripts obtained during previous shoots is used to guide the placement of each set of manuscripts. This guidance information is overlaid on the display unit, along with an image showing the current state captured by the shooting unit. Image processing device.

[0100] (((2))) The aforementioned information is an image of a manuscript obtained during a previous photo shoot. The image processing device described in (((1))).

[0101] (((3))) The aforementioned guidance information is an image of a document obtained during past photography, with the transparency adjusted to a predetermined level. The image processing device described in (((2))).

[0102] (((4))) The aforementioned informational data consists of framed images representing the outlines of each manuscript, taken during past photo shoots. The image processing device described in (((1))).

[0103] (((5))) The aforementioned guidance information includes an image showing at least one of the directions (up, down, left, or right) of each document. The image processing device described in (((4))).

[0104] (((6))) The aforementioned processor, The transparency level when displaying the aforementioned guidance information can be changed by user operation. An image processing apparatus as described in any one of items (((1))) to (((5))).

[0105] (((7))) The aforementioned processor, The user can switch between displaying and hiding the aforementioned guidance information. An image processing apparatus as described in any one of items (((1))) to (((6))).

[0106] (((8))) Each set consists of multiple originals, one for the front side and one for the back side of a single medium. An image processing apparatus as described in any one of items (((1))) to (((7))).

[0107] (((9))) When there are multiple sets of multiple manuscripts, and multiple manuscripts, including at least one manuscript from each of all or some of the sets, are simultaneously photographed by the photography unit that photographs the manuscripts, During subsequent shooting sessions, the system uses information about the original documents acquired during previous shooting sessions to display guidance information for the placement of each set of documents. This guidance information is overlaid on an image representing the current state captured by the shooting unit and displayed on the display unit. A program that causes a computer to execute something.

[0108] The effects of the configuration described below are explained below.

[0109] According to the image processing device of (((1))), when there are multiple sets of related documents, and multiple documents, each containing one document from each set, are being photographed simultaneously, the user can be made aware of the position in which each set of documents should be placed.

[0110] According to the image processing device (((2))), it is possible to guide the user to the placement position while confirming the content of previously captured images.

[0111] According to the image processing device (((3))), even when the guidance information and the image of the newly shot manuscript overlap in a video representing the current state, the contents of both images can be made visible.

[0112] According to the image processing device (((4))), the content of the guidance information can be displayed in a simplified form consisting only of a border.

[0113] According to the image processing device (((5))), it is possible to align and associate related documents in the vertical, horizontal, and vertical directions.

[0114] According to the image processing device (((6))), the density of the displayed guidance information can be adjusted according to the user's preference.

[0115] According to the image processing device (((7))), it is possible to make it easier to confirm the image of the document being newly photographed compared to when guidance information is always displayed.

[0116] According to the image processing apparatus of (((8))), for a medium that has a front-side original and a back-side original, the image of the front-side original and the image of the back-side original can be associated.

[0117] According to the program in (((9))), when there are multiple sets of related documents, and multiple documents, each containing one document from each set, are photographed simultaneously, the user can understand the position in which each set of documents should be placed. [Explanation of symbols]

[0118] 10 Image forming apparatus 12 Main unit of the device 14. Discharge tray 16 Mounting section 18. Imaging device 20 Irradiation device 22 Control Panel 24 Posts 31 CPU 32 memory 33 Storage device 34 Communication Interfaces 35 User Interface Device 36 Scanners 37 Print Engine 40 Control bus 41 Control Unit 42 Communications Department 43 Display Input Section 44 Storage section 45 Image reading unit 46 Image forming unit 47 Image output section 48 Photography Department 49 Irradiation area

Claims

1. Equipped with a processor, The aforementioned processor, When there are multiple sets of multiple manuscripts, and multiple manuscripts, including at least one manuscript from each of all or some of the sets, are simultaneously photographed by the photography unit that photographs the manuscripts, During subsequent shoots, information about the manuscripts obtained during previous shoots is used to guide the placement of each set of manuscripts. This guidance information is overlaid on the display unit, along with an image showing the current state captured by the shooting unit. Image processing device.

2. The aforementioned information is an image of a manuscript obtained during a previous photo shoot. The image processing apparatus according to claim 1.

3. The aforementioned guidance information is an image of a document obtained during past photography, with the transparency adjusted to a predetermined level. The image processing apparatus according to claim 2.

4. The aforementioned informational data consists of framed images representing the outlines of each manuscript, taken during past photo shoots. The image processing apparatus according to claim 1.

5. The aforementioned guidance information includes an image showing at least one of the directions (up, down, left, or right) of each document. The image processing apparatus according to claim 4.

6. The aforementioned processor, The transparency level when displaying the aforementioned guidance information can be changed by user operation. The image processing apparatus according to claim 1.

7. The aforementioned processor, The user can switch between displaying and hiding the aforementioned guidance information. The image processing apparatus according to claim 1.

8. Each set consists of multiple manuscripts, each comprising a front-side and back-side manuscript of a single medium. The image processing apparatus according to claim 1.

9. When there are multiple sets of multiple manuscripts, and multiple manuscripts, including at least one manuscript from each of all or some of the sets, are simultaneously photographed by the photography unit that photographs the manuscripts, During subsequent shooting sessions, the system uses information about the original documents acquired during previous shooting sessions to display guidance information for the placement of each set of documents. This guidance information is overlaid on an image representing the current state captured by the shooting unit and displayed on the display unit. A program that causes a computer to execute something.

Images