Image processing device and program

Abstract

To provide an image processing device and program which can correctly set a page number even when a plurality of documents are placed in a matrix in a disordered state.SOLUTION: An image processing device executes the first processing of extracting position coordinates of each document image from a whole image obtained by imaging a plurality of documents, and extracting the document image with the shortest distance between the first coordinate axis in parallel to the arrangement direction of the set documents with an original point in the whole image as a reference and the first side being the side farther from the first coordinate axis in the two sides along the arrangement direction from a plurality of the document images included in the whole image, executes the second processing of extracting the other document image overlapping a line obtained by extending the first side of the extracted document image in the arrangement direction as the document image of the same group, and executes the third processing of setting a page number in the order of proximity from the original point to each of the extracted document images of the same group.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an image processing apparatus and a program. [Background Art]

[0002] Patent Document 1 describes an image reading apparatus that, in a multi-crop function of acquiring placement area image data corresponding to an area where a plurality of documents are placed on a document platen and cutting out document image data for each individual document therefrom, can add the order in which documents are placed on the document platen directly to the document image data.

[0003] Patent Document 2 describes a multi-form scanning method that, when scanning a plurality of forms at once with a stand-type scanner or the like to acquire image data of each form, can assign order information to each form and record the same.

[0004] Patent Document 3 describes an image processing apparatus that identifies the order among a plurality of documents photographed simultaneously, and further organizes, stores, outputs or the like document image data in the identified order.

[0005] Patent Document 4 describes an image processing apparatus that, when it is desired to read a set of a plurality of pages of documents placed side by side on a document platen and convert the plurality of pages into one file, can automatically present an initial order and then allow a user to change the order.

[0006] Patent Document 5 describes an image processing apparatus that can output read images corresponding to a plurality of documents placed on a document platen based on the order in which the documents are arranged on the document platen. [Prior Art Documents] [Patent Documents]

[0007] [Patent Document 1] Japanese Patent No. 6807630 [Patent Document 2] Japanese Unexamined Patent Application Publication No. 2012-104986 [Patent Document 3] Japanese Patent Publication No. 2014-216953 [Patent Document 4] Patent No. 6849387 [Patent Document 5] Japanese Patent Publication No. 2008-034973 [Overview of the project] [Problems that the invention aims to solve]

[0008] In image processing devices such as multifunction printers, multiple documents placed on a document tray or similar surface can be captured, and each document image can be extracted from the overall image. By assigning a page number to each document image and arranging them in page number order, multiple document images can be managed as a single document.

[0009] For example, if multiple documents are placed in a row horizontally, with the top left corner of the placement area as the reference point, one could consider assigning page numbers to the first row of documents extracted from the overall image, starting from the left, and then similarly assigning page numbers to the second row and subsequent rows, starting from the left.

[0010] However, if multiple original documents are placed in a disorganized state, such as when the top or bottom edges of each original image are not aligned in the row direction, or when the left or right edges of each original image are not aligned in the column direction, it may not be possible to set the page numbers correctly.

[0011] The object of the present invention is to provide an image processing device and program that can correctly set page numbers even when multiple documents are arranged in a disorganized manner in a matrix. [Means for solving the problem]

[0012] The first embodiment of the image processing apparatus includes a processor, which extracts the position coordinates of each document image from an overall image in which multiple documents have been photographed, and performs a first process to extract from the multiple document images included in the overall image the document image in which the distance between a first coordinate axis parallel to the set document arrangement direction relative to the origin in the overall image and a first side which is the side of two sides along the arrangement direction that is furthest from the first coordinate axis is the shortest distance, and performs a second process to extract other document images that overlap with a line extending the first side of the extracted document image in the arrangement direction as document images of the same group, and performs a third process to set page numbers for each of the extracted document images of the same group in order of proximity to the origin.

[0013] The image processing apparatus of the second embodiment, in the image processing apparatus of the first embodiment, has the processor exclude original document images with page numbers set from the original document images included in the overall image, and repeats the fourth process, in which the first process, the second process, and the third process are executed in order, until there are no original document images without page numbers set.

[0014] In the third embodiment, the image processing apparatus, in the first or second embodiment, if the original image is rectangular but there are no sides in the original image that are parallel to the alignment direction, or if the original image is not rectangular, the processor considers the shape of the original image to be a rectangle having sides that are tangent to the outer periphery of the original image and parallel to the alignment direction.

[0015] The fourth image processing apparatus, in the first or second image processing apparatus, has a processor that, in response to user instructions, changes at least one setting of the position of the origin in the overall image and the alignment direction.

[0016] The image processing apparatus of the fifth embodiment, in the image processing apparatus of the fourth embodiment, changes the position of the origin in the overall image to one of the following settings in response to user instructions: a first setting in which the position of the origin in the overall image is set to the upper left when the user is facing the plane on which the document is placed, and the alignment direction is the horizontal direction in the overall image; a second setting in which the position of the origin in the overall image is set to the upper left when the user is facing the plane on which the document is placed, and the alignment direction is the vertical direction in the overall image; a third setting in which the position of the origin in the overall image is set to the upper right when the user is facing the plane on which the document is placed, and the alignment direction is the horizontal direction in the overall image; and a fourth setting in which the position of the origin in the overall image is set to the upper right when the user is facing the plane on which the document is placed, and the alignment direction is the vertical direction in the overall image.

[0017] The sixth image processing apparatus, in the first or second image processing apparatus, displays the page number set for each original image in the overall image.

[0018] The seventh image processing apparatus is an image processing apparatus in the sixth embodiment in which the processor can move each document image in the overall image in response to user instructions, and resets the page number of each document image in accordance with the movement of each document image.

[0019] The eighth image processing apparatus, in the first or second image processing apparatus, displays an image in which each document image is arranged in the order of the page numbers set for each document image.

[0020] A program according to a ninth aspect causes a computer to execute: a step of extracting position coordinates of each document image from an entire image obtained by capturing a plurality of documents; a step of executing a first process of extracting, from among the plurality of document images included in the entire image, a document image having the shortest distance between a first coordinate axis parallel to a set document arrangement direction with an origin in the entire image as a reference, and a first side which is a side farther from the first coordinate axis among two sides along the arrangement direction; a step of executing a second process of extracting another document image overlapping a line obtained by extending the first side of the extracted document image in the arrangement direction as a document image of the same group; and a step of executing a third process of setting page numbers in order from closest to the origin for each of the extracted document images of the same group. [Effects of the Invention]

[0021] According to the image processing apparatus of the first aspect, page numbers can be correctly set even when a plurality of documents are placed in a matrix in a disturbed state.

[0022] According to the image processing apparatus of the second aspect, page numbers can be set more correctly compared to a case where the first process, the second process, and the third process are performed only once.

[0023] According to the image processing apparatus of the third aspect, page numbers can be set even when rectangular documents are placed inclined with respect to the arrangement direction, or when documents have a shape other than a rectangle.

[0024] According to the image processing apparatus of the fourth aspect, the page number setting method can be changed in accordance with the manner when a user places a plurality of documents.

[0025] According to the image processing apparatus of the fifth aspect, it is possible to cope with a typical manner when a user places a plurality of documents.

[0026] According to the image processing apparatus of the sixth aspect, the user can be caused to recognize the set page numbers.

[0027] According to the image processing apparatus of the seventh embodiment, even if the placement of the original document is so disordered that the page numbers cannot be set correctly, the user can adjust the position of the original document on the overall image.

[0028] According to the image processing apparatus of the eighth embodiment, the user can be made aware of the set page number.

[0029] According to the program of the ninth aspect, even when multiple documents are arranged in a disorganized manner in a row, page numbers can be set correctly. [Brief explanation of the drawing]

[0030] [Figure 1] This figure shows the external appearance of an image forming apparatus according to one embodiment of the present invention, where (A) is a side view of the image forming apparatus and (B) is a front view of the image forming apparatus. [Figure 2] This is a block diagram showing the hardware configuration of an image forming apparatus. [Figure 3] This is a block diagram showing the functional configuration of an image forming apparatus. [Figure 4] Figure (1) illustrates the process of setting page numbers for each original image in the first configuration. [Figure 5] Figure (2) illustrates the process of setting page numbers for each original image in the first configuration. [Figure 6] Figure (3) illustrates the process of setting page numbers for each original image in the first configuration. [Figure 7] Figure (4) illustrates the process of setting page numbers for each original image in the first configuration. [Figure 8] Figure (5) illustrates the process of setting page numbers for each original image in the first configuration. [Figure 9] Figure (6) illustrates the process of setting page numbers for each original image in the first configuration. [Figure 10]Figure (7) illustrates the process of setting page numbers for each original image in the first configuration. [Figure 11] Figure (8) illustrates the process of setting page numbers for each original image in the first configuration. [Figure 12] Figure (9) illustrates the process of setting page numbers for each original image in the first configuration. [Figure 13] Figure (10) illustrates the process of setting page numbers for each original image in the first configuration. [Figure 14] This figure shows an example where the original image is rectangular, but there are no edges in the original image that are parallel to the direction of arrangement. [Figure 15] This figure shows an example where the original image is not rectangular. [Figure 16] Figure (1) illustrates the process of setting page numbers for each original image in the second setting. [Figure 17] Figure (2) illustrates the process of setting page numbers for each original image in the second setting. [Figure 18] Figure (3) illustrates the process of setting page numbers for each original image in the second setting. [Figure 19] Figure (4) illustrates the process of setting page numbers for each original image in the second setting. [Figure 20] Figure (5) illustrates the process of setting page numbers for each original image in the second setting. [Figure 21] Figure (6) illustrates the process of setting page numbers for each original image in the second setting. [Figure 22] Figure (7) illustrates the process of setting page numbers for each original image in the second setting. [Figure 23] Figure (8) illustrates the process of setting page numbers for each original image in the second setting. [Figure 24] Figure (9) illustrates the process of setting page numbers for each original image in the second setting. [Figure 25] Figure (10) illustrates the process of setting page numbers for each original image in the second setting. [Figure 26] This diagram illustrates the overall image and page number settings in the third configuration. [Figure 27] This is a diagram illustrating the overall image and page number settings in the fourth setting. [Figure 28] This figure shows an example where the page number is displayed along with each original document image in the overall image. [Figure 29] This figure shows an example where page numbers are aligned to each original document image within the overall image, and it depicts the state after some of the original document images have been moved from the state shown in Figure 28. [Figure 30] Figure (1) shows an example of a collection image in which each original document image is arranged in the order of the page numbers assigned to each original document image. [Figure 31] Figure (2) shows an example of a collection image in which each original document image is arranged in the order of the page numbers assigned to each original document image. [Figure 32] This flowchart shows the process for assigning page numbers to each original document image within the overall image. [Modes for carrying out the invention]

[0031] Embodiments of the present invention will now be described in detail with reference to the drawings. Figure 1 shows the external appearance of an image forming apparatus 10 as an example of an image processing apparatus according to an embodiment of the present invention, where (A) is a side view of the image forming apparatus 10 and (B) is a front view of the image forming apparatus 10. The image forming apparatus 10 is a device installed in an office, such as a multifunction printer.

[0032] As shown in Figure 1, the image forming apparatus 10 consists of the apparatus body 12, an discharge tray 14 as a medium discharge section, a mounting section 16, an imaging device 18, an illumination device 20 composed of four light sources 20a, 20b, 20c, and 20d, and an operation panel 22, etc.

[0033] The output tray 14 is where paper, an example of a media, is ejected. The output tray 14 is also positioned so that the media can be removed by a standing user.

[0034] The mounting section 16, as will be described in detail later, is located on the top surface of the device body 12, specifically at the top of the device body 12. Furthermore, the mounting section 16 is positioned vertically above the output tray 14. The mounting section 16 is configured to accommodate documents such as paper, business cards, and receipts.

[0035] The imaging device 18 is equipped with an image sensor such as a CCD (Charge Coupled Device) and captures images of a subject such as a document to acquire image data. The imaging device 18 is installed above the mounting section 16 and is configured to photograph the document placed on the mounting section 16 from above. Here, "above the mounting section 16" means that, when the upper surface of the mounting section 16 is used as a reference plane, it is not limited to being vertically above the reference plane, but is above in the vertical direction and is at a position higher than the reference plane.

[0036] Furthermore, a support column 24 is provided on the top surface of the main body 12, on the rear side of the upper surface of the mounting section 16. The support column 24 extends upward in a substantially perpendicular direction relative to the upper surface of the mounting section 16, and its end is bent upwards toward the mounting section 16. An imaging device 18 is attached to the end of the support column 24.

[0037] Between the output tray 14 and the placement section 16, there is an image forming unit that forms an image of the subject placed on the placement section 16. In other words, above the output tray 14, there is an image forming unit that forms an image on the paper that is ejected into the output tray 14.

[0038] The illumination device 20 is composed of one or more light sources, such as LEDs (Light Emitting Diodes), and is composed of, for example, light sources 20a, 20b, 20c, and 20d. The light sources 20a, 20b, 20c, and 20d are provided on the support column 24. In other words, the light sources 20a, 20b, 20c, and 20d are provided above the mounting section 16.

[0039] Specifically, the light sources 20a and 20b are located near the imaging device 18 and are positioned downward on both sides of the imaging device 18 on the support column 24. The light sources 20c and 20d are located near the operation panel 22 and are positioned diagonally downward on both sides of the support column 24 at the lower end of the operation panel 22.

[0040] In other words, the light sources 20a, 20b and 20c, 20d are positioned at different heights from the mounting section 16. That is, the light sources 20a, 20b, 20c, and 20d are positioned at different angles of light hitting the subject, and are configured to illuminate the document from different directions. This improves the ability to distinguish between the document and the mounting section 16.

[0041] The control panel 22 is equipped with a display screen and is configured for setting the image forming apparatus 10. This control panel 22 is installed on the support column 24 between the mounting section 16 and the imaging device 18, at the rear of the main body of the apparatus 12.

[0042] A document feeder with simultaneous double-sided scanning functionality is provided inside the main body 12 of the device located below the top plate of the mounting section 16. The document feeder can be used by sliding a portion of the top plate of the mounting section 16 in a planar direction.

[0043] Next, the hardware configuration of the image forming apparatus 10 of this embodiment will be described. Figure 2 is a block diagram showing the hardware configuration of the image forming apparatus 10.

[0044] As shown in Figure 2, the image forming apparatus 10 includes a CPU 31, memory 32, storage device 33 such as a hard disk drive, a communication interface (IF) 34 for transmitting and receiving data to and from external devices via a network, a user interface (UI) device 35 including a touch panel or liquid crystal display and keyboard, a scanner 36, a print engine 37, a shooting device 18, and an illumination device 20. These components are connected to each other via a control bus 40.

[0045] The communication interface 34 transmits and receives data to and from external devices. The user interface 35 receives user input. The scanner 36 reads the original document loaded into the image forming apparatus 10 as image data. The print engine 37 prints the image onto a recording medium such as printing paper through processes such as charging, exposure, development, transfer, and fixing.

[0046] The CPU 31 is a processor that controls the operation of the image forming apparatus 10 by executing predetermined processes based on a control program stored in the memory 32 or storage device 33. In this embodiment, the CPU 31 is described as reading and executing a control program stored in the memory 32 or storage device 33, but it is not limited to this. This control program may be provided in the form of a computer-readable recording medium. For example, this program may be provided in the form of a CD (Compact Disc)-ROM (Read Only Memory) or DVD (Digital Versatile Disc)-ROM recorded on an optical disc, or in the form of a USB (Universal Serial Bus) memory or memory card recorded on a semiconductor memory. Alternatively, this control program may be acquired from an external device via a communication line connected to the communication IF 34.

[0047] Next, the functional configuration of the image forming apparatus 10 of this embodiment will be described. Figure 3 is a block diagram showing the functional configuration of the image forming apparatus 10.

[0048] As shown in Figure 3, the image forming apparatus 10 includes a control unit 41, a communication unit 42, a display input unit 43, a storage unit 44, an image reading unit 45, an image forming unit 46, an image output unit 47, an imaging unit 48, and an illumination unit 49.

[0049] The control unit 41 controls the overall operation of the image forming apparatus 10, and for example, based on user input, it controls the shooting unit 48 to take a picture of the original document, and controls the image output unit 47 to output print data such as the original document image.

[0050] The communication unit 42 transmits and receives data with external devices. The display input unit 43 displays various information on the display screen of the operation panel 22 based on control by the control unit 41. The display input unit 43 also inputs various operation information performed by the user on the operation panel 22. The display input unit 43 is an example of a display unit in the technology disclosed herein. The storage unit 44 stores various data, such as image data generated by the control unit 41, in addition to the control program.

[0051] The image reading unit 45 performs scanning operations to read various documents based on control by the control unit 41. The image forming unit 46 forms an image for output from the image output unit 47 based on control by the control unit 41. The image output unit 47 outputs the image formed in the image forming unit 46 onto a recording medium such as printing paper, based on control by the control unit 41.

[0052] The imaging unit 48 photographs the document placed on the placement unit 16 based on control by the control unit 41. The illumination unit 49 irradiates light onto the document placed on the placement unit 16 based on control by the control unit 41.

[0053] The image forming apparatus 10 of this embodiment extracts individual document images from an overall image captured of multiple documents placed on the placement section 16, assigns a page number to each document image, and arranges them in page number order, thereby managing multiple document images as a single document.

[0054] When setting page numbers, the control unit 41 extracts the position coordinates of each document image from the overall image in which multiple documents are photographed, and performs a first process to extract the document image from among the multiple document images included in the overall image in which the distance between the first coordinate axis, which is parallel to the set document arrangement direction based on the origin in the overall image, and the first side, which is the side of the two sides along the arrangement direction that is furthest from the first coordinate axis, is shortest. The control unit 41 then performs a second process to extract other document images that overlap with the line extending the first side of the extracted document image in the arrangement direction as document images of the same group, and performs a third process to set page numbers for each of the extracted document images of the same group in order of proximity to the origin.

[0055] In this embodiment, the control unit 41 may exclude the original document images in the overall image that have page numbers set, and repeat the fourth process, which sequentially executes the first process, the second process, and the third process, until there are no more original document images that do not have page numbers set.

[0056] The following describes in detail the process of setting page numbers for each original image in the overall image using the image forming apparatus 10 of this embodiment. Figures 4 to 13 are diagrams illustrating the process of setting page numbers for each original image.

[0057] In this example, we will explain a case where the origin in the overall image I is the upper left corner when the user is facing the plane on which the document is placed, and the alignment direction is the horizontal direction in the overall image I.

[0058] For example, if 12 originals, from original a to original l, are placed on the mounting unit 16 in two rows of six, with the top left corner of the overall image I as the origin and the horizontal direction as the arrangement, the overall image I captured of these originals will look like the one shown in Figure 4. As shown in Figure 4, the overall image I includes 12 original images, from original image Ia of original a to original image Il of original l.

[0059] As part of the first processing, the control unit 41 first extracts the position coordinates of each document image Ia from the overall image I. Next, the control unit 41 creates a list of information for each document image. This list manages the number of document images included in the overall image I and the position coordinates of each document image.

[0060] Next, as shown in Figure 5, the control unit 41 extracts from among multiple document images Ia included in the overall image I, from among the document images Il, the document image Ic that has the shortest distance between the X-coordinate axis, which is parallel to the set document arrangement direction relative to the origin in the overall image I, and the bottom edge, which is the side furthest from the X-coordinate axis among the two sides (here, the top edge and the bottom edge) along the arrangement direction. Note that the X-coordinate axis is an example of the first coordinate axis in the technology of this disclosure. The bottom edge is also an example of the first edge in the technology of this disclosure.

[0061] Next, as shown in Figure 6, the control unit 41 performs a second process to extract the other document images Ia, Ib, Id, Ie, and If, which overlap with the line extending horizontally from the lower edge of the extracted document image Ic in the direction of alignment, as document images of the same group G.

[0062] Next, as shown in Figure 7, the control unit 41 performs a third process to set page numbers for each of the extracted original images in the same group, in order of proximity to the origin. In this process, page 1 is set for original image Ia, page 2 for original image Ib, page 3 for original image Ic, page 4 for original image Id, page 5 for original image Ie, and page 6 for original image If.

[0063] Next, as part of the fourth process, as shown in Figure 8, the control unit 41 excludes document image If from document images Ia to document images Il included in the overall image I, from document image Ia to document image If, ​​which has a page number set. The control unit 41 also removes the information of the document images with page numbers set from the list.

[0064] Next, the control unit 41 executes the first process, the second process, and the third process in order as part of the fourth process.

[0065] Specifically, as shown in Figure 9, the control unit 41 performs a first process to extract from the remaining multiple document images Ig included in the overall image I, the document image Ih, from among the document images Il, the document image Ih that has the shortest distance between the X-coordinate axis, which is parallel to the set document arrangement direction relative to the origin in the overall image I, and the lower side, which is the side furthest from the X-coordinate axis among the two sides (here, the upper side and the lower side) along the arrangement direction.

[0066] Next, as shown in Figure 10, the control unit 41 performs a second process to extract other document images Ig, Ii, Ij, Ik, and Il that overlap with the line extending horizontally from the lower edge of the extracted document image Ih in the direction of alignment, as document images of the same group G.

[0067] Next, as shown in Figure 11, the control unit 41 performs a third process to set page numbers for each of the extracted document images in the same group, in order of proximity to the origin. In this process, page 7 is set for document image Ig, page 8 for document image Ih, page 9 for document image Ii, page 10 for document image Ij, page 11 for document image Ik, and page 12 for document image Il.

[0068] The control unit 41 repeats the fourth process described above until there are no more document images without page numbers assigned, that is, until there is no more information about document images registered in the list. In this example, as shown in Figure 12, since a page number has been assigned to document image Il, there are no more document images without page numbers assigned, so the process ends here.

[0069] Through the above process, even if multiple documents are placed on the placement unit 16 in a disorganized state, page numbers will be correctly assigned to all document images Ia through Il according to the set arrangement direction, as shown in Figure 13.

[0070] Alternatively, the control unit 41 may set page numbers for all original images Ia through Il, and then arrange the original images in the set page order to create a document.

[0071] In this embodiment, as shown in Figure 14, the control unit 41 may consider the original image Im to be a rectangle R having sides parallel to the alignment direction if the original image is rectangular but does not have sides parallel to the alignment direction.

[0072] Furthermore, as shown in Figure 15, if the original image In is not rectangular, the control unit 41 may consider the shape of the original image as a rectangle R having sides that are tangent to the outer periphery of the original image and parallel to the alignment direction.

[0073] Furthermore, the control unit 41 may change at least one setting of the origin position and alignment direction in the overall image I, in accordance with user instructions.

[0074] In this case, the control unit 41 may change the position of the origin in the overall image I to one of the following settings in response to user instructions: a first setting where the position of the origin in the overall image I is set to the upper left when the user is facing the plane on which the document is placed, and the alignment direction is the horizontal direction in the overall image I; a second setting where the position of the origin in the overall image I is set to the upper left when the user is facing the plane on which the document is placed, and the alignment direction is the vertical direction in the overall image I; a third setting where the position of the origin in the overall image I is set to the upper right when the user is facing the plane on which the document is placed, and the alignment direction is the horizontal direction in the overall image I; and a fourth setting where the position of the origin in the overall image I is set to the upper right when the user is facing the plane on which the document is placed, and the alignment direction is the vertical direction in the overall image I.

[0075] The process for setting page numbers for each original document image in the overall image I, when using the first setting, that is, the arrangement starting from the top left and arranged horizontally, is as described above.

[0076] The process for setting page numbers for each document image in the second configuration, namely the configuration with the images arranged vertically starting from the top left, will be explained in detail. Figures 16 to 25 are diagrams illustrating the process for setting page numbers for each document image in the overall image I.

[0077] For example, if 12 originals, from original a to original l, are placed on the mounting unit 16 in six rows of two, with the top left corner of the overall image I as the origin and the vertical direction as the arrangement, the overall image I captured by photographing these originals will look like the one shown in Figure 16.

[0078] As part of the first process, the control unit 41 first extracts the position coordinates of each document image Ia from the overall image I. Next, the control unit 41 lists the information of each document image. Then, as shown in Figure 17, as part of the first process, the control unit 41 extracts from the multiple document images Ia included in the overall image I the document image Il that has the shortest distance between the Y-coordinate axis, which is parallel to the set document arrangement direction relative to the origin in the overall image I, and the right side, which is the side furthest from the Y-coordinate axis among the two sides (here, the left side and the right side) along the arrangement direction. Note that the Y-coordinate axis is an example of the first coordinate axis in the technology of this disclosure. Also, the right side is an example of the first side in the technology of this disclosure.

[0079] Next, as shown in Figure 18, the control unit 41 performs a second process in which it extracts other document images Ib that overlap with a line extending the right-hand side of the extracted document image Ia in the vertical direction, which is the alignment direction, as document images of the same group G.

[0080] Next, as shown in Figure 19, the control unit 41 performs a third process to assign page numbers to each of the extracted document images in the same group, in order of proximity to the origin. In this process, page 1 is assigned to document image Ia, and page 2 is assigned to document image Ib.

[0081] Next, as part of the fourth process, as shown in Figure 20, the control unit 41 excludes document images Ia and Ib, which have page numbers set, from the document images Il included in the overall image I. The control unit 41 also removes the information of the document images with page numbers set from the list.

[0082] Next, the control unit 41 executes the first process, the second process, and the third process in order as part of the fourth process.

[0083] Specifically, as shown in Figure 21, the control unit 41 performs a first process to extract from the remaining multiple document images Ic included in the overall image I, from among the document images Il, the document image Id that has the shortest distance between the Y-coordinate axis, which is parallel to the set document arrangement direction relative to the origin in the overall image I, and the right side, which is the side furthest from the Y-coordinate axis among the two sides (in this case, the left side and the right side) along the arrangement direction.

[0084] Next, as shown in Figure 22, the control unit 41 performs a second process in which it extracts other document images Ic that overlap with a line extending the right-hand side of the extracted document image Id in the vertical direction, which is the alignment direction, as document images of the same group G.

[0085] Next, as shown in Figure 23, the control unit 41 performs a third process to set page numbers for each of the extracted original images in the same group, in order of proximity to the origin. In this process, page 3 is set for original image Ic, and page 4 is set for original image Id.

[0086] The control unit 41 repeats the fourth process described above until there are no more document images without page numbers assigned, that is, until there is no more information about document images registered in the list. In this example, as shown in Figure 24, once a page number has been assigned to document image Id, document images Ie through Il, which do not have page numbers assigned, remain. Therefore, the control unit 41 repeats the fourth process described above until there are no more document images without page numbers assigned, and then terminates the process.

[0087] As a result of the above process, even if multiple documents are placed on the placement unit 16 in a disorganized state, page numbers will be correctly assigned to all document images Ia through Il according to the set arrangement direction, as shown in Figure 25.

[0088] The process for setting page numbers for each original document image in the overall image I when using the third setting, namely the configuration where the images are arranged horizontally starting from the upper right, will be explained in detail. Figure 26 is a diagram illustrating the overall image I and the page number setting configuration in the third setting.

[0089] For example, if 12 documents, from document a to document l, are placed on the mounting unit 16 in two rows, with the upper right corner of the overall image I as the origin and the horizontal direction as the arrangement, the overall image I of these documents will look like the one shown in Figure 26. Note that Figure 26 also displays the page numbers.

[0090] The process for setting page numbers in the third setting is basically the same as the process for the first setting. Comparing the process for the third setting with the process for the first setting, the only difference is that when setting page numbers for each of the extracted original images in the same group, in order of proximity to the origin, the page numbers are set from the right.

[0091] In the third setting, as shown in Figure 26, the page numbers are set horizontally, starting from the top right.

[0092] The process for setting page numbers for each document image in the overall image I when using the fourth setting, namely the configuration with the images arranged vertically starting from the upper right, will be explained in detail. Figure 27 is a diagram illustrating the overall image I and the page number setting configuration in the fourth setting.

[0093] For example, if 12 documents, from document a to document l, are placed on the mounting unit 16 in 6 columns, with the upper right corner of the overall image I as the origin and the vertical direction as the arrangement, the overall image I of these documents will look like Figure 27. Note that Figure 27 also displays the page numbers.

[0094] The process for setting page numbers in the fourth setting is basically the same as the process for the second setting. Comparing the processes for the fourth setting and the second setting, the only difference is that when extracting original images from the same group G, the extraction starts from the right.

[0095] In the fourth setting, as shown in Figure 27, the page numbers are set vertically, starting from the top right.

[0096] Furthermore, as shown in Figure 13, the control unit 41 may also display the page number set for each original document image in the overall image I.

[0097] In this case, the control unit 41 can move each document image in the overall image I according to the user's instructions, and may also reset the page number of each document image according to the movement of each document image.

[0098] For example, suppose a user places 12 documents, from document a to document l, on the placement unit 16 in two rows, with the top left corner of the overall image I as the origin and the horizontal direction as the arrangement direction, as shown in Figure 28.

[0099] At this time, since document d is significantly misaligned with documents a, b, c, e, and f, the control unit 41 considers that the 12 documents are placed across 3 rows and sets the page numbers as shown in Figure 28.

[0100] Specifically, page 1 is set for document image Ia, page 2 for document image Ib, page 3 for document image Ic, page 4 for document image Ie, and page 5 for document image If. Additionally, page 6 is set for document image Id. Furthermore, page 7 is set for document image Ig, page 8 for document image Ih, page 9 for document image Ii, page 10 for document image Ij, page 11 for document image Ik, and page 12 for document image Il.

[0101] In such an overall image I, as shown in Figure 29, the original document image Id is moved upward in the Y-axis direction so that it overlaps with the original document a, etc., at the user's instruction. The instructions for moving each original document image in the overall image I can be obtained in any manner, for example, by displaying the overall image I on the operation panel 22, which serves as the display input unit 43, and receiving instructions from the user to move each original document image on the operation panel 22.

[0102] When the control unit 41 detects movement of the original image Id, it re-executes the page number setting process for each original image and resets the page numbers. As a result, as shown in Figure 29, page 1 is set for original image Ia, page 2 for original image Ib, page 3 for original image Ic, page 4 for original image Id, page 5 for original image Ie, and page 6 for original image If.

[0103] Furthermore, the control unit 41 may, as an example shown in Figure 30, display a composite image Is in which each original document image is arranged in the order of the page numbers set for each original document image. Here, "an image in which each original document image is arranged in the order of the page numbers set for each original document image" means an image in which each original document image is arranged in the order of its page number to form a single image, and any such image can be in any form.

[0104] The aggregate image Is may, for example, be configured such that the number of rows and columns of the original images in the aggregate image Is matches the arrangement of the original documents, as shown in Figure 30. Alternatively, the aggregate image Is may be configured such that the original images are arranged in one row in order of page number, as shown in Figure 31.

[0105] Next, the process of setting page numbers for each document image in the overall image will be explained with reference to the flowchart in Figure 32. Here, we will explain an example where the origin of the overall image is the top left corner when the user is facing the plane on which the document is placed, and the arrangement direction is the horizontal direction of the overall image.

[0106] First, in step S11, the control unit 41 photographs multiple documents arranged in a matrix and acquires an overall image.

[0107] Next, in step S12, the control unit 41 extracts the position coordinates of each document image from the overall image.

[0108] Next, in step S13, if there is a document image that is rectangular but has no sides parallel to the alignment direction, or a document image that is not rectangular, the control unit 41 extracts the coordinates of a rectangle (i.e., a circumscribed rectangle) that is tangent to the outer periphery of the document image and has sides parallel to the alignment direction.

[0109] Next, in step S14, the control unit 41 lists the information of each original image.

[0110] Next, in step S15, the control unit 41 extracts the document image in which the distance between the X-coordinate axis, which is parallel to the set document arrangement direction with respect to the origin in the overall image, and the lower side, which is the side furthest from the X-coordinate axis among the two sides (in this case, the upper side and the lower side) along the arrangement direction, is the shortest.

[0111] Next, in step S16, the control unit 41 extracts other document images that overlap with a line extending horizontally from the bottom edge of the extracted document image, which is the direction of alignment, and in step S17, sets the extracted document images as document images of the same group.

[0112] Next, in step S18, the control unit 41 assigns page numbers to each of the original images in the same group, in order of proximity to the origin.

[0113] Next, in step S19, the control unit 41 deletes the original document images of the same group from the list, that is, the original document images for which page numbers have been set.

[0114] Next, in step S20, the control unit 41 determines whether or not there is a document image remaining in the list.

[0115] If it is determined in step S20 that there is still an image of the original document in the list, the control unit 41 proceeds to step S15 and re-executes the processes from step S15 to step S19.

[0116] If it is determined in step S20 that there are no original document images remaining in the list, the control unit 41 arranges the original document images in the page order set in step S21 to create a document and then terminates the process.

[0117] [Differentiation] Although an image forming apparatus according to one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment and can be modified as appropriate.

[0118] In each of the embodiments described above, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0119] Furthermore, the processor operations in each of the above embodiments may not be performed by a single processor, but may also be performed by multiple processors located in physically separate locations working together. Also, the order of the processor operations is not limited to the order described in each of the above embodiments, and may be changed as appropriate.

[0120] Furthermore, although the above embodiment described the application of the present invention to a multifunction printer as an image forming apparatus, the present invention is not limited to this and can also be applied to various image processing devices such as scanners.

[0121] [Note] The following are preferred forms of this disclosure.

[0122] (((1))) Equipped with a processor, The aforementioned processor, Extract the position coordinates of each document image from the overall image in which multiple documents were photographed. A first process is performed to extract from among multiple original document images included in the overall image the original document image in which the distance between a first coordinate axis parallel to the direction of arrangement of the original documents set with respect to the origin in the overall image, and a first side which is the side furthest from the first coordinate axis among two sides along the direction of arrangement, is shortest. A second process is performed to extract other original images that overlap with the line obtained by extending the first edge of the extracted original image in the direction of arrangement, as original images of the same group. A third process is performed to assign page numbers to each of the extracted original images in the same group, in order of proximity to the origin. Image processing device.

[0123] (((2))) The aforementioned processor, The fourth process, which involves excluding the original document images with page numbers set from the original document images included in the overall image, and then sequentially executing the first process, the second process, and the third process, is repeated until there are no more original document images without page numbers set. The image processing device described in (((1))).

[0124] (((3))) The aforementioned processor, If the original image is rectangular but does not have any sides parallel to the direction of arrangement, or if the original image is not rectangular, the shape of the original image shall be considered as a rectangle having sides that are tangent to the outer perimeter of the original image and parallel to the direction of arrangement. The image processing apparatus described in (((1))) or (((2))).

[0125] (((4))) The aforementioned processor, In response to user instructions, the system changes the position of the origin in the overall image and at least one of the alignment directions. An image processing apparatus as described in any one of items (((1))) to (((3))).

[0126] (((5))) The aforementioned processor, In accordance with the user's instructions, The first setting is that the origin in the overall image is the upper left corner when the user faces the plane on which the document is placed, and the direction of arrangement is the horizontal direction in the overall image. A second setting where the origin in the overall image is the upper left corner when the user faces the plane on which the document is placed, and the orientation is the vertical direction in the overall image. A third setting where the origin in the overall image is set to the upper right when the user is facing the plane on which the document is placed, and the alignment direction is set to the horizontal direction in the overall image, and, The origin of the overall image is set to the upper right corner when the user is facing the plane on which the document is placed, and the alignment direction is set to the vertical direction in the overall image. This setting is then changed to one of the fourth settings. The image processing device described in (((4))).

[0127] (((6))) The aforementioned processor, In the overall image, the page numbers assigned to each original document image are displayed accordingly. An image processing apparatus as described in any one of items (((1))) to (((5))).

[0128] (((7))) The aforementioned processor, It is possible to move individual document images within the overall image according to the user's instructions. The page number for each document image is reset as each document image is moved. The image processing device described in (((6))).

[0129] (((8))) The aforementioned processor, This displays an image in which each original document image is arranged in the order of the page numbers assigned to each original document image. An image processing apparatus as described in any one of items (((1))) to (((5))).

[0130] (((9))) The steps include: extracting the position coordinates of each document image from an overall image containing multiple documents; The first step is to extract from among multiple original images included in the overall image the original image image in which the distance between a first coordinate axis parallel to the direction of arrangement of the originals set with respect to the origin in the overall image and a first side which is the side of two sides along the direction of arrangement that is furthest from the first coordinate axis is the shortest distance, The process involves performing a second step of extracting other original images that overlap with a line extending the first edge of the extracted original image in the direction of alignment, as original images of the same group. A third step is to perform a process in which page numbers are assigned to each of the extracted original images in the same group in order of proximity to the origin, A program that causes a computer to execute something.

[0131] The effects of the configuration described below are explained below.

[0132] According to the image processing device (((1))), even when multiple documents are placed in a disorganized, linear arrangement, page numbers can be set correctly.

[0133] According to the image processing device (((2))), page numbers can be set more accurately compared to the case where the first, second, and third processes are performed only once.

[0134] According to the image processing device (((3))), page numbers can be set even when a rectangular document is placed at an angle to the alignment direction, or when the document is of a shape other than a rectangle.

[0135] According to the image processing device (((4))), the method for setting page numbers can be changed to suit the situation when the user places multiple documents.

[0136] The image processing device (((5))) can accommodate the case in which a user typically places multiple documents.

[0137] According to the image processing device (((6))), the user can be made aware of the set page number.

[0138] According to the image processing device (((7))), even if the placement of the original document is so distorted that the page numbers cannot be set correctly, the user can adjust the position of the document on the overall image.

[0139] According to the image processing device (((8))), the user can be made aware of the set page number.

[0140] According to the program (((9))), even if multiple manuscripts are arranged in a disorganized row, page numbers can be set correctly. [Explanation of symbols]

[0141] 10 Image forming apparatus 12 Main unit of the device 14. Discharge tray 16 Mounting section 18. Imaging device 20 Irradiation device 22 Control Panel 24 Posts 31 CPU 32 memory 33 Storage device 34 Communication Interfaces 35 User Interface Device 36 Scanners 37 Print Engine 40 Control bus 41 Control Unit 42 Communications Department 43 Display Input Section 44 Storage section 45 Image reading unit 46 Image forming unit 47 Image output section 48 Photography Department 49 Irradiation area

Claims

1. Equipped with a processor, The aforementioned processor, Extract the position coordinates of each document image from the overall image in which multiple documents were photographed. A first process is performed to extract from among multiple original document images included in the overall image the original document image in which the distance between a first coordinate axis parallel to the direction of arrangement of the original documents set with respect to the origin in the overall image, and a first side which is the side of the two sides along the arrangement direction that is furthest from the first coordinate axis, is shortest. A second process is performed to extract other original images that overlap with the line obtained by extending the first edge of the extracted original image in the direction of arrangement, as original images of the same group. A third process is performed to assign page numbers to each of the extracted original images in the same group, in order of proximity to the origin. Image processing device.

2. The aforementioned processor, The fourth process, which involves excluding the original document images with page numbers set from the original document images included in the overall image, and then sequentially executing the first process, the second process, and the third process, is repeated until there are no more original document images without page numbers set. The image processing apparatus according to claim 1.

3. The aforementioned processor, If the original image is rectangular but does not have any sides parallel to the direction of arrangement, or if the original image is not rectangular, the shape of the original image shall be considered as a rectangle having sides that are tangent to the outer perimeter of the original image and parallel to the direction of arrangement. The image processing apparatus according to claim 1 or 2.

4. The aforementioned processor, In response to user instructions, the origin position in the overall image and at least one of the alignment directions are changed. The image processing apparatus according to claim 1 or 2.

5. The aforementioned processor, In accordance with the user's instructions, The first setting is that the origin in the overall image is the upper left corner when the user faces the plane on which the document is placed, and the direction of arrangement is the horizontal direction in the overall image. A second setting where the origin in the overall image is the upper left corner when the user faces the plane on which the document is placed, and the orientation is the vertical direction in the overall image. A third setting where the origin in the overall image is set to the upper right when the user is facing the plane on which the document is placed, and the alignment direction is set to the horizontal direction in the overall image, and The origin of the overall image is set to the upper right corner when the user is facing the plane on which the document is placed, and the alignment direction is set to the vertical direction in the overall image. This setting is then changed to one of the fourth settings. The image processing apparatus according to claim 4.

6. The aforementioned processor, In the overall image, the page numbers assigned to each original document image are displayed accordingly. The image processing apparatus according to claim 1 or 2.

7. The aforementioned processor, It is possible to move individual document images within the overall image according to the user's instructions. The page number for each document image is reset as each document image is moved. The image processing apparatus according to claim 6.

8. The aforementioned processor, This displays an image in which each original document image is arranged in the order of the page numbers assigned to each original document image. The image processing apparatus according to claim 1 or 2.

9. The steps include: extracting the position coordinates of each document image from an overall image containing multiple documents; The first step is to extract from among multiple original images included in the overall image the original image image in which the distance between a first coordinate axis parallel to the direction of arrangement of the originals set with respect to the origin in the overall image and a first side which is the side of two sides along the direction of arrangement that is furthest from the first coordinate axis is the shortest distance, The process involves performing a second step of extracting other original images that overlap with a line extending the first edge of the extracted original image in the direction of arrangement, as original images of the same group. A third step is to perform a process in which page numbers are assigned to each of the extracted original images in the same group in order of proximity to the origin, A program that causes a computer to execute something.

Images