Image processing device and method for determining multi-cropped image

Abstract

To group multi-cropped original images according to a user's intention by a simple process based on the arrangement of each original placed on an original table, not on the contents of the original images.SOLUTION: An image processing device includes an image reading unit that reads multiple originals placed on a document table at once, a multi-crop processing unit that cuts out original images corresponding to each of the originals from the read image, a group determination unit that determines whether there are other original images placed closer to each of the original images than a predetermined standard, and determines a group of original images that are determined to be placed closely together as one group, and a data output unit that outputs data of each of the original images determined to belong to the same group in a manner that makes it distinguishable from data of other groups or original images that do not belong to any group.SELECTED DRAWING: Figure 16

Description

[Technical field]

[0001] The present disclosure relates to an image processing device capable of multi-cropping and a method for determining a multi-cropped image. [Background technology]

[0002] When scanning small documents such as business cards, postcards, and other cards, photographs, and the like, a multi-crop process is known in which multiple documents are placed side by side on a document table, scanned, and images corresponding to each document are extracted. The order in which the data of images that have undergone multi-crop processing is output is not fixed, and the initial page order must be determined immediately after extraction. It is possible to change the output order using a page editing function for files in a PC application. However, if the initial page order is not what the user desires, changing the output order can be very time-consuming.

[0003] In view of this, a method has been proposed in which an initial order is presented and the user can change the order when multiple documents arranged on a document table are read and converted into one file (see, for example, Patent Document 1). According to this method, an image processing device includes a reading means for reading multiple documents placed on a document table and generating image data, and an acquisition means for acquiring image data for each document from the image data generated by the reading means. The image processing device also includes a determination means for determining a page order based on geometric information of the images acquired by the acquisition means, and a file generation means for rearranging the page order determined by the determination means and creating one file from the image data for each document. As geometric information, position coordinates (top left coordinates, top right coordinates, etc.) where each document was located on the read image and image area of ​​each document image are disclosed. Furthermore, similarity of the images of each document is disclosed. It is described that similarity may be determined using known techniques such as difference images, histograms, average pixel values, or the aHash method. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-074180 A Summary of the Invention [Problem to be solved by the invention]

[0005] According to the method described in Patent Document 1, documents randomly placed on the document tray are read during multi-crop processing. In this case, in addition to the multi-crop processing that cuts out the document image, processing is required to obtain the geometric information and image similarity of each document image. For this reason, it is necessary to perform image processing such as investigating geometric information such as area and pattern matching, which makes the processing to achieve this complicated. On the other hand, users who place each document on the document tray often place documents that have already been classified to a certain extent on the document tray. For example, in the case of business cards, multiple business cards obtained at the same time on the same day are obtained from attendees of the same meeting, and those of the same business partner or related business partners are often stored together. One method is to perform all processing for grouping on the image processing device side. However, another method is to have the user place each document on the document tray according to their intention, and the image processing device classifies each document according to the user's intention.

[0006] The present disclosure has been made in consideration of the above circumstances, and provides a method for grouping multi-cropped original images in accordance with a user's intentions using simple processing based on the arrangement of each original placed on a platen, rather than processing based on the content of the original image. [Means for solving the problem]

[0007] The present disclosure provides an image processing device including an image reading unit that reads multiple originals placed on a document tray at the same time, a multi-crop processing unit that cuts out original images corresponding to each original from the read image, a group determination unit that determines whether there are other original images placed closer to each original image than a predetermined standard and determines a group of original images that are determined to be placed closely together as one group, and a data output unit that outputs data of each original image determined to belong to the same group in a manner that is distinguishable from data of other groups or original images that do not belong to any group.

[0008] Also, from a different viewpoint, the present disclosure provides a method for determining a multi-cropped image, the method including the steps of: a control unit of an image processing device using an image reading unit to read multiple documents placed on a document table all at once; performing a multi-crop process to cut out document images corresponding to each document from the read image; determining whether there are other document images placed closer to each document image than a predetermined standard, and determining a group of document images determined to be placed closely as one group; and outputting data of each document image determined to belong to the same group in a manner distinguishable from data of other groups or document images not belonging to any group. Effect of the Invention

[0009] The image processing device according to the present disclosure includes a group determination unit that determines whether there are other original images placed closer to each original image than a predetermined standard, and determines a group of original images that are determined to be placed close to each other as one group, and a data output unit that outputs data of each original image determined to belong to the same group in a manner that is distinguishable from data of other groups or original images that do not belong to any group.Therefore, multi-cropped original images can be grouped according to the user's intentions by simple processing based on the arrangement of each original placed on the platen, rather than processing based on the content of the original images. The method of determining a multi-cropped image according to the present disclosure also achieves the same effects. [Brief description of the drawings]

[0010] [Figure 1] 1 is an explanatory diagram showing an example of a usage environment of a multifunction peripheral, which is one aspect of an image processing apparatus, according to an embodiment of the present disclosure; [Diagram 2] 2 is an external perspective view showing the vicinity of an image reading unit of the multifunction peripheral shown in FIG. 1. [Diagram 3] 3 is a block diagram showing an example of a hardware configuration of the multifunction peripheral shown in FIGS. 1 and 2. FIG. [Figure 4] 4 is a block diagram showing a functional configuration of a control unit shown in FIG. 3. [Diagram 5] 5 is a first flowchart showing a process flow in which the control unit shown in FIGS. 3 and 4 executes a scan job using a multi-crop function in the embodiment. [Figure 6] 5 is a second flowchart showing the flow of processing in which the control unit shown in FIGS. 3 and 4 executes a scan job using a multi-crop function in the embodiment. [Figure 7] 5 is a third flowchart showing the flow of processing in which the control unit shown in FIGS. 3 and 4 executes a scan job using a multi-crop function in the embodiment. [Figure 8] 11 is an explanatory diagram showing an example of a group process selection screen that a control unit causes an operation unit to display in the embodiment; FIG. [Figure 9] 11 is an explanatory diagram showing an example of a document type selection screen that the control unit causes the operation unit to display in the embodiment; FIG. [Figure 10] 11 is an explanatory diagram showing an example of a document arrangement screen that a control unit causes an operation unit to display in the embodiment; FIG. [Figure 11] 1 is an explanatory diagram showing a state in which an original to be read by applying a multi-crop function is placed on an original platen in an embodiment. FIG. [Figure 12] 5 is an explanatory diagram showing a method for determining the positions of the centers of gravity of each document image and the distance between the centers of gravity in an embodiment; FIG. [Figure 13]12 is an explanatory diagram showing an example of an image obtained by collectively reading the originals shown in FIG. 11. FIG. [Figure 14] 14 is an explanatory diagram showing an example of determining the proximity state based on the distance between the centers of gravity of adjacent documents in the X and Y directions in the batch scanned image shown in FIG. 13. FIG. [Figure 15] 15 is an explanatory diagram showing a result of determining that a group of document images in which proximity states are linked belong to the same group, based on the determination result shown in FIG. 14. FIG. [Figure 16] 11 is an explanatory diagram showing an example of a group confirmation screen that a control unit causes an operation unit to display in the embodiment; FIG. [Figure 17] 16 is an explanatory diagram showing the result of outputting document images belonging to the same group with file names having consecutive numbers based on the determination result shown in FIG. 15. FIG. [Figure 18] 16 is an explanatory diagram showing the result of outputting document images belonging to the same group with file names including the group identifiers based on the determination result shown in FIG. 15. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] The present disclosure will be described in further detail below with reference to the drawings. Note that the following description is illustrative in all respects and should not be construed as limiting the present disclosure. Configuration of the image processing device FIG. 1 is an explanatory diagram showing an example of a usage environment of a multifunction peripheral, which is one embodiment of an image processing apparatus, and FIG. 2 is an external perspective view showing the vicinity of an image reading unit of the multifunction peripheral shown in FIG. As shown in FIG. 1, the multifunction device 10 communicates with personal computers (hereinafter referred to as PCs) connected to the network 11 and used by a plurality of users. The network 11 is, for example, an intranet installed within the premises of a business entity, and the PC 12 is used by user A, the PC 13 is used by user B, and the PC 14 is used by user C. Users A, B, and C use the multifunction device 10 through their respective PCs or by using the operation unit of the multifunction device 10. For example, user A places a plurality of documents to be read using the multi-crop function on the document table of the multifunction device 10, and operates the PC 12 to execute a so-called pull scan job, thereby allowing the images of each document cut out by the multi-crop process to be stored in the PC 12. Alternatively, the operation unit of the multifunction device 10 is operated to specify the PC 12 as the output destination, and a so-called push scan job involving the multi-crop process is executed, allowing the images of each document to be stored in the PC 12.

[0012] As shown in FIG. 2, the multifunction device 10 includes an image reading unit 20 for reading an image of an original, a transparent document table 22, a document feeder 23, and a transparent document reading unit 24. The image reading unit 20 includes a scanning mechanism, an image sensor, and an image processing circuit. The document placed on the transparent document table 22 is operated by the scanning mechanism, and the lower surface of the document is read by the image sensor and processed by the image processing circuit to generate image data. The document feeder 23 can be closed so as to cover the document reading unit 24 and the document table 22 around a hinge at the back, and conveys the set documents one by one to the document reading unit 24. In this case, the image reading unit 20 reads the lower surface of the document passing through the transparent document reading unit 24 with the image sensor to generate image data. When a scan job using the multi-crop function is executed, multiple documents are read on the document table 22. The multifunction device 10 includes an operation unit 25 on the front side of the document table 22. The operation unit 25 includes a display 25D using, for example, a liquid crystal panel and a touch sensor 25S such as a transparent touch panel arranged on the surface of the display 25D.

[0013] Fig. 3 is a block diagram showing an example of the hardware configuration of the multifunction machine shown in Fig. 1 and Fig. 2, and Fig. 4 is a block diagram showing the functional configuration of the control unit shown in Fig. 3. As shown in Fig. 3, the multifunction machine 10 includes an image reading unit 20, an operation unit 25, a control unit 30, an auxiliary storage unit 32, a communication unit 33, an image forming unit 34, and a paper supply and transport unit 35.

[0014] The control unit 30 is an example of a control means that controls the overall control of the multifunction device 10. For this reason, the control unit 30 has a processor 30P as a control execution means of the multifunction device 10. In addition, the control unit 30 has a main memory unit 30M as a storage means that the processor 30P can directly access. The main memory unit 30M includes a read only memory (ROM) and a random access memory (RAM), not shown. The ROM stores a control program executed by the processor. The RAM provides a working area and a buffer area when the processor 30P executes processing based on the control program. The hardware resources of the control unit 30, centered on the processor 30P and the main memory unit 30M, and the software of the control program are organically combined to realize the function of the control unit 30. The auxiliary memory unit 32 is a storage means having a larger capacity than the main memory unit 30M, and is applied with a hard disk drive or a solid state drive (SSD). The auxiliary storage unit 32 stores various data such as image data of the document read by the image reading unit 20 and data related to a print job received from the external PCs 12 to 14. The data related to the print job includes print data. The communication unit 33 is an interface circuit that handles communication with external devices such as the PCs 12 to 14 connected via the network 11.

[0015] The image forming unit 34 is disposed below the image reading unit 20, and forms an image based on the image data and print data described above, and prints it on a print sheet. This image formation is performed, for example, by a known electrophotographic method. For this purpose, the image forming unit 34 includes a photoconductor drum, a charging device, an exposure device, a developing device, a transfer device, a fixing device, a cleaning device, a charge removing device, and the like, which are not shown. Note that the image forming unit 34 is not limited to the electrophotographic method, and may perform image formation processing, for example, by an inkjet method. The paper supply transport unit 35 has one or more paper feed trays (not shown in FIG. 2) disposed below the image forming unit 34. The paper feed tray transports the print sheet stored in the paper feed tray to the image forming unit 34. The image forming unit 34 transfers the formed image onto the print sheet using a transfer device. The paper supply transport unit 35 further transports the print sheet onto which the image has been transferred, and leads it to the paper discharge tray 34E.

[0016] As shown in FIG. 4, the control unit 30 functionally includes an operation control unit 41, a reading control unit 42, a print control unit 43, a job management unit 44, a multi-crop processing unit 45, a group determination unit 46, and a data output unit 47. The operation control unit 41 performs processing related to the control of the operation unit 25. The reading control unit 42 performs control related to the image reading unit 20. The print control unit 43 performs control related to the image forming unit 34 and the paper supply transport unit 35. The job management unit 44 performs processing related to the setting and execution of jobs such as a scan job, a print job, and a copy job received from the PCs 12 to 14 via the operation unit 25 and the communication unit 33. The multi-crop processing unit 45 performs processing related to the clipping of each document image in a job using the multi-crop function of this embodiment. The group determination unit 46 performs processing related to group determination of each document image in a job using the above-mentioned multi-crop function. The data output unit 47 performs processing related to the output of data of each document image clipped in a job using the above-mentioned multi-crop function.

[0017] <Flowchart> 5 to 7 are flowcharts showing a series of processing steps when the control unit 30 shown in FIG. 3 and FIG. 4 executes a scan job using the multi-crop function. Here, the processing steps will be described with reference to the flowcharts, taking as an example a case where a so-called push scan job to which the multi-crop function is applied is executed by operating the operation unit 25 of the multi-function device 10. A pull scan job differs from a push scan in that the operation is performed on the side of the PC that receives the output data, but the operation flow is basically the same as that of the push scan. As shown in FIG. 5, when a scan job using the multi-crop function is selected (Yes in step S11), the control unit 30 as the operation control unit 41 displays a group processing selection screen on the operation unit 25 to accept the user's selection of whether or not to perform grouping (step S13). Note that the flow chart in FIG. 5 omits descriptions related to settings related to the scan job other than the grouping process for the sake of simplicity, but these settings are also accepted appropriately in the same manner as the selection of the grouping process.

[0018] FIG. 8 is an explanatory diagram showing an example of a group selection screen that accepts a selection of whether or not to group the read documents. The control unit 30 as the operation control unit 41 displays a group processing selection screen 80 shown in FIG. 8 on the operation unit. A [Yes] key 81 and a [No] key 82 are arranged on the group processing selection screen 80, and waits for any operation key to be operated (a loop returning to step S13 via No in step S15 and No in S16). If the [No] key 82 is operated (Yes in step S16), the control unit 30 as the operation control unit 41 advances the process to step S71 shown in FIG. 7 and executes a normal multi-crop process that does not perform grouping. That is, the control unit 30 as the reading control unit 42 collectively scans the entire surface of the document table 22 to obtain a collective scan image including images of the multiple documents placed on the document table. The control unit 30 as the multi-crop processing unit 45 cuts out the images of each document from the collective scan image (step S71). In the case of multi-crop processing, scanning is performed with the document cover open so that the multi-crop processing unit 45 can determine the cut-out area of ​​each document. The control unit 30 as the multi-crop processing unit 45 cuts out each document image from the batch scanned image and determines the center of gravity of each document image in the batch scanned image. Then, for example, the order of arrangement of each document image is determined so that the centers of gravity are arranged from the left to the right and from the top to the bottom of the document table 22 (step S73). The control unit 30 as the data output unit 47 sends each document image to the output destination PC in the determined order, giving it a file name with, for example, a consecutive number (step S75), and ends the job.

[0019] On the other hand, if the [Yes] key 81 on the group processing selection screen 80 is operated (Yes in step S15), the control unit 30 as the operation control unit 41 advances the process to step S17, and displays a screen (document type selection screen) for accepting the selection of the document type on the operation unit 25 to accept the user's selection (step S17). FIG. 9 is an explanatory diagram showing an example of the document type selection screen for accepting the selection of the document type. The document type selection screen 90 has a [Business card (horizontal)] key 91, a [Business card (vertical)] key 92, a [Postcard (horizontal)] key 93, a [Postcard (vertical)] key 94, and a [Cancel] key 95 arranged thereon. The control unit 30 as the operation control unit 41 waits for any of the operation keys to be operated (a loop returning to step S21 via No in step S21, No in S23, No in step S25, No in S27, and No in S29).

[0020] For example, when the [Business Card (landscape)] key 91 is operated (Yes in step S21), the control unit 30 as the operation control unit 41 causes the operation unit 25 to display an original arrangement screen showing how to place the selected type of original on the original table 22 (step S22). FIG. 10 is an explanatory diagram showing an example of an original arrangement screen 100 displayed when a business card (landscape) original is selected. As shown in FIG. 10, the original arrangement screen 100 includes an original arrangement illustration area 101. The original arrangement illustration area 101 is an area showing by illustrations that when placing business card originals side by side on the original table 22, the business cards to be grouped should be placed at a predetermined interval in each of the vertical and horizontal directions (i.e., the Y direction and the X direction). The original arrangement screen 100 includes not only the original arrangement illustration area 101 but also verbal explanations.

[0021] The user places multiple documents on the document table 22 in accordance with the rules shown in the illustration and explanation. Documents to be grouped into the same group are placed close to each other within a predetermined range. Documents not to be grouped are placed with a distance greater than the predetermined range. In the example shown in FIG. 10, the minimum distance between the opposing sides of adjacent documents is 5 mm in both the vertical and horizontal directions. This distance is determined to correctly extract each document image. The maximum distance is 15 mm in both the vertical and horizontal directions. If the distance is greater than this, the documents will not be grouped. The maximum distance is the threshold for grouping. As will be described later, the group determination unit 46 according to this embodiment determines the documents to be grouped based on the distance between the centers of gravity of each document image, but the document arrangement screen 100 shows the illustration with the minimum distance between the opposing sides of adjacent documents. This is because it is easier for the user to understand. Business cards are almost always rectangular with a long side (X direction when placed horizontally) of 91 mm and a short side (Y direction when placed horizontally) of 55 mm. Using these lengths, the relationship between the distance between opposing sides and the distance between the centers of gravity can be derived.

[0022] As shown in FIG. 10, an [OK] key 102 and a [Cancel] key 103 are arranged on the document arrangement screen 100. The control unit 30 as the operation control unit 41 waits for any operation key to be operated (a loop returning to step S31 via No in step S31 and No in S32 shown in FIG. 6). Even if an operation key for another document type is operated instead of the [Business Card (Landscape)] key 91 in the above-mentioned step S21, the control unit 30 as the operation control unit 41 displays a document arrangement screen according to the selected document type on the operation unit 25. For example, when the [Business Card (Landscape)] key 92 is operated (Yes in step S23), the corresponding document arrangement screen is displayed (step S24). When the [Postcard (Landscape)] key 93 is operated (Yes in step S25), the corresponding document arrangement screen is displayed (step S26). Alternatively, when the [Postcard (Landscape)] key 94 is operated (Yes in step S27), the corresponding document arrangement screen is displayed (step S28). On the other hand, if the [Cancel] key 95 is operated (Yes in step S29), the process returns to step S13, and a group process selection screen for accepting the selection of whether or not to perform grouping is displayed on the operation unit 25, and the user's selection is accepted.

[0023] Although the document arrangement screen according to the document type has a different maximum interval value according to the document type, it is basically the same as the document arrangement screen 100 shown in FIG. 10, and includes a document arrangement illustration area 101, an [OK] key 102, and a [Cancel] key 103. When an operation key corresponding to the [Cancel] key 103 is operated (Yes in step S32), the control unit 30 as the operation control unit 41 causes the operation unit 25 to display a dialogue for accepting the selection of the operation screen to be displayed next (step S33). That is, as the operation screen to be displayed next, the control unit 30 allows the user to select whether to display the document type selection screen 90 to accept a reselection of the document type, or to display the group processing selection screen 80 to accept a reselection of whether to perform division. Then, the control unit 30 waits for any selection to be made (a loop returning to S34 via No in step S34 and No in S36). When the document type selection screen is selected (Yes in step S34), the control unit 30 as the operation control unit 41 causes the operation unit 25 to display the document type selection screen 90 (step S35). 5, and accepts the selection of the document type or cancellation. If the group processing selection screen is selected (Yes in step S36), the control unit 30 as the operation control unit 41 returns the process to step S13 shown in FIG. 5, and displays the group processing selection screen 80 on the operation unit 25 to accept the selection of whether or not to perform grouping.

[0024] When the document placement screen is displayed and the scan job is to be continued without being canceled, the user arranges documents on the document table 22 according to the explanation of the document placement screen and the illustration in the document placement illustration area. FIG. 11 is an explanatory diagram showing an example in which the user arranges a total of nine business cards (documents) horizontally on the document table 22 according to the document placement screen 100 described above. Documents 111 and 112, which are marked with a symbol in FIG. 11, are placed close to each other so as to be determined as being in the same group. Four documents, including two documents not marked with a symbol, are placed close to each other. In contrast, documents 112 and 113 are placed at a distance greater than a predetermined distance so as not to be determined as being in the same group. Two documents, including document 113, which are not marked with a symbol, are placed at a distance greater than a predetermined distance so as not to be determined as being in the same group. Two documents, including document 113, which are not marked with a symbol, are placed at a distance greater than a predetermined distance so as not to be determined as being in the same group. Although not labeled, three documents, including document 114, are placed close together so as to be in the same group. Therefore, the nine documents shown in FIG. 11 are placed so as to be judged as three groups.

[0025] When an operation key corresponding to the [OK] key 102 on the document placement screen is operated with documents placed on the document table 22 (Yes in step S31), the control unit 30 as the reading control unit 42 responds by scanning the entire surface of the document table 22 in a batch to obtain a batch scanned image including images of the multiple documents placed on the document table. The control unit 30 as the multi-crop processing unit 45 cuts out images of each document from the batch scanned image (step S41). When performing multi-crop processing, scanning is performed with the document cover open so that the multi-crop processing unit 45 can determine the cut-out area of ​​each document. Then, the center of gravity position of each document image in the batch scanned image is obtained (step S43). Furthermore, it is determined whether the X and Y coordinates of the center of gravity of each document are closer than a reference distance according to the type of document (step S45). The reference distance is determined from the maximum interval shown to the user on the document placement screen and the size of the document according to the selected document type.

[0026] FIG. 12 is an explanatory diagram showing an example of a method in which the control unit 30 as the group determination unit 46 determines the position of the center of gravity of each document image and the distance between the centers of gravity in this embodiment. Documents 111 and 112 shown in FIG. 11 are taken as an example. The batch scanned image is an image of each document seen from below the document table 22, but in FIG. 12, the document is replaced with an image seen from above to be consistent with FIG. 11. The replacement is easily realized by taking the Y coordinate axis in the opposite direction. The left rear corner of the document table 22 is set as the origin of coordinates. The names and coordinate values ​​of the four vertices of the document 111 (hereinafter also referred to as document A) are defined as follows. The left rear is P11 (x11, y11), the right rear is P12 (x12, y12), the left front is P13 (x13, y13), and the right front is P14 (x14, y14). The center of gravity of the document 111 is G1 (x1, y1). Similarly, the left rear corner of the four vertices of the original 112 (hereinafter also referred to as original B) is P21 (x21, y21), the right rear corner is P22 (x22, y22), the left front corner is P23 (x23, y23), and the right front corner is P24 (x24, y24). The center of gravity of the original 112 is G2 (x2, y2). Assuming that the original 111 is a rectangle, the coordinates of the center of gravity G1 (x1, y1) are the intersection of the diagonals of the four vertices and the midpoint of the diagonals. Whether the long side of the original A is placed parallel to the X-coordinate axis or not, the coordinates of G1 (x1, y1) can be found by the following formula using the coordinates of the diagonal vertices P11 and P14.

[0027] G1(x1,y1)=((x11+x14) / 2,(y11+y14) / 2)) Alternatively, using the coordinates of the other diagonal vertices P12 and P13, G1(x1,y1)=((x12+x13) / 2,(y12+y13) / 2)) The center of gravity of the original B can be found in the same manner. G2(x2,y2)=((x21+x24) / 2,(y21+y24) / 2)) Alternatively, using the coordinates of the other diagonal vertices P12 and P13, G2(x2,y2)=((x22+x23) / 2,(y22+y23) / 2)) And, if the distances in the X and Y directions between the two centers of gravity (G1, G2) are D12X and D12Y, respectively, then (D12X,D12Y)=(|x1-x2|,|y1-y2|)

[0028] When the coordinates of the four vertices of the original A and the original B are obtained from the batch scanned image, the coordinates of the center of gravity of each original are obtained based on the coordinates, and the distance between the centers of gravity is obtained from the coordinates of the center of gravity. Although two originals 111 and 112 are given as an example, the same applies to other originals. In this way, the control unit 30 as the group determination unit 46 can determine whether two originals are closer than the criterion for group determination. For example, in the case of a business card, the length of the long side is 91 mm and the length of the short side is 55 mm. If the maximum interval is 15 mm as shown in FIG. 10, if the distance between the centers of gravity of two business card originals placed horizontally is equal to or less than the reference in the X direction (X reference) 15+91=106 mm and equal to or less than the reference in the Y direction (Y reference) 15+55=70 mm, the two should be clearly determined to be in the same group. Since the minimum interval is a regulation for the multi-crop processing unit 45 to correctly cut out each original, the group determination unit 46 assumes that each original image has been correctly cut out and does not use the minimum interval for group determination.

[0029] FIG. 13 is an explanatory diagram showing a state in which the documents shown in FIG. 11 are read at once and the center of gravity positions of each document are obtained. As shown in FIG. 13, the other two business cards placed close to the document 111 (document A) and the document 112 (document B) are document C and document D, and the centers of gravity of the documents C and D are G4 (x4, y4) and G5 (x5, y5), respectively. Furthermore, the document 113 is document E, and the document placed close to it is document F. The centers of gravity of the documents E and F are G3 (x3, y3) and G6 (x6, y6), respectively. Furthermore, the document 114 is document G, and the two documents placed close to it are document H and document J. The centers of gravity of the documents G, H, and J are G7 (x7, y7), G8 (x8, y8), and G9 (x9, y9), respectively. 13, the numbers of the centers of gravity G of each document are assigned in the order in which the centers of gravity are arranged from left to right and from top to bottom on the document table 22 for the sake of convenience. This indicates that the group determination unit 46 adopts this order for the sake of convenience before performing group determination. Note that this is merely an example, and the centers of gravity G may be arranged in vertical order instead of horizontal order as in FIG.

[0030] FIG. 14 is an explanatory diagram showing an example of determining the proximity state based on the distance between the centers of gravity of adjacent documents in the X and Y directions in the batch scanning image shown in FIG. 13. The rows and columns in FIG. 14 are the names of the nine documents and the names of the centers of gravity shown in FIG. 13. The order is the same as in normal multi-crop processing, and in FIG. 14, the centers of gravity of each document image are arranged from the left side to the right side and from the top to the bottom of the document table 22. The rule for determining the order is the same as the numerical order of the names of the centers of gravity of each document image shown in FIG. 13. For example, a double circle (◎) is written in the column where the row item is document A (G1) and the column item is document B (G2). This indicates that the group determination unit 46 determines that the documents are placed closely together because the distance between the centers of gravity of G1 and G2 is less than the X standard in the X direction (106 mm in the above example) and less than the Y standard in the Y direction (70 mm in the above example). The column with the row item being manuscript B (G2) and the column item being manuscript A (G1) also shows the same relationship, so it is also marked with a double circle. On the other hand, the distance between the centers of gravity of manuscript A (G1) and manuscript E (G3) is equal to or less than the Y criterion in the Y direction, but is farther away than the X criterion in the X direction. Since neither the X criterion nor the Y criterion is satisfied, the group determination unit 46 makes a primary determination that the two are not in the same group. The cross mark in the column with the row item being manuscript A (G1) and the column item being manuscript E (G3) indicates the result of the primary determination. The same is true for the column with the row item being manuscript E (G3) and the column item being manuscript A (G1). The group determination unit 46 makes a similar determination for other combinations of manuscripts, and the results are as shown in the table of FIG. 14. For example, when document A (G1) is used as a reference, document B (G2), document C (G4), and document D (G5) are determined to belong to the same group because their center-of-gravity distances are equal to or less than the X reference and equal to or less than the Y reference. However, document E (G3), document F (G6), and document J (G9) are determined to not belong to the same group because their center-of-gravity distances exceed the X reference. Furthermore, document G (G7), document H (G8), and document J (G9) are determined to not belong to the same group because their center-of-gravity distances exceed the Y reference. As described above, the control unit 30 as the group determination unit 46 performs a primary determination of whether each document belongs to a group based on whether the distance between the centers of gravity of each document image fits within the range of the X reference and the Y reference (step S47).According to this aspect, by comparing the distance between the center of gravity of each document and the center of gravity of the documents surrounding it with a reference, it is possible to determine whether the documents are arranged as part of the same group.

[0031] It should be noted that in the first judgment stage, manuscript G (G7) and manuscript J (G9) are judged not to be in the same group because the distance between the centers of gravity exceeds the X standard, and are marked with an X. As shown in FIG. 13, manuscript H (G8) is placed between manuscript G (G7) and manuscript J (G9) and is close to both of them. Therefore, in FIG. 14, the column where the item of manuscript G (G7) and the item of manuscript H (G8) intersect is marked with a ◎ mark, and the group judgment unit 46 judges that the two are close to each other. Similarly, the column where the item of manuscript H (G8) and the item of manuscript J (G9) intersect is also marked with a ◎ mark, and the group judgment unit 46 judges that the two are also close to each other. However, the column where the item of manuscript G (G7) and the item of manuscript J (G9) intersect is marked with an X mark as described above.

[0032] The group determination unit 46 performs a final determination following the primary determination. FIG. 15 is an explanatory diagram showing the result of the final determination in which the group determination unit 46 determines that a group of document images in which proximity is linked belong to the same group based on the result of the primary determination shown in FIG. 14. In the final determination, the group determination unit 46 corrects the primary determination by determining that documents in which proximity is linked belong to the same group. In the example shown in FIG. 14, a document J (G9) in proximity (marked with a ◎ mark) is found for a document H (G8) in proximity to a document G (G7). In FIG. 15, the cross mark in the section where the document J (G9) and the document G (G7) intersect is changed to a circle mark, which indicates the correction of the result of the primary determination. According to this embodiment, the group of document images determined to be placed in proximity includes not only documents placed in proximity to the target document, but also documents placed in proximity to the documents in the vicinity of the target document.

[0033] In addition, the order of rows and columns in FIG. 15 is changed from that shown in FIG. 14 so that documents belonging to the same group are grouped together. That is, document A (G1) is followed by document B (G2), document C (G4), and document D (G5) which belong to the same group. Next, document E (G3) which is determined not to be in the same group as document A (G1) and document F (G6) which belongs to the same group as document E (G3) are prioritized. Next, document G (G7) which is determined not to be in the same group as either document A (G1) or document E (G3), and document H (G8) and document J (G9) which belong to the same group as document G (G7) are arranged. In the table shown in FIG. 15, documents grouped along the column (column marked with -) where the items of the same document intersect are shown as three groups marked with ◎ or ○ in a rectangular shape. That is, they are shown as a first group area 151, a second group area 152, and a third group area 153.

[0034] Based on the result of the above final judgment, the control unit 30 as the group judgment unit 46 makes a final judgment as to whether each document image belongs to a group (step S49). Then, the control unit 30 instructs the operation control unit 41 to display a preview of the documents grouped based on the final judgment on the operation unit 25. Based on the instruction, the control unit 30 as the operation control unit 41 causes the operation unit 25 to display a group confirmation screen (step S51). The group confirmation screen may be configured to accept input of the name of each group by the user. An embodiment in which input of a group name is accepted is called embodiment 1. In contrast, an embodiment in which input of a group name is not accepted is called embodiment 2.

[0035] FIG. 16 is an explanatory diagram showing an example of a group confirmation screen that the control unit 30 as the operation control unit 41 displays on the operation unit in this embodiment. As shown in FIG. 16, the group confirmation screen 160 includes a thumbnail display area 161, group name input fields 162 to 164, an [OK] key, and a [Re-position and re-read] key 166. The thumbnail display area 161 displays thumbnail images corresponding to the positions of the documents placed on the document table 22 based on the batch scanning image. That is, the arrangement of the thumbnail images of the documents corresponds to the arrangement of the documents shown in FIG. 11 and FIG. 13. The chain line frame surrounding the thumbnail images in the thumbnail display area 161 surrounds the thumbnails of the documents determined to be in the same group by the group determination unit 46. Documents A, B, C, and D are surrounded by a chain line frame as group 1, and documents E and F are surrounded by a chain line frame as group 2. Furthermore, documents G, H, and J are surrounded by a chain line frame as group 3. Group 1 corresponds to the first group area 151 shown in Fig. 15, and group 2 corresponds to the second group area 152. Group 3 corresponds to the third group area 153. The user checks in the thumbnail display area 161 whether the grouping is as intended. Note that Fig. 16 shows an example in which business cards (landscape) are selected as the document type, but the same applies to other document types.

[0036] The group confirmation screen 160 has a group name input field for receiving input of the group name of each group. This corresponds to the first embodiment. In the example shown in FIG. 16, a group name input field 162 is arranged for group 1, a group name input field 163 is arranged for group 2, and a group name input field 164 is arranged for group 3. In the first embodiment, when a group name is input in any of the group name input fields (Yes in step S53), the control unit 30 as the data output unit 47 stores the input group name in the RAM of the main storage unit 30M as an identifier of the group (step S55) and waits for the next operation. The group identifier input here is reflected in the file name of the output in the example described later. According to this aspect, the document images determined to belong to the same group are displayed on the operation unit to have the user input an identifier, and the identifier can be added to the file name and output. In an aspect without a group name input field (second embodiment), the default group name (group 1, group 2, group 3) may be used as the identifier, or the group name may not be reflected in the output.

[0037] If the user checks the thumbnail display area 161 of the group confirmation screen 160 and determines that the grouping is as intended, the [OK] key 165 is operated. On the other hand, if the user determines that the grouping is not as intended, the [Reposition and reload] key 166 is operated. If the [Reposition and reload] key 166 is operated (No in step S53 and Yes in step S57), the control unit 30 as the operation control unit 41 causes the operation unit 25 to display the selected type of document arrangement screen (step S59) and returns the process to the above-mentioned step S31. The user repositions the documents on the document table 22 so that the intended grouping is performed, and then operates the [OK] key on the document arrangement screen. Alternatively, to cancel the grouping, the [Cancel] key is operated. On the other hand, if the [OK] key 165 of the group confirmation screen 160 is operated (No in step S57 and Yes in step S61), the control unit 30 as the data output unit 47 assigns a consecutive number to each document image. If a group identifier is stored, the file name is given with the group identifier attached thereto, and each document image is stored in the output destination (step S63), and the process ends.

[0038] FIG. 17 is an explanatory diagram showing an example in which the control unit 30 as the data output unit 47 outputs each document image by attaching a file name including a unique number. In the example shown in FIG. 17, the data output unit 47 outputs document images determined to belong to the same group by attaching consecutive numbers. The names of each document written in the leftmost column (document image column 171) of the table in FIG. 17 correspond to the names of documents shown in FIG. 13 and FIG. 16. The rightmost column (file name column 172) of the table in FIG. 17 shows an example of a file name that the data output unit 47 assigns to the output data corresponding to each document. In the example shown in FIG. 17, the file name of the output data is "File_NoXX.pdf", and a two-digit number, for example, is attached as a unique name for each document at the 8th and 9th characters XX from the beginning. That is, 01 for document A, 02 for document B, 03 for document C, 04 for document D, 05 for document E, 06 for document F, 07 for document G, 08 for document H, and 09 for document J. As can be seen by referring to Fig. 15 or Fig. 16, sequential numbers 01 to 04 are assigned to group 1, sequential numbers 05 to 06 to group 2, and sequential numbers 07 to 09 to group 3. This can be said to correspond to the second embodiment in which there is no group name input field. According to this aspect, sequential numbers are assigned to data of original images classified into the same group, so that, for example, when the data is arranged in numerical order, data of the same group will be consecutive. This makes it easy to distinguish data of original images that belong to other groups or to no groups.

[0039] The "Printed Company Name" in the second column and the "Printed Name" in the third column in Fig. 17 are examples of company names and names printed on the business cards of each manuscript corresponding to the thumbnail images in Fig. 16. These can be extracted from the business cards of the manuscript by, for example, a character recognition processing unit not shown in Fig. 3, but the character recognition processing unit is not an essential component of the present disclosure and is shown in Fig. 17 for reference.

[0040] FIG. 18 is an explanatory diagram showing an example in which the control unit 30 as the data output unit 47 outputs each document image with a file name including a unique name (number) and a group identifier when a group identifier is stored. The leftmost column (document image column 181) in FIG. 18 corresponds to FIG. 17. The same applies to the "printed company name" in the second column and the "printed name" in the third column. In the example of the rightmost column (file name column 182), the fifth and sixth characters GG from the beginning of "File_GG_NoXX.pdf" are two characters corresponding to the group identifier. In the example shown in FIG. 18, the group identifiers are "α Company" for group 1, "β Company" for group 2, and "γ Company" for group 3, which are input in the group name input fields 162 to 164 of the group confirmation screen 160, for example. This corresponds to the first embodiment in which there is a group name input field. Alternatively, it corresponds to a pattern in which a default group name is adopted in the second embodiment. According to this aspect, a common group identifier is assigned to data of each document image classified into the same group, making it easy to distinguish the data from other groups or data of document images that do not belong to any group.

[0041] Fig. 18 shows an example in which the group identifier is reflected in the file name of each document. As another example, a folder corresponding to the group identifier may be generated, and output files of document images belonging to each group may be stored in a folder for each group. This example is referred to as embodiment 3. In embodiment 3, the file name of each document image may include only a unique name (number) as in the example shown in Fig. 17, or may include a group identifier in addition to a unique name as in the example shown in Fig. 18.

[0042] It should be understood that the present disclosure also includes any combination of the above-described aspects. In addition to the above-described embodiment, various modifications of the present disclosure are possible. These modifications should not be interpreted as not belonging to the scope of the present disclosure. The invention according to the present disclosure should include all modifications that are equivalent to the scope of the claims and that belong to the scope of the present disclosure. [Explanation of symbols]

[0043] 10: Multifunction device, 11: Network, 12, 13, 14: PC, 20: Image reading section, 22: Document table, 23: Document feeder, 24: Document reading section, 25: Operation unit, 25D: Display, 25S: Touch sensor, 30: Control section, 30M: Main memory section, 30P: Processor, 32: Auxiliary memory section, 33: Communication section, 34: Image forming section, 34E: Paper output tray, 35: Paper supply and transport section, 41: Operation control section, 42: Reading control section, 43: Print control section, 44: Job management section, 45: Multi-crop processing section, 46: Group determination section, 47: Data output section, 80: Group processing selection screen, 81: [Yes] key, 82: [No] key, 90: Document type selection screen, 91: [Business card (landscape)] key, 92: [Business card (portrait)] key, 93: [Postcard (landscape)] key, 94: [Postcard (portrait)] key, 95, 103: [Cancel] key, 100: Original arrangement screen, 101: Original arrangement illustration area, 102, 165: [OK] key, 111, 112, 113, 114: Original, 151: First group area, 152: Second group area, 153: Third group area, 160: Group confirmation screen, 161: Thumbnail display area, 162, 163, 164: Group name input field, 166: [Reposition and reload] key, 171, 181: Original image row, 172, 182: File name row

Claims

1. an image reading unit that reads multiple documents placed on a document table at once; a multi-crop processing unit that cuts out an original image corresponding to each original from the read image; a group determination unit that determines whether or not there is another document image placed around each document image closer than a predetermined standard, and determines a group of document images that are determined to be placed close to each other as one group; An image processing apparatus comprising: a data output section that outputs data of each document image determined to belong to the same group in a manner that makes it possible to distinguish the data of each document image from other groups or from data of document images that do not belong to any group.

2. 2. The image processing device according to claim 1, wherein the data output unit outputs data of each original image by giving each original image a file name including a unique number, and original images belonging to the same group are each assigned consecutive numbers as the unique number.

3. 2 . The image processing apparatus according to claim 1 , wherein the data output unit outputs the data of each original image by giving a file name including a group identifier to each original image, and assigns a common identifier to original images belonging to the same group.

4. 2. The image processing apparatus according to claim 1, wherein it is determined whether or not the distance between the center of gravity of each document and the center of gravity of another document is closer than the reference value.

5. The image processing device of claim 1, wherein the group determination unit determines that the first to third original images belong to the same group when a second original image is placed closer to a first original image than the standard and a third original image is placed closer to the second original image than the standard.

6. an operation unit for receiving an input of an identifier of the group; the group determination unit causes the operation unit to display which of the document images placed on the document platen have been determined to belong to the same group; 4. The image processing apparatus according to claim 3, wherein the data output section adds the contents input for each group as the identifier to the file names of the document images belonging to that group.

7. A control unit of the image processing device A step of collectively reading a plurality of documents placed on a document table using an image reading unit; A step of performing a multi-crop process for cutting out document images corresponding to each document from the read image; a step of determining whether or not there is another original image placed around each original image closer than a predetermined standard, and determining a group of original images that are determined to be placed close to each other as one group; A method for determining groups of multi-cropped images, comprising a step of outputting data of each original image determined to belong to the same group in a manner distinguishable from data of other groups or original images not belonging to any group.

Images