Image processing system, and image processing method

Abstract

To provide an image processing system and an image processing method that can improve operability of an operation to designate an area to be cut out from a read image.SOLUTION: An image processing system 100 comprises: a portable terminal 2 including a detection processing unit that detects, by using a camera, a designation operation to designate, for a document, a cut-out area to be cut out from the document, and a recognition processing unit that recognizes the cut-out area designated by the designation operation; and an image forming apparatus 1 including a reading processing unit that reads the image of the document, and a cut-out processing unit that cuts out part of a read image read by the reading processing unit on the basis of a result of recognition made by the recognition processing unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an image processing system and an image processing method. [Background technology]

[0002] BACKGROUND ART An image processing apparatus that displays a read image read from a document on a display unit and accepts an operation to specify an area to be cut out from the read image on the display unit is known as a related art (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-161463 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the image processing device according to the related art described above, the range in which an operation for specifying an area to be cut out from the scanned image is accepted is limited to within the display area of ​​the display unit.

[0005] An object of the present invention is to provide an image processing system and an image processing method that can improve the operability of the operation for specifying an area to be cut out from a scanned image. [Means for solving the problem]

[0006] According to one aspect of the present invention, an image processing system includes a detection processing unit, a recognition processing unit, a reading processing unit, and a cropping processing unit. The detection processing unit uses a camera to detect a designation operation on a document to designate a cropping area to be cropped from the document. When the designation operation is detected by the detection processing unit, the recognition processing unit recognizes the cropping area designated by the designation operation. The reading processing unit reads an image of the document. The cropping processing unit crops a portion of the read image read by the reading processing unit based on the recognition result by the recognition processing unit.

[0007] An image processing method according to another aspect of the present invention includes a detection step, a recognition step, a reading step, and a cropping step. In the detection step, a camera is used to detect a designation operation on an original document that designates a cropping area to be cropped from the original document. In the recognition step, if the designation operation is detected in the detection step, the cropping area designated by the designation operation is recognized. In the reading step, an image of the original document is read. In the cropping step, a portion of the read image read in the reading step is cropped based on the recognition result in the recognition step. [Effects of the Invention]

[0008] According to the present invention, it is possible to improve the operability of the operation for specifying the area to be cut out from the scanned image. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing the configuration of an image processing system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing the configuration of the image forming apparatus of the image processing system according to the embodiment of the present invention. [Figure 3] FIG. 3 is a block diagram showing the configuration of a mobile terminal of the image processing system according to the embodiment of the present invention. [Figure 4]FIG. 4 is a diagram showing an example of an imaging result display screen displayed on a mobile terminal of the image processing system according to the embodiment of the present invention. [Figure 5] FIG. 5 is a diagram showing an example of an imaging result display screen displayed on a mobile terminal of the image processing system according to the embodiment of the present invention. [Figure 6] FIG. 6 is a diagram showing an example of a read image read by the image forming apparatus of the image processing system according to the embodiment of the present invention. [Figure 7] FIG. 7 is a flowchart showing an example of a cut-out image forming process executed by the image processing system according to the embodiment of the present invention. [Figure 8] FIG. 8 is a flowchart showing an example of a cutout area recognition process executed by the image processing system according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. Note that the following embodiment is an example of a specific embodiment of the present invention and does not limit the technical scope of the present invention.

[0011] [Configuration of image processing system 100] First, with reference to FIG. 1, the configuration of an image processing system 100 according to an embodiment of the present invention will be described.

[0012] 1, an image processing system 100 includes an image forming apparatus 1 and a portable terminal 2. In the image processing system 100, the image forming apparatus 1 and the portable terminal 2 are connected to each other so as to be able to communicate with each other via a communication network 3. For example, the communication network 3 is the Internet or a LAN (local area network).

[0013] [Configuration of image forming apparatus 1] Next, the configuration of the image forming apparatus 1 will be described with reference to FIG.

[0014] The image forming apparatus 1 is a multifunction machine having multiple functions such as a scanning function for reading an image from an original, a printing function for forming an image on a sheet based on image data, a fax function, and a copy function.

[0015] The image forming apparatus 1 is capable of executing image repeat printing processing, which is processing in which a part of an image of a document read by the scanning function is set as an image to be repeated, and the image to be repeated is printed multiple times on a sheet.

[0016] As shown in FIG. 2, the image forming apparatus 1 includes a control unit 11, an ADF (automatic document feeder) 12, an image reading unit 13, an image forming unit 14, a paper feeding unit 15, an operation display unit 16, a communication unit 17, and a memory unit 18.

[0017] The control unit 11 comprehensively controls the image forming apparatus 1. As shown in FIG. 2, the control unit 11 includes a CPU 21, a ROM 22, and a RAM 23. The CPU 21 is a processor that executes various types of arithmetic processing. The ROM 22 is a non-volatile storage device that pre-stores information such as control programs for causing the CPU 21 to execute various types of processing. The RAM 23 is a volatile or non-volatile storage device that is used as a temporary storage memory (work area) for the various types of processing executed by the CPU 21. The CPU 21 executes the various control programs pre-stored in the ROM 22. In this way, the CPU 21 comprehensively controls the image forming apparatus 1.

[0018] The ADF 12 transports a document whose image is to be read by the image reading unit 13. The ADF 12 includes a document setting unit, a plurality of transport rollers, a document holder, and a paper discharge unit.

[0019] The image reading unit 13 realizes the scanning function and includes a document table, a light source, a plurality of mirrors, an optical lens, and a CCD.

[0020] Image forming unit 14 realizes the printing function. For example, image forming unit 14 forms a color or monochrome image on a sheet supplied by paper supply unit 15 using an electrophotographic method. For example, image forming unit 14 includes a plurality of image forming units, an optical scanning device, an intermediate transfer belt, a secondary transfer roller, a fixing device, and a paper output tray. Note that image forming unit 14 may also form an image on a sheet supplied by paper supply unit 15 using another image forming method, such as an inkjet method.

[0021] The paper feed unit 15 supplies sheets to the image forming unit 14. The paper feed unit 15 includes a paper feed cassette, a manual feed tray, and a plurality of transport rollers.

[0022] The operation display unit 16 is a user interface of the image forming apparatus 1. The operation display unit 16 includes a first display unit and a second operation unit. The first display unit displays various information in response to control instructions from the control unit 11. For example, the first display unit is a flat panel display such as a liquid crystal display. The second operation unit inputs various information to the control unit 11 in response to user operations. For example, the second operation unit includes operation keys and a touch panel.

[0023] The communication unit 17 is a communication interface that executes wired or wireless data communication via the communication network 3 with an external communication device such as the mobile terminal 2.

[0024] The storage unit 18 is a nonvolatile storage device, such as a nonvolatile memory such as a flash memory, a solid state drive (SSD), or a hard disk drive (HDD).

[0025] [Configuration of mobile device 2] Next, the configuration of the mobile terminal 2 will be described with reference to FIG.

[0026] The mobile terminal 2 is a portable information processing device carried by the user of the image forming apparatus 1. For example, the mobile terminal 2 is a smartphone or a tablet terminal.

[0027] As shown in FIG. 3, the mobile terminal 2 includes a control unit 31, an operation display unit 32, a communication unit 33, a storage unit , and a camera .

[0028] 3, the control unit 31 has a CPU 41, a ROM 42, and a RAM 43. The CPU 41, the ROM 42, and the RAM 43 have the same functions as the CPU 21, the ROM 22, and the RAM 23 of the image forming apparatus 1.

[0029] The operation display unit 32 is a user interface of the mobile terminal 2. The operation display unit 32 includes a second display unit and a second operation unit. The second display unit displays various information in response to control instructions from the control unit 31. For example, the second display unit is a flat panel display such as a liquid crystal display. The second operation unit inputs various information to the control unit 31 in response to user operations. The second operation unit includes a touch panel.

[0030] The communication unit 33 is a communication interface that performs wireless data communication via the communication network 3 with external communication devices such as the image forming apparatus 1.

[0031] The storage unit 34 is a non-volatile storage device similar to the storage unit 18 of the image forming apparatus 1.

[0032] The camera 35 is used to capture an image of a subject.

[0033] Incidentally, an image processing apparatus that displays a read image read from a document on the operation display unit 16 and accepts an operation on the operation display unit 16 to specify an area to be cut out from the read image is known as related art.

[0034] However, in the image processing device according to the related art described above, the range in which an operation for specifying an area to be cut out from the scanned image is accepted is limited to within the display area of ​​the operation and display unit 16.

[0035] In contrast to this, the image processing system 100 according to the embodiment of the present invention can improve the operability of the operation for specifying the area to be cut out from the scanned image, as will be described below.

[0036] Specifically, a clipping area recognition program for causing the control unit 31 to function as the display processing unit 51, the measurement processing unit 52, the detection processing unit 53, and the recognition processing unit 54 shown in Fig. 3 is stored in advance in the storage unit 34 of the mobile terminal 2. The CPU 41 of the control unit 31 executes the clipping area recognition program to function as each of the above-mentioned processing units.

[0037] 2. The memory unit 18 of the image forming apparatus 1 stores in advance a cut-out image forming program for causing the control unit 11 to function as the reading processing unit 61, the determination processing unit 62, the cut-out processing unit 63, the generation processing unit 64, and the formation processing unit 65 shown in FIG. The CPU 21 of the control unit 11 executes the cut-out image forming program to function as each of the above-mentioned processing units.

[0038] Note that some or all of the processing units included in the control unit 31 of the mobile terminal 2 may be configured with electronic circuits. Also, the cutout area recognition program may be a program for causing a plurality of processors to function as the processing units shown in FIG.

[0039] In addition, some or all of the processing units included in the control unit 11 of the image forming apparatus 1 may be configured with electronic circuits. In addition, the cut-out image forming program may be a program for causing a plurality of processors to function as the processing units shown in FIG.

[0040] The display processing unit 51 displays the image captured by the camera 35 on the operation display unit 32 (an example of the display unit of the present invention).

[0041] For example, the display processing unit 51 causes the operation display unit 32 to display an imaging result display screen X10 (see FIG. 4) including the imaging result of the camera 35.

[0042] An example of the imaging result display screen X10 is shown in Fig. 4. As shown in Fig. 4, the imaging result display screen X10 includes an imaging result display field X11 and a message display field X12.

[0043] The imaging result display field X11 displays in real time the imaging results of the camera 35. The imaging result display field X11 shown in FIG.

[0044] The message display field X12 displays messages to the user.

[0045] When an image of a document is captured by the camera 35, the measurement processing unit 52 measures the size of the document.

[0046] For example, when a rectangular sheet is included in the image captured by the camera 35, the measurement processing unit 52 determines that the sheet is a document.

[0047] For example, the measurement processing unit 52 measures the size of the document imaged by the camera 35 by a known method using triangulation.

[0048] The detection processing unit 53 detects a designation operation on a document, which designates a cutout area to be cut out from the document, using the camera 35. The designation operation is a gesture operation using a finger on the document. Note that the designation operation may also be an operation using a pen or the like instead of a finger.

[0049] Here, the cutout area is a rectangular area with one side parallel to the long or short side of the document.

[0050] The designation operation includes a first designation operation and a second designation operation for designating the positions of a first corner and a second corner that form diagonal corners of the cutout area.

[0051] For example, the first designation operation may be an operation of double-tapping a position on the document where the first corner is to be formed. Note that the first designation operation may also be an operation of keeping a fingertip still for a predetermined period of time at the position on the document where the first corner is to be formed.

[0052] The second designation operation may be an operation of double-tapping the position on the document where the second corner is to be formed. Note that the second designation operation may be an operation of keeping a fingertip still for a predetermined period of time at the position on the document where the second corner is to be formed.

[0053] When the detection processing unit 53 detects the designation operation, the recognition processing unit 54 recognizes the cutout area designated by the designation operation.

[0054] Specifically, the recognition processing unit 54 recognizes the positions of the first corner and the second corner on the document. That is, the recognition processing unit 54 acquires first position information indicating the position of the first corner on the document and second position information indicating the position of the second corner on the document.

[0055] For example, the first position information is information indicating the distance along the longitudinal direction of the document from a predetermined reference position P0 (see FIG. 5) on the document to the first position P1 (see FIG. 5) specified by the first specifying operation, and the distance along the lateral direction of the document. For example, the reference position P0 is the corner located on the upper left side of the imaging result display field X11 among the four corners of the document.

[0056] In addition, the second position information is information indicating the distance along the longitudinal direction of the document and the distance along the short direction of the document from a reference position P0 (see Figure 5) on the document to a second position P2 (see Figure 5) specified by the second specification operation.

[0057] Here, when the cutout area is recognized by the recognition processing unit 54, the display processing unit 51 displays the cutout area recognized by the recognition processing unit 54 in an identifiable manner on the captured image IM10 of the document (see Figure 5) displayed on the operation display unit 32.

[0058] For example, the display processing unit 51 displays a line image IM30 (see Figure 5) of a predetermined color indicating the edge of the cutout area recognized by the recognition processing unit 54 on the captured image IM10 (see Figure 5) of the document displayed on the operation display unit 32.

[0059] Fig. 5 shows an imaging result display screen X10 displayed by the display processing unit 51 after the recognition processing unit 54 recognizes the cutout area. The imaging result display field X11 shown in Fig. 5 includes an image IM20 of the user's finger captured by the camera 35. The imaging result display field X11 shown in Fig. 5 also includes a line image IM30 indicating the edge of the cutout area recognized by the recognition processing unit 54. In Fig. 5, the line image IM30 is indicated by a dashed line. In Fig. 5, a first position P1 and a second position P2 are indicated by black circles.

[0060] 5 also includes an operation key X21 and an operation key X22. The operation key X21 is an operation key that is operated when the cutout area is subsequently specified. The operation key X22 is an operation key that is operated when the cutout area specification is terminated.

[0061] When one or more cutout areas are designated, the portable terminal 2 transmits to the image forming apparatus 1 the first position information and the second position information corresponding to each of the designated cutout areas.

[0062] The reading processing unit 61 reads an image of a document.

[0063] Specifically, the reading processing unit 61 uses the image reading unit 13 to read an image of the document.

[0064] FIG. 6 shows an example of a read image IM40 read from a document by the reading processing unit 61.

[0065] The determination processing unit 62 determines whether or not the document whose image has been read by the reading processing unit 61 is the same as the document whose cutout area has been recognized by the recognition processing unit 54 .

[0066] For example, in the image processing system 100, a captured image IM10 of a document acquired by the portable terminal 2 is transmitted to the image forming apparatus 1. The determination processing unit 62 compares the captured image IM10 of the document transmitted from the portable terminal 2 with a read image IM40 (see FIG. 6 ) read from the document by the reading processing unit 61, thereby determining whether the document whose image has been read by the reading processing unit 61 is the same as the document whose cutout area has been recognized by the recognition processing unit 54.

[0067] The cutout processing unit 63 cuts out a part of the read image IM40 read by the reading processing unit 61 based on the recognition result by the recognition processing unit 54.

[0068] Specifically, the cutout processing unit 63 cuts out a rectangular area specified based on the first position information and the second position information in the scanned image IM40.

[0069] For example, the cropping processing unit 63 compares an image IM10 (see Figure 5) of a document sent from the mobile terminal 2 with a read image IM40 (see Figure 6) read from the document by the reading processing unit 61, thereby identifying a first corresponding position P11 (see Figure 6) in the read image IM40 that corresponds to the reference position P0 (see Figure 5).

[0070] Further, the cutout processing unit 63 identifies a second corresponding position P12 (see FIG. 6) in the scanned image IM40 that corresponds to the first position P1 (see FIG. 5) based on the first position information transmitted from the portable terminal 2.

[0071] Further, the cutout processing unit 63 identifies a third corresponding position P13 (see FIG. 6) in the scanned image IM40 that corresponds to the second position P2 (see FIG. 5) based on the second position information transmitted from the portable terminal 2.

[0072] Then, the cutout processing unit 63 cuts out a rectangular area (area surrounded by a dashed line in FIG. 6) specified based on the specified second corresponding position P12 and third corresponding position P13 from the read image IM40.

[0073] When a plurality of pieces of information (the first position information and the second position information) corresponding to the plurality of cutout areas are transmitted from the portable terminal 2, the cutout processing unit 63 cuts out the plurality of areas from the read image IM40.

[0074] The generation processing unit 64 generates specific image data including the cut image cut out by the cut-out processing unit 63 .

[0075] For example, the generation processing unit 64 generates the specific image data in which a plurality of the cropped images are arranged within an area of ​​a predetermined document size. Furthermore, when a plurality of the cropped images are acquired by the cropping processing unit 63, the generation processing unit 64 generates the specific image data for each of the cropped images.

[0076] The forming processing unit 65 forms an image on a sheet based on the specific image data generated by the generation processing unit 64.

[0077] Specifically, the forming processing unit 65 uses the image forming unit 14 to form an image based on the specific image data on a sheet.

[0078] [Cut-out image formation processing] 7, an example of the procedure of the cut-out image forming process executed by the control unit 11 of the image forming apparatus 1 and the image processing method of the present invention will be described below. Here, steps S11, S12, etc. represent the numbers of the processing procedures (steps) executed by the control unit 11. For example, the cut-out image forming process is executed when an instruction to execute the image repeat printing process is input by a user's operation on the operation display unit 16.

[0079] <Step S11> First, in step S11, the control unit 11 instructs the mobile terminal 2 to execute a cutout area recognition process, which will be described below.

[0080] [Cutout area recognition processing] Here, an example of the procedure of the cutout area recognition process executed by the control unit 31 of the mobile terminal 2 will be described with reference to FIG.

[0081] <Step S21> First, in step S21, the control unit 31 activates the camera 35.

[0082] <Step S22> In step S22, the control unit 31 causes the operation display unit 32 to display the image pickup result captured by the camera 35. The process of step S22 is executed by the display processing unit 51 of the control unit 31.

[0083] Specifically, the control unit 31 causes the operation display unit 32 to display an imaging result display screen X10 (see FIG. 4).

[0084] <Step S23> In step S23, the control unit 31 determines whether the camera 35 has captured an image of the document.

[0085] Specifically, when a rectangular sheet is included in the captured image captured by the camera 35, the control unit 31 determines that the image of the document has been captured by the camera 35.

[0086] Here, when the control unit 31 determines that the document has been imaged by the camera 35 (Yes in S23), it shifts the process to step S24. On the other hand, when the document has not been imaged by the camera 35 (No in S23), the control unit 31 waits for the document to be imaged by the camera 35 in step S23.

[0087] <Step S24> In step S24, the control unit 31 measures the size of the document imaged by the camera 35. The process of step S24 is executed by the measurement processing unit 52 of the control unit 31.

[0088] Specifically, the control unit 31 measures the size of the document imaged by the camera 35 using a known method that uses triangulation.

[0089] <Step S25> In step S25, the control unit 31 determines whether or not the first designating operation has been detected.

[0090] Specifically, when the camera 35 captures an image of a double tap on the document, the control unit 31 determines that the first designating operation has been detected.

[0091] Here, if the control unit 31 determines that the first designation operation has been detected (Yes in S25), it shifts the process to step S26. On the other hand, if the first designation operation has not been detected (No in S25), the control unit 31 waits for the detection of the first designation operation in step S25.

[0092] <Step S26> In step S26, the control unit 31 acquires the first position information indicating the first position P1 (see FIG. 5) designated by the first designation operation on the document.

[0093] Specifically, the control unit 31 uses the measurement results from step S24 to obtain the distance along the longitudinal direction of the document from the reference position P0 (see Figure 5) to the first position P1 (see Figure 5) and the distance along the short direction of the document.

[0094] <Step S27> In step S27, the control unit 31 determines whether the second designating operation is detected. The processes of steps S25 and S27 are an example of a detection step of the present invention, and are executed by the detection processing unit 53 of the control unit 31.

[0095] Specifically, when the camera 35 captures an image of a double tap on the document, the control unit 31 determines that the second designating operation has been detected.

[0096] Here, if the control unit 31 determines that the second designating operation has been detected (Yes in S27), it shifts the process to step S28. On the other hand, if the second designating operation has not been detected (No in S27), the control unit 31 waits for the detection of the second designating operation in step S27.

[0097] <Step S28> In step S28, the control unit 31 acquires the second position information indicating the second position P2 (see FIG. 5) on the document specified by the second specifying operation. The processes of steps S26 and S28 are an example of a recognition step of the present invention, and are executed by the recognition processing unit 54 of the control unit 31.

[0098] Specifically, the control unit 31 uses the measurement results from step S24 to obtain the distance along the longitudinal direction of the document from the reference position P0 (see Figure 5) to the second position P2 (see Figure 5) and the distance along the short direction of the document.

[0099] <Step S29> In step S29, the control unit 31 causes the cutout area recognized in the processes of steps S26 and S28 to be identifiable on the captured image IM10 of the document (see FIG. 5) displayed on the operation display unit 32. The process of step S29 is executed by the display processing unit 51 of the control unit 31.

[0100] Specifically, the control unit 31 displays a line image IM30 (see FIG. 5) indicating the edge of the cutout area recognized in the processes of steps S26 and S28 on the captured image IM10 (see FIG. 5) of the document displayed on the operation display unit 32. The control unit 31 also displays an operation key X21 (see FIG. 5) and an operation key X22 (see FIG. 5) in the message display field X12.

[0101] <Step S30> In step S30, the control unit 31 determines whether or not an instruction to end the designation of the cutout region has been issued.

[0102] Specifically, when a user operation on the operation key X22 (see FIG. 5) is accepted, the control unit 31 determines that an instruction to end the designation of the cutout region has been issued.

[0103] Here, if the control unit 31 determines that an instruction to end the designation of the cutout area has been issued (Yes in S30), the control unit 31 shifts the process to step S32. On the other hand, if an instruction to end the designation of the cutout area has not been issued (No in S30), the control unit 31 shifts the process to step S31.

[0104] <Step S31> In step S31, the control unit 31 determines whether or not an instruction to continue the designation of the cutout region has been issued.

[0105] Specifically, when a user operation on the operation key X21 (see FIG. 5) is accepted, the control unit 31 determines that an instruction to continue the designation of the cutout region has been given.

[0106] Here, if the control unit 31 determines that an instruction to continue designating the cutout area has been issued (Yes in S31), the control unit 31 shifts the process to step S25. On the other hand, if an instruction to continue designating the cutout area has not been issued (No in S31), the control unit 31 shifts the process to step S30.

[0107] <Step S32> In step S32, the control unit 31 transmits the first position information and the second position information corresponding to each of the specified cutout areas to the image forming apparatus 1. The control unit 31 also transmits the captured image IM10 of the document captured by the camera 35 to the image forming apparatus 1.

[0108] <Step S33> In step S33, the control unit 31 displays a guidance message on the operation display unit 32 urging the user to place the document imaged by the camera 35 on the document setting unit of the ADF 12 of the image forming device 1 or on the document table of the image reading unit 13.

[0109] This concludes the description of the cutout area recognition process, and the description of the cutout image formation process will now be resumed.

[0110] <Step S12> In step S12, the control unit 11 determines whether a user operation on the operation display unit 16 has input an instruction to read the document placed on the document setting unit of the ADF 12 or the document table of the image reading unit 13.

[0111] Here, when the control unit 11 determines that the read instruction has been input (Yes in S12), it shifts the process to step S13. On the other hand, when the read instruction has not been input (No in S12), the control unit 11 waits for the input of the read instruction in step S12.

[0112] <Step S13> In step S13, the control unit 11 executes a reading process to read an image of a document placed on the document setting unit of the ADF 12 or the document table of the image reading unit 13. The process of step S13 is an example of a reading step of the present invention, and is executed by the reading processing unit 61 of the control unit 11.

[0113] <Step S14> In step S14, the control unit 11 determines whether or not the document read in the reading process is the same as the document whose cutout area was recognized in the processes of steps S26 and S28.

[0114] Specifically, the control unit 11 compares the captured image IM10 of the document sent from the mobile terminal 2 with the read image IM40 (see Figure 6) read from the document in the reading process, and determines whether the document read in the reading process is the same as the document whose cut-out area was recognized in the processing of steps S26 and S28.

[0115] Here, when the control unit 11 determines that the document read in the reading process is the same as the document whose cutout area was recognized in the processes of steps S26 and S28 (Yes in S14), it shifts the process to step S16. On the other hand, when the document read in the reading process is not the same as the document whose cutout area was recognized in the processes of steps S26 and S28 (No in S14), it shifts the process to step S15.

[0116] <Step S15> In step S15, the control unit 11 causes the operation display unit 16 to display a message indicating that the document read in the reading process is not the same as the document whose cutout area was recognized in the processes of steps S26 and S28.

[0117] <Step S16> In step S16, the control unit 11 executes a cutout process to cut out a part of the read image IM40 (see FIG. 6) read in the reading process, based on the cutout area recognition results from the processes of steps S26 and S28. The process of step S16 is an example of a cutout step of the present invention, and is executed by the cutout processing unit 63 of the control unit 11.

[0118] Specifically, the control unit 11 compares a captured image IM10 (see FIG. 5) of the document transmitted from the portable terminal 2 with a read image IM40 (see FIG. 6) read from the document in the reading process, thereby identifying a first corresponding position P11 (see FIG. 6) in the read image IM40 that corresponds to the reference position P0 (see FIG. 5). Furthermore, the control unit 11 identifies a second corresponding position P12 (see FIG. 6) in the read image IM40 that corresponds to the first position P1 (see FIG. 5) based on the first position information transmitted from the portable terminal 2. Furthermore, the control unit 11 identifies a third corresponding position P13 (see FIG. 6) in the read image IM40 that corresponds to the second position P2 (see FIG. 5) based on the second position information transmitted from the portable terminal 2. The control unit 11 then cuts out a rectangular area (the area surrounded by the dashed line in FIG. 6) identified based on the identified second corresponding position P12 and third corresponding position P13 from the read image IM40.

[0119] When a plurality of pieces of information (the first position information and the second position information) corresponding to the plurality of cutout regions are transmitted from the portable terminal 2, the control unit 11 cuts out the plurality of regions from the read image IM40.

[0120] <Step S17> In step S17, the control unit 11 generates the specific image data including the cropped image cropped in the cropping process. If multiple cropped images are obtained in the cropping process, the control unit 11 generates the specific image data for each cropped image. The process of step S17 is executed by the generation processing unit 64 of the control unit 11.

[0121] <Step S18> In step S18, the control unit 11 executes a forming process to form an image on a sheet based on the specific image data generated in step S 17. The process of step S18 is executed by the forming process unit 65 of the control unit 11.

[0122] The control unit 11 may generate a plurality of specific image data sets each having a different layout of the cropped image. In this case, the control unit 11 may execute the formation process based on the specific image data set selected by a user's operation to select one of the plurality of specific image data sets.

[0123] In this way, the image processing system 100 uses the camera 35 to detect the designation operation that designates the cutout area for the document. The cutout area designated by the detected designation operation is then recognized. Then, based on the recognition result of the cutout area, a portion of the scanned image IM40 scanned by the image forming apparatus 1 is cut out. This allows the acceptance range of the operation that designates the area to be cut out from the scanned image IM40 to be expanded from the display area of ​​the operation display unit 16 to the area of ​​the actual document. Therefore, the operability of the operation that designates the area to be cut out from the scanned image IM40 can be improved.

[0124] The cutout area may be a polygonal area, in which case the designation operation may be an operation of designating the positions of the corners of the cutout area.

[0125] The cutout area may be an area of ​​any shape. In this case, the designation operation may be an operation of designating the positions of the points that form the boundary line of the cutout area.

[0126] Furthermore, the image processing system 100 may include a webcam capable of capturing an image of the image forming apparatus 1 from above the image forming apparatus 1, instead of the portable terminal 2. In this case, the control unit 11 may include a display processing unit 51, a measurement processing unit 52, a detection processing unit 53, and a recognition processing unit 54.

[0127] [Notes on the Invention] The following is a summary of the invention extracted from the above-described embodiment. Note that the configurations and processing functions described in the following supplementary notes can be selected and combined as desired.

[0128] <Appendix 1> An image processing system comprising: a detection processing unit that uses a camera to detect a designation operation for designating a cutout area to be cut out from a document; a recognition processing unit that, when the designation operation is detected by the detection processing unit, recognizes the cutout area designated by the designation operation; a reading processing unit that reads an image of the document; and a cutting processing unit that cuts out a portion of the read image read by the reading processing unit based on the recognition result by the recognition processing unit.

[0129] <Appendix 2> The image processing system described in Appendix 1, wherein the cutout area is a rectangular area with one side parallel to the long side or short side of the document, the designation operation includes a first designation operation and a second designation operation that designate the positions of a first corner and a second corner that form diagonal corners of the cutout area, the recognition processing unit acquires first position information indicating the position of the first corner in the document and second position information indicating the position of the second corner in the document, and the cutout processing unit cuts out the rectangular area identified based on the first position information and the second position information in the read image.

[0130] <Appendix 3> 3. The image processing system according to claim 1, further comprising: a display unit that displays the image captured by the camera; and a display processing unit that, when the cutout area is recognized by the recognition processing unit, causes the cutout area recognized by the recognition processing unit to be identifiable on the captured image of the document displayed on the display unit.

[0131] <Appendix 4> 4. The image processing system according to any one of claims 1 to 3, further comprising a forming processing section that forms an image on a sheet based on specific image data including the cut image cut out by the cut-out processing section.

[0132] <Appendix 5> An image processing method including: a detection step of detecting, using a camera, a designation operation for designating a cutout area to be cut out from a document; a recognition step of recognizing, when the designation operation is detected by the detection step, the cutout area designated by the designation operation; a reading step of reading an image of the document; and a cutting step of cutting out a portion of the read image read by the reading step based on the recognition result by the recognition step. [Explanation of symbols]

[0133] 1. Image forming device 2. Mobile devices 3. Communication Network 11 Control section 12 ADF 13 Image reading unit 14 Image forming unit 15 Paper feed section 16 Operation display section 17 Communications Department 18 Memory section 31 Control Unit 32 Operation display section 33 Communications Department 34 Storage section 35 Camera 51 Display processing unit 52 Measurement processing section 53 Detection processing section 54 Recognition processing section 61 Reading processing unit 62 Judgment processing unit 63 Cutting processing unit 64 Generation processing section 65 Formation Processing Section 100 Image Processing System

Claims

1. a detection processing unit that detects a designation operation for designating a cutout area to be cut out from a document using a camera; a recognition processing unit that recognizes the cutout area designated by the designation operation when the designation operation is detected by the detection processing unit; a reading processing unit that reads an image of the document; a cutout processing unit that cuts out a part of the read image read by the reading processing unit based on the recognition result by the recognition processing unit; An image processing system comprising:

2. The cutout area is a rectangular area with one side parallel to a long side or a short side of the document, the designation operation includes a first designation operation and a second designation operation for designating positions of a first corner and a second corner that are diagonal corners of the cutout area, the recognition processing unit acquires first position information indicating a position of the first corner in the document and second position information indicating a position of the second corner in the document; the cutout processing unit cuts out a rectangular area specified based on the first position information and the second position information from the read image; The image processing system according to claim 1 .

3. a display unit on which the image captured by the camera is displayed; a display processing unit that, when the cutout area is recognized by the recognition processing unit, causes the cutout area recognized by the recognition processing unit to be identifiable on the captured image of the document that is displayed on the display unit; and The image processing system according to claim 1 , comprising:

4. a forming processing unit that forms an image on a sheet based on specific image data including the cut image cut by the cut processing unit; 4. The image processing system according to claim 1.

5. a detection step of detecting a designation operation for designating a cutout area to be cut out from a document using a camera; a recognition step of recognizing the cutout area designated by the designation operation when the designation operation is detected by the detection step; a reading step of reading an image of the document; a cropping step of cropping a part of the read image read by the reading step based on the recognition result by the recognition step; An image processing method comprising:

Images