Image processing apparatus and image forming apparatus
The image processing device addresses the challenge of enlarging or reducing document images by determining the content area and setting an appropriate enlargement or reduction rate, ensuring the content remains legible and visually appealing.
Patent Information
- Application Number
- JP2023147928
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-09-12
- Publication Date
- 2025-03-25
AI Technical Summary
Existing image processing technologies enlarge or reduce entire document images, including content and marginal areas, which can result in insufficient enlargement or excessive reduction of content, making it difficult to view.
An image processing device that reads an original image, determines the content area, and sets an enlargement or reduction rate based on the output size specification, ensuring the content area fits within the image area, thereby improving readability.
The solution allows for easy enlargement or reduction of the content area of an original image, ensuring it remains legible and visually appealing, while avoiding the issues of insufficient enlargement or excessive reduction.
Smart Images

Figure 2025040861000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an image processing apparatus and an image forming apparatus, and more particularly to a technique for enlarging or reducing an original image obtained by scanning an original. [Background technology]
[0002] An image forming apparatus, which is an example of an image processing apparatus, reads an image of an original document and forms the image of the original document on recording paper. When enlarging or reducing the image of the original document, the entire image of the original document is enlarged or reduced at an enlargement or reduction ratio designated by the user, for example, and the entire enlarged or reduced image of the original document is formed on recording paper.
[0003] The content trimming method described in Patent Document 1 identifies content features of an image, determines horizontal and vertical histogram frequencies of the identified content features, determines the boundaries of a document bounding box based on the determined horizontal and vertical histogram frequencies, determines horizontal and vertical centroids of the horizontal and vertical histogram frequencies, respectively, resizes the document bounding box based on the determined horizontal and vertical centroids, and trims the content of the image according to the resized document bounding box.
[0004] In addition, in a method for cropping a photographic image from an image of a photo album page described in Patent Document 2, corners in the image are detected using a corner detection algorithm or as intersections of line segments (and their extensions) in the image using edge, corner, or line detection techniques. The detected corner pairs are used to define rectangular regions (diagonal vertices) in the image. A correlation matrix is generated for each eligible pair of rectangular regions, and candidate rectangular regions are selected based on the eigenvectors of the correlation matrix. The contents of the selected rectangular regions are checked using a saliency map based on a neuron network. The resulting photographic image is extracted as a separate file for further processing or manipulation by the user. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] US09008422B2 publication [Patent Document 2] US010452905B2 publication Summary of the Invention [Problem to be solved by the invention]
[0006] Here, as described above, the entire document image is enlarged or reduced at the enlargement or reduction rate specified by the user, and not only content such as text and photographs contained in the document image, but also blank areas where no content is formed are subject to enlargement or reduction. As a result, there is a risk that the content portion may not be enlarged sufficiently or may be reduced too much, making the content portion difficult to see. As shown in Patent Documents 1 and 2, when image content is individually specified and trimmed or enlarged or reduced to make the content easier to see, it takes time and effort to set the enlargement or reduction process to make the content easier to see, and it is difficult to appropriately enlarge or reduce all the content in the document image with a simple operation.
[0007] The present invention has been made in view of the above circumstances, and has as its object to easily enlarge or reduce the content area of a document image obtained by document scanning to a state that is easy to view. [Means for solving the problem]
[0008] An image processing device according to one aspect of the present invention comprises a reading unit that reads an image of a document, an operation unit into which an output size designation instruction is input that designates the output size at which the document image obtained by document reading by the reading unit is to be output, and a control unit that determines a content area in the document image obtained by document reading by the reading unit, and sets an enlargement or reduction ratio at which the image of the content area fits into the image area based on the size of the image area corresponding to the output size indicated by the output size designation instruction input to the operation unit and the size of the content area, and enlarges or reduces the image of the content area using the set enlargement or reduction ratio.
[0009] An image forming apparatus according to one aspect of the present invention includes an image processing apparatus according to one aspect of the present invention and an image forming unit that forms the original image on recording paper, and the control unit causes the image forming unit to form the original image, with the content area enlarged or reduced, in an image area on the recording paper. [Effects of the Invention]
[0010] According to the present invention, it is possible to easily enlarge or reduce the content area of a document image obtained by document scanning to an easily viewable state. [Brief explanation of the drawings]
[0011] [Figure 1] 1 is a cross-sectional view showing an image forming apparatus according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing the internal configuration of the image forming apparatus. [Figure 3] 1A is a diagram showing a content area in an image of a document, and FIG. 1B is a diagram showing a margin area, an image area, and an image of the content area on a recording sheet. [Figure 4] 1A is a diagram showing an image of an original document, and FIG. 1B is a diagram showing the state in which the image of the original document is enlarged or reduced and formed on recording paper. [Figure 5A] 10 is a flowchart showing a process of enlarging or reducing an image in a content region of a document image obtained by reading a document. [Figure 5B] 5B is a flowchart showing the process following FIG. 5A. [Figure 5C] 5C is a flowchart showing the processing following FIG. 5B. [Figure 6] FIG. 10 is a diagram showing a function selection screen displayed on a display unit. [Figure 7] FIG. 10 is a diagram showing a first content area setting screen displayed on a display unit. [Figure 8] 1A is a diagram showing an image of an original document, and FIG. 1B is a diagram showing a binarized image of the original document. [Figure 9] 1A is a diagram showing a content area in an image of a document, and FIG. 1B is a diagram showing an image of the content area. [Figure 10] 10A and 10B are diagrams showing two examples of margin areas on recording paper. [Figure 11] 10 is a diagram showing an image of a content area formed on a recording sheet by being enlarged or reduced by an enlargement or reduction method associated with a fit key. FIG. [Figure 12] 10A and 10B are diagrams showing an image of a content area formed on recording paper by being enlarged or reduced by a method of enlargement or reduction associated with a fill key; [Figure 13] 10A and 10B are diagrams showing an image of a content area formed on a recording sheet by being enlarged or reduced by a method of enlarging or reducing the content area associated with a stretch key; [Figure 14] FIG. 10 is a diagram showing a second content area setting screen displayed on the display unit. DETAILED DESCRIPTION OF THE INVENTION
[0012] An image forming apparatus according to one embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a cross-sectional view showing an image forming apparatus according to one embodiment of the present invention. As shown in FIG. 1, the image forming apparatus 10 of this embodiment is an MFP (multi-function peripheral) that combines multiple functions such as a copy function and a printer function. The image forming apparatus 10 includes an image reading unit 11 and an image forming unit 12.
[0013] The image reading unit 11 has an imaging element (CCD sensor, CIS) that optically reads an image of a document, and image data representing the image of the document is generated from the analog output of this imaging element. In addition, this image reading unit 11 reads an image of a document placed on a document table (platen glass) using the imaging element, or uses an ADF (automatic document feeder) to pull out and transport multiple documents set on a document tray one by one, and reads the images of the documents being transported using the imaging element.
[0014] The image forming unit 12 is an electrophotographic mechanism that forms an image represented by the image data on recording paper. It includes a magenta image forming unit 3M, a cyan image forming unit 3C, a yellow image forming unit 3Y, and a black image forming unit 3Bk. Each of the image forming units 3M, 3C, 3Y, and 3Bk uniformly charges the surface of the photosensitive drum 4, exposes the surface of the photosensitive drum 4 to light, forms an electrostatic latent image on the surface of the photosensitive drum 4, develops the electrostatic latent image on the surface of the photosensitive drum 4 into a toner image, and primarily transfers the toner image on the surface of the photosensitive drum 4 to the intermediate transfer belt 5. This forms a color toner image on the intermediate transfer belt 5. This color toner image is then secondarily transferred to the recording paper P, which has been transported from the paper feed unit 14 through the transport path 8, in the nip region N between the intermediate transfer belt 5 and the secondary transfer roller 6.
[0015] Thereafter, the recording paper P is heated and pressed in the fixing device 15, the toner image on the recording paper P is fixed by heat and pressure, and the recording paper P is then discharged onto a discharge tray 17 via discharge rollers 16.
[0016] Next, Fig. 2 is a block diagram showing the main internal configuration of the image forming apparatus 10 of this embodiment. As shown in Fig. 2, the image forming apparatus 10 of this embodiment includes an image reading unit 11, an image forming unit 12, a display unit 21, an operation unit 22, a touch panel 23, an image memory 26, a storage unit 27, and a control unit 28. These components are capable of transmitting and receiving data or signals to and from each other via a bus.
[0017] The display unit 21 is configured by a liquid crystal display (LCD) or an organic light-emitting diode (OLED) display.
[0018] The operation unit 22 includes physical keys such as a numeric keypad, a decision key, a start key, etc. The operation unit 22 receives various instructions from the user.
[0019] A touch panel 23 is arranged on the screen of the display unit 21. The touch panel 23 is a so-called resistive or capacitive touch panel, which detects contact (touch) of a user's finger or the like with the touch panel 23 together with the contact position, and outputs a detection signal indicating the coordinates of the contact position to a control unit 29 (described later) of the control unit 28, etc.
[0020] In the image memory 26, image data representing the image of the original M read by the image reading unit 11 is stored.
[0021] The storage unit 27 is a large-capacity storage device such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive), and stores various application programs and various data.
[0022] The control unit 28 is composed of a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), etc. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). The control unit 28 functions as a control unit 29 when a control program stored in the ROM or the storage unit 27 is executed by the processor.
[0023] The control unit 29 comprehensively controls the image forming apparatus 10. The control unit 28 is connected to the image reading unit 11, the image forming unit 12, the display unit 21, the operation unit 22, the touch panel 23, the image memory 26, and the storage unit 27. The control unit 29 controls the operation of these components and transmits and receives signals or data to and from each of the components.
[0024] The control unit 29 serves as a processing unit that executes various processes required for image formation by the image forming apparatus 10. The control unit 29 also accepts operation instructions input by the user based on detection signals output from the touch panel 23 or operation of the physical keys of the operation unit 22. For example, the control unit 29 accepts touch operations on a GUI (Graphical User Interface) displayed on the screen of the display unit 21 through the touch panel 23. The control unit 29 also has a function of controlling the display operation of the display unit 21. The control unit 29 also processes image data stored in the image memory 26.
[0025] In the image forming apparatus 10 configured as described above, for example, a user places an original M in the image reading unit 11 and inputs a copy operation execution instruction by operating the start key on the operation unit 22. In accordance with the copy operation execution instruction input to the operation unit 22, the control unit 29 causes the image reading unit 11 to read the image of the original M, and causes the image forming unit 12 to form the original image obtained by reading the original M on recording paper.
[0026] In this embodiment, when enlarging or reducing an image of original M and forming it on recording paper, the user sets original M in image reading unit 11, touches the GUI displayed on display unit 21, inputs a designation instruction specifying a method for enlarging or reducing the original image of original M via touch panel 23, and inputs a processing execution instruction by operating the start key on operation unit 22. In accordance with the input designation instruction and processing execution instruction, control unit 29 causes image reading unit 11 to read the image of original M, and performs enlargement or reduction processing on the original image obtained by reading original M using the instructed method.
[0027] When the entire document image obtained by scanning the document is enlarged or reduced at a rate specified by the user, not only the content, such as text and photographic images, contained in the document image but also the blank areas where no content is formed are subject to enlargement or reduction. As a result, there is a risk that the content portion will not be enlarged sufficiently or will be reduced too much, making the content portion difficult to see. In other words, the content, such as text and photographic images, contained in the document image will not necessarily be enlarged or reduced appropriately to make it easy to see.
[0028] Therefore, the image forming apparatus 10 of this embodiment enlarges or reduces the content area in the document image without solving the above problem. The control unit 29 determines the content area, which is composed of content such as text or a photographic image, in the document image obtained by document scanning by the image scanning unit 11. The control unit 29 also sets the width of a margin area surrounding the content area in accordance with instructions input by the user, and sets the area inside the margin area as the image area. Furthermore, the control unit 29 sets the enlargement or reduction rate of the image in the content area based on the size of the image area corresponding to the output size indicated by the output size designation instruction input to the operation unit 22 and the size of the content area, and enlarges or reduces the image in the content area at the set enlargement or reduction rate. The control unit 29 then stores the document image with the enlarged or reduced content area in the storage unit 27, or causes the image forming unit 12 to form the enlarged or reduced content area on recording paper.
[0029] For example, when enlarging or reducing a document image im of a document M as shown in FIG. 3A, the control unit 29 determines and extracts a content area CR from the document image im. This content area CR contains content C such as text or an image. The content area CR is a rectangular area including a character area and / or an image area, and is the smallest rectangular area that can include a character area and / or an image area. The control unit 29 distinguishes between a character area and an image area using a known method. For example, the control unit 29 distinguishes between character images by performing OCR processing or the like on the document image im, and distinguishes an area consisting of the character images as a character area, and distinguishes an area consisting of a photograph, graphic image, or the like as an image area.
[0030] Furthermore, an output size designation instruction specifying the size at which the document image im is to be output is input from the user to the operation unit 22. In this embodiment, the output size is a standard recording paper size, such as A4, A3, B5, B4, etc. Furthermore, for each output size, the control unit 29 stores an image area within that size in which the image is to be arranged (the maximum rectangular area in which an image can be formed on recording paper of each recording paper size).
[0031] Furthermore, the user inputs a width specification instruction to the operation unit 22, specifying the width of the margin area. The margin area is provided in an area surrounding the content area, with a width specified by the width specification instruction. The control unit 29 sets the margin area around the content area CR in accordance with the width specification instruction that specifies the width of the margin area. That is, the control unit 29 sets the area inward from the outer edge of the image area corresponding to the specified output size by the width specified by the width specification instruction as the margin area. Therefore, when no margin area is set, the control unit 29 sets each of the image areas corresponding to the output size as the image area as is, but when a margin area is set, the control unit 29 sets the area inside the set margin area as the image area.
[0032] For example, as shown in Fig. 3(B), the user sets the width of the margin area YR, and the margin area YR is arranged along the periphery of the area indicated by the standard size corresponding to the specified output size. The area inside the margin area YR is set as the image area GR. The control unit 29 enlarges or reduces the image CZ in the content area CR to the size of the image area GR.
[0033] Note that when enlarging or reducing the entire document image im of document M shown in Fig. 4(A) rather than the content area CR and arranging it along the periphery of the area indicated by the standard size corresponding to the specified output size, not only the content, such as text and photographic images, contained in the document image but also the blank area where no content is formed are subject to enlargement or reduction. Therefore, as shown in Fig. 4(B), there is a risk that the content portion may not be enlarged sufficiently or may be reduced too much, making the content portion difficult to see (Fig. 4(B) shows the case of reduction). However, the enlargement or reduction process performed by the control unit 29 in this embodiment reduces such problems.
[0034] Next, a description will be given of the process of enlarging or reducing the image in the content area of the document image obtained by reading the document M as described above. Figures 5A, 5B, and 5C are flowcharts showing the process of enlarging or reducing the image in the content area of the document image obtained by reading the document M.
[0035] The control unit 29 displays a function selection screen GS, such as that shown in Fig. 6, on the display unit 21. This function selection screen GS displays a plurality of function keys 41a to 41h, each associated with a respective function. After touching the function key 41h, the user places a document on the document table of the image reading unit 11, or sets one or more documents in the document tray of the image reading unit 11. When the user touches the function key 41h, the control unit 29 receives, via the touch panel 23, an instruction to execute a process associated with the function key 41h to enlarge or reduce the image in the content area of the document image obtained by reading the document M (S101).
[0036] Then, control unit 29 controls image reading unit 11 to read the image of the document placed on the document table (platen) as described above using an imaging element, or to pull out and transport one or more documents set on the document tray one by one using the ADF, and to read the image of the document being transported using the imaging element. Image reading unit 11 is provided with a first sensor (not shown) that detects the document placed on the document table, and a second sensor (not shown) that detects the document in the document tray.
[0037] For example, when a user places a document on the platen glass serving as the document table of the image reading unit 11 and the control unit 29 receives a signal from the first sensor detecting the document M on the document table (S102 "Document Table"), the control unit 29 sets a first mode in which the image reading unit 11 reads the image of the document M on the document table (S103).
[0038] Furthermore, when the user places a document on the document tray of the image reading unit 11 and the control unit 29 detects a signal from the second sensor indicating that a document is in the document tray (S102 "Tray"), the ADF is used to pull the document out of the document tray and transport it, and the second mode is set so that the image reading unit 11 reads the image of the document being transported (S150).
[0039] When the first mode is set (S103), the control unit 29 causes the display unit 21 to display a first content area setting screen G1 such as the example shown in FIG. 7 (S104).
[0040] The first content area setting screen G1 shown in FIG. 7 displays the document image of the document M. It also displays a fit key K11, a fill key K12, and a stretch key K13 for selecting one of three enlargement or reduction methods. It also displays four margin display fields YL1, YL2, YL3, and YL4, which display the specified widths of the margin areas located above, below, left, and right of the content area in the document image of the document M. Each margin display field YL1 to YL4 also displays an increase key K21 and a decrease key K22 for increasing or decreasing the width of the margin area displayed in the margin display field. It also displays a threshold display field NL1 for displaying a specified threshold Sh used when binarizing the document image of the document M. It also displays an increase key K24 and a decrease key K25 for increasing or decreasing the threshold Sh displayed in the threshold display field NL1, as well as an OK key K27.
[0041] Furthermore, the first content area setting screen G1 displays size keys K31, K32, K33, and K34 for accepting the output size of the document image im.
[0042] The user touches the increase key K21 or decrease key K22 for each of the margin display fields YL1 to YL4 to input a width designation instruction to increase or decrease the width of the margin area. The control unit 29 receives the width designation instruction associated with the touch operation on the increase key K21 or decrease key K22 for each of the margin display fields YL1 to YL4 via the touch panel 23, sets the width of each margin area increased or decreased by the amount of change indicated by the width designation instruction (S105), and displays the set value in the margin display fields YL1 to YL4.
[0043] The user also touches any of the fit key K11, fill key K12, and stretch key K13 to input an instruction to select one of three types of enlargement or reduction methods. The control unit 29 receives a designation instruction associated with the operated fit key K11, fill key K12, or stretch key K13 through the touch panel 23, and sets the enlargement or reduction method of the type indicated by the designation instruction (S106).
[0044] Here, the fit process associated with the fit key K11 is a process of enlarging or reducing the image of the content area CR by maintaining the aspect ratio of the content area CR and making the shorter of the vertical or horizontal width of the content area CR equal to the corresponding width of the image area.
[0045] The fill process associated with the fill key K12 is a process of enlarging or reducing the image of the content area CR to the maximum size that maintains the aspect ratio of the content area CR and allows both the vertical and horizontal widths of the content area CR to fit within the image area.
[0046] The stretch process associated with the stretch key K13 is a process of enlarging or reducing the image in the content area CR by making the width of the content area CR equal to the width of the image area and the height of the content area CR equal to the height of the image area without maintaining the aspect ratio of the content area CR.
[0047] The user also touches the increase key K24 or the decrease key K25 to input an instruction to increase or decrease the threshold value Sh used in binarizing the document image. The control unit 29 receives an instruction associated with the touch operation on the increase key K24 or the decrease key K25 via the touch panel 23, and increases or decreases the threshold value Sh to the value indicated by the instruction (S107). The threshold value Sh is used to binarize the document image. For example, when the gradation of each pixel constituting the document image is expressed in gradations of 0 to 255, the control unit 29 converts the pixel to "white" (pixel value 255) if the pixel value is equal to or greater than the threshold value Sh, and converts the pixel to "black" (pixel value 0) if the pixel value is less than the threshold value Sh.
[0048] The user touches any one of the size keys K31, K32, K33, and K34 to input a size designation instruction that specifies the output size of the document image im. The control unit 29 receives the size designation instruction associated with the touched size key K31, K32, K33, or K34 through the touch panel 23 (S108).
[0049] Here, when the user touches the OK key K27 and the control unit 29 receives an image processing execution instruction associated with the OK key K27 through the touch panel 23, the image reading unit 11 reads the document M on the document table (S109), and the document image obtained by the reading is stored in the image memory 26.
[0050] Next, the control unit 29 binarizes the original image stored in the image memory 26 for each pixel constituting the original image using the threshold value Sh set in S107, and generates a binary image of the original image (S110). As a result, for example, the original image im of the original M shown in Fig. 8(A) is converted into the binary image NZ shown in Fig. 8(B). The original image im and the binary image NZ naturally have the same size (the same number of pixels arranged in the row and column directions), the same coordinate system, and the coordinate position of each content C in the original image im and the coordinate position of each content C in the binary image NZ match.
[0051] For example, for each pixel in the binary image NZ of the original M shown in FIG. 8(B), the control unit 29 compares the horizontal position in FIG. 8(B) of each pixel converted to "black" for each horizontal row in FIG. 8(B), selects the "black" pixels located on both outermost sides in the horizontal direction, and sets vertical lines VL on both sides in the horizontal direction that pass through the positions of the "black" pixels located on both outermost sides in the horizontal direction for all rows.
[0052] In addition, the control unit 29 compares the vertical position of each row containing "black" pixels, selects the rows located on both outermost sides in the vertical direction, and sets horizontal lines HL on both sides of the vertical direction that pass through the rows containing "black" pixels located on both outermost sides in the vertical direction.
[0053] Then, the control unit 29 sets a rectangular area surrounded by the vertical lines VL on both sides in the horizontal direction and the horizontal lines HL on both sides in the vertical direction in the binarized image NZ of the document image im as a content area CR (S111).
[0054] Furthermore, the control unit 29 overlays the content area CR in the binary image NZ on the original image im, as shown in Figures 9(A) and (B), and cuts out the image CZ of the content area from the original image im to generate the image CZ of the content area (S112).
[0055] The control unit 29 sets a margin area YR by extending inward from the entire area of the recording paper having the specified output size along the top, bottom, left, and right edges in FIG. 10(A) or (B) by the width of each of the top, bottom, left, and right edges set in S105, as shown in, for example, FIG. 10(A) or (B), and sets the area inside each margin area YR as the image area GR (S113).
[0056] Note that the control unit 29 does not set a margin area if all of the width values of the margin area set in S105 are "0." In this case, the control unit 29 sets the image area corresponding to the output size accepted in S108 as the image area as is.
[0057] Then, using the enlargement or reduction method of the type set in S106, control unit 29 enlarges or reduces image CZ of the content area generated in S112 so that it fits within image area GR, and places this enlarged or reduced image CZ of the content area in image area GR to generate a processed original image im2 (S114). That is, control unit 29 sets an enlargement or reduction ratio at which the image of the content area fits within the image area based on the size of the image area corresponding to the output size when no margin area is set, or the size of the image area that is the area inside the margin area when a margin area is set, and the size of the content area, and then enlarges or reduces the image of the content area using the set enlargement or reduction ratio to generate original image im2.
[0058] Here, when a fit process associated with the fit key K11 is set in S106, the control unit 29 maintains the aspect ratio of the content area CR, as shown in FIG. 11, and enlarges or reduces the image in the content area CR by making the shorter of the vertical or horizontal width of the content area CR equal to the corresponding width of the image area.
[0059] Furthermore, when a fill process associated with the fill key K12 is set in S106, the control unit 29 maintains the aspect ratio of the content area CR and enlarges or reduces the image of the content area CR to the maximum size that allows both the vertical and horizontal widths of the content area CR to fit within the image area, as shown in FIG. 12.
[0060] Furthermore, when a stretch process associated with the stretch key K13 is set in S106, for example, when a document image of standard size A4 portrait is enlarged or reduced to an image area of output size having the size of standard size A4 landscape, the control unit 29 does not maintain the aspect ratio of the content area CR, but makes the width of the content area CR equal to the width of the image area and makes the height of the content area CR equal to the height of the image area, as shown in FIG. 13, thereby enlarging or reducing the image in the content area CR.
[0061] The image CZ in the content area is enlarged or reduced by a known method such as pixel interpolation or thinning.
[0062] In accordance with instructions from the user input to the operation unit 22, the control unit 29 (i) stores the document image im2 generated in S114 in the storage unit 27, or (ii) causes the image forming unit 12 to form the document image im2 on recording paper P of a size corresponding to the output size specified in S108 (S115). After this, the process ends.
[0063] On the other hand, if the second mode is set in S104 (S150), the control unit 29 causes the display unit 21 to display a second content area setting screen G2 as shown in FIG. 14 (S116).
[0064] 14 displays the same keys as those on the first content area setting screen G1 shown in Fig. 7, as well as a page-by-page key K14 for receiving input of instructions to set the enlargement or reduction method, the width of the margin area, and the threshold Sh for each document image of multiple documents M. Note that the second content area setting screen G2 does not have an area for displaying document images, as in the first content area setting screen G1.
[0065] When the user touches the page-by-page key K14, the control unit 29 receives, via the touch panel 23, an instruction to execute page-by-page processing, which processes the document images individually for each of the document images of multiple documents M that are pulled out from the document tray and transported by the ADF ("individual" in S117).
[0066] In this case, the control unit 29 executes the process in accordance with each instruction input by the user's operation, similar to S105 to S115 described above (S130 to S140). In this case, in S134, the control unit 29 controls the image reading unit 11 to pull out the document from the document tray and read it.
[0067] After S140, the control unit 29 determines whether the next document in the document tray has been detected by the second sensor of the image reading unit 11 (S141), and if it determines that the next document in the document tray has been detected (S141 "Yes"), the next document remains in the document tray, so the processes of S130 to S140 are repeated.
[0068] Also, if the control unit 29 determines that the second sensor of the image reading unit 11 has not detected the next document in the document tray (S141 "No"), the processing ends because there is no next document remaining in the document tray.
[0069] On the other hand, if the user does not touch the page unit key K14 in S117, the control unit 29 accepts an instruction to execute batch processing to perform the same processing on all of the document images of the multiple documents M (S117 "Batch").
[0070] In this case, the control unit 29 executes the process in accordance with each instruction input by the user's operation in the same manner as in S105 to S115 described above (S118 to S128). In this case, in S122, the control unit 29 controls the image reading unit 11 to pull out the document from the document tray and read it.
[0071] After S128, the control unit 29 determines whether the next document in the document tray has been detected by the second sensor of the image reading unit 11 (S129). If it determines that the next document in the document tray has been detected (S129 "Yes"), the next document remains in the document tray, so the process returns to S122 and repeats the processes of S122 to S128.
[0072] Also, if the control unit 29 determines that the second sensor of the image reading unit 11 has not detected the next document in the document tray (S129 "No"), the processing ends because there is no next document remaining in the document tray.
[0073] In this way, in the image forming device 10 according to this embodiment, the content area in the document image of the document M is determined, and an enlargement or reduction ratio is set so that the image of the content area fits into the image area based on the size of the image area of the output size, or the size of the image area that is the area inside the margin area if a margin area is set, and the size of the content area. The image of the content area is enlarged or reduced using the set enlargement or reduction ratio, so that the content area in the document image obtained by document reading can be enlarged or reduced to a state that is easy to see.
[0074] The configurations and processes of the above-described embodiment explained with reference to FIGS. 1 to 14 are merely examples of the present invention, and the present invention is not limited to these configurations. [Explanation of symbols]
[0075] 10 Image forming device 11 Image reading unit 12 Image forming unit 21 Display section 22 Control section 23 Touch Panel 26 Image Memory 27 Memory section 28 Control Unit 29 Control Unit
Claims
1. A reading unit that reads an image of a document; an operation unit for inputting an output size designation instruction for designating an output size for outputting an original image obtained by the original reading by the reading unit; An image processing device comprising: a control unit that determines a content area in a document image obtained by reading the document using the reading unit; sets an enlargement or reduction ratio at which an image of the content area fits into the image area based on the size of the image area corresponding to the output size indicated by the output size designation instruction input to the operation unit and the size of the content area; and enlarges or reduces the image of the content area using the set enlargement or reduction ratio.
2. The image processing device according to claim 1 , wherein the control unit sets a margin area in accordance with a width specification instruction input to the operation unit that specifies the width of an area around the content area, and sets the area inside the set margin area as the image area.
3. The image processing apparatus according to claim 1 , wherein the control unit binarizes the document image to generate a binary image, and determines the content area based on the binary image.
4. The control unit is a fit process that maintains the aspect ratio of the content area and makes the shorter of the height or width of the content area equal to the corresponding width of the image area, thereby enlarging or reducing the image of the content area; A fill process that enlarges or reduces the image of the content area so that both the vertical and horizontal widths of the content area are the maximum size that fits within the image area while maintaining the aspect ratio of the content area; 2. The image processing device of claim 1, wherein the content area is enlarged or reduced by either a stretching process that does not maintain the aspect ratio of the content area, makes the width of the content area equal to the width of the image area, and makes the height of the content area equal to the height of the image area, thereby enlarging or reducing the image of the content area.
5. the width designation instruction is input to the operation unit for each document to be read by the reading unit; 3. The image processing device of claim 2, wherein the control unit sets a margin area for the document image for each document in accordance with the width specification instruction for each document input to the operation unit, sets the area inside the set margin area as the image area, determines a content area in each document image for each document read by the reading unit, sets an enlargement or reduction ratio of the content area for each document image based on the size of the image area and the size of the content area, and enlarges or reduces the image of the content area at the set enlargement or reduction ratio.
6. Further comprising a storage unit, The image processing apparatus according to claim 2 , wherein the control unit causes the document image with the content area enlarged or reduced to be stored in the storage unit.
7. An image processing device according to any one of claims 1 to 6, an image forming unit that forms the document image on a recording sheet; The control unit causes the image forming unit to form the document image, the content area of which has been enlarged or reduced, in an image area on the recording paper.
Citation Information
Patent Citations
US010452905B2
Methods of content-driven image cropping
US9008422B2