Information processing systems and programs
By rotating and rescanning the document to combine images, the system effectively removes abnormal areas caused by dirt on the sensor, ensuring accurate document reading and printing.
Patent Information
- Application Number
- JP2025077957
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-05-08
- Publication Date
- 2026-11-19
AI Technical Summary
Dirt such as paper dust adhering to the reading sensor of a reading device can cause abnormal regions in the scanned image, leading to incorrect document reading.
The system rotates the document orientation and rescans it to obtain a second image, combining the first and second images to eliminate abnormal areas, and performs image processing to identify and remove these regions.
Enables the acquisition of a document image free of abnormal areas, allowing for accurate identification and printing of the original document.
Smart Images

Figure 2026182051000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an information processing system and a program.
Background Art
[0002] Patent Document 1 describes an image processing apparatus capable of automatically extracting only the image data of a document to be read when the size of the document cannot be specified.
[0003] Patent Document 2 describes a scanner system capable of automatically specifying a document size in a scanner system having a sheet-through type ADF scanner.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Patent Document 2
Summary of the Invention
Problems to be Solved by the Invention
[0005] If dirt such as paper dust or dust adheres to the reading sensor of a reading device, an abnormal region where the document is not correctly read may occur in the image obtained by reading the document.
[0006] An object of the present disclosure is to provide an information processing system and a program capable of acquiring an image of a document free of abnormal regions even when an abnormal region occurs in the image of the document read by a reading device.
Means for Solving the Problems
[0007] The first embodiment of the information processing system includes a processor, which, when an abnormal area is detected in the document portion of a first image generated by reading the document with a reading device, rotates the orientation of the document and reads it again with the reading device to obtain a second image, and combines the first image and the second image to obtain a third image in which the abnormal area of the document portion has been eliminated.
[0008] In the second embodiment of the information processing system, the processor identifies the region of the original document from the third image, performs a trimming process on the region of the original document identified from the third image, and obtains an image of only the original document.
[0009] In the third embodiment of the information processing system, the processor displays an image of only the original document and prints the image of only the original document in response to instructions from the user.
[0010] In the fourth embodiment of the information processing system, the processor compares the first image and the second image to identify areas that match and areas that do not match between the two images. The matching areas are defined as either the first image or the second image, and the areas that do not match are defined as the image containing image information among the first image and the second image. The first image and the second image are then combined to obtain the third image.
[0011] In the fifth embodiment of the information processing system, in the fourth embodiment of the information processing system, the processor, with respect to the non-matching region, uses the image from which character information has been extracted by optical character recognition processing from the first image and the second image as an image containing image information.
[0012] In the sixth aspect of the information processing system, in the fourth aspect of the information processing system, the processor, with respect to the non-matching region, uses an image from which zeros have been extracted by binarization processing from the first image and the second image as an image containing image information.
[0013] The program of the seventh embodiment causes the computer to perform the following steps: when an abnormal area is detected in the document portion of a first image generated by reading the document with a reading device, the orientation of the document is rotated and the document is read again by the reading device to obtain a second image generated; and the first image and the second image are combined to obtain a third image in which the abnormal area of the document portion is eliminated. [Effects of the Invention]
[0014] According to the information processing system of the first embodiment, even if an abnormal area occurs in the image of a document read by the reading device, an image of the document without the abnormal area can be obtained.
[0015] According to the information processing system of the second embodiment, it is possible to acquire images of only the original document without any missing parts.
[0016] According to the information processing system of the third embodiment, after obtaining approval from the user, it is possible to print an image containing only the complete original document.
[0017] According to the information processing system of the fourth embodiment, abnormal areas in the original document portion of an image can be complemented by the first image and the second image.
[0018] According to the information processing system of the fifth embodiment, an image containing character information can be used to synthesize a third image.
[0019] According to the information processing system of the sixth embodiment, an image that is not plain white after binarization can be used to synthesize a third image.
[0020] According to the program of the seventh embodiment, even if an abnormal area occurs in the image of the original document read by the reading device, an image of the original document without abnormal areas can be obtained. [Brief explanation of the drawing]
[0021] [Figure 1] This is an external view of an image forming apparatus according to an embodiment of the present disclosure. [Figure 2] This is a block diagram showing the hardware configuration of the above image forming apparatus. [Figure 3] This is a diagram showing an example of a document. [Figure 4] This is a diagram showing a state where an abnormal area occurs in an image obtained by scanning a document. [Figure 5] This is a diagram for explaining a process for acquiring an image of a document that has no abnormal area. [Figure 6] This is a diagram for explaining a process for acquiring an image of a document that has no abnormal area. [Figure 7] This is a diagram for explaining a process for acquiring an image of a document that has no abnormal area. [Figure 8] This is a diagram for explaining a process for acquiring an image of a document that has no abnormal area. [Figure 9] This is a diagram for explaining a process for acquiring an image of a document that has no abnormal area. [Figure 10] This is a flowchart for explaining the flow of the process for acquiring an image of a document that has no abnormal area. [Figure 11] This is a flowchart for explaining the specific flow of the process for acquiring an image of a document that has no abnormal area. [Mode for Carrying Out the Invention]
[0022] Hereinafter, exemplary embodiments for implementing the technology of the present disclosure will be described in detail with reference to the drawings. Figure 1 is an external view of an image forming apparatus according to one embodiment.
[0023] The image forming apparatus 10 shown in Figure 1 is an apparatus called a so-called multifunction peripheral having a plurality of functions such as a copy function, a print function, a fax function, and a scan function. The image forming apparatus 10 is an example of the information processing system in the technology of the present disclosure.
[0024] Next, the hardware configuration of the image forming apparatus 10 of this embodiment will be described. Figure 2 is a block diagram showing the hardware configuration of the image forming apparatus 10.
[0025] As shown in Figure 2, the image forming apparatus 10 comprises a control unit 11, a communication interface (abbreviated as communication IF) 12, a user interface device (abbreviated as UI device) 13, a print engine 14, and a scanner 15. These components are connected to each other via a control bus 16.
[0026] The control unit 11 comprises a processor 11a, a memory 11b, and a storage unit 11c. The processor 11a executes predetermined processing based on a program read from the storage unit 11c and expanded into the memory 11b. The storage unit 11c is composed of, for example, a ROM, HDD, or SSD. Various programs and data are stored in the storage unit 11c.
[0027] In this embodiment, the processor 11a is described as reading and executing a program stored in the memory unit 11c, but it is not limited to this. This program may be provided in the form of a computer-readable recording medium as described above. Alternatively, this program may be obtained from an external device via a communication line.
[0028] The communication IF 12 transmits and receives data to and from external devices. The UI device 13 is a device for the user to receive and input information, such as a touch panel and / or buttons. The print engine 14 prints an image onto a recording medium such as printing paper through processes such as charging, exposure, development, transfer, and fixing. The scanner 15 reads the original document loaded into the image forming apparatus 10 and outputs it as image data in a set image format. The scanner 15 is an example of a reading device in the technology of this disclosure.
[0029] In an image forming apparatus, if paper dust or other contaminants adhere to the reading sensor of the scanner 15, there is a risk that abnormal areas will occur in the scanned image where the original document was not read correctly.
[0030] For example, when scanning a document like the one shown in Figure 3, if the scanner 15's reading sensor is a one-dimensional line sensor and dirt is attached to this one-dimensional line sensor, an abnormal region R will occur in the scanned image G, as shown in Figure 4.
[0031] In this explanation, the direction in which the one-dimensional line sensor of the scanner 15 extends is referred to as the primary scanning direction, and the direction in which the document moves relative to the one-dimensional line sensor is referred to as the secondary scanning direction. In the example shown in Figure 4, the Y-axis direction is the primary scanning direction, and the X-axis direction is the secondary scanning direction.
[0032] As shown in Figure 4, if dirt adheres to the one-dimensional line sensor, an abnormal region R will appear in the scanned image G, extending in the sub-scanning direction corresponding to the location of the dirt. Since the dirt adhering to the one-dimensional line sensor is mainly paper dust from the document, if, for example, white documents are regularly used, white dirt will adhere to the sensor. In this case, the abnormal region R will appear as a blank white area in the scanned image G.
[0033] Furthermore, while Figure 4 shows only the image of the original document for clarity, in the case of an irregularly shaped document, for example, a wider area than the document area is scanned, and the document area is identified after scanning using image recognition processing. In such cases, if abnormal areas occur in the scanned image of the document, there is a risk that the white, abnormal areas may be mistakenly identified as the edge of the document area when identifying the document area from the scanned image, making it impossible to accurately identify the document area.
[0034] Thus, in order to obtain an image of a document without abnormal areas even when abnormal areas occur in the image of the document scanned by the scanner 15, the control unit 11 of the image forming apparatus 10 of this embodiment, when it detects an abnormal area in the document portion of the first image generated by scanning the document with the scanner 15, rotates the orientation of the document and scans it again with the scanner 15 to obtain a second image, and combines the first image and the second image to obtain a third image in which the abnormal area in the document portion has been removed.
[0035] Specifically, as shown in Figure 5, if the control unit 11 detects an abnormal region R1 in the document portion of the first image G1 generated by scanning the document with the scanner 15, it rotates the orientation of the document and scans it again with the scanner 15 to obtain a second image G2, and then combines the first image G1 and the second image G2 to obtain a third image G3 in which the abnormal region in the document portion has been removed.
[0036] In this embodiment, the control unit 11 may identify the area of the original document from the third image G3, and perform a cropping process on the area of the original document identified from the third image G3 to obtain an image of only the original document.
[0037] In this case, the control unit 11 may display an image of only the original document and print the image of only the original document in response to instructions from the user.
[0038] Next, we will explain the specific process for obtaining a third image G3 by combining the first image G1 and the second image G2 to remove the abnormal areas in the original document.
[0039] Furthermore, there are no particular limitations on the process for obtaining a third image G3, which is obtained by combining the first image G1 and the second image G2 to remove the abnormal area of the original document. Any process that can obtain a third image G3, which is obtained to remove the abnormal area of the original document, is acceptable.
[0040] For example, as shown in Figure 6, the control unit 11 compares the first image G1 and the second image G2 to identify areas that match and areas that do not match between the two images. The comparison between the two images is performed after rotating the original document and inverting the second image G2, which was obtained by scanning the original document, so that the orientation of the original document for the first image G1 and the second image G2 matches. Then, as shown in Figure 7, the control unit 11 may select either the first or second image as the matching area, and the image containing image information from the first image G1 and the second image G2 as the area that does not match, and then combine the first image G1 and the second image G2 to obtain a third image G3.
[0041] In this case, as shown in Figure 8, the control unit 11 may, for the non-matching regions, select the image from the first image and the second image from which character information has been extracted by optical character recognition processing and treat it as the image containing the image information.
[0042] Furthermore, as shown in Figure 9, the control unit 11 may, in particular when the contrast of the images is lower than a certain level, use the image from which 0 (i.e., black) is extracted by binarization processing from the first image and the second image for areas that do not match as the image containing image information.
[0043] Hereinafter, an example of the processing flow for acquiring an image of a document without abnormal areas in the image forming apparatus 10 of this embodiment will be described in detail with reference to the flowcharts in Figures 10 and 11.
[0044] As shown in Figure 10, first, in step SU01, the user scans a non-standard sized document (synonymous with "reading" above).
[0045] In step SP01, the control unit 11 of the image forming apparatus 10 acquires a first image generated by scanning a non-standard sized document.
[0046] Next, in step SP02, the control unit 11 determines whether or not there is an abnormal region in the first image.
[0047] If it is determined in step SP02 that there are no abnormal areas in the first image, the control unit 11 prints the first image in step SP03 and terminates the process.
[0048] If it is determined in step SP02 that there is an abnormal area in the first image, the control unit 11 notifies the user in step SP04 to rotate the document and rescan.
[0049] In step SU02, the user rotates the document 180° and rescans it.
[0050] In step SP05, the control unit 11 acquires a second image generated by scanning a non-standard sized document.
[0051] Next, in step SP06, the control unit 11 combines the first image and the second image to obtain a third image in which the abnormal area of the original document has been removed.
[0052] The details of the process in step SP06 will be explained in detail with reference to the flowchart in Figure 11.
[0053] As shown in Figure 11, in step SP061, the control unit 11 compares the first image and the second image to identify areas that match and areas that do not match between the two images.
[0054] Next, in step SP062, the control unit 11 extracts regions that do not match between the two images from the first image and the second image.
[0055] Next, in step SP063, the control unit 11 performs optical character recognition processing on the areas of the first image and the second image that do not match.
[0056] Next, in step SP064, the control unit 11 combines the image from which characters were extracted, based on the results of optical character recognition processing for the non-matching regions of the first and second images, with the image of the region that matches between the two images.
[0057] In step SP065, the control unit 11 repeats the process in step SP064 until it has combined images for all regions that do not match between the two images.
[0058] Next, in step SP066, the control unit 11 acquires the image synthesized in steps SP064 to SP065 as a third image from which the abnormal area of the original document has been removed.
[0059] Returning to Figure 10, in step SP07, the control unit 11 identifies the area of the original document from the third image, performs a trimming process on the area of the original document identified from the third image, and obtains an image of only the original document.
[0060] Next, in step SP08, the control unit 11 displays a preview of the image containing only the original document.
[0061] In step SU03, the user inputs an instruction to indicate whether or not to print from the preview display.
[0062] If a print command is input by the user in step SU03, the control unit 11 prints only the image of the original document in step SP09 and terminates the process.
[0063] Furthermore, if the user inputs a print cancellation command in step SU03, the control unit 11 cancels the print in step SP10 and terminates the process.
[0064] [Differentiation] Although an information processing system according to one embodiment of the present disclosure has been described above, the technology of the present disclosure is not limited to the above embodiment and can be modified as appropriate.
[0065] In each of the embodiments described above, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).
[0066] Furthermore, the operation of the processor in the above embodiments may not be performed by a single processor, but may be performed by multiple processors located in physically separate locations working together. Also, the order of the processor operations is not limited to the order described in each of the above embodiments, but may be changed as appropriate.
[0067] Furthermore, in the technology of this disclosure, a system includes both systems composed of multiple devices and systems composed of a single device.
[0068] Furthermore, the technology disclosed herein can also be applied to programs and program products.
[0069] [Note] With regard to the embodiments described above, the following additional information is disclosed.
[0070] (((1))) Equipped with a processor, The aforementioned processor, If an abnormal area is detected in the original document portion of the first image generated by reading the original document with the reading device, a second image is obtained by rotating the orientation of the original document and reading it again with the reading device. A third image is obtained by combining the first and second images to remove the abnormal areas in the original document. Information processing system.
[0071] (((2))) The aforementioned processor, The region of the original document is identified from the third image, The area of the original document identified from the third image is cropped to obtain an image of only the original document. The information processing system described in (((1))).
[0072] (((3))) The aforementioned processor, The system displays an image of only the aforementioned document and prints the image of only the document according to the user's instructions. The information processing system described in (((2))).
[0073] (((4))) The aforementioned processor, By comparing the first image and the second image, the regions that match and the regions that do not match between the two images are identified. The matching region is defined as either the first image or the second image, and the non-matching region is defined as the image containing image information from either the first image or the second image. The first image and the second image are then combined to obtain the third image. An information processing system as described in any one of items (((1))) to (((3))).
[0074] (((5))) The aforementioned processor, For the non-matching region, the image from which character information is extracted by optical character recognition processing among the first and second images is defined as the image containing the image information. The information processing system described in (((4))).
[0075] (((6))) The aforementioned processor, For the non-matching region, the image from which zeros are extracted by the binarization process from the first image and the second image is defined as the image containing image information. The information processing system described in (((4))).
[0076] (((7))) If an abnormal area is detected in the original document portion of the first image generated by reading the original document with the reading device, the process includes the step of rotating the orientation of the original document and obtaining a second image generated by reading it again with the reading device, The steps include: obtaining a third image by combining the first image and the second image to eliminate abnormal areas in the original document; A program that causes a computer to execute something.
[0077] The effects of the configuration described below are explained below.
[0078] According to the information processing system (((1))), even if an abnormal area occurs in the image of the original document read by the reader, an image of the original document without abnormal areas can be obtained.
[0079] According to the information processing system (((2))), it is possible to obtain images of only the original document without any missing parts.
[0080] According to the information processing system (((3))), after obtaining approval from the user, it is possible to print images of only the original document without any missing parts.
[0081] According to the information processing system (((4))), abnormal areas in the original document portion of an image can be complemented by the first image and the second image.
[0082] According to the information processing system (((5))), an image containing text information can be used to synthesize a third image.
[0083] According to the information processing system (((6))), an image that is not plain white after binarization can be used to synthesize a third image.
[0084] According to the program in (((7))), even if an abnormal area occurs in the image of the document read by the scanner, an image of the document without abnormal areas can be obtained. [Explanation of Symbols]
[0085] 10 Image forming apparatus 11 Control Unit 11a processor 11b memory 11c storage section 12 Communication Interfaces 13. User Interface Device 14 Print Engines 15 Scanners 16 Control bus
Claims
1. Equipped with a processor, The aforementioned processor, If an abnormal area is detected in the original document portion of the first image generated by reading the original document with the reading device, a second image is obtained by rotating the orientation of the original document and reading it again with the reading device. A third image is obtained by combining the first image and the second image to remove the abnormal area in the original document. Information processing system.
2. The aforementioned processor, The region of the original document is identified from the third image, The area of the original document identified from the third image is cropped to obtain an image of only the original document. The information processing system according to claim 1.
3. The aforementioned processor, The system displays an image of only the aforementioned document and prints the image of only the document according to the user's instructions. The information processing system according to claim 2.
4. The aforementioned processor, By comparing the first image and the second image, the regions that match and the regions that do not match between the two images are identified. The matching region is either the first image or the second image, and the non-matching region is the image containing image information from the first image or the second image. The third image is obtained by combining the first image and the second image. The information processing system according to claim 1.
5. The aforementioned processor, For the non-matching region, the image from which character information is extracted by optical character recognition processing among the first and second images is defined as the image containing the image information. The information processing system according to claim 4.
6. The aforementioned processor, For the non-matching region, the image from which zeros are extracted by the binarization process from the first image and the second image is defined as the image containing image information. The information processing system according to claim 4.
7. If an abnormal area is detected in the original document portion of the first image generated by reading the original document with a reading device, the process involves rotating the orientation of the original document and obtaining a second image generated by reading it again with the reading device. The steps include: obtaining a third image by combining the first image and the second image to eliminate abnormal areas in the original document; A program that causes a computer to execute something.
Citation Information
Patent Citations
Scanner system, scanner controller, method for specifying document size, and program
JP2009225225A
Image processing apparatus, control method thereof, and program
JP2019036891A
