Information processing device, information processing method, and program

Abstract

The present invention provides an information processing device, an information processing method, and a program that can reduce errors in determining the size of documents of irregular sizes. [Solution] The present invention comprises a detection unit that detects the edges of the original document within an image generated by scanning the original document to detect the original document size; a recording unit that records the original document size detection result by the detection unit; and a determination unit that, when the original document size is detected later, determines the final original document size based on the original document size detected later and the recorded original document size detection result.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] In image forming apparatuses that scan a document to create an image file, automatic detection technologies for automatically detecting the document size of the document to be scanned have been developed. Patent Document 1 discloses a configuration in which image size information is stored, an object region including characters and graphics is extracted, and a clipping region of the image is determined, for the purpose of handling both standard-size and non-standard-size documents without the need to input the document size.

Summary of the Invention

Problems to be Solved by the Invention

[0003] However, with the above-described automatic document size detection technology, it is difficult to pre-register all possible sizes for non-standard-size documents in the apparatus, and the document size is detected and determined each time a scan is performed, which may cause errors. In addition, the technique described in Patent Document 1 is characterized in that a clipping region surrounding an object region such as characters and graphics is determined at a predetermined interval, but for a document where the margins relative to the object are not at a fixed interval, a range different from that of the original document will be clipped.

[0004] The present invention has been made in view of the above, and an object of the present invention is to provide an information processing apparatus, an information processing method, and a program that can reduce errors in size determination for non-standard-size documents.

Means for Solving the Problems

[0005] To solve the above-mentioned problems and achieve the objective, the present invention comprises: a detection unit that detects the edges of the original document in an image generated by scanning the original document to detect the original document size; a recording unit that records the original document size detection result by the detection unit; and a determination unit that, when the original document size is detected later, determines the final original document size based on the original document size detected later and the recorded original document size detection result. [Effects of the Invention]

[0006] The present invention has the effect of reducing errors in determining the size of documents of irregular sizes. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 shows an example of the configuration of the information processing device according to this embodiment. [Figure 2] Figure 2 shows an example of the functional configuration of the information processing device according to this embodiment. [Figure 3] Figure 3 is a flowchart illustrating the logic for determining the document size using a document size determination result recording table in the information processing device according to this embodiment. [Figure 4] Figure 4 is a flowchart illustrating the size classification number assignment logic in the information processing device according to this embodiment. [Figure 5] Figure 5 is a flowchart illustrating the logic for displaying and allowing the user to select the closest document size using a document size determination result recording table in the information processing device according to this embodiment. [Figure 6] Figure 6 shows an example of a screen image displayed on the operation panel in the information processing device according to this embodiment. [Modes for carrying out the invention]

[0008] The following describes in detail embodiments of the image processing device (or information processing device), information processing method, and program with reference to the attached drawings.

[0009] Figure 1 shows an example of the configuration of an information processing device according to this embodiment. The information processing device according to this embodiment is an image processing device or image forming device such as an MFP (Multi-Function Peripheral) that scans a document and generates an image, and as shown in Figure 1, it has a reading device 101, an image forming device 102, a non-volatile storage area 103, a memory 104, an operation panel 105, a CPU (Central Processing Unit) 106, and a communication means 107.

[0010] The reading device 101 is a device for reading documents such as paper, and is equipped with an ADF (Automatic Document Feeder) and a document glass.

[0011] The image-forming device 102 is a device (printer unit) that prints the image of the scanned original or an electronic image sent from a PC or the like onto transfer paper. If the information processing device according to this embodiment is a scanner device alone, rather than an image forming apparatus such as an MFP (Multi-Function Peripheral), then the image-forming device 102 does not need to be included.

[0012] The non-volatile memory area 103 stores the MFP's OS (Operating System) and application programs. It also stores device settings and operation history.

[0013] Memory 104 is used to run the OS and application programs. Memory 104 is also used to temporarily hold read image data.

[0014] The control panel 105 is used when the OS or applications display something to the user or receive instructions from the user.

[0015] The CPU 106 executes an OS and applications.

[0016] The communication unit 107 is a network communication unit such as Ethernet (registered trademark), Wi-Fi (registered trademark), or a modem, and is used to communicate with other apparatuses on a network.

[0017] Figure 2 is a diagram illustrating an example of a functional configuration of the information processing apparatus according to the present embodiment. As illustrated in Figure 2, the information processing apparatus according to the present embodiment includes a scanner application 201, an operation panel control service 202, a reading control service 203, a communication control service 204, an initial setting database 205, an operation history database 206, and the like.

[0018] The scanner application 201 implements a function of transmitting an email or a file to a folder. In the present embodiment, the scanner application 201 is described as a representative application that performs reading, but the same applies to a copy application and a fax application.

[0019] The operation panel control service 202 displays a UI for using a transmission application on the screen of the operation panel 105 in accordance with an instruction from an application having a transmission function (transmission application) such as the scanner application 201. Further, the operation panel control service 202 notifies the transmission application when a touch panel or a button is operated.

[0020] The reading control service 203 operates the reading apparatus 101 in accordance with an instruction from a transmission application such as the scanner application 201 to read a document such as paper. Further, the reading control service 203 scans the document with the reading apparatus 101 to generate an image. Further, the reading control service 203 is an example of a detection unit that detects an edge of the document in the generated image to detect a document size (for example, an irregular document size).

[0021] In the document size detection method, the edge of the document may be detected as a feature amount of a visible light image captured by the reading device 101 by irradiating the document with visible light, and an invisible light image captured by the reading device 101 by irradiating the document with invisible light such as near-infrared light, and the document size may be detected based on the edge detection result. For detecting the edge of the document, an edge detection method may be used based on the fact that there is a significant difference in the background read values between the visible light image and the invisible light image.

[0022] Further, the reading control service 203 functions as an example of a determination unit that, when a document size is detected later, determines the final document size based on the subsequently detected document size and the document size detection result recorded in the operation history database 206. As a result, the document size determination result obtained by edge detection for a document of irregular size is recorded in the device each time, and then the final document size can be determined from the document size detection result recorded when the document size is determined by scanning. For example, if the detected document size is close to the recorded detection result, it is determined that they are the same size, and the error is reduced by taking the average value, and the closest document size detection result can be presented to the user for selection. As a result, it is possible to reduce the error in size determination for documents of irregular size.

[0023] For example, the reading control service 203 may detect a document size within a predetermined error range from among the document size detection results recorded in the operation history database 206 with respect to the detected document size, and determine the final document size based on the average value of the relevant document sizes. As a result, by averaging the errors of similar document sizes, the errors can be converged and the error in document size can be reduced.

[0024] Furthermore, the scanning control service 203 may extract the closest document size from the detected document sizes recorded in the operation history database 206, generate scanned images using both document sizes, display them on the screen, allow the user to select the document size, and then confirm the selected document size as the final document size. This eliminates errors by automatically classifying the closest document sizes in the system while allowing the user to select the desired document size.

[0025] The communication control service 204 controls devices such as communication means 107 for performing network communication such as Ethernet and Wi-Fi.

[0026] The initial settings database 205 is a database for storing the settings required to use the device.

[0027] The operation history database 206 is a database that records job conditions and the results of the document size determination (document size determination results). In other words, the operation history database 206 is an example of a recording unit that records the results of document size detection by the reading control service 203 within the device. In this embodiment, the operation history database 206 stores a document size determination result recording table as shown in Table 1 below. [Table 1] The document size determination result record table shown in Table 1 is a table that records the detection (determination) results of the document size when scanning with automatic detection of irregular document size. The document size determination result record table records sequentially starting from record number 1 each time a scan job is performed and the document size is detected, and records the date and time the scan job was performed, the user who performed the scan job, the scan job number, the page number, and the width (determination size width) and length (determination size length) of the document size for each page, linking them together.

[0028] Figure 3 is a flowchart illustrating the logic for determining the document size using the document size determination result record table in the information processing device according to this embodiment. In this example, the error in document size is reduced by searching for a document size that falls within the error range in the document size determination result record table for the detected document size and taking its average value.

[0029] When the detection of the original document size begins (step S301), the scanning control service 203 sets the record number n in the original document size determination result record table to 1 (step S302). Each time the scanning control service 203 scans and detects the original document size, it refers to the determination size width and determination size length in order from record number n in the original document size determination result record table, starting from 1, and determines whether the detected original document size is within the error range (steps S303, steps S304).

[0030] The error range may be pre-registered as a default value allowed by the device, or it may be freely set by the user. In the following embodiments, the error range is set to 2 mm. The reading control service 203 considers the detected document size to be the same if both the width and length are within the error range, and calculates the average value to minimize the error between the two and determines the detected size (step S305). Next, if there is a next record number n (step S306: Yes), the reading control service 203 increments the record number n (step S307) and returns to step S203. On the other hand, if there is no next record number n (step S306: No), the reading control service 203 records the determined detected size in the last record number n of the document size determination result record table (step S308).

[0031] A concrete example is shown using the document size determination result record table shown in Table 1. Suppose the detected document size is width: 59 mm and length: 149 mm. In the document size determination result record table shown in Table 1, the records where both the determined width and determined length fall within the error range of 2 mm are record numbers 2 and 7. Therefore, following the flowchart shown in Figure 3, the reading control service 203 takes the average of the determined width and determined length of record numbers 2 and 7 and the detected document size for the current document, resulting in a width of (59 + 61 + 60) / 3 = 60 mm and a length of (149 + 150 + 151) / 3 = 150 mm. As a result, the reading control service 203 records the confirmed document size as width: 60 mm and length: 150 mm in the last record number of the document size determination result record table, 11, and creates an image of this size.

[0032] Table 2 below is the document size determination result record table with size classification numbers added to the document size determination result record table in Table 1. The reading control service 203 classifies the detected document sizes that are considered to be the same within the error range and assigns them numbers (size classification numbers) to make it easier to handle similar document sizes. The following figures will explain the method of assigning and utilizing the size classification numbers in an embodiment. In other words, the operation history database 206 may classify the detected document size into document sizes that fall within a predetermined error range from the recorded document size detection results and record them. This allows the system to automatically classify similar document sizes, enabling it to handle only document sizes with similar errors. [Table 2]

[0033] Figure 4 is a flowchart illustrating the logic for assigning size classification numbers in the information processing device according to this embodiment. Similar to Figure 3, the reading control service 203 determines whether the detected document size is within the error range of the document size in the document size determination result record table. If it is within the error range, it considers it to be the same document size and assigns the same size classification number (step S401). If there is no document size that falls within the error range, the reading control service 203 assigns a new size classification number that does not overlap with other size classification numbers (step S402).

[0034] A concrete example is shown using the document size determination result record table shown in Table 2. When the reading control service 203 detects the document size and the detected document size is width: 90 mm and length: 230 mm, the record number in the document size determination result record table shown in Table 2 that falls within the error range of 2 mm for both width and length is record number: 6. In this case, considering it to be the same size classification number as record number: 6, width: 90 mm and length: 230 mm is recorded as size classification number: 5 at the end of the table, record number: 11.

[0035] Alternatively, if the document size is detected and the detected document size is 70mm wide and 140mm long, then in the document size determination result record table shown in Table 2, there is no record number in which the width and length fall within the error range of 2mm. In this case, since there is no matching size classification number, a new size classification number, 7, is recorded as the last record number in the document size determination result record table, 12.

[0036] Figure 5 is a flowchart illustrating the logic for displaying and allowing the user to select the closest document size using a document size determination result record table in the information processing device according to this embodiment. Similar to Figure 3, the reading control service 203 determines whether the detected document size is within the error range of the document size in the document size determination result record table. If it is within the error range, it extracts the closest document size with the smallest error among those with the same size classification number as a representative (step S501). Next, the reading control service 203 creates a scanned image using the current document size and the extracted document size (representative size) and displays it on the operation panel as a size candidate (step S502). The user can then select the document size they actually want to use, allowing them to finalize the size that best suits their needs.

[0037] For example, suppose the document size detection is performed and the dimensions are 48mm wide and 58mm long. The reading control service 203, in the document size determination result record table shown in Table 2, records number 9, which has a width and length within an error range of 2mm, and its size classification number is 1. Although record number 1 also falls under the same size classification number 1, the closest value to 48mm wide and 58mm is record number 9, which has a width of 50mm and a length of 60mm. Therefore, record number 9 is extracted and displayed on the control panel as the closest size.

[0038] Figure 6 shows an example of a screen image displayed on the operation panel in the information processing device according to this embodiment. The reading control service 203 creates a preview of the scanned image using the closest document size between the document size detection result and the document size determination result record table, and displays that document size and the scanned image on the screen. The user can compare the numerical value of the document size with the scanned image and select the document size they actually want to use. In the specific example shown in Figure 5, the document size detection result is width: 48 mm, length: 58 mm, and the closest displayed is width: 50 mm, length: 60 mm, so as shown in Figure 6, each document size and the scanned image are displayed.

[0039] In this embodiment, the reading control service 203 may store the feature quantities of the image read by the reading device 101 and the document size selected by the user in the image processing device, etc. (stored in the operation history database 206 shown in Figure 2). The reading control service 203 may then use the stored data as training data to construct a document size determination model, store it in the image processing device, etc., and use that determination model to detect the document size.

[0040] Here, image features include, for example, the color distribution of the image or character information obtained through character recognition. In the case of a document like the receipt shown in Figure 6, the proportion of white, which is the background color of the document, is high, the proportion of black, which is the character color, is low, and the distribution of other colors, especially intermediate colors, is even smaller. On the other hand, in the case of an image like a photograph, the distribution of white is smaller compared to the aforementioned receipt, and the distribution of intermediate colors is relatively larger. Also, in the case of a photograph, the amount of character information that can be recognized in the image is relatively small. This color distribution and the amount of character information, along with the document size selected by the user, can be accumulated and used as the training data mentioned above. This makes it possible to improve the accuracy of the document size determination model.

[0041] As described above, the information processing device according to this embodiment records the result of determining the size of an irregularly shaped document by edge detection each time, and then, when the document is scanned and the document size is determined, the final document size can be determined from the recorded detection result. As a result, the error in determining the size of an irregularly shaped document can be reduced.

[0042] In this embodiment, the document size determination process is implemented in an image processing device such as an MFP, but it is not limited to this, and the document size determination process may also be implemented in an information processing device such as a PC (Personal Computer) that can be connected to a scanner and printer (at least the scanner).

[0043] The program executed by the information processing device of this embodiment is provided pre-installed in ROM (Read Only Memory) or the like. The program executed by the information processing device of this embodiment may also be provided as an installable or executable file recorded on a computer-readable recording medium such as a CD-ROM, flexible disk (FD), CD-R, or DVD (Digital Versatile Disk).

[0044] Furthermore, the program executed by the information processing device of this embodiment may be stored on a computer connected to a network such as the Internet and provided by downloading it via the network. Alternatively, the program executed by the information processing device of this embodiment may be provided or distributed via a network such as the Internet.

[0045] The program executed by the information processing device of this embodiment has a modular configuration that includes the above-mentioned parts (scanner application 201, operation panel control service 202, reading control service 203, and communication control service 204). In actual hardware, a processor such as a CPU (Central Processing Unit) reads the program from the ROM and executes it, loading the above-mentioned parts onto the main memory, and generating the scanner application 201, operation panel control service 202, reading control service 203, and communication control service 204 on the main memory.

[0046] In the above embodiment, the image forming apparatus of the present invention is described using an example in which it is applied to a multifunction device having at least two functions from among a copy function, a printer function, a scanner function, and a facsimile function. However, it can be applied to any image forming apparatus such as a copier, printer, scanner, or facsimile device.

[0047] Examples of the present invention are as follows: <1> A detection unit that detects the edges of the original document within the image generated by scanning the original document to determine the size of the original document, A recording unit that records the detection result of the document size by the detection unit, A determination unit that, when the document size is detected later, determines the final document size based on the document size detected later and the recorded document size detection result, An information processing device equipped with the following features. <2> The determination unit detects the document size within a predetermined error range from the recorded document size detection results for the detected document size, and determines the final document size based on the average value of the document size. <1> The information processing device described above. <3> The recording unit classifies and records the detected document sizes that fall within a predetermined error range from the recorded document size detection results. <1> or <2> The information processing device described above. <4> The confirmation unit extracts the closest document size from the recorded document size detection results to the detected document size, generates scanned images using both document sizes, displays them on the screen, allows the user to select the document size, and confirms the selected document size as the final document size. <1> from <3> An information processing device as described in any one of the following. <5> An information processing method performed by an information processing device, The steps include detecting the edges of the document within the image generated by scanning the document to determine the size of the document, The steps include recording the detection result of the aforementioned document size, If the document size is detected later, the final document size is determined based on the document size detected later and the recorded document size detection result. Information processing methods including <6> Computers, A detection unit that detects the edges of the original document within the image generated by scanning the original document to determine the size of the original document, A recording unit that records the detection result of the document size by the detection unit, A determination unit that, when the document size is detected later, determines the final document size based on the document size detected later and the recorded document size detection result, A program to make it work. [Explanation of Symbols]

[0048] 101 Reader 102 Imaging device 103 Non-volatile memory area 104 memory 105 Control Panel 106 CPU 107 Means of communication 201 Scanner Apps 202 Control Panel Control Service 203 Read Control Service 204 Communication Control Service 205 Initial Setup Database 206 Operation History Database [Prior art documents] [Patent Documents]

[0049] [Patent Document 1] Japanese Patent Publication No. 2012-5062

Claims

1. A detection unit that detects the edges of the original document within the image generated by scanning the original document to determine the size of the original document, A recording unit that records the detection result of the document size by the detection unit, A determination unit that, when the document size is detected later, determines the final document size based on the document size detected later and the recorded document size detection result, An information processing device equipped with the following features.

2. The information processing apparatus according to claim 1, wherein the determination unit detects a document size within a predetermined error range from the recorded document size detection results with respect to the detected document size, and determines the final document size based on the average value of the document sizes.

3. The information processing apparatus according to claim 1 or 2, wherein the recording unit classifies and records the detected document sizes that fall within a predetermined error range from the recorded document size detection results.

4. The information processing apparatus according to claim 1 or 2, wherein the confirmation unit extracts the closest document size from the recorded document size detection results to the detected document size, generates scanned images using both document sizes, displays them on the screen, allows the user to select the document size, and confirms the selected document size as the final document size.

5. An information processing method performed by an information processing device, The steps include detecting the edges of the document within the image generated by scanning the document to determine the size of the document, The steps include recording the detection result of the aforementioned document size, If the document size is detected later, the final document size is determined based on the document size detected later and the recorded document size detection result. Information processing methods including

6. Computers, A detection unit that detects the edges of the original document within the image generated by scanning the original document to determine the size of the original document, A recording unit that records the detection result of the document size by the detection unit, A determination unit that, when the document size is detected later, determines the final document size based on the document size detected later and the recorded document size detection result, A program to make it work.

Images