Image processing system

Abstract

To provide an image processing system that has a process in which an enlargement range is determined according to feature points of a detected document to make an enlarged display.SOLUTION: There is provided processing from the reception of a scan request of an image reader to the end of scanning, and the processing includes: an image read process S505 by image read means (an image read unit) reading the document; an enlarged display range determination process S508 by feature point detection means (CPU) of detecting feature points of the document read by the image read means, feature position calculation means (CPU) of calculating positions of the feature points, and large display range determination means (CPU) of determining an enlarged display range for enlarging and displaying the feature points based upon the calculated positions; and a transmission process S509 by transmission means (USBIF) transmitting information on the enlarged display range to an external information terminal.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an image processing system for reading and processing an image. [Background technology]

[0002] Some image reading devices that read images from a document have a function to enlarge the area that the user has preset, and some automatically enlarge the image when it is small. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6500863 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with the above technology, there is a problem that if the part that the user wants to check (for example, a bent edge of the document, a part where the document content is hidden by a sticky note, or a part where the text is faint or crowded and difficult to read) is outside the specified range, the part will not be displayed. [Means for solving the problem]

[0005] In view of the above, an image processing system according to the present invention comprises: image reading means for reading an original; a feature position calculation means for calculating the positions of feature points of the image read by the image reading means; an enlargement display range determination means for determining an enlargement display range in which the feature point is enlarged and displayed based on the calculated position; and a transmitting means for transmitting information about the enlarged display range to an external information terminal. [Effects of the Invention]

[0006] According to the present invention, it is possible to provide an image processing system that can determine the range to be enlarged in accordance with the detected feature points of the document and display the enlarged image. [Brief explanation of the drawings]

[0007] [Figure 1] Schematic diagram of the entire system. [Figure 2] FIG. 1 is a schematic diagram of an image reading device. [Figure 3] FIG. 1 is a block diagram illustrating an image reading apparatus. [Figure 4] A simplified diagram of the scanning application screen. [Figure 5] 10 is a flowchart showing processing from the start of scanning to the end of scanning. [Figure 6] Example image of bent edges. [Figure 7] 10 is a flowchart showing the process of determining the enlarged display range when the edge is bent. [Figure 8] An example of the zoomed in display range of the bent edge. [Figure 9] An example of an overflowing image. [Figure 10] 10 is a flowchart showing the process of determining the enlarged display range when the display area protrudes. [Figure 11] An example of an overflowing zoom range. [Figure 12] Example image of light text. [Figure 13] 10 is a flowchart showing a process for determining an enlarged display range when characters are light. [Figure 14] An example of the enlarged display range for light text. [Figure 15] Example image of dense text. [Figure 16] 10 is a flowchart showing a process for determining an enlarged display range when characters are densely packed. [Figure 17] An example of the zoomed display range for densely packed text. [Figure 18] Schematic representation of the display application screen. [Figure 19] 10 is a flowchart showing processing from the start of scanning to the end of scanning. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. Note that the following embodiments are merely examples and are not intended to limit the scope of the present invention. Furthermore, in the following drawings, components that are not necessary for describing the embodiments are omitted.

[0009] <First Embodiment> 1 is a schematic diagram of an image reading device 10 according to an embodiment and a PC 20. The image reading device 10 and the PC 20 are connected via USB. The PC 20 transmits a scan request to read an image of a document to the image reading device 10 and obtains image data (read image).

[0010] FIG. 2 is a schematic diagram of an image reading device 10 according to an embodiment.

[0011] Original documents 90 to be read are stacked and stored on the original table 101. An original table original detection sensor 108 detects the original documents 90 on the original table 101. A paper feed roller 104 separates the original documents 90 one by one and sends them to a conveying path 106. A conveying roller 105 conveys the original documents 90 along the conveying path 106 and discharges them to a discharge section 102. The discharge section 102 stacks and stores the original documents 90 after image reading processing. An discharge section original detection sensor 109 detects the discharged original documents 90. A registration sensor 107 detects the original documents 90 conveyed along the conveying path 106. An image reading unit 103 serving as image reading means begins reading the image of the original documents 90 when the registration sensor 107 detects the original documents 90. Two image reading units 103 are provided on both sides of the conveying path 106, one reading the front side of the original documents 90 and the other reading the back side of the original documents 90.

[0012] The document to be scanned may be, for example, a sheet of paper such as an office paper, a check, a banknote, or a card, and may be either a thick or thin sheet. Examples of cards include insurance cards, driver's licenses, and credit cards. Also included are booklets such as passports.

[0013] FIG. 3 is a diagram showing the control configuration of the image reading device 10 according to an embodiment.

[0014] The control unit 200 of the image reading device 10 includes a CPU 201, a ROM 202, a RAM 203, an input / output IF 204, and a USB IF 205. The CPU 201 executes programs stored in the ROM 202 and controls the entire image reading device 10. The ROM 202 stores programs executed by the CPU 201 and fixed data. The RAM 203 stores variable data such as image data read by the image reading unit 103 and calculation results by the CPU 201. However, the ROM 202 and RAM 203 may be other storage devices. The input / output IF 204 connects the control unit 200 to each component of the image reading unit 103. The CPU 201 sends control signals and data to each component and acquires data from each component via the input / output IF 204. The USB IF 205 is an interface that serves as a transmission means and connects to a PC 20, an external information terminal, via USB.

[0015] In the present invention, the CPU 201 serves as a feature point detection means for detecting feature points (feature areas) in the scanned image, a feature position calculation means for calculating the positions of feature points in the scanned image, and an enlarged display range determination means for determining an enlarged display range for enlarging and displaying feature points, as will be described later.

[0016] FIG. 4 shows an example of a screen of an application that operates on the PC 20 and serves as an enlargement setting means for setting the enlargement of a scanned image.

[0017] Pressing the button 4a sends a scan request to the image reading device 10. For the enlargement setting in the checkbox 4b, checking the item of the feature point in the scanned image that you want to enlarge turns the enlargement setting ON, and the target feature point is set to be enlarged. The process of determining the enlargement display range corresponding to each item will be described later.

[0018] 5 is a flowchart showing the processing from reception of a scan request to completion of scanning in the image reading device 10. The processing performed by the image reading device 10 will be described with reference to FIG.

[0019] A scan request is received from the PC 20 via the USBIF 205 (S501), and it is confirmed whether or not a document is placed on the platen 101 (S502). If a document is placed (S502: YES), the process proceeds to step S503. If a document is not placed (S502: NO), the process ends.

[0020] If a document is placed, the document starts to be conveyed (S503), and it is checked whether an error such as a paper jam has occurred during the conveyance (S504). If no error has occurred (S504: NO), the process proceeds to step S505. If an error has occurred (S504: YES), the details of the error are notified (S510), and the process ends.

[0021] If no error occurs (S504: NO), the scanned image is read up to the end of the document (S505), and the image data is saved in RAM 203 (S506). After saving in RAM 203 (S506), the image data is sent to PC 20 (S507). After sending the image data (S507), the enlarged display range is determined from the image data saved in RAM 203 based on the enlargement setting described above (S508), and information on the determined enlarged display range is sent to PC 20 (S509). Having received the information on the enlarged display range, PC 20 enlarges and displays the image data based on the enlarged display range information.

[0022] Next, the process of determining the enlarged display range when setting each feature point will be described below.

[0023] Fig. 6 shows an example of an image when the scanned image has bent edges. Fig. 7 is a flowchart showing the process of determining the enlarged display range of the scanned image. The process performed by the image scanning device 10 will be explained with reference to Fig. 7. This process is executed when the bent edges item is selected and turned ON in the enlargement settings shown in Fig. 4.

[0024] The feature point detection means checks whether or not there is a bent corner as shown in Figure 6 in the scanned image (S701). If there is a bent corner (S701: YES), the feature position calculation means calculates the position of the bent corner (S702), and the enlarged display range determination means determines the enlarged display range based on the calculated position (S703). The enlarged display range, as will be described later, is a rectangle extending a certain length from the rectangle formed by the bent corner position to the outside of the frame of the document 90. After the enlarged display range is determined (S703), the process ends. If there is no bent corner (S701: NO), the process ends.

[0025] To determine whether or not there is a bent corner, the system first detects the corners of the document in the scanned image, then calculates the two points that connect diagonally across the entire rectangle, and determines that there is a bent corner if there are two points that connect diagonally.If there are multiple bent corners in one scanned image, the point with the largest bent area will be used as the enlarged display area for that scanned image.

[0026] 8 shows an example of the enlarged display range when the scanned image has a folded edge. As mentioned above, the enlarged range is a rectangular range extending a certain length from the rectangle formed by the folded edge position to the outside of the frame of the document 90.

[0027] Next, a case where the enlarged display range is determined based on the protruding position in the read image acquired from the document will be described.

[0028] Fig. 9 shows an example of an image in which a scanned image includes a sticky note, memo, or the like that extends beyond the frame of the document 90. Fig. 10 is a flowchart showing the process of determining the enlarged display range of the scanned image. Fig. 11 shows an example of the enlarged display range in which the scanned image includes an extension. The process performed by the image scanning device 10 will be explained with reference to Fig. 10. This process is executed when the extension item is selected and turned ON in the enlargement settings shown in Fig. 4.

[0029] The feature point detection means checks whether or not there is any overhang in the scanned image as shown in FIG. 9 (S1001). If there is overhang (S1001: YES), the process proceeds to step S1002. If there is no overhang (S1001: NO), the process ends. To determine whether there is overhang, the vertices of the document in the scanned image are first detected, and then the rectangle of the entire document enclosed by each vertex is estimated. If one or more vertices are detected outside the entire rectangle, it is determined that there is overhang. If there are multiple overhangs in one scanned image, the area with the largest overhang is used as the target for the enlarged display range of that scanned image.

[0030] If there is overflow (S1001: YES), the position of the overflow is calculated by the characteristic position calculation means (S1002), and the enlarged display range is determined by the enlarged display range determination means based on the calculated position (S1003). The enlarged display range is a rectangle extending a certain length outside the rectangle formed by the overflow position, including the outside of the frame of the document 90, as shown in Figure 11.

[0031] Next, a case where the enlarged display range is determined based on the position of faint characters in the scanned image obtained from the document will be described.

[0032] Fig. 12 shows an example of an image in which faint characters are present in the scanned image. Fig. 13 is a flowchart showing the process of determining the display range of the scanned image. The process performed by the image scanning device 10 will be explained with reference to Fig. 13. This process is executed when the faint characters item is selected and turned ON in the enlargement settings shown in Fig. 4.

[0033] The feature point detection means checks whether or not there are faint characters in the scanned image as shown in Fig. 12 (S1301). If there are faint characters (S1301: YES), the process proceeds to step S1302. If there are no faint characters (S1301: NO), the process ends. To determine whether or not there are faint characters, the character portions in the scanned image are first detected, and then the density of the character portions is calculated. If the density is equal to or less than a certain value (a predetermined absolute density value), it is determined that there are faint characters. If there are faint characters in multiple locations in a single scanned image, the location with the lowest density is set as the target for the enlarged display range of that scanned image.

[0034] If there are faint characters (S1301: YES), the position of the faint characters is calculated by the feature position calculation means (S1302), and the enlarged display range is determined by the enlarged display range determination means based on the calculated position (S1303). The enlarged display range is a rectangle that is a certain length outside the rectangle formed by the positions of the faint characters. After the enlarged display range is determined (S1303), the process ends.

[0035] 14 shows an example of the enlarged display range when there is faint text in the scanned image. As mentioned above, the enlarged range is a rectangular range that is a certain length outside the rectangle formed by the position of the faint text.

[0036] Next, a case will be described in which the enlarged display range is determined based on the position where characters are densely packed in the scanned image obtained from the document.

[0037] Fig. 15 shows an example of an image in which dense characters are present in the scanned image. Fig. 16 is a flowchart showing the process of determining the display range of the scanned image. The process performed by the image scanning device 10 will be explained with reference to Fig. 16. This process is executed when the dense character item is selected and turned ON in the enlargement settings shown in Fig. 4.

[0038] The feature point detection means checks whether the scanned image contains a character cluster as shown in Fig. 15 (S1601). If a character cluster is present (S1601: YES), the process proceeds to step S1602. If a character cluster is not present (S1601: NO), the process ends. To determine whether a character cluster is present, the character portion of the scanned image is first detected, and then if the number of black dots in the character portion is greater than a certain number (an absolute predetermined number of dots), it is determined that a character cluster is present. If a scanned image contains multiple character clusters, the portion with the greatest number of dots is selected as the target for the enlarged display range of the scanned image.

[0039] If there is a character cluster (S1601: YES), the position of the character cluster is calculated by the characteristic position calculation means (S1602), and the enlarged display range is determined by the enlarged display range determination means based on the calculated position (S1603). The enlarged display range is a rectangle that is a certain length outside the rectangle formed by the position of the character cluster.

[0040] Figure 17 shows an example of the enlarged display range when there is dense text in the scanned image. As mentioned above, the enlarged range is a rectangular range that is a certain length outside the rectangle formed by the position of the dense text.

[0041] 18 shows an example of a screen of an application that runs on the PC 20 and displays a scanned image acquired from the image scanning device 10. As an example, a bent edge is displayed in an enlarged manner.

[0042] If the scanned image contains a feature point to be enlarged, it will be displayed as shown in Figure 18. Pressing button 18a will display the next enlarged image, and pressing button 18b will display the previous enlarged image.

[0043] The display screen may display both a scanned image without feature points and an enlarged image of the feature points of the scanned image.

[0044] <Embodiment 2> Next, an embodiment will be described in which multiple feature points are enlarged and displayed regardless of their type. The device structure and control configuration are the same, so a description thereof will be omitted. When there are multiple enlarged display areas, the display is repeated multiple times for one scanned image. Note that the enlarged display areas are not limited to the feature points described in the first embodiment.

[0045] 19 is a flowchart showing the processing from reception of a scan request to completion of scanning in the image reading device 10. The processing performed by the image reading device 10 will be described with reference to FIG.

[0046] A scan request is received from the PC 20 via the USBIF 205 (S1901), and it is confirmed whether or not a document is placed on the platen 101 (S1902). If a document is placed (S1902: YES), the process proceeds to step S1903. If a document is not placed (S1902: NO), the process ends.

[0047] If an original is placed, the transport of the original begins (S1903), and it is checked whether an error such as a paper jam has occurred during transport (S1904). If an error has occurred (S1904: YES), the details of the error are notified (S1910), and the process ends. If no error has occurred (S1904: NO), the scanned image is read up to the end of the original (S1905), and the scanned image data is saved in RAM 203 (S1906).

[0048] After being saved in RAM 203 (S1906), the image data is transmitted to PC 20 (S1907), feature points detected from the image data saved in RAM 203 by the feature point detection means are used as targets for enlarged display, an enlarged display range is determined by enlarged display range determination means (S1908), and information on the determined enlarged display range is sent to PC 20 (S1909). Upon receiving the information on the enlarged display range, PC 20 enlarges and displays the image data based on the enlarged display range information.

[0049] After transmitting the enlarged display range information to the PC 20 (S1909), the feature point detection means checks whether any enlarged display range information (feature points) to be transmitted remains (S1910). If enlarged display range information remains (S1910: YES), the process returns to step S1909 and repeats. If no enlarged display range information remains (S1910: NO), the process returns to step 1902 and repeats.

[0050] Although the second embodiment also assumes that the image data is enlarged and displayed as shown in Fig. 18, other display methods are also possible. As described above, both the scanned image without feature points and an enlarged image of the feature points of the scanned image may be displayed on the display screen.

[0051] In the present invention, when the image reading unit 103 reads both sides of the document 90 and the feature points of both sides of the read image overlap, only the feature points of either the front or back side of the document 90 may be enlarged and displayed.

[0052] Furthermore, in the present invention, the range of enlarged display is determined on the image reading device 10 side, but it may be determined by an application on the PC 20.

[0053] In the present invention, the image is displayed on the PC 20 side, but a display means may be provided on the image reading device 10 for display.

[0054] The present invention is not limited to the above-described embodiments, and can be modified as appropriate within the scope of the present invention. [Explanation of symbols]

[0055] 10 Image reading device 20 PC 90 manuscripts 101 manuscript table 102 Discharge section 103 Image reading unit 104 Paper feed roller 105 Conveyor roller 106 Transport path 107 Resist Sensor 108 Document platen document detection sensor 109 Document detection sensor at exit 200 control section 201 CPU 202 ROM 203 RAM 204 Input / Output Interface 205 USBIF

Claims

1. image reading means for reading an original; a feature point detection means for detecting feature points of the image read by the image reading means; a feature position calculation means for calculating the position of the feature point; an enlargement display range determination means for determining an enlargement display range in which the feature point is enlarged and displayed based on the calculated position; and a transmitting means for transmitting information about the enlarged display range to an external information terminal.

2. an enlargement setting means for selecting the feature point to be enlarged and displayed; 2. The image processing system according to claim 1, wherein said enlarged display range determining means determines said enlarged display range based on said feature points set by said enlargement setting means.

3. 2. The image processing system according to claim 1, wherein the enlarged display range determining means determines the enlarged display range based on the feature points detected by the feature point detecting means.

4. The image processing system according to claim 1, characterized in that, if there are multiple enlarged display ranges in the scanned image, after sending information about the enlarged display ranges to the external information terminal, it is confirmed whether any enlarged display ranges remain.

5. 2. The image processing system according to claim 1, wherein the image reading means reads both sides of the document, and when the feature points on both sides of the read image overlap, the enlarged display range is determined based on the feature points on one side.

6. 6. The image processing system according to claim 1, wherein the enlarged display range is a range outside the position of the feature point or a range including the outside of the position of the feature point and the outside of the frame of the document in the scanned image.

Images