Image reading system

Abstract

To provide an image reading system that detects a division position, even if unable to detect it, specifies a division position suitable for image data, and displays the divided image data with improved visibility of a boundary position of the divided image data.SOLUTION: An image reading system has: image reading means that reads a document 101; feature information detection processing means that detects, through scanning at a predetermined interval, feature information on an image related to image data read by the image reading means; division position specification processing means that specifies a division position of the image related to the image data; division processing means that divides the image data corresponding to the division position; and division image storage processing means that performs processing of storing the divided image data. The division position specification processing means specifies the position of the feature information as the division position.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to an image reading system and to a method for controlling scanned image data. [Background technology]

[0002] Conventionally, in an image reading device equipped with an automatic document feeder (ADF) that automatically transports a document set on a document table to a reading position, various techniques are known for processing image data when outputting the image data obtained by reading the document. For example, a technique is known for reading a medium consisting of a single foldable sheet of paper, with information attached to each of a number of pages separated by folds, and processing the read image. Examples of such a medium include a folded pamphlet or a restaurant menu. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2008-258913 A [Patent Document 2] JP 2012-151586 A Summary of the Invention [Problem to be solved by the invention]

[0004] The device disclosed in Patent Document 1 proposes a technique in which, when the above-mentioned original is read, the user specifies the position where the image data is to be divided and output, and the image data is divided at the specified dividing position. Also, the device disclosed in Patent Document 2 proposes a technique in which the fold positions of a folded original are used as page dividing positions, and the image data is divided.

[0005] However, the device disclosed in Patent Document 1 requires the user to specify the separator position, and there is a problem that the user must specify the separator position repeatedly when the document is long or when multiple pages of the document are to be read. Also, the device disclosed in Patent Document 2 has a problem that if the fold cannot be detected, the separator position of the document cannot be identified and the image data cannot be divided. Furthermore, the devices disclosed in Patent Documents 1 and 2 have a problem that the image is divided and output even when the document contains continuous information across multiple pages, so that there is a problem that the boundary positions are not easily visible when checking the obtained image data. [Means for solving the problem]

[0006] In view of the above, an image reading system according to the present invention comprises: an image reading means for reading an original; a feature information detection processing means for scanning and detecting feature information of an image related to the image data read by the image reading means at a predetermined interval; a division position specification processing means for specifying a division position of the image related to the image data; a division processing means for dividing the image data in accordance with the division positions; A divided image storage processing means for storing the divided image data, The division position specification processing means is characterized in that it determines the position of the feature information as the division position. Effect of the Invention

[0007] According to the present invention, it is possible to identify the delimiting positions of image data without the user having to repeatedly specify them, and it is possible to identify suitable delimiting positions of image data even when folds in a document cannot be detected. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram showing the overall configuration of an image reading system according to an embodiment of the present invention. [Diagram 2] 1 is a schematic diagram of an image reading apparatus according to an embodiment of the present invention; [Diagram 3] FIG. 2 is a schematic configuration diagram of an image reading unit according to the embodiment. [Figure 4] FIG. 2 is a diagram showing an example of a document having a crease according to the embodiment; [Diagram 5] FIG. 2 is a control configuration diagram of the image reading apparatus according to the embodiment. [Figure 6] FIG. 4A is a diagram showing the configuration of a PC according to the present embodiment, FIG. 4B is a diagram showing a scan application according to the present embodiment, and FIG. 4C is a diagram showing the configuration of application software and a driver on the PC according to the present embodiment. [Figure 7] 4 is a flowchart showing a processing flow of the image reading system according to the embodiment. [Figure 8] 10 is a flowchart showing the flow of feature information detection processing according to the embodiment. [Figure 9] 10 is a flowchart showing the flow of a division position specification process based on feature information according to the embodiment. [Figure 10] FIG. 13 is a diagram showing how division positions are detected at predetermined intervals. [Figure 11] 11 is a flowchart showing the flow of a division position specification process based on a predetermined size according to the embodiment. [Figure 12] 5 is a flowchart showing the flow of an image division process and a divided image storage process according to the present embodiment. [Figure 13] 10 is a flowchart showing a process when a transport abnormality occurs according to the embodiment. [Figure 14] FIG. 11 is a diagram relating to a reading restart confirmation screen according to the embodiment. [Figure 15] 5 is a flowchart showing a process for detecting a jam according to the embodiment. [Figure 16] 5 is a flowchart showing a process for detecting skew according to the embodiment. [Figure 17] 6 is a flowchart showing a process for detecting multiple feeds according to the embodiment. [Figure 18] 6 is a flowchart showing a process for calculating a return amount of a document according to the embodiment. [Figure 19]FIG. 11 is a diagram relating to a reading restart confirmation screen according to the embodiment. [Figure 20] (a) An image read before a multifeed occurs and transport is stopped, according to the present embodiment; (b) an image re-read after the multifeed occurs, according to the present embodiment; (c) an image combining images read before and after the multifeed occurs, according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. In addition, in each of the following drawings, components that are not necessary for the description of the embodiments are omitted from the drawings. Note that each of the following embodiments is merely an example, and the present invention is not limited to the contents of each embodiment.

[0010] FIG. 1 is a diagram showing the overall configuration of an image reading system according to this embodiment.

[0011] The image reading device 100 and a personal computer (PC) 200 are connected via a USB cable. When the image reading device 100 reads an image of a document, it transmits the read image data to the PC 200. The PC 200 divides the received image data and outputs it to a storage area.

[0012] In this embodiment, the image reading device 100 and the PC 200 are connected by a USB cable, but this is not limiting and any connection method that allows communication between the image reading device 100 and the PC 200 may be used. For example, the image reading device 100 and the PC 200 may be connected via a network.

[0013] Furthermore, the image reading device 100 is configured to be connected to the PC 200, but this is not limiting and any device may be used as long as it can be connected to the image reading device 100. For example, the image reading device 100 may be configured to be connected to a tablet terminal or a smartphone terminal.

[0014] FIG. 2 is a schematic diagram of the image reading device 100 according to this embodiment.

[0015] The document table 102 holds and stores the document 101 to be read. The document 101 on the document table 102 is separated one by one by a paper feed roller 106 and sent to a conveying path 108, and is conveyed along the conveying path 108 by a conveying roller 107 and discharged to a discharge section 103. The registration sensor 109 detects the document 101 conveyed along the conveying path 108. When the registration sensor 109 detects the document 101, the image reading unit 104 starts reading the image formed on the document. In this embodiment, two image reading units 104 are provided on both sides of the conveying path 108, one of which reads the front side of the document 101 and the other of which reads the back side of the document 101. Note that a configuration in which only one image reading unit 104 is provided may be used. A background plate 105 is provided at a position opposite each image reading unit 104. The background plate 105 is, for example, a white member.

[0016] The encoder 110 is a rotary encoder, and detects the amount of movement of the document 101 conveyed through the conveying path 108 by rotating together with the conveying roller 107. The skew detection sensor 111 is provided on both the left and right ends of the conveying path, and detects the inclination of the document. The double feed detection sensor 112 is provided on both sides of the conveying path 108, and is a sensor for detecting double feed when conveying media such as the document 101 are in close contact with each other due to static electricity or the like and pass through the conveying path 108, that is, when the conveying media are conveyed overlapping and in a double feed state. Various types of double feed detection sensor 112 can be used, but in this embodiment, it is an ultrasonic sensor. The pressure detection sensor 113 is provided at the upper part of the conveying path 108, and detects the pressure when the document 101 is pressed against the upper part when the document 101 is jammed during conveying, and detects the paper jam. The process when the above-mentioned conveying abnormality occurs will be described later.

[0017] FIG. 3 is a schematic diagram of the image reading unit 104 according to this embodiment.

[0018] The image reading unit 104 is sealed by a housing 1041 and a glass plate 1042 provided facing the conveying path 108. Inside the image reading unit 104, a line image sensor 1043 and a light emitting unit 1044 are provided. The line image sensor 1043 extends in a direction (main scanning direction) perpendicular to the conveying direction of the original 101, and reads one line of image in the main scanning direction at a time. The line image sensor 1043 is, for example, a CCD line sensor or a contact image sensor. The line image sensor 1043 and the light emitting unit 1044 extend substantially in parallel. The light emitting unit 1044 is, for example, an LED array made up of a plurality of LEDs. As shown by the dashed arrow in FIG. 3, the line image sensor 1043 receives and detects light irradiated by the light emitting unit 1044 and reflected by the original 101 to read the image on the original 101. As shown in FIG. 4, when reading a folded original 101, the amount of light received by the line image sensor 1043 significantly changes in density due to the formation of the fold in the original 101, and a shadow-like image is output.

[0019] FIG. 5 is a diagram showing a control configuration of the image reading apparatus 100 according to this embodiment.

[0020] The image reading device 100 includes an image reading unit 104 that reads a document 101, an image processing circuit 14 that performs image processing on the read image, a RAM 13 that temporarily stores image data output from the image processing circuit 14, a ROM 12 that stores programs used within the image reading device 100, a CPU 11 that controls the entire image reading device in accordance with the programs stored in the ROM 12, and a communication IF 15 that transfers image data sent from the CPU 11 to a PC 200 and also transfers an interrupt from the PC 200 instructing image reading to the CPU 11.

[0021] FIG. 6(a) is a diagram showing the configuration of a PC in this embodiment, and FIG. 6(b) is a diagram showing the UI of a scan application in this embodiment.

[0022] The PC 200 includes a communication IF 505 that transmits instructions such as document reading to the external image reading device 100 and receives image data from the external image reading device 100. The PC 200 also includes a CPU 500 that performs image processing such as image division on the image data received by the communication IF 505, a RAM 501 that temporarily stores the image data received by the communication IF 505 and data when the CPU 500 operates, a HDD 502 that stores programs used within the PC 200, a display unit 503 that displays a user interface (UI) such as a setting screen to the user, and an operation unit 504 that allows the user to operate the UI displayed on the display unit 503.

[0023] The UI displayed on the display unit 503 is, for example, a scan application as shown in FIG. 6(b). The scan application runs on the PC 200, and by pressing the scan button after setting the scan settings, the set scan settings are sent to the image reading device 100. The scan settings can be set to a dpi setting of "200 dpi / 300 dpi," a mode setting of "color / gray," and a long document setting of "ON / OFF." When the control program stored in the ROM 12 in the image reading device 100 receives the scan settings, it starts reading the document according to the scan settings. The UI, scan setting items, and setting candidates are not limited to these.

[0024] In addition, in this embodiment, a scan application that runs on the PC 200 is used, but the present invention is not limited to this and may be installed in the image reading device 100. Also, it may be installed in a tablet terminal connected via a LAN, and although the operation unit 504 uses a mouse connected to a PC in this embodiment, the present invention is not limited to this and may be installed in a keyboard or a touch panel.

[0025] FIG. 6C is a diagram showing the configuration of application software and drivers on the PC 200.

[0026] A user installs application software 401 and driver 402 in advance in the PC 200. The installed application software 401 communicates with the image reading device 100 via the driver 402. A determined protocol is used for communication between the application software 401 and the driver 402, and between the driver 402 and the image reading device 100. In this embodiment, communication between the application software 401 and the driver 402 is performed using a protocol determined by a standard called Twain, and communication between the driver 402 and the image reading device 100 is performed using a protocol determined by a standard called SCSI.

[0027] However, the protocol is not limited to this. For example, the communication standard between the application software 401 and the driver 402 may be ISIS or WIA, and the communication standard between the driver 402 and the image reading device 100 may be a serial communication standard such as USB or a wireless communication standard.

[0028] FIG. 7 is a flowchart showing the flow of processing in the image reading system according to this embodiment.

[0029] A user issues an instruction to start reading an original document via application software 401 running on PC 200. The original document handled in this embodiment is a long original document 101 with folds as shown in FIG. 4. The instruction to start reading the original document is sent to image reading device 100 via driver 402. Upon receiving the instruction to start reading the original document, image reading device 100 transports original document 101, reads original document 101, and acquires an image (S701). The generated image data is transferred to driver 402. Driver 402 stores the received image data in RAM 501, and notifies application software 401 of the acquisition of the image.

[0030] In this embodiment, the instruction to start reading the document is given by application software on the PC 200, but this is not limiting. For example, the instruction to start reading the image may be given from a touch panel on the image reading device 100 (not shown).

[0031] The application software 401 detects image feature information from the stored image data, and performs processing to specify the division positions, with the positions of the feature information being the division positions (S702).

[0032] In step S702, the process of specifying the division position in which the position of the image feature information is used as the division position is completed, and the process result (true or false) is set in a variable "status" prepared in advance. The process of detecting the feature information of the image data and the process of specifying the division position will be described later.

[0033] After performing a process of identifying the division position using the position of the image feature information as the division position (S702), it is determined whether or not the division position has been successfully identified (S703). If the value of the variable "status" is true, the process of identifying the division position is deemed to have been completed correctly, and the process ends. If the value of the variable "status" is false, the process of identifying the division position is deemed to have not been completed correctly, and a process of identifying the division position using a predetermined size A is performed (S704). The process of identifying the division position using a predetermined size A will be described later. After performing the process of identifying the division position using each processing method, the image is divided, and the divided images are saved (S705).

[0034] In this embodiment, the CPU 11 serves as a feature information detection processing means for performing feature information detection processing of image data, and a split position identification processing means for performing split position identification processing, while the CPU 500 serves as a split processing means for performing split processing of image data, and a split image storage processing means for performing storage processing of the split images.

[0035] In this embodiment, the image characteristic information is the shadow caused by the fold of the document, and the method of identifying the division position is to detect the shadow that occurs in the image when the document 101 with the fold is read, and use the shadow position as the division position, but the present invention is not limited to this. The method of identifying the division position may be any method that identifies the division position from within the image area. For example, the perforation that is provided to cross the document may be used as the division position. The method of determining the perforation may be a general one, but for example, a method of determining that a perforation exists may be used in which, when consecutive pixels have density differences at regular intervals from the left end of the document in the main scanning direction, the existence of a perforation is determined.

[0036] In addition, in this embodiment, if the division position specifying process using a shadow is not completed correctly, the division position specifying process using the predetermined size A is performed, but the present invention is not limited to this, and the user may be notified and allowed to select whether or not to perform division processing using the predetermined size. Also, the division position specifying process using a shadow may not be performed, and only the division position specifying process using the predetermined size may be performed.

[0037] 8 is a flowchart showing the flow of the characteristic information detection process according to this embodiment. In this embodiment, the characteristic information is a shadow generated by a fold in the document, so the shadow is detected.

[0038] In this embodiment, a shadow is detected using the density difference of the shadow detection pixels. Also, in this embodiment, a process of detecting the shadow of a fold in a document will be described. When a document with a fold is read, a shadow occurs in the image from the left edge to the right edge of the document. Shadows are detected within a range of a predetermined distance α from the left edge and the right edge of the image, and the average position coordinate of the detected shadows is regarded as the shadow of the fold in the document.

[0039] Note that this processing method is just one example, and any method that can detect a shadow within an image area may be used.

[0040] After starting the process of detecting shadows from folds in a document, a threshold value T and a search start position S are obtained (S801). The threshold value T is used when detecting a shadow from an image, and is used to determine whether a density difference between adjacent pixels corresponds to a shadow. The search start position S indicates the position coordinate in the sub-scanning direction at which the search starts when searching for a shadow. However, in this embodiment, the threshold value T is stored in the RAM 13 in advance, and the CPU 11 reads out the value, and the value of the search start position S is set in step S902 or step S906 in FIG. 9, which will be described later.

[0041] After acquiring the threshold value T and the search start position S, the CPU 11 sets 0 to the variable x indicating the main scanning direction coordinate stored in the RAM 13, sets the value of the search start position S to the variable y indicating the sub-scanning direction coordinate stored in the RAM 13, and sets -1 to the variables s1 indicating the position of the shadow at the left edge of the image and s2 indicating the position of the shadow at the right edge of the image (S802). After the settings, the variable x is compared with a predetermined interval α (S803).

[0042] If it is determined that the variable x is equal to or smaller than the predetermined interval α, it is determined whether y+1 is smaller than the length of the image (S804). If it is determined that y+1 is greater than the length of the image, the process proceeds to step S810 to process the pixel at the adjacent coordinate in the x direction. If it is determined that y+1 is less than the length of the image, the density of the pixel at the coordinate (x, y) and the density of the pixel at the adjacent coordinate (x, y+1) in the y direction are obtained (S805), and it is determined whether the absolute value of the difference between the two densities is equal to or greater than the threshold value T (S806).

[0043] If it is determined that the absolute value of the density difference is less than the threshold value T, then 1 is added to y (S807), and the process proceeds to step S804 to process the pixel at the adjacent coordinate in the y direction. If it is determined that the absolute value of the density difference is equal to or greater than the threshold value T, then the variable y is compared with the variable s1 (S808). If it is determined that the variable y is greater than the variable s1, then in step S809, the value of the variable y is set to the variable s1, and the process proceeds to step S810. If it is determined that the variable y is equal to or less than the variable s1, then the process proceeds directly to step S810.

[0044] To continue processing on the pixel at the adjacent coordinate in the x direction, in step S810, x is incremented by 1 and y is set to the search start position S. After setting, the process proceeds to step S803 and continues processing.

[0045] If it is determined in step S803 that the variable x is greater than the predetermined interval α, the process proceeds to step S811, where it is confirmed whether the value of the variable s1 is -1. If the value of the variable s1 is -1, the coordinates of the end of the image are set as the shadow position (S812), and the process ends. If the value of the variable s1 is not -1, it is determined that detection of the shadow at the left edge of the image is completed, and the value obtained by subtracting the predetermined interval α from the image width is set to the variable x in order to detect the shadow at the right edge (S813).

[0046] After setting, it is determined whether the variable x is smaller than the image width (S814). If it is determined that the variable x is smaller than the image width, it is determined whether y+1 is smaller than the image length (S815). If it is determined that y+1 is smaller than the image length, the density of the pixel at coordinates (x, y) and the density of the pixel at coordinates (x, y+1) are obtained (S816), and it is determined whether the absolute value of the difference between the two densities is equal to or greater than a threshold value T (S817).

[0047] If it is determined that the absolute value of the density difference is less than the threshold value T, then 1 is added to the variable y (S818), and the process proceeds to step S815 to process the pixel at the adjacent coordinate in the y direction. If it is determined that the absolute value of the density difference is equal to or greater than the threshold value T, then the variable y is compared with the variable s2 (S819). If it is determined that the variable y is greater than the variable s2, then the value of the variable y is set to the variable s2 (S820), and the process proceeds to step S821. If it is determined that the variable y is equal to or less than the variable s2, then the process proceeds directly to step S821.

[0048] If it is determined in step S815 that y+1 is equal to or greater than the length of the image, the process proceeds directly to step S821.

[0049] In step S821, 1 is added to the variable x, and the variable y is set to S. After the setting, the process proceeds to step S814, where processing is performed on the pixel at the adjacent coordinate in the x direction.

[0050] If it is determined in step S814 that the variable x is greater than the image width, it is checked whether the value of the variable s2 is -1 (S822). If the value of the variable s2 is -1, the coordinates of the end of the image are determined to be the shadow position (S823), and the process ends. If the value of the variable s2 is not -1, it is determined that the detection of the shadows on both ends of the image is completed, and the average value of the values ​​of the variables s1 and s2 is determined to be the position coordinates of the shadow (S824), and the process ends.

[0051] FIG. 9 is a flowchart showing the flow of division position specification processing based on the shadow position according to this embodiment.

[0052] After reading the original 101 and acquiring an image, the length Len of the entire image data is acquired (S901). The length Len of the entire image data is assumed to be stored in the RAM 13 in advance, and the value is read by the CPU 11. After acquiring the length Len of the entire image data, a predetermined interval B is set at the scanning start position S at the beginning of the image data. In this embodiment, the predetermined interval B is set to 0. A list structure that holds the coordinates of the position of the detected shadow is set as a variable N, and is initialized to an empty list (S902).

[0053] The scanning start position S is set as the search start position S for performing shadow detection on the image shown in FIG. 8 (S801), and shadow detection is performed by the method shown in FIG. 8 (S903).

[0054] After detecting the shadow in the image, it is determined whether the detected shadow is the shadow of the end of the document (S904). If the difference between the position of the detected shadow and the length Len of the entire image data is within a predetermined value, it is determined to be the shadow of the end of the document.

[0055] If the difference between the detected shadow position and the length Len of the entire image data is not within a predetermined value, it is determined that the shadow is not the shadow of the end of the document, but the shadow of a fold in the document, and the detected shadow is set as the division position in variable N of the list structure and saved (S905). Since variable N has a list structure, new division positions are added to the end.

[0056] The detected shadow is set as the division position in the variable N of the list structure and saved, and then the scanning start position S is changed to become the next scanning start position S (S906). The value of the division position using the last value of the variable N of the list structure plus a predetermined interval B is set as the next scanning start position S.

[0057] If it is determined in step S904 that the shadow is a shadow at the end of the document, it is determined whether the scanning start position S is the beginning of the document (scanning start position S=predetermined interval B) (S907). If the value of the scanning start position S is not the predetermined interval B, it is determined that the scanning start position S is not the beginning and the shadow has been correctly detected, and each division size, which is the length of the image when divided from the specified division position (the value stored in the variable N of the list structure), is obtained, and it is determined whether the variance value of all division sizes is smaller than a predetermined value (S908).

[0058] If it is the beginning of variable N of the list structure, the beginning value is obtained as the division size. After that, Nnext-N is obtained as the division size. If it is the end of variable N of the list structure, Len-Nend is obtained as the division size. If the variance value of all these division sizes is smaller than a predetermined value, it is determined that the division positions have been identified at appropriate intervals, and the previously prepared variable status is set to true (S909), and the process ends.

[0059] If the scanning start position S is at the beginning, or if the variance value of all division sizes is greater than a predetermined value, it is determined that the division positions have not been identified at an appropriate interval, the previously prepared variable status is set to false (S910), and the division position identification process using a predetermined size A shown in Figure 11 described below is performed.

[0060] In this embodiment, the validity of the division position identification process is determined based on whether the variance value of all division sizes is smaller than a predetermined value (S908), but the present invention is not limited to this. Any method may be used as long as it can correctly determine the validity of the division position.

[0061] In this embodiment, the predetermined interval B is set to 0, but is not limited to this. For example, as shown in FIG. 10, the predetermined interval B may be set at the scanning start position S such that the predetermined interval B=the length of A4 and the length of B5. Alternatively, it may be calculated based on the position coordinates of the shadow detected first. For example, B=Nbegin-predetermined interval B may be used. By setting the predetermined interval, scanning can be started from a location close to the shadow, making it possible to reduce processing.

[0062] FIG. 11 is a flowchart showing the flow of division position specification processing based on the predetermined size A according to this embodiment.

[0063] After reading the document 101 and acquiring the image, the length Len of the entire image data is acquired (S1101). The length of the entire image data is assumed to be stored in the RAM 13 in advance, and the CPU 11 reads out the value. After acquiring the length of the entire image data, the value of the length Len of the entire image data is compared with the length of a predetermined size A×2 set (S1102). In this embodiment, the predetermined size A is the length of A4. If the value of the length Len of the entire image data is smaller than the length of the predetermined size A×2, it is determined that there is no need to divide the image data by the predetermined size A, and the process ends. If the value of the length Len of the entire image data is equal to or greater than the length of the predetermined size A×2, the reference position S of the beginning of the image data is set to 0 (S1103).

[0064] The value obtained by adding the length of the specified size A to the variable S as the reference position S is set as the division position to the variable N of the list structure prepared in advance and saved (S1104). The variable N has a list structure, and the new division position is added to the end. After that, the reference position S is changed (S1105). Here, the value of the division position is set as the next reference position S. The value of the division position is obtained and used as the value of the variable N of the list structure. It is determined whether the document is at the rear end by whether the value obtained by adding the reference position S and the length of the specified size A is equal to or greater than the length Len of the entire image data (S1106). If the value obtained by adding the value of the reference position S and the length of the specified size A is smaller than the length Len of the entire image data, the process proceeds to step S1904 and continues. If the value obtained by adding the value of the reference position S and the length of the specified size A is equal to or greater than the length Len of the entire image data, the division position identification process is completed and it is determined that the document is at the rear end, and the process ends.

[0065] In addition, in this embodiment, the predetermined size A is a length that is determined in advance, but it is not limited to this, and may be specified by the user through a UI (not shown) on the application software 401. Also, it may be calculated from the length of the entire image data, such as 1 / n (n is a natural number) of the length of the entire image data.

[0066] FIG. 12 is a flowchart showing the flow of image data division processing and storage processing according to this embodiment.

[0067] Image data is acquired (S1201), and all division positions saved in step S705 shown in Fig. 7 are acquired (S1202). It is assumed that the image data is stored in advance in RAM 501, and the values ​​are read by CPU 500. The acquired division positions are held as variable N of the list structure.

[0068] When displaying the divided image data, the size Y of the overlapping image area is acquired to improve the visibility of the divided boundary positions (S1203). In this embodiment, the size Y of the overlapping area is set to 3 cm (354 pixels in the case of 300 dpi). However, the size Y of the overlapping area is not limited to this embodiment and may be variable. Also, the size Y of the overlapping area may be held as a constant in advance, may be set to 0, or may be set by the user via a UI (not shown).

[0069] In step S1204, a start position P of the image to be output to the file is set. An initial value of 0 is set to the start position P. After that, the number of division positions is set to variable i, and 0 is set to variable j (S1205). The number of division positions is obtained by counting the number of items from the start to the end of list N. A rear end position P' of the image to be output to the file is set. A value obtained by adding the division position N to the start position P is set as the rear end position P' (S1206).

[0070] After the setting, it is determined whether the value of the start position P is greater than the initial value (P=0) (S1207). If the value of the start position P is equal to or less than the initial value, image data from the start position P and the rear end position P' to a position (P'+Y) including the size Y of the overlapping area is obtained, and output to the HDD 502 as a file (S1208). If the start position P is greater than the initial value, image data from a position (PY) obtained by subtracting the size Y of the overlapping area from the start position P and from the rear end position P' to a position (P'+Y) including the size Y of the overlapping area is obtained, and output to the HDD 502 as a file (S1209). After output to the HDD 502 as a file, 1 is added to the variable j (S1210), and the previous rear end position P' is set to the start position P as the new start position (P=P') (S1211).

[0071] After that, it is determined whether or not the splitting process has been performed at all splitting positions (S1212). If the variable j is smaller than the number of splitting positions i (j < i), it is determined that there are remaining splitting positions, and the process proceeds to step S1206 to perform the next splitting process. If the variable j is greater than or equal to the number of splitting positions i (j ≧ i), it is determined that the splitting process has been performed at all splitting positions, and the end position of the image data is set to the trailing end position P' (P' = image end position) (S1213). The image data from the position (P - Y) obtained by subtracting the size Y of the overlapping area from the leading position P to the trailing end position P' is acquired and output as a file to the HDD502 (S1214). After that, the image data is deleted from the temporary storage area (S1215), and the process ends.

[0072] Subsequently, the processing when an abnormality occurs during the conveyance of the document will be described.

[0073] FIG. 13 is a flowchart showing the processing when a conveyance abnormality occurs while reading a long document according to the present embodiment. In the present embodiment, the long document is one sheet. FIGS. 14(a) and (b) show a document reading restart confirmation screen.

[0074] When the reading of the document starts (S1301), the conveyance of the document starts (S1302). It is confirmed by the conveyance abnormality detection means whether or not an abnormality has occurred during the conveyance (S1303). If it is determined that an abnormality has occurred, the conveyance of the document is stopped (S1304). Details of the detection of the occurrence of a conveyance abnormality during the conveyance of the document will be described later.

[0075] The image data read until the conveyance is stopped is temporarily stored in the RAM13 (S1305). After storing the image data, the amount of return of the position of the document is calculated by the document position return amount calculation means (S1306). The method for calculating the amount of return of the position of the document will be described later.

[0076] After calculating the return amount of the document position, it is determined whether or not to resume reading of the document (S1307). In this embodiment, the determination is made by confirming with the user using a display means of the image reading device 100 as shown in Figs. 14(a) and (b). If the user presses "No", the image data stored in RAM 13 is discarded and the process ends (S1308). If the user presses "Yes", the process proceeds to step S1301 and reading is resumed.

[0077] If it is determined in step S1303 that no abnormality has occurred, it is checked whether the document is still being read (S1309). In this embodiment, when the registration sensor 109 shown in Fig. 2 detects the document, it is determined that the document is still present, and the process proceeds to step S1302, where the transport of the document is repeated. If it is determined that the reading of the document is complete, the transport is stopped (S1310).

[0078] After the conveyance is stopped, the presence or absence of image data stored in the RAM 13 in step S1305 is confirmed (S1311). If it is determined that there is image data, the image data read after reading is resumed and the stored image data are combined (S1312), and the process ends. The method of combining image data will be described later. If it is determined that there is no image data, the process ends.

[0079] The image combining in step S1312 may be performed not only within the image reading device 100 but also in an external device such as the PC 200 connected to the image reading device 100.

[0080] Next, a description will be given of the details of what happens when a transport abnormality is detected during transport of the document in step S1303 in Fig. 13. Fig. 15, Fig. 16, and Fig. 17 are flowcharts showing the processing when an abnormality occurs during transport according to this embodiment.

[0081] The abnormalities during conveyance include jamming, skewing, and double feeding. In this embodiment, a program stored in the ROM 12 controls the detection of abnormalities such as jamming, skewing, and double feeding.

[0082] FIG. 15 is a flowchart showing the process when a jam that has occurred during transport of the document is detected in step S1303 in FIG.

[0083] In this embodiment, if a document becomes jammed during transport, the pressure-sensitive detection sensor 113 is pushed up, and the jam is detected.

[0084] During the transport of the document, the pressure sensor 113, which is a transport abnormality detection means, is checked to determine whether the pressure sensor 113 has detected a pressure signal (S1501). If the pressure sensor 113 has not detected a pressure signal, it is determined in step S1309 in FIG. 13 whether the image reading device 100 is reading an image.

[0085] On the other hand, if the pressure detection sensor 113 detects a pressure signal in step S1501, it is determined that a paper jam has occurred during transport of the original 101 (S1502), and the process proceeds to step S1304 in FIG. 13 to stop the transport.

[0086] FIG. 16 is a flow chart showing the process when skew is detected during transport of the document in step 1303 in FIG.

[0087] While the document is being transported, the skew detection sensor 111, which is a transport abnormality detection means, is checked to determine whether or not either one of the skew detection sensors 111 at both the left and right ends of the transport path has detected the document 101 (S1601). If the document is not detected by the skew detection sensor 111, it is determined in step S1309 in FIG. 13 whether or not the image reading device 100 is reading an image.

[0088] On the other hand, if the document is detected by the skew detection sensor 111, it is determined that skew has occurred and the document 101 is being transported in a tilted state along the transport path 108 (S1602), and the process proceeds to step S1304 in FIG. 13, where the transport is stopped.

[0089] FIG. 17 is a flowchart showing the process when a double feed is detected during the transport of the original 101 in step S1303 in FIG.

[0090] While the document is being transported, the image reading device 100 checks the multi-feed detection sensor 112, which is a transport abnormality detection means, to determine whether the multi-feed detection sensor 112 has detected a multi-feed state (S1701).If a multi-feed state is not detected, the image reading device 100 determines in step S1309 in FIG. 13 whether the image reading device 100 is reading an image.

[0091] On the other hand, if the multi-feed state is detected by the multi-feed detection sensor 112, it is determined that the original 101 is being transported in a multi-feed state on the transport path 108 (S1702), and the process proceeds to step S1304 in FIG. 13, where the transport is stopped.

[0092] In this embodiment, the double feed detection sensor 112 is composed of an ultrasonic double feed detection sensor, with a transmitter located above the transport path 108 and a receiver located below, across the transport path 108 from the transmitter. As an example of a detection method, whether or not a double feed has occurred is detected based on the difference in the amount of attenuation when the ultrasonic waves emitted from the transmitter are detected by the receiver when one original is sandwiched between the transmitter and receiver, and the amount of attenuation when two originals are sandwiched; however, other methods for detecting double feed may also be adopted.

[0093] Next, the process of calculating the amount of return for the document position and the process from the occurrence of a transport abnormality to the restart of document reading in step S1306 in Fig. 13 of this embodiment will be described. Fig. 18 is a flowchart showing the process of calculating the amount of return for the document position when an abnormality occurs and the process from the occurrence of a transport abnormality to the restart of document reading according to this embodiment. Fig. 19 is a diagram showing a dialog for confirming whether to restart document reading.

[0094] When an abnormality occurs (S1801), the value of the encoder 110 immediately after the abnormality occurs is obtained (S1802). Then, the transport of the original 101 is stopped (S1803). After the transport of the original 101 is stopped, the image reading device 100 obtains the value of the encoder 110 at the time the transport of the original is stopped (S1804).

[0095] From the values ​​of the encoders acquired in steps S1802 and S1804, the amount of movement l until an abnormality occurs and transport stops is calculated (S1805).

[0096] The CPU 11 functioning as a transport abnormality determination means determines the type of the transport abnormality that has occurred (S1806), and if it determines that the detected transport abnormality is a jam or a skew, it sets the value of the movement amount l calculated in step S1905 as the return amount L of the document position (S1807). On the other hand, if it determines that the transport abnormality is not a jam or a skew, it determines that the abnormality that has occurred is a "multiple feed" (S1808).

[0097] If it is determined that the transport abnormality is a multifeed, a calculation process for calculating the return amount P of the document position at the time of the multifeed is performed, and the return amount P of the document position at the time of the multifeed is obtained (S1809). The calculation process for the return amount P of the document position at the time of the multifeed will be described later.

[0098] The user is notified of the amount of document position return L calculated in step S1807, or the amount of document position return P during multiple feeding calculated in step S1809, using a confirmation dialog such as those shown in Figures 14(a) and (b) (S1810), and the processing is terminated.

[0099] In this embodiment, the amount of return of the document position is calculated according to a transport abnormality such as a jam, skew, or double feed that occurs during transport, but the present invention is not limited to this. A mechanism may be used in which the user can stop transport at will. For example, transport may be stopped by pressing a stop button on a scan application running on the PC 200 or a stop button on the image reading device 100 (not shown). In this case, since the user does not need to correct the document position, a confirmation dialog such as that shown in FIG. 19 may be used to confirm whether or not to resume reading without returning the document position.

[0100] Next, a calculation process for the return amount P of the document position in the case of multi-feeding will be described. In this embodiment, it is assumed that multi-feeding has occurred due to an unnecessary sticky note attached to the document 101.

[0101] Fig. 20(a) is the image scanned before the double feed occurred and transport was stopped. Fig. 20(b) is the image scanned when the user returned the document to its original position and scanned it again. Fig. 20(c) is the image obtained by combining Fig. 20(a) and Fig. 20(b).

[0102] If a multifeed occurs during scanning of an original, the user removes the unnecessary sticky note that caused the multifeed and then resumes scanning based on the instructions shown in the confirmation dialog shown in Fig. 14(b). At that time, the confirmation dialog in Fig. 14(b) shows an instruction to resume scanning by moving the original back by the return amount P of the original position at the time of the multifeed in order to read the area that could not be read correctly due to the unnecessary sticky note, as described above.

[0103] In the merging process used to combine the image read before the multifeed shown in Figure 20(a) and the image read after reading is resumed as shown in Figure 20(b), the return amount P of the document position during the multifeed is expressed by the formula P=J+M, where J is the length of the area detected as a "multifeed" (multifeed area) and M is the length of the overlapping area required to determine that the images are from the same area.

[0104] After the return amount P of the document position is calculated, as shown in step S1810 of FIG. 18, the user is notified of the return amount P of the document position in the dialog shown in FIG. 14(b).

[0105] In this embodiment, the length M of the overlapping area is a constant and is stored in advance in ROM 12. However, it is a variable value depending on the combining process used when combining the image read before the double feed shown in FIG. 20(a) and the image read after reading is resumed as shown in FIG. 20(b), and it is also possible to calculate the length M of the overlapping area instead of the return amount P of the document position during the double feed.

[0106] In addition, the double feed area J can be determined by the difference between the value of encoder 110 at the time when the double feed is detected by the double feed detection sensor 112 and the value of encoder 110 up to the time when the double feed state is cleared by the same sensor.

[0107] Next, a description will be given of the image combining process in step S1312 shown in Fig. 13. The image combining process is performed by an image processing program stored in the ROM 12.

[0108] The image processing program detects an overlapping portion between two images, a first image read before a transport abnormality occurs and transport is stopped for the original 101 stored in the RAM 13, and a second image read after the transport abnormality occurs and transport of the original 101 is resumed. The image processing program detects the overlapping portion between the first image and the second image using a known pattern matching technique.

[0109] The image processing program extracts an area from each of the first and second images that corresponds to the previously calculated amount of return of the position of the original 101, and calculates the degree of similarity between each area. A normalized cross-correlation value is used as the degree of similarity. If the calculated degree of similarity is equal to or greater than a threshold, the extracted area is detected as an overlapping portion. The first and second images are synthesized to generate a synthesized image by synthesizing the first and second images.

[0110] If it is determined that there is no overlapping portion, a composite image is generated by combining the rear end of the first image and the front end of the second image.

[0111] If the amount by which the user moves the document back is smaller than the value calculated in the document position return amount calculation process described above, pattern matching may not be performed correctly. In that case, the user may be allowed to select whether to read the document again or to simply generate a composite image by combining the rear end of the first image and the front end of the second image.

[0112] In addition, the user may be allowed to select the position where the first image and the second image are combined.

[0113] Furthermore, in this embodiment, the case where an abnormality occurs in the transport of a long document has been described, but the document does not have to be a long document.

[0114] In this embodiment, the image reading system is configured such that the image reading device 100 performs processing for detecting characteristic information of image data and processing for identifying division positions, and the PC 200 performs processing for dividing images and saving divided images, but all of the processing may be performed by only one of the devices.

[0115] (Appendix 1) Image reading means for reading a document; a transport abnormality detection means for detecting an abnormality in transport while the document is being transported; a stop means for stopping the transport of the document when the transport abnormality detection means detects a transport abnormality; a pre-abnormality image data storage means for storing a first image until the transport of the document is stopped when the transport abnormality detection means detects a transport abnormality; a rescan notification means for notifying a user to select whether to resume scanning of the document; an image combining means for combining the first image and a second image read by restarting reading of the document, an amount of return for returning the position of the document after the transport of the document is stopped, and reading of the document is resumed by calculating the amount of return for the position of the document.

[0116] (Appendix 2) 2. The image reading system according to claim 1, wherein the notification changes the instruction to resume reading of the document depending on the type of the transport abnormality detected by the transport abnormality detection means.

[0117] (Appendix 3) 3. The image reading system according to claim 1, wherein the notification means requests the user to return the document to its original position before restarting image reading.

[0118] (Appendix 4) 2. The image reading system according to claim 1, wherein the amount of return of the document position is calculated by a document position return amount calculation means in accordance with the type of abnormality detected by the abnormality detection means.

[0119] (Appendix 5) The image reading system described in Appendix 4, wherein the abnormality detection means includes a double feed detection means, and the document position return amount calculation means determines the amount of return of the document position using the double feed area detected by the double feed detection means. [Explanation of symbols]

[0120] 100 Image reader 101 Manuscripts 102 Manuscript stand 103 Discharge section 104 Image reading unit 105 Background board 106 Paper feed roller 107 Transport roller 108 Transport Path 109 Resist sensor 11 CPU 12 ROM 13 RAM 14 Image processing circuit 15 Communication Interface 1041 Case 1042 Glass plate 1043 Line Image Sensor 1044 Light emitting part 200 PC 401 Application Software 402 Scanner driver

Claims

1. an image reading means for reading an original; a feature information detection processing means for scanning and detecting feature information of an image related to the image data read by the image reading means at a predetermined interval; a division position specification processing means for specifying a division position of the image related to the image data; a division processing means for dividing the image data in accordance with the division positions; A divided image storage processing means for storing the divided image data, The image reading system according to the present invention, wherein the dividing position specifying processing means determines a position of the characteristic information as the dividing position.

2. 2. The image reading system according to claim 1, wherein the document has a fold, a shadow of the fold is detected as the characteristic information from the image by the characteristic information detection processing means, and the image data is divided at the position of the shadow.

3. 2. The image reading system according to claim 1, wherein the feature information has a predetermined size, and the image data is divided at positions of the predetermined size.

4. 4. The image reading system according to claim 1, wherein a boundary position of the image related to the divided image data is displayed by being overlapped with an overlapping area which is an image area.

Images