Image processing system and program

Abstract

To lighten the operation burden of display on a user as compared with a case in which the whole read image is displayed on reading.SOLUTION: An image processing system has one or more processors, which are configured to make a preview display such that in an operation mode for making a preview display of a document image 4 read out of a document being conveyed by a conveying mechanism at a display part 132, the document image 4 by the conveying mechanism has an intermediate part, positioned between end parts of the document in a direction X crossing a direction Y of conveyance by the conveying mechanism, omitted.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an image processing system and a program. [Background technology]

[0002] For example, Patent Document 1 discloses an original reading device with a preview function, which includes an original reading unit that reads an original image, an image processing unit that processes the read original image to generate an image for output, an output unit that outputs the image for output to the outside, and a display unit for a user to preview the original image, and the image processing unit extracts ranges of a predetermined width based on the top, bottom, left and right edges of the rectangular image area so as to include the edges of the rectangular image area as each of the top, bottom, left and right end areas, and sets the magnification of the preview image for each of the top, bottom, left and right end areas to a size that fits within the display unit for either the top and bottom pair of end areas or the left and right pair of end areas but does not fit the other pair, and positions the top end area higher than the bottom end area and the left end area to the left of the right end area, and displays the preview image on the display unit with the top and bottom directions of the top, bottom, left and right end areas aligned. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 5081885 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, when an image of a document is read while the document is being transported, deviation or meandering in a direction intersecting the document transport direction is likely to occur if the document length in the transport direction or the document width in the intersecting direction is large. For example, consider a case where a read image is displayed to show the state of document deviation, etc. to a user to prompt the user to take action when deviation, etc. occurs. If the read image is displayed in a manner showing the entirety of the document, a reduced image will be displayed in the case of a document with a certain length or width, and if user operations for the display, such as operations for enlarging or moving the image, are required, the burden of operating the display for the user during reading will increase. An object of the present invention is to reduce the operational burden on the user with respect to display, as compared to a case in which the entire read image is displayed when reading. [Means for solving the problem]

[0005] The invention described in claim 1 is an image processing system having one or more processors, which, in an operating mode in which a document image read from a document being transported by a transport mechanism is previewed on a display unit, previews the document image by the transport mechanism in a manner that omits an intermediate portion located between each end of the document in a direction intersecting the direction of transport by the transport mechanism. The invention recited in claim 2 is the image processing system recited in claim 1, characterized in that the mode of the preview display is a mode including each of the end portions. The invention described in claim 3 is the image processing system described in claim 2, characterized in that the aspect including each end portion displays the ratio between the end portion of the document in the intersecting direction and the area outside the document as a predetermined value. The invention recited in claim 4 is the image processing system recited in claim 3, characterized in that the predetermined value is changeable by settings. The invention described in claim 5 is the image processing system described in claim 1, characterized in that the preview display mode is a mode in which an additional image is added to grasp the movement of the original document associated with transport in the intersecting direction. The invention described in claim 6 is the image processing system described in claim 5, characterized in that the additional image is a linear image extending in the transport direction. The invention described in claim 7 is the image processing system described in claim 5, characterized in that the additional image is an image of a scale indicating an amount of movement in the intersecting direction. The invention described in claim 8 is the image processing system described in claim 7, characterized in that the image of the scale includes an image indicating the position of the end when reading of the document being transported begins, and an image indicating the position of the end during reading. The invention described in claim 9 is the image processing system described in claim 5, characterized in that the additional image is an image of a numerical value indicating an amount of movement in the intersecting direction. The invention described in claim 10 is the image processing system described in claim 9, characterized in that the additional image includes an image that alerts a user when the numerical value exceeds a predetermined threshold value. The invention described in claim 11 is the image processing system described in claim 1, characterized in that the mode of the preview display is a mode that displays an original image of the part of the original that was first read, and also displays an original image that accompanies reading in the transport direction. The invention described in claim 12 is the image processing system described in claim 1, characterized in that the display unit is capable of changing a display range of the document image after reading is completed. The invention described in claim 13 is a program that enables an information processing device to realize, in an operating mode in which a document image read from a document being transported by a transport mechanism is previewed on a display unit, a function of acquiring the document image by the transport mechanism, and a function of previewing the acquired document image in a manner that omits an intermediate portion located between each end of the document in a direction intersecting the direction of transport by the transport mechanism. Effect of the Invention

[0006] According to the invention of claim 1, the operational burden on the user with respect to display can be reduced compared to when the entire read image is displayed during reading. According to the invention of claim 2, the preview display mode can improve the visibility for the user compared to a case where the preview display mode does not include each end portion. According to the invention of claim 3, an aspect including each end portion can improve visibility for a user compared to a configuration that does not include a configuration that displays the ratio between the end portion of the document in the intersecting direction and the area outside the document as a predetermined value. According to the invention of claim 4, it is possible to improve ease of use for the user, compared to a case where the predetermined value is not configured to be changeable by settings. According to the invention of claim 5, the preview display mode can improve visibility for the user compared to a case in which an additional image is added to grasp the movement of the document accompanying transport in the intersecting direction. According to the invention of claim 6, the additional image is a linear image extending in the transport direction, so that the misalignment of the document can be easily grasped, compared to a case where the additional image is not a linear image extending in the transport direction. According to the invention of claim 7, the amount of deviation of the document can be more easily grasped than in a case where the additional image is not provided with a configuration in which the additional image is an image of a scale indicating the amount of movement in the intersecting direction. According to the invention of claim 8, the image of the scale includes an image indicating the position of the end when reading of the document being transported begins and an image indicating the position of the end during reading, making it easier to grasp the position at the start of reading and the change in position thereafter, compared to a case in which the image of the scale does not include an image indicating the position of the end during reading. According to the invention of claim 9, the amount of movement can be grasped numerically. According to the invention of claim 10, the additional image can improve ease of use for the user compared to a case where the additional image does not include a configuration including an image that alerts the user when the numerical value exceeds a predetermined threshold value. According to the invention of claim 11, the preview display mode displays an original image of the part of the original that was first read, and at the same time, improves user visibility compared to a case in which the preview display mode does not include a configuration in which an original image associated with reading in the transport direction is displayed. According to the invention of claim 12, the display unit can improve ease of use for the user compared to a case where the display unit does not have a configuration that allows the display range of the document image to be changed after reading is completed. According to the invention of claim 13, the operational burden on the user with respect to display can be reduced compared to when the entire read image is displayed during reading. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 illustrates an example of an image processing system. [Diagram 2] FIG. 2 is a diagram illustrating an example of the hardware configuration of an information processing unit and a server device provided in the image forming apparatus. [Diagram 3] 1A and 1B are diagrams illustrating the configuration of an image reading device, in which FIG. 1A is a plan view and FIG. [Figure 4] 13A and 13B are diagrams illustrating an example of a preview display of an operation receiving unit in an operation mode. [Diagram 5] 13A and 13B are diagrams illustrating another example of display on the operation receiving unit in the operation mode. [Figure 6] FIG. 2 is a block diagram illustrating a functional configuration according to the present embodiment. [Figure 7] 10 is a flowchart showing a processing procedure when a preview display is performed. [Figure 8] 11A and 11B are diagrams for explaining generation of a gauge to be displayed in an auxiliary image display area, where (a) shows the original and (b) shows the gauge. [Figure 9] 11A and 11B are diagrams for explaining the generation of the right and left edges of an original image displayed in the right-end display area and the left-end display area, where (a) shows line data, (b) shows the right edge, and (c) shows the left edge. [Figure 10]13A and 13B are diagrams illustrating an example of a display on the operation receiving unit when the amount of skew of a document increases during scanning. [Figure 11] 13A and 13B are diagrams illustrating another example of a preview display of the operation reception unit in the operation mode. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing an example of an image processing system 1. As shown in FIG. The image processing system 1 of the present embodiment includes an image forming apparatus 100 and a server apparatus 200 connected to the image forming apparatus 100 via a communication line 190. In the present embodiment, the image forming apparatus 100, which is an example of an image processing system, reads an original 1A and creates a read image 1C. Furthermore, the image processing system 1 of this embodiment is provided with a user terminal 300 that is connected to the server device 200 and accepts operations from a user.

[0009] The user terminal 300 is provided with a display device 310. The user terminal 300 is realized by a computer. Examples of the form of the user terminal 300 include a PC (Personal Computer), a smartphone, and a tablet terminal.

[0010] The image forming apparatus 100 is provided with an image forming section 100A that forms an image on paper, which is an example of a recording medium. The image forming unit 100A forms an image on a sheet of paper using, for example, an inkjet system or an electrophotographic system. Note that the image forming unit 100A may form an image on a sheet of paper using any system other than the inkjet system or the electrophotographic system. The image forming apparatus 100 further includes an information processing section 100B. The information processing section 100B executes various processes performed by the image forming apparatus 100.

[0011] Furthermore, the image forming apparatus 100 is provided with an image reading device 130 that reads the document 1A, creates a read image 1C, and transmits it to the server device 200. The image forming apparatus 100 is also provided with an operation receiving unit 132 that receives and displays various operations. Details will be described later.

[0012] 2 is a diagram showing an example of the hardware configuration of the information processing unit 100B and the server device 200 provided in the image forming apparatus 100. The information processing unit 100B and the server device 200 provided in the image forming apparatus 100 are realized by a computer. Each of the information processing unit 100B and the server device 200 includes an arithmetic processing unit 11 that executes digital arithmetic processing according to a program, and a secondary storage unit 12 that stores information. The secondary storage unit 12 is realized by an existing information storage device such as an HDD (Hard Disk Drive), a semiconductor memory, or a magnetic tape.

[0013] The arithmetic processing unit 11 includes a CPU 11a as an example of a processor. The arithmetic processing unit 11 also includes a RAM 11b used as a working memory for the CPU 11a, and a ROM 11c in which programs executed by the CPU 11a are stored. The arithmetic processing unit 11 is also provided with a non-volatile memory 11d that is rewritable and can retain data even if the power supply is interrupted, and an interface unit 11e that controls each unit, such as a communication unit, connected to the arithmetic processing unit 11.

[0014] The non-volatile memory 11d is composed of, for example, a battery-backed SRAM, a flash memory, etc. In the secondary storage unit 12, in addition to storing files and the like, the programs executed by the arithmetic processing unit 11 are also stored. In this embodiment, the arithmetic processing unit 11 reads a program stored in the ROM 11c or the secondary storage unit 12, and thereby each process is executed.

[0015] The program executed by the CPU 11a may be provided to the server device 200 and the information processing unit 100B in a state where it is stored in a computer-readable recording medium such as a magnetic recording medium (such as a magnetic tape or a magnetic disk), an optical recording medium (such as an optical disk), a magneto-optical recording medium, a semiconductor memory, etc. Also, the program executed by the CPU 11a may be provided to the server device 200 and the information processing unit 100B using a communication means such as the Internet.

[0016] In this specification, the term "processor" refers to a processor in a broad sense, including general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.). In addition, the operations of the processor may not only be performed by one processor, but may be performed by multiple processors in physically separate locations working together. The order of the operations of the processor is not limited to the order described in this embodiment, and may be changed.

[0017] The processing in the image processing system 1 described below may be performed by a CPU 11a as an example of a processor provided in the image forming apparatus 100, or may be performed by a CPU 11a as an example of a processor provided in the server apparatus 200. The processing may be realized by one apparatus such as one server apparatus 200, or may be realized by multiple apparatuses. In this embodiment, the term "system" includes both a system made up of multiple devices and a system made up of a single device.

[0018] Returning to FIG. 1, the image forming apparatus 100 will be described. In this embodiment, as described above, image forming apparatus 100 is provided with image forming section 100A that forms an image on paper, which is an example of a recording medium.

[0019] The image forming apparatus 100 is also provided with an image reading device 130 as an example of an image reading means for reading the image of the original 1A. This image reading device 130 is a so-called scanner having a transport mechanism 26 (see FIG. 3) for the original 1A, and scans the original 1A by transporting it with the transport mechanism 26. Hereinafter, image reading may be referred to as "scanning". The image reading device 130 includes a light source that emits light to be irradiated onto the original 1A, and a light receiving unit such as a CCD that receives reflected light from the original 1A. In this embodiment, a read image, which will be described later, is generated based on the reflected light received by the light receiving unit. An image reading position is preset in the image reading device 130, and the image reading device 130 sequentially scans the image of the area of ​​the conveyed original 1A at this reading position line by line, and reads the scan line data. Furthermore, the image forming apparatus 100 has an information transmission function for transmitting information to the server apparatus 200 (see FIG. 1).

[0020] In this embodiment, an image reading device 130 is provided on the upper part of the image forming apparatus 100. The image reading device 130 reads an original 1A set by a user.

[0021] Furthermore, each image forming apparatus 100 is provided with an operation reception unit 132 that receives operations from a user. This operation reception unit 132 is configured with a so-called touch panel. The operation reception unit 132 displays information to the user and receives operations performed by the user. Note that the display of information to the user and the reception of user operations are not limited to being performed by one operation reception unit 132 as in the present embodiment, but an operation reception unit and an information display unit may be provided separately. The operation reception unit 132 is an example of a display unit.

[0022] In this embodiment, an original 1A to be read is placed on the image reading device 130 as shown by reference symbol 1B in Fig. 1, and when a reading start operation is performed, conveyance of the original 1A is started and the original is read by the image reading device 130. By reading the original in this way, a read image 1C is created as data. In this embodiment, the scanned image 1C is transmitted to the server device 200 and stored therein.

[0023] The image forming apparatus 100 of this embodiment is capable of forming images on long sheets of paper, such as A4 size (210 mm x 297 mm), A3 size (420 mm x 297 mm), and also sheets larger than A3 size, such as A0 size (841 mm x 1189 mm) and A0 width 10 m (841 mm x 10,000 mm), and is also capable of reading images on sheets of such sizes.

[0024] FIG. 3 is a diagram for explaining the configuration of the image reading device 130, where (a) is a plan view thereof and (b) shows a part of the transport mechanism 26. 3(a), the image reading device 130 includes a pair of guide members 21, 22 spaced apart in a cross direction X, which is a direction intersecting a transport direction Y of the original 1A, and a light receiving unit 23 located between the pair of guide members 21, 22 and provided along the cross direction X. The image reading device 130 also includes a plurality of original position sensors 24, 25 located between the pair of guide members 21, 22 and spaced apart in the cross direction X. The light receiving unit 23 is an example of a reading unit that reads an image, and the document position sensors 24 and 25 are an example of a detection unit provided separately from the reading unit. The conveying direction Y is an example of a conveying direction, and the cross direction X is an example of a direction crossing the conveying direction.

[0025] A pair of guide members 21, 22 are provided on the transport surface and define an area through which the original 1A transported in the transport direction Y passes. The guide member 21 is located at one end in the cross direction X, and the guide member 22 is located at the other end. The light receiving unit 23 is, for example, an image sensor for reading the original 1A by receiving light that is emitted from a light source and reflected by the original 1A, and can also be called an image reading unit that outputs image data obtained by reading.

[0026] The document position sensors 24 and 25 optically detect the position of the document 1A and detect whether the document 1A is at a predetermined position. That is, the document position sensors 24 and 25 detect the positional deviation of the document 1A in the cross direction X. This allows the information processing unit 100B (see FIG. 1) to determine whether the transport of the document 1A should be temporarily stopped. In this embodiment, two document position sensors 24 and 25 are provided, but the present invention is not limited to this and three or more documents may be provided.

[0027] As shown in FIG. 3(b), the transport mechanism 26 includes a transport roller 26a that is rotatably held, and a motor 26b that drives the transport roller 26a to rotate. The transport roller 26a has a lifting mechanism (not shown) that can be displaced in the vertical direction Z and can select an upper position or a lower position, and when the lower position is selected, it is in a nip state where it presses against the upper surface of the original 1A, and when the upper position is selected, it is in a non-nip state where it does not contact the upper surface of the original 1A. When the motor 26b operates in the lower position, the transport roller 26a rotates and the original 1A is transported in the transport direction Y. It should be noted that the right hand graphic 31 and the left hand graphic 32 in FIG. 3(a) are examples of a user placing his or her hands on the document 1A being transported.

[0028] Here, the image forming apparatus 100 has an operation mode in which a document image read by the reading device 130 from the document 1A being transported by the transport mechanism 26 is displayed as a preview on the operation reception unit 132 (see FIG. 1). When the document 1A is being transported by the transport mechanism 26, if the document 1A meanders in the left-right direction or is oblique to the transport direction Y and approaches the guide members 21, 22, transport by the transport mechanism 26 is temporarily stopped to prevent damage to the document 1A. Therefore, in this operation mode, the user is prompted to suppress misalignment and meandering of the document while viewing the preview display on the operation reception unit 132 (see FIG. 1). However, in the case of a large-format document 1A that is long or wide, so-called skew, such as misalignment or meandering, is likely to occur, and the preview display of the operation reception unit 132 reduces the visibility of the user if the entire document image is reduced. Also, if the user operates the operation reception unit 132 to enlarge the preview display during transport, the user will have to operate while being concerned about misalignment of the document 1A, which increases the operational burden on the user. Therefore, in this embodiment, the preview is displayed in a manner that omits the intermediate portion 1G (see FIG. 3(a)) located between the ends 1F, 1H (see FIG. 3(a)) of the document 1A, so that the reduction ratio of the document image does not become small. A specific description will be given below.

[0029] 4 is a diagram illustrating an example of a preview display of the operation reception unit 132 in the operation mode. The preview display here refers to sequentially displaying in real time the document images read before the reading of the document 1A (see FIG. 1) is completed while the document 1A is being read while being conveyed.

[0030] In the example shown in FIG. 4, in the operation mode, the operation reception unit 132 displays a right edge display area 5 located on the right side of the screen and a left edge display area 6 located on the left side of the screen. The right edge display area 5 is an area for displaying a right edge 41 of the document image 4 read from the document being conveyed, and the left edge display area 6 is an area for displaying a left edge 42 of the document image 4. In this embodiment, the scanned document image is saved as data, and only the left and right edges of the document image are cut out in real time and displayed separately on the screen. Note that in this embodiment, the right edge 41 and the left edge 42 of the document image 4 are displayed, but this is not limiting, and it is also possible to display either the right edge 41 or the left edge 42.

[0031] On the operation reception unit 132, the entire document image 4 is not displayed, but rather the right end 41 and the left end 42 are displayed while the display of the intermediate portion located between the right end 41 and the left end 42 is omitted. As a result, the right end display area 5 and the left end display area 6 on the operation reception unit 132 are enlarged and displayed larger than when the entire document image 4 is displayed, so that the reduction ratio does not become small.

[0032] The right end display area 5 and the left end display area 6 of the operation reception unit 132 are preview displays that are displayed in real time. The operation reception unit 132 also displays the right end 41 and the left end 42, and the display of the middle part is omitted. This provides a visual and real-time display specialized for determining the skew of the original 1A, which greatly affects the quality of the original image 4, which is the scan data, while it is being read.

[0033] More specifically, while the original 1A is being transported, for example, a right corner 4a of the original image 4 displayed in the right edge display area 5 of the operation reception unit 132 is touched, as shown in the right hand figure 31. In response to this touch, a right guide line 51 extending linearly in the transport direction Y is displayed at the position of the right corner 4a in the right edge display area 5. The right corner 4a is the right edge of the front end 43, which is the front side of the right edge 41 in the transport direction Y.

[0034] Furthermore, as shown in the left-hand figure 32, for example, a position 4b corresponding to the front end 43 of the outer edge 44 of the document image 4 displayed in the left-end display area 6 of the operation reception unit 132 is touched. In response to this touch, a left guide line 61 is displayed in the left-end display area 6 at the position 4b of the outer edge 44.

[0035] In this way, the operation reception unit 132 displays a preview in a manner in which the document image 4 read from the document 1A is added with additional images, that is, the right guide line 51 and the left guide line 61. That is, by enabling the user to tap an edge or other position in the document image and overlay an auxiliary line extending in the transport direction Y, the visibility of the preview display on the operation reception unit 132 is improved, making it easier for the user to recognize the state of skew. This makes it easier for the user to manually correct the skew of the document or to determine whether to stop scanning. The operation reception unit 132 is an example of a display unit. The right guide line 51 and the left guide line 61 are an example of an additional image, and are an example of a linear image extending in the conveying direction. The additional image referred to here refers to an image that is displayed when the original image 4 is previewed on the operation reception unit 132, and includes the case where it is displayed superimposed on the original image 4 (see FIG. 4 described below) as well as the case where it is displayed without being superimposed on the original image 4 (see FIG. 5 described below).

[0036] An arrow graphic 45 indicating the transport direction Y is displayed between the right-end display area 5 and the left-end display area 6 in the operation reception section 132. This improves the visibility of the document image 4 displayed on the operation reception section 132.

[0037] In this embodiment, the right end display area 5 and the left end display area 6 are displayed on the operation reception unit 132, but the present invention is not limited to this and it is also possible to adopt a mode in which either the right end display area 5 or the left end display area 6 is displayed. When it is determined that the original 1A is, for example, shifted to the right with respect to a predetermined position, it is possible to consider a mode in which only the right end display area 5 is displayed and the display of the left end display area 6 is omitted.

[0038] FIG. 5 is a diagram illustrating another example of display of the operation receiving unit 132 in the operation mode. 5, the operation mode operation acceptance unit 132 displays the auxiliary image display area 7. The auxiliary image display area 7 displays the change in the skew amount more specifically than in the right end display area 5 and the left end display area 6, and displays an image of a gauge display. Although the auxiliary image display area 7 is displayed on the operation reception section 132 together with the right edge display area 5 and the left edge display area 6, which are preview displays, only the auxiliary image display area 7 may be displayed on the operation reception section 132.

[0039] The auxiliary image display area 7 displays an image of a gauge 71 extending in a direction X (hereinafter referred to as "cross direction X") intersecting with the transport direction Y. The gauge 71 includes scale lines at 1 mm intervals that enable confirmation of changes in the amount of skew, i.e., the amount of movement, and also includes the number "5" indicating that the amount of movement is 5 mm. Note that the number indicates the maximum amount of movement, but it may also be considered to indicate a fixed value as a marker. The gauge 71 is an example of an image of a scale indicating the amount of movement in the intersecting direction. "5" is an example of an image of a number indicating the amount of movement in the intersecting direction.

[0040] More specifically, the gauge 71 includes a "start" line 72 indicating the position of a predetermined portion of the document image, such as the right edge, at the start of scanning, and a "current" line 73 indicating the current position during scanning. The gauge 71 also includes a "rightmost" line 74 indicating the rightmost position from the start of scanning to the present, and a "leftmost" line 75 indicating the leftmost position. The display of the gauge 71 makes it possible to grasp the deviation in numerical terms. The "start" line 72 is an example of an image indicating the position of the edge when scanning of the document being transported starts, and the "current" line 73 is an example of an image indicating the position of the edge during reading. Note that the "current" line 73 also includes a double-headed arrow with left and right arrows to indicate that it may change.

[0041] In this way, in the case where the auxiliary image display area 7 is displayed in real time while the scan is being performed, in addition to the "current" line 73 which may change successively in real time, the lines 72, 74, and 75 indicating past states are displayed. Therefore, the auxiliary image display area 7 displays the peak of the positional deviation.

[0042] By displaying the auxiliary image display area 7, the maximum amount of deviation can be grasped, and even if the image meanders, the state of deviation can be confirmed after the scan. The auxiliary image display region 7 is a small display area, and even if it is displayed on the screen of the operation reception unit 132 together with the preview display, it can be prevented from being displayed too small.

[0043] When the auxiliary image display area 7 is displayed on the screen of the operation reception unit 132 together with the preview display, it is also possible to enable scrolling display in which the displayed portion of the original image is returned in the opposite direction by performing a touch operation in the direction opposite to the transport direction Y after scanning is completed. In such a case, it is possible to know whether the image is cut off at the position of the original image corresponding to the "rightmost" line 74 or the "leftmost" line 75, and to determine whether rescanning is necessary. The gauge 71 and the like displayed in the auxiliary image display area 7 are examples of additional images.

[0044] Next, the functional configuration of this embodiment will be described. FIG. 6 is a block diagram illustrating a functional configuration according to the present embodiment. In the configuration example shown in FIG. 6, the image reading device 130 includes the light receiving unit 23 and document position sensors 24 and 25 described above.

[0045] The information processing unit 100B includes an image management unit 81 that manages the document image data generated by the light receiving unit 23 and the document position data detected by the document position sensors 24, 25, and a data storage unit 82 that stores the image data and the document position data. The image management unit 81 records the document image data and the document position data in the RAM 11b. The recorded document image data and document position data are stored in the secondary storage unit 12 by the data storage unit .

[0046] Furthermore, information processing unit 100B includes a preview image generating unit 83. Preview image generating unit 83 generates a preview image to be displayed on the screen during preview display using the document image data and the document position data. Furthermore, preview image generating unit 83 causes operation receiving unit 132 to display the generated preview image. The preview image here includes the images displayed in the right edge display area 5 and the left edge display area 6 described above, and also includes the image displayed in the auxiliary image display area 7 if there is an auxiliary image display area 7.

[0047] Information processing section 100B also includes a screen operation control section 84. Screen operation control section 84 performs control for changing the display when it is detected that a user's operation has been performed on operation receiving section 132. That is, screen operation control section 84 instructs preview image generating section 83 to change the display. Preview image generating section 83 generates a new preview image. Such user operations include, for example, a screen touch operation using the right hand figure 31 (see FIG. 4), the above-mentioned screen touch operation for instructing scroll display, etc. In addition, an operation for instructing a predetermined enlarged or reduced display is also conceivable.

[0048] Although the image processing is performed by the information processing unit 100B of the image forming apparatus 100 in the above-described configuration, the present invention is not limited to this, and the image processing may be performed by the server device 200. The information processing section 100B of the image forming apparatus 100 or the server apparatus 200 is an example of an information processing apparatus.

[0049] FIG. 7 is a flowchart showing a processing procedure when a preview display is performed. In the processing example shown in FIG. 7, when the original 1A (see FIG. 3) is conveyed and scanning by the light receiving unit 23 is started (step 101), data called scan line data and original edge coordinate data are read (step 102). The document edge coordinate data is data on document edge coordinates (see document edge coordinates 1D, 1E shown in FIG. 8) for specifying the positions of the edges of the document 1A, and thereby the reading range of the document 1A is determined. The document edge coordinate data also specifies the right edge 41 and the left edge 42 (see FIG. 4) displayed in the right edge display area 5 and the left edge display area 6. Hereinafter, the document edge coordinate data will be referred to as "coordinate data."

[0050] Here, the coordinate data is also used to determine the ranges of the right edge 41 and the left edge 42 (see FIG. 4) of the document image 4 that are to be displayed in the right edge display area 5 and the left edge display area 6. More specifically, in the right-end display area 5, the display ratio in the left-right direction between the display portion 401 at the right end 41 and the portion 402 other than the original image 4 may be fixed at, for example, 50:50. In this case, in the left-end display area 6, the display ratio in the left-right direction between the display portion 403 at the left end 42 and the portion 404 other than the original image 4 may be fixed at, for example, 50:50. Ends 1F, 1H (see FIG. 3) of document 1A corresponding to display portions 401, 403 are an example of document end portions in the intersecting direction, and the portions of reading device 130 (see FIG. 3) corresponding to display portions 402, 404 are an example of an area outside the document. The display ratio is an example of a ratio between the document end portions in the intersecting direction and the area outside the document, and the above-mentioned 50:50, for example, is an example of a predetermined value.

[0051] The fixed value may be changed by setting in addition to 50:50. For example, the display ratio may be different, such as 60:40, by making the display portions 401 and 403 larger than the display portions 402 and 404. The display ratio may be changeable rather than being a fixed value. That is, the display ratio may be changeable by the user selecting one of predetermined values, or may be changeable by the user inputting a numerical value. In this embodiment, the above-mentioned display ratios in the right edge display area 5 and the left edge display area 6 are the same, but it is also possible to use different display ratios.

[0052] Returning to the flowchart, the explanation will be continued. It is determined whether the read data is coordinate data (step 103). If it is coordinate data (Yes in step 103), the acquired coordinate data is stored in the RAM 11b (step 104), and the preview image generating unit 83 converts it to an absolute value (step 105), and controls the screen display of the gauge 71 (see FIG. 5) (step 106). Thereafter, the process proceeds to step 110, which will be described later.

[0053] If the read data is not coordinate data (No in step 103), the read data is line data, and so the line data is stored in RAM 11b (step 107).Then, the preview image generating unit 83 (see FIG. 4) generates left and right end display images, i.e., images of the right end 41 and the left end 42 (see FIG. 4) to be displayed in the right end display area 5 and the left end display area 6 (step 108), and displays the generated images on the operation receiving unit 132 (step 109).

[0054] The image management unit 81 determines whether the scan is complete (step 110), and if the scan is not complete (No in step 110), the process returns to step 102. If the scan is complete (Yes in step 110), the process ends.

[0055] 8 and 9 are diagrams for explaining the generation of an image to be displayed on the operation reception unit 132 based on line data. More specifically, Fig. 8 is a diagram for explaining the generation of a gauge 71 to be displayed in the auxiliary image display area 7, where (a) shows the document 1A and (b) shows the gauge 71. Fig. 9 is a diagram for explaining the generation of the right end 41 and the left end 42 of the document image 4 to be displayed in the right end display area 5 and the left end display area 6, where (a) shows the line data, (b) shows the left end 42, and (c) shows the right end 41.

[0056] As shown in FIG. 8(a), when document edge coordinates 1D, 1E of a document 1A are acquired as coordinate data, a reading range 1E is determined by the first document edge coordinates 1DR, 1DL. In the gauge 71 shown in FIG. 8(b), the position of the "start time" line 72 is determined by the initial document edge coordinates 1D, 1E.

[0057] Furthermore, each time document edge coordinates 1D, 1E are acquired by scanning document 1A transported in transport direction Y, a "current" line 73 in cross direction X is updated. Furthermore, a "rightmost" line 74 and a "leftmost" line 75 are changed by comparing "start time" line 72 with "current" line 73, which fluctuates during scanning.

[0058] As shown in FIG. 8(a), by scanning an original 1A conveyed in a conveying direction Y, line data LDn and the subsequent line data LDn+1 are transmitted to the image management unit 81 (see FIG. 6).

[0059] 9(a), the right end 41 and the left end 42 of the document image 4 are set for the line data LDn and LDn+1. The set right end 41 and left end 42 are displayed in the right end display area 5 and the left end display area 6, respectively, on the screen of the operation reception unit 132, as shown in FIG. 9(b). In other words, the display of the intermediate image portion 46 located between the right end 41 and the left end 42 of the document image 4 shown in FIG. 9(a) is omitted on the screen of the operation reception unit 132. This allows the right end 41 and the left end 42 to be displayed larger on the screen of the operation reception unit 132. The intermediate image portion 46 referred to here is an image of the intermediate portion 1G (see FIG. 3(a)) of the document 1A.

[0060] Next, the contents displayed on the operation reception section 132 when the amount of skew of the original 1A increases during scanning will be described. FIG. 10 is a diagram showing an example of a display on the operation receiving section 132 when the amount of skew of the original 1A increases during scanning. 10, a notification is displayed to the user saying, "A large amount of movement of the document has been detected." Such a notification is displayed on the operation receiving unit 132 when the amount of skew exceeds a predetermined threshold value.

[0061] This allows the user to check the amount of skew displayed on the gauge 71, i.e., the position of the "rightmost" line 74 or the "leftmost" line 75 (see, for example, FIG. 8(b)), giving the user an opportunity to decide whether to stop the scan and scan again.

[0062] FIG. 11 is a diagram for explaining another example of the preview display of operation acceptance section 132 in the operation mode, and corresponds to FIG. 4 described above. 11, a right edge display area 5 and a left edge display area 6 are also displayed. The right edge display area 5 has a first area 5a and a second area 5b, and the left edge display area 6 has a first area 6a and a second area 6b.

[0063] The first area 5a of the right edge display area 5 displays the right edge 41a of the document image 4 that is read first, and the second area 5b displays the right edge 41b of the document image 4 that is read afterwards. More specifically, during scanning, the first area 5a is a fixed display in which the same image including the leading edge 43 continues to be displayed as the right edge 41a. On the other hand, the second area 5b is an updated display in which the latest image that is updated as the document is conveyed in the conveying direction Y is displayed as the right edge 41b. Therefore, in the right edge display area 5, the right guide line 51 of the first area 5a and the right guide line 51 of the second area 5b are not continuous in the cross direction X.

[0064] The first area 6a of the left edge display area 6 displays the left edge 42a of the document image 4 that is read first, and the second area 6b displays the left edge 42b of the document image 4 that is read next. During scanning, the left-end display area 6 is the same as the above-mentioned right-end display area 5. That is, the first area 6a is a fixed display like the first area 5a, and the second area 6b is an updated display like the second area 5b. The left guide line 61 of the left end display region 6 is not continuous with the first region 6a and the second region 6b in the cross direction X.

[0065] The first area 5a of the right-end display area 5 and the first area 6a of the left-end display area 6 are areas that display the document image of the part of the document that was read first, and the second area 5b of the right-end display area 5 and the second area 6b of the left-end display area 6 are areas that display the document image as it is read in the transport direction. That is, the display mode shown in Fig. 11 is an example of a mode that displays the document image of the part of the document that was read first and also displays the document image as it is read in the transport direction.

[0066] <Additional Notes> (((1))) having one or more processors, The one or more processors: In an operation mode in which a preview of an original image read from an original being transported by a transport mechanism is displayed on a display unit, a preview display of the document image conveyed by the conveying mechanism in a manner in which an intermediate portion of the document located between each end of the document in a direction intersecting with a conveying direction by the conveying mechanism is omitted; Image processing system. (((2))) the preview display mode includes each of the ends of the document image; 2. The image processing system according to claim 1 , (((3))) In the aspect including each end of the document image, a ratio of an end of the document in the intersecting direction to an area outside the document is displayed as a predetermined value. The image processing system according to (((2))) is characterized in that (((4))) The predetermined value can be changed by setting. The image processing system according to (((3))) is characterized in that (((5))) the preview display mode is a mode in which an additional image for grasping a movement of the document accompanying the transport in the intersecting direction is added; 2. The image processing system according to claim 1 , (((6))) the additional image is a linear image extending in the conveying direction; The image processing system according to (((5))) is characterized in that (((7))) the additional image is an image of a scale indicating an amount of movement in the intersecting direction; The image processing system according to (((5))) is characterized in that (((8))) the scale image includes an image indicating the position of the end when reading of the document being transported is started, and an image indicating the position of the end during reading; 4. The image processing system according to claim 3, wherein: (((9))) The additional image is an image of a numerical value indicating the amount of movement in the intersecting direction. The image processing system according to (((5))) is characterized in that (((10))) The additional image includes an image that alerts a user when the numerical value exceeds a predetermined threshold value. 4. The image processing system according to claim 3, wherein: (((11))) The preview display mode is a mode in which an original image of a portion of the original that is first read is displayed, and an original image accompanying reading in the conveyance direction is displayed. 2. The image processing system according to claim 1, wherein the image processing system comprises: (((12))) the display unit is capable of changing a display range of the document image after reading is completed; 2. The image processing system according to claim 1, wherein the image processing system comprises: (((13))) In the information processing device, In an operation mode in which a preview of an original image read from an original being transported by a transport mechanism is displayed on a display unit, a function of acquiring the document image by the transport mechanism; a function of displaying a preview of the acquired document image in a manner in which an intermediate portion located between each end of the document in a direction intersecting a direction of conveyance by the conveying mechanism is omitted; A program to achieve this.

[0067] According to the invention (((1))), the operational burden on the user with respect to display can be reduced compared to when the entire read image is displayed during reading. According to the invention (((2))), the preview display mode can improve the visibility for the user compared to a case where the preview display mode does not include each end portion. According to the invention (((3))), the aspect including each end can improve visibility for the user compared to a configuration that does not include a configuration that displays the ratio between the end of the document in the intersecting direction and the area outside the document as a predetermined value. According to the invention (((4))), it is possible to improve ease of use for the user, compared to a case where the predetermined value is not configured to be changeable by settings. According to the invention (((5))), the preview display mode can improve visibility for the user compared to a case in which an additional image is added to grasp the movement of the document as it is transported in the intersecting direction. According to the invention (((6))), the additional image is a linear image extending in the transport direction, so that the misalignment of the document can be easily detected compared to a case where the additional image is not a linear image extending in the transport direction. According to the invention of (((7))), the additional image is an image of a scale indicating the amount of movement in the intersecting direction, so that the amount of deviation of the document can be easily grasped compared to a case where the additional image is not provided with the configuration of the scale indicating the amount of movement in the intersecting direction. According to the invention (((8))), the scale image includes an image indicating the position of the end when reading of the document being transported begins, and an image indicating the position of the end during reading, making it easier to grasp the position at the start of reading and the change in position thereafter, compared to a case in which the scale image does not include an image indicating the position of the end during reading. According to the invention (((9))), the amount of movement can be grasped numerically. According to the invention of (((10))), the additional image can improve ease of use for the user compared to a case where the additional image does not include a configuration including an image that alerts the user when a numerical value exceeds a predetermined threshold value. According to the invention (((11))), the preview display mode displays an original image of the part of the original that was first read, and also displays an original image that accompanies reading in the direction of transport, thereby improving visibility for the user compared to a case in which the preview display mode does not include a configuration in which an original image is displayed as the original image is read in the direction of transport. According to the invention (((12))), the display unit can improve ease of use for the user compared to a case where the display unit does not have a configuration that allows the display range of the document image to be changed after reading is completed. According to the invention of (((13))), the operational burden on the user with respect to display can be reduced compared to when the entire read image is displayed during reading. [Explanation of symbols]

[0068] 1...image processing system, 1A...original, 1F, 1H...end, 1G...middle section, 4...original image, 11a...CPU, 26...transport mechanism, 41, 41a, 41b...right end, 42, 42a, 42b...left end, 46...middle image section, 51...right guideline, 61...left guideline, 71...gauge, 72, 73, 74, 75...lines, 132...operation reception section, 401, 402, 403, 404...display section

Claims

1. In an operation mode in which a preview of an original image read from an original being transported by a transport mechanism is displayed on a display unit, a preview display of the document image conveyed by the conveying mechanism in a manner in which an intermediate portion of the document located between each end of the document in a direction intersecting with a conveying direction by the conveying mechanism is omitted; Image processing system.

2. The aspect of the preview display includes each of the ends.

2. The image processing system according to claim 1.

3. In the aspect including each end, a ratio of an end of the document in the intersecting direction to an area outside the document is displayed as a predetermined value.

3. The image processing system according to claim 2.

4. The predetermined value can be changed by setting.

4. The image processing system according to claim 3.

5. the preview display mode is a mode in which an additional image for grasping a movement of the document accompanying the transport in the intersecting direction is added; 2. The image processing system according to claim 1.

6. the additional image is a linear image extending in the conveying direction; 6. The image processing system according to claim 5.

7. the additional image is an image of a scale indicating an amount of movement in the intersecting direction; 6. The image processing system according to claim 5.

8. the scale image includes an image indicating the position of the end when reading of the document being conveyed is started, and an image indicating the position of the end during reading; 8. The image processing system according to claim 7.

9. The additional image is an image of a numerical value indicating the amount of movement in the intersecting direction.

6. The image processing system according to claim 5.

10. The additional image includes an image that alerts a user when the numerical value exceeds a predetermined threshold value.

10. The image processing system according to claim 9.

11. The preview display mode is a mode in which an original image of a portion of the original that is first read is displayed, and an original image accompanying reading in the conveyance direction is displayed.

2. The image processing system according to claim 1.

12. the display unit is capable of changing a display range of the document image after reading is completed; 2. The image processing system according to claim 1.

13. In the information processing device, In an operation mode in which a preview of an original image read from an original being transported by a transport mechanism is displayed on a display unit, a function of acquiring the document image by the transport mechanism; a function of displaying a preview of the acquired document image in a manner in which an intermediate portion located between each end of the document in a direction intersecting a direction of conveyance by the conveying mechanism is omitted; A program to achieve this.

Images