Image processing device, control method thereof, and program

Abstract

To improve the separation of a document while specifying whether a document is handwritten or printed.SOLUTION: An image processing device according to the present invention that can communicate with an information processing device that executes character recognition processing on received image data and registers a character string acquired by the character recognition processing includes generation means that reads the image of a document and generates a plurality of pieces of image data, setting means that sets information indicating whether the image data is image data generated by reading a handwritten document for each of the pieces of image data, and transmission means that transmits the image data generated by the generation means and the information set by the setting means to the information processing device.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to an image processing apparatus, a control method thereof, and a program. [Background technology]

[0002] 2. Description of the Related Art There is a known service in which an image file generated by scanning an original such as a receipt with an image processing device is registered in an external expense processing system (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-124981 A Summary of the Invention [Problem to be solved by the invention]

[0004] Generally, manuscripts such as receipts are divided into those that are partially or completely handwritten and those that are mechanically printed (type). If the manuscript is mechanically printed, it is possible to extract the characters using optical character recognition (OCR). However, the accuracy of OCR is lower for handwritten characters than for printed characters, and there is a high possibility of misrecognition. Therefore, it is necessary to perform separate character recognition processes for handwritten manuscripts and printed manuscripts.

[0005] Furthermore, when registering a handwritten document in an expense processing system, it is also possible for an operator to visually check character strings and then register the character strings, rather than performing OCR.

[0006] For example, if you set whether the document is handwritten or printed for each scan, when you register image data generated by reading multiple documents that contain a mixture of handwritten and printed documents in an expense processing system, you will need to perform multiple scans, which makes it difficult to put the documents down.

[0007] In view of the above problems, the present invention has an object to facilitate easy release of documents while allowing the user to specify whether the document is handwritten or printed. [Means for solving the problem]

[0008] The image processing device of the present invention is an image processing device capable of communicating with an information processing device that executes character recognition processing on received image data and registers a character string obtained by the character recognition processing, and includes a generating means for reading images of a plurality of documents and generating a plurality of image data, and a generating means for generating image data from the plurality of image data by reading a handwritten document, the image data being generated by reading a handwritten document, and information indicating that the image data is image data generated by reading a handwritten document. Based on the user's instruction and the judgment by the image processing device A setting means for setting; a transmission means for transmitting the image data generated by the generation means and the information set by the setting means to the information processing device, wherein the character recognition process is performed on first image data, which is not set with information indicating that the image data is generated by reading the handwritten document, among the transmitted image data, and the information indicating that the image data is generated by reading the handwritten document is not set among the transmitted image data. The transmitted information The method is characterized in that a process of visually checking the second image data in which the above is set is executed. Effect of the Invention

[0009] According to the present invention, it is possible to easily release the document while specifying whether it is a handwritten document or a printed document. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 illustrates a hardware configuration of an image processing apparatus. [Diagram 2] FIG. 1 is a diagram showing a software module configuration of an image processing apparatus. [Diagram 3] A diagram showing the overall configuration of the linked system [Figure 4] Flowchart of embodiment 1 for registering expenses of evidence by a linked system [Diagram 5]Screen before scanning document with image processing device [Figure 6] Screen of document scanning by image processing device [Figure 7] Setting confirmation screen before registering evidence on image processing device [Figure 8] Screen showing evidence registration on image processing device [Figure 9] Result confirmation screen after document registration on image processing device [Figure 10] Flowchart of embodiment 2 for registering expenses of evidence by a linked system DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments of the present invention will be described in detail with reference to the drawings. Note that the following embodiments do not limit the invention according to the claims, and all of the combinations of features described in the embodiments are not necessarily essential to the solution of the invention.

[0012] <First embodiment> A first embodiment of the present invention will be described.

[0013] FIG. 1 is a block diagram showing a hardware configuration of an image processing device. In this embodiment, as shown in FIG. 1, the image processing device 1 is realized as a so-called MFP (multi-function peripheral device) in which multiple functions, such as a scanning function and a printing function, are integrated. The image processing device 1 includes a controller unit 100 that controls the entire device, an operation unit 106, a scanner 112, and a printer 114. The operation unit 106 includes a numeric keypad and various hard keys for receiving input of instructions such as job execution from a user, and also includes a display panel that displays device information, job progress information, etc., or a setting screen of functions that the image processing device 1 can execute to the user. The scanner 112 is an image input device that optically reads an image on a set document. The printer 114 is an image output device that prints an image on a recording medium such as printing paper based on image data.

[0014] The operation unit 106 is connected to an operation unit interface (I / F) 105 included in the controller unit 100. The scanner 112 and the printer 114 are respectively connected to a scanner processing unit 111 and a printer processing unit 113 included in the controller unit 100. With this configuration, the operation unit 106, the scanner 112, and the printer 114 each operate under the control of the controller unit 100.

[0015] If necessary, an external storage device 116 such as a USB memory medium can be connected to the image processing device 1. At this time, the external storage device 116 is connected via an external storage I / F 115, and operates under the control of the controller unit 100.

[0016] The controller unit 100 includes a CPU 101 that controls each block of the controller unit 100. The CPU 101 is connected to a RAM 102, a ROM 103, a hardware disk drive (HDD) 104, an operation unit I / F 105, and a network I / F 107 via a system bus 117. The CPU 101 is also connected to a fax I / F 109, an image processing unit 109, a device I / F 110, and an external storage I / F 115. The RAM 102 is a general-purpose RAM and is a memory for providing a working area for the CPU 101. The RAM 102 is also used as a memory for temporarily storing parameters, setting values, etc., and as an image memory for storing image data in predetermined units such as pages. The ROM 103 is a general-purpose ROM, and stores a system boot program as a boot ROM, for example. The HDD 104 stores system software programs, history data, tables, etc. The functions of the image processing device 1 are realized, for example, by the CPU 101 reading out a program stored in the ROM 103 into the RAM 102 and executing it.

[0017] The operation unit I / F 105 is an interface for inputting and outputting information to and from the operation unit 106. In response to an instruction from the CPU 101, the operation unit I / F 105 outputs display data to the operation unit 106, and also transmits information input by the user on the operation unit 106 to the CPU 101.

[0018] The network I / F 107 is connected to a LAN 108 of a wired or wireless medium, and enables input and output of information between the image processing device 1 and devices on the LAN 108. The network I / F 107 has a configuration compatible with the LAN 108, and may have a configuration compatible with near field communication with a wireless distance of about several tens of centimeters, for example. In that case, mutual communication is performed with a portable wireless terminal.

[0019] The image processing unit 109 executes general-purpose image processing. For example, it executes processes such as enlargement / reduction, rotation, and conversion on image data acquired from the outside via the LAN 108. The image processing unit 109 also executes a process of expanding the PDL code received via the LAN 108 into a bitmap image. The image processing unit 109 also executes a process of converting the image data compressed and encoded and stored in the RAM 102 into a format processable by the printer processing unit 113 when outputting the image data to the printer 114 via the printer processing unit 113.

[0020] The device I / F 110 is connected to the scanner 112 and printer 114 via the scanner processing unit 111 and printer processing unit 113, and performs synchronous / asynchronous conversion of image data and transmits setting values, adjustment values, etc. The device I / F 110 also transmits status information of the scanner 112 and printer 114 to the CPU 101. The status information includes, for example, error information such as a jam that has occurred in the scanner 112 or printer 114.

[0021] The scanner processing unit 111 performs various processes corresponding to the scanning function, such as correction, processing, image area separation, magnification, binarization, etc., on the read data read and input by the scanner 112. The scanner 112 includes an automatic continuous document feeder and a pressure plate reader (not shown), and can read a document placed on a document glass table and read both sides of multiple documents. The scanner 112 is also provided with sensors that detect the opening and closing of a feeder cover (not shown), the opening and closing of a document cover (not shown), the presence or absence of a document, the document size, etc. Detection signals of these sensors and status information of the scanner 112 are transmitted to the CPU 101 via the scanner processing unit 111 and the device I / F 110, and the CPU 101 recognizes the status of the scanner 112, such as the occurrence of an error and the cancellation of the error.

[0022] The printer processing unit 113 performs processing corresponding to the print function, such as output correction, resolution conversion, and adjustment of the print position of the image corresponding to the output characteristics of the printer 114, on the image data to be printed. The printer 114 includes one or more paper feed cassettes (not shown) for storing print paper, one or more toner trays (not shown) for storing toner, and a paper feed unit (not shown) capable of sequentially feeding paper one sheet at a time from the paper feed cassette. The printer 114 further includes a marking unit (not shown) for printing toner on the fed paper, and a fixing unit (not shown) for fixing the toner printed by the marking unit by heat and pressure. The printer 114 is provided with sensors that detect the open / closed status of each paper feed cassette, the remaining amount of paper, the open / closed status of the toner tray, the open / closed status of the paper feed unit cover (not shown), the presence or absence of toner, the position of the paper being fed, and the like. Detection signals from the sensors and status information of the printer 114 are sent to the CPU 101 via the printer processing unit 113 and the device I / F 110, and the CPU 101 recognizes the status of the printer 114, such as the occurrence of an error and the release of the error.

[0023] When an external storage device 116 is connected, the external storage I / F 115 reads data stored in the external storage device 116 and writes data to the external storage device 116 in response to an instruction from the CPU 101 .

[0024] Fig. 2 is a diagram showing a software module configuration of the image processing device 1. Each module in Fig. 2 is realized by the CPU 101 executing a program.

[0025] The UI processing unit 201 performs processing related to the operation unit I / F 105 and the operation unit 106. The UI processing unit 201 notifies other modules of operations performed by the user on the operation unit 106 as necessary, and displays a screen on the operation unit 106 in response to instructions from the other modules. The UI processing unit 201 also performs editing of drawing data to be displayed on the operation unit 106.

[0026] The network processor 202 performs communication processing with devices on the LAN 108 via the network I / F 107. When the network processor 202 receives a control command or data from a device on the LAN 108, it notifies the other modules of the information. In addition, the network processor 202 transmits a control command or data to the device on the LAN 108 in response to an instruction from the other module.

[0027] The job control unit 203 controls other modules and centrally controls the execution of each job generated in the image processing apparatus 1, such as copy, print, and fax. When a job is input from the UI processing unit 201 or the network processing unit 202, the job control unit 203 determines the type of job and instructs an input processing unit suitable for the type to execute processing to generate an image for printing. For example, if a copy is input, an execution instruction is issued to the scan input processing unit 206, and if a PDL is input, an execution instruction is issued to the PDL input processing unit 207. Each input processing unit generates an image for each page, stores it in the storage unit 205, and notifies the job control unit 203. Upon receiving the notification, the job control unit 203 instructs the output processing unit 209 to execute processing to print the image on a recording medium. This series of controls is repeated the number of times corresponding to the number of pages of the job to print the image.

[0028] The image processing unit 204 performs processing related to the image processing unit 109. The image processing unit 204 performs image processing by software or image processing by hardware using the image processing unit 109 in response to instructions from each input processing unit and output processing unit 209.

[0029] A storage unit 205 reads data from and writes data to the RAM 102 and the HDD 104. The storage unit 205 stores job settings and image data in response to instructions from other modules.

[0030] The scan input processing unit 206 controls the scanner processing unit 111 and the scanner 112 in response to an instruction from the job control unit 203 to execute a reading process of a document placed on the scanner 112. The scan input processing unit 206 controls the scanner processing unit 111 to execute image processing on the read image data. The scan input processing unit 206 also acquires status information of the scanner processing unit 111 and the scanner 112, and notifies the job control unit 203. Furthermore, when the scan input processing unit 206 receives an interrupt instruction (described later) from the job control unit 203, it can interrupt the reading process of the document and the image generation process.

[0031] The PDL input processor 207 analyzes the PDL data received via the network processor 202 and converts it into a bitmap image for each page in response to an instruction from the job controller 203. The converted bitmap image is stored in a storage area by the storage unit 205. Furthermore, when the PDL input processor 207 receives an interrupt instruction from the job controller 203 (to be described later), it can interrupt the PDL analysis process and the image generation process.

[0032] A fax input processor 208 performs processing for converting data received via the network processor 202 into a binary image for each page in response to an instruction from the job controller 203. The converted binary image is stored in a storage area by the storage unit 205.

[0033] The output processing unit 209 controls the image processing unit 204, printer processing unit 113, and printer 114 according to instructions from the job control unit 203, performs appropriate image processing on image data generated by each input processing unit, and prints the image data on a recording medium. The output processing unit 209 also acquires status information of the printer processing unit 113 and the printer 114, and notifies the job control unit 203. The output processing unit 209 does not perform print processing of other jobs while it is performing print processing of a certain job, but may interrupt processing of the job being printed and start processing of another job only when it receives a priority update notification from the job control unit 203, which will be described later.

[0034] A transmission processing unit 210 controls the image processing unit 204 and the network processing unit 202 in response to an instruction from the job control unit 203 to transmit an image to a device on the LAN 108 .

[0035] 3 shows the overall configuration of the linkage system in this embodiment. The image processing device 1 is connected to an image processing system 301 and an expense processing system 302 via a network 303. The image processing device 1 requests the image processing system 301 to divide image data and determine handwriting, which will be described later. The image processing device 1 also requests the expense processing system 302 to register expenses using images, which will be described later. Here, the expense processing system 302 is composed of a server, which is an information processing device. The image processing device 1 is an image processing device that performs character recognition processing on received image data and is capable of communicating with an information processing device that registers a character string acquired by the character recognition processing.

[0036] When image data obtained by scanning a mechanically printed (type) manuscript is registered, the expense processing system 302 automatically obtains character strings such as the amount by OCR (character recognition processing) and registers them as additional information. Processing of handwritten manuscripts differs depending on the expense processing system. For example, an operator who operates the expense processing system visually checks an image based on the transmitted image data, inputs character strings manually, and registers the input character strings in the expense processing system. In other words, the server of the expense processing system 302 can register the input character strings by performing a process other than character recognition processing on the received image data together with information that the received image data is not image data generated by scanning a handwritten manuscript.

[0037] 4 is a flowchart showing the process of registering expenses on a voucher by the image processing device 1. The process of this flowchart is realized, for example, by the CPU 101 reading a program stored in the HDD 104 into the RAM 102 and executing it.

[0038] In S401, the CPU 101 displays the pre-scan screen D01 of FIG. 5 on the operation unit 106. D02 explains how to place an original on the scanner 112 in order to scan multiple originals (evidence) at once. D03 is a setting button for previewing and checking an image before sending. By selecting this, S407, which will be described later, is executed. D04 is a start button for starting scanning. D05 is a stop button for canceling the registration process. Pressing this button interrupts the ongoing process and transitions to a home screen, not shown.

[0039] In S402, the CPU 101 accepts the user's pressing of the start button D04.

[0040] In S403, the CPU 101 executes scanning. At this time, the operation unit 106 displays a scanning screen E01 in Fig. 6. This screen continues to be displayed until the processing of S404 and S405 described later is completed. E02 is the same cancel button as D05.

[0041] At this time, a plurality of documents (receipts, etc.) placed on a document table (not shown) are scanned at once, and one image data is generated.

[0042] In S404, CPU 101 transmits the image data obtained by scanning to image processing system 301 to divide the image data for each image of the document. If the image data cannot be transmitted due to a communication error or the like, an error screen (not shown) is displayed and the registration process is stopped. In the image processing system, a multi-crop function is executed to divide the image data received from image processing device 1 for each image of the document, and multiple pieces of image data are generated. In addition, for each of the multiple pieces of image data generated, a determination is made as to whether the image data was generated by reading a handwritten document. Here, the division of the image data and the determination as to whether the image data was generated by reading a handwritten document may be executed in image processing device 1.

[0043] In S405, the CPU 101 receives a plurality of image data from the image processing system 301. At this time, information as to whether each image data is handwritten or not is also received. If the data cannot be received due to a communication error or the like, an error screen (not shown) is displayed and the registration process is aborted.

[0044] In S406, if the setting is such that the confirmation screen is to be displayed, the CPU 101 proceeds to S407, whereas if the setting is such that the confirmation screen is not to be displayed, the CPU 101 proceeds to S411.

[0045] In S407, the CPU 101 displays the confirmation screen F01 of FIG. 7 for setting options for confirming an image and registering the image. F02 is an image preview field. F03 and F04 are reduction / enlargement buttons for instructing the image to be reduced or enlarged. F05 is a number display indicating which page of image data is being previewed among a plurality of image data. In FIG. 7, it is indicated that the third page of six pages of image data is being previewed. F06 and F07 are image switching buttons for switching the image to be previewed. F08 is a check box indicating the handwriting setting (handwritten or not) of the image being previewed. In FIG. 7, the check box is unchecked because a non-handwritten image is being previewed. If a handwritten image is being previewed, the check box is checked. The user can also manually check the check box F08 by pressing it. This is useful when the image processing system 301 cannot detect a handwritten manuscript, or when a manuscript that is not handwritten is determined to be handwritten. F09 is a start button for starting the registration of image data to the expense processing system 302. F10 is the same cancel button as D05. In this way, when previewing an image of a manuscript that has been determined to be handwritten by the image processing system, a check box indicating that the image is handwritten can be checked. This allows you to switch between requesting OCR or requesting visual confirmation when registering image data generated by scanning the manuscript in the expense processing system. In this way, information indicating whether the image data is image data generated by scanning a handwritten manuscript can be set for each image data based on the result of the determination of whether the image data is handwritten.

[0046] In S408, the CPU 101 branches the process according to a user operation. If the check box F08 is pressed, the process proceeds to S409. If the image switching button F06 / 07 is pressed, the process proceeds to S410. If the start button F09 is pressed, the process proceeds to S411.

[0047] In S409, the CPU 101 switches the handwriting setting of the image being previewed, and then proceeds to S407 to update the display of the check box F08.

[0048] In S410, the CPU 101 switches the image to be previewed. If F06 is pressed, the image is switched to the previous image, and if F07 is pressed, the image is switched to the next image. Then, the process proceeds to S407 to update the display in the preview field F02.

[0049] In S411, CPU 101 checks whether there is any unregistered image data among the multiple pieces of image data that have been generated. If there is, proceed to S412. If not, proceed to S413. At this time, the transmission screen G01 of FIG. 8 is displayed on the operation unit 106. G02 displays the number of the image data currently being transmitted. When the process of S412, which will be described later, is normally completed, the number increases. G03 is the same cancel button as D05. Note that this screen continues to be displayed until proceeding to S413, which will be described later.

[0050] In S412, the CPU 101 transmits the image data to the expense processing system 302 and requests registration as expense data. At this time, depending on the information of the handwriting setting, switching is performed between registering as a handwritten image or registering as a mechanically printed image (typewritten manuscript). Specifically, the image processing device 1 transmits information indicating whether the image data to be transmitted is image data generated by reading a handwritten manuscript to the server of the expense processing system 302 together with the image data.

[0051] It is also possible to switch between transmitting information requesting OCR and transmitting information requesting visual inspection together with the image data to be registered.

[0052] If the expense processing system 302 has registered the image as a mechanically printed image, it uses OCR to read the amount, etc. If the transmission is successful, the system proceeds to S411 to transmit the remaining image data. If the transmission is unsuccessful, the system stops the transmission process regardless of whether there is remaining image data, and proceeds to S413.

[0053] In S413, the CPU 101 displays the transmission result screen H01 to the expense processing system 302 of Fig. 9. H02 displays the total number of receipt images. H03 displays the number of images that were successfully transmitted to the expense processing system 302. H04 is an end button for ending the registration process. The transmission result screen H01 may also be configured to display a list (not shown) showing the registered contents (date, amount, etc.).

[0054] By following the above procedure, both handwritten documents and mechanically printed documents can be registered in the expense processing system with a single scan from the image processing device.

[0055] <Second embodiment> A second embodiment of the present invention will now be described.

[0056] In the first embodiment, the image processing such as image division and handwriting determination is performed by the image processing system 301, but in the second embodiment, these are performed by the image processing device 1. If the CPU performance and memory resources of the image processing device 1 are sufficient, such a configuration may be adopted.

[0057] In the following description, parts that are not different from the first embodiment will be omitted.

[0058] 10 is a flowchart showing the expense registration of image data performed by the image processing device 1. The process of this flowchart is realized, for example, by the CPU 101 reading a program stored in the HDD 104 into the RAM 102 and executing it.

[0059] In steps S1001 to S1003, the above-mentioned processes in steps S401 to S403 are performed.

[0060] In S1004, the CPU 101 divides the image data generated by scanning into individual images of the original document. If the processing cannot be completed due to memory exhaustion or the like, an error screen (not shown) is displayed and the registration processing is stopped.

[0061] In S1005, the CPU 101 checks whether there is image data for which the handwriting determination has not yet been performed. If there is, the process proceeds to S1006. If there is not, the process proceeds to S1007.

[0062] In S1006, the CPU 101 determines whether the image data is handwritten. If it is determined to be handwritten, the check box for the handwriting setting is checked on the confirmation screen F01 in Fig. 7 described above. If it is determined not to be handwritten, the check box is not checked.

[0063] In steps S1007 to S1015, the above-mentioned processes in steps S406 to S413 are carried out.

[0064] By the above procedure, both handwritten and mechanically printed documents can be registered in the expense processing system from the image processing device with one scan. In addition, because the image processing device performs the division and handwritten determination, the possibility of failure due to communication conditions is reduced compared to the first embodiment.

[0065] <Other embodiments> The present invention can be realized by supplying a program that realizes one or more functions of the above-mentioned embodiments to a system or device via a network or a storage medium. Then, one or more processors in the computer of the system or device can read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0066] 1 Image processing device 301 Image Processing System 302 Expense Processing System

Claims

1. An image processing device capable of communicating with an information processing device that executes character recognition processing on received image data and registers a character string obtained by the character recognition processing, A generating means for reading images of a plurality of documents and generating a plurality of image data; a setting means for setting information indicating that the image data is image data generated by reading a handwritten document, among the plurality of image data, based on an instruction from a user and a determination by the image processing device; a transmission means for transmitting the image data generated by the generation means and the information set by the setting means to the information processing device, the character recognition process is performed on a first image data set that does not include information indicating that the image data set is generated by reading the handwritten document, among the transmitted image data sets; An image processing device characterized in that, among the transmitted image data, information indicating that the image data is image data generated by reading the handwritten manuscript is executed, and a process is executed to visually confirm the second image data in which the transmitted information is set.

2. Further comprising a manuscript table; 2 . The image processing apparatus according to claim 1 , wherein the generating means reads the plurality of documents placed on the document table to generate one image data, and divides the one image data to generate the plurality of image data.

3. 3. The image processing apparatus according to claim 2, wherein the generating means generates the plurality of image data by dividing the image data for each image of the document placed on the document table.

4. a determination means for determining whether the image data generated by the generation means is image data generated by reading a handwritten document; An image processing device as claimed in any one of claims 1 to 3, characterized in that, based on the judgment result of the judgment means, information indicating that the image data is image data generated by reading a handwritten manuscript is set in the image data generated by reading the handwritten manuscript.

5. a receiving means for receiving an instruction from a user to set that the image data generated by reading the handwritten document is image data generated by reading the handwritten document; The image processing device according to any one of claims 1 to 3, characterized in that, based on an instruction accepted by the accepting means, the setting means sets information to the image data generated by reading the handwritten manuscript, indicating that the image data is image data generated by reading a handwritten manuscript.

6. a display means for displaying an image based on the image data generated by the generation means; 6. The image processing apparatus according to claim 5, wherein the accepting means accepts the instruction while the image is being displayed.

7. A method for controlling an image processing device capable of communicating with an information processing device that executes character recognition processing on received image data and registers a character string obtained by the character recognition processing, comprising: A generating step of reading a plurality of document images and generating a plurality of image data; a setting step of setting information indicating that the image data is image data generated by reading a handwritten document, among the plurality of image data, based on an instruction from a user and a determination by the image processing device; a transmission step of transmitting the image data generated in the generation step and the information set in the setting step to the information processing device, the character recognition process is performed on a first image data set that does not include information indicating that the image data set is generated by reading the handwritten document, among the transmitted image data sets; An image processing device characterized in that, among the transmitted image data, information indicating that the image data is image data generated by reading the handwritten manuscript is executed, and a process is executed to visually confirm the second image data in which the transmitted information is set.

8. 7. A program for causing a computer to execute each of the means of the image processing apparatus according to claim 1.

Images