Information processing apparatus, information processing system, control method, program

Abstract

To provide a mechanism that can determine whether a captured image is clear or not, depending on the characteristics of the image.SOLUTION: An information processing device according to the present invention acquires an image of a target, and includes determining means that determines a criterion for determining whether the image is clear on the basis of the type of an object, and notification means that notifies whether the image is clear on the basis of the determination result of whether the image is clear for each divided small region and the criterion.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a technique for acquiring and processing images.

Background Art

[0002] Although the application procedures for products and services have been digitized and can be applied via a network, there are still documents that need to be attached for the application. To address this, the applicant user (applicant or salesperson) utilizes the camera function of a mobile terminal or smartphone to take pictures of the documents, transmits (uploads) the document images to the server of the application recipient via the network, and the server uses OCR (Optical Character Recognition) to recognize the necessary items from the document images and register them as digital data.

[0003] However, the images taken by the applicant user, who is a general user, are often unclear. In such cases, the necessary items cannot be recognized on the server side, and it is necessary to request the applicant user to retake the picture and resend it. Such back-and-forth work is a hassle and burden for both the applicant user and the application recipient. Here, if it is possible to know whether retaking is necessary before uploading the taken image to the server, it is possible to eliminate back-and-forth and improve efficiency.

[0004] Patent Document 1 discloses a mechanism for detecting the outer shape of a form included in a form image obtained by photographing a form and notifying the user whether retaking is necessary based on whether the detected outer shape of the form is complete.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, in Patent Document 1, only the determination of whether the outer shape detected from the form image is complete is made, and the determination of whether the form image is clear is not mentioned.

[0007] In addition, the characteristics (such as complexity) of the images taken vary depending on the composition, content, etc. of the form. Therefore, the criteria for determining whether the captured image is clear differ depending on the type of the form and the characteristics of the image.

[0008] Furthermore, even within one form image, the determination of whether it is clear may differ for each partial region due to differences in light and dark, etc. Also, areas of white background or solid color areas do not have boundaries (edges) for which clarity determination is possible, so the determination itself cannot be made, and the proportion of the entire image for which clarity determination can be made differs depending on the type of form, etc.

[0009] Therefore, an object of the present invention is to provide a mechanism capable of determining whether a captured image is clear according to the captured image.

Means for Solving the Problems

[0010] The present invention is Document an information processing apparatus that acquires an image of Document and based on the type of Of the said document determines a criterion for determining whether the image is clear, and based on the determination result of whether each small region obtained by dividing the image is clear and the criterion, notifies whether the image is clear. Of the document It is characterized by comprising a determination means and a notification means. Determined Based on the Of the document image and the criterion,

Effects of the Invention

[0011] According to the present invention, a mechanism capable of determining whether a captured image is clear can be provided according to the captured image.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Mode for Carrying Out the Invention

[0013] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0014] As shown in FIG. 1, the information processing system 100 of the present embodiment has a configuration in which the information processing apparatus 101 and the server 102 are communicably connected by a network 103.

[0015] The information processing apparatus 101 captures an image of a form (hereinafter referred to as a captured image) using a camera or the like, and performs sharpness determination. The information processing apparatus 101 acquires a threshold setting table 800 from the server 102 in order to determine a threshold value necessary for sharpness determination of the captured image.

[0016] In this embodiment, the information processing apparatus 101 acquires the threshold setting table 800 managed by the server 102 and performs sharpness determination on the captured image. However, the present invention is not limited to this form. The information processing apparatus 101 may manage the threshold setting table 800, or the information processing apparatus 101 may provide necessary data to the server 102 so that the server 102 performs sharpness determination on the captured image.

[0017] The information processing apparatus 101 is a portable terminal such as a mobile phone, a smartphone, a tablet terminal, a notebook PC, and a PDA terminal, on which a browser or a dedicated application is installed, and can communicate with the server 102 via the network 103 by wireless communication.

[0018] Hereinafter, with reference to FIG. 2, an example of a hardware configuration applicable to the information processing apparatus 101 and the server 102 shown in FIG. 1 will be described.

[0019] In FIG. 2, reference numeral 201 denotes a CPU, which comprehensively controls each device and controller connected to the system bus 204. Further, in the ROM 203 or the external memory 212, a BIOS (Basic Input / Output System) which is a control program of the CPU 201, an operating system program (hereinafter referred to as an OS), and various programs necessary for realizing functions executed by each server or each PC are stored.

[0020] Reference numeral 202 denotes a RAM, which functions as a main memory, a work area, etc. of the CPU 201. The CPU 201 loads programs and the like necessary for execution of processing from the ROM 203 or the external memory 212 into the RAM 202, and realizes various operations by executing the loaded programs.

[0021] Also, 205 is an input controller that controls the input from the touch sensor 210. 206 is a video controller that controls the display on a display device such as the display 211. In FIG. 2, it is described as the display 211, but the display device may be other than a CRT, such as a liquid crystal display. These are used by the user of the information processing apparatus 101 as needed.

[0022] 207 is a memory controller that controls access to an external storage device (hard disk (HD)) that stores a boot program, various applications, font data, user files, edited files, various data, etc., a flexible disk (FD), or an external memory 212 such as a CompactFlash (registered trademark) memory connected via an adapter to a PCMCIA card slot.

[0023] 208 is a communication I / F controller that connects and communicates with an external device via the network 103 and executes communication control processing on the network. For example, communication using TCP / IP is possible.

[0024] Note that the CPU 201 enables display on the display 211 by executing an outline font expansion (rasterization) process in, for example, the display information area in the RAM 202. Also, the CPU 201 enables reception of a user's touch operation instruction at the touch sensor 210 on the display 211.

[0025] Various programs and various tables described later for realizing the present invention are recorded in the external memory 212, loaded into the RAM 202 as needed, and executed by the CPU 201.

[0026] 209 is an imaging image input controller that controls the input from the camera 215 via the imaging image input processing unit 214. It is possible to recognize and capture the imaging image input from the camera 215.

[0027] Figure 3 is a flowchart showing an example of the overall processing in the information processing system 100.

[0028] The overall processing in FIG. 3 will be described.

[0029] In step S101, the information processing device 101 captures an image of a form and captures the captured image. Here, the user logs in to the server 102 in advance via a browser or a dedicated application, displays a shooting screen (not shown), and allows the user to capture the form. At that time, the user may be allowed to select the size of the form and the type of the form (target type).

[0030] In step S102, the information processing device 101 performs image adjustment and correction of the captured image. Specifically, in order to improve the efficiency of subsequent image processing, the color-captured image is converted to grayscale, and trapezoidal correction or the like is performed on the distortion. In step S103, the information processing device 101 acquires the threshold setting table 800 transmitted in step S104 from the server 102.

[0031] In step S105, the information processing device 101 executes a threshold determination process to determine a threshold. The threshold determination process will be described in detail with reference to FIG. 4.

[0032] Figure 4 is a flowchart showing an example of the threshold determination process.

[0033] In step S201, the information processing device 101 determines whether the target type of the captured image can be specified. For example, it is determined that it can be specified when the user accepts the selection of the form type from a shooting screen (not shown) before and after shooting, or when the identification information indicating the form type is included in a barcode or the like included in the captured image. Also, the form type may be acquired from another information processing system, or the form type may be determined for each function executed by the user. If it can be specified, the process proceeds to step S202; if it cannot be specified, the process proceeds to step S205.

[0034] In step S202, the information processing apparatus 101 identifies the target type of the captured image. For example, when receiving a selection of the form type from the user, the selected form type is identified; when the identification information indicating the form type is included in a barcode or the like included in the captured image, the form type indicated by the identification information is identified as the target type of the captured image.

[0035] In step S203, the information processing apparatus 101 collates the identified target type with the conditions in the threshold setting table 800. Specifically, it collates whether the identified target type exists in the target type 801 of the threshold setting table 800. If it does not exist, the process proceeds from step S205 in the same manner as when the target type cannot be identified. The threshold setting table 800 will be described later.

[0036] In step S204, the information processing apparatus 101 determines the threshold 806 of the record collated in the threshold setting table 800 as the threshold and ends this processing flow.

[0037] In step S205, the information processing apparatus 101 performs image analysis of the captured image and acquires the feature amount of the image in step S206.

[0038] Here, a specific example of image analysis will be described with reference to FIG. 9.

[0039] The form image 900 is an image diagram showing an example of the photographed image targeted this time. The form image 900 includes various regions such as a single-line text region 901, a multi-line text region 902, a table region 903, a text region surrounded by ruled lines 904, and a graphic region 905. In the image analysis of this embodiment, using block selection (for block selection, refer to Japanese Patent Application Laid-Open No. 2006-195887, etc.), each region is extracted as a block group, and further, for the text region, blocks for each line (911, 912, 914) and for the table region, even the blocks of cells are decomposed and extracted (913). For blocks containing characters, the number of characters is obtained, and for the table region and the text region surrounded by ruled lines, the number of ruled lines is obtained. Further, the pixel ratio of the entire image (the ratio of non-white pixels) is also obtained.

[0040] Note that the above method of image analysis is an example, and various information (feature amounts) indicating the characteristics of the photographed image may be obtained using known techniques or the like.

[0041] Return to the description of FIG. 4.

[0042] In step S207, the information processing apparatus 101 collates the feature amounts acquired in step S206 with the conditions in the threshold setting table 800. Specifically, it collates whether the acquired feature amounts such as the number of blocks, the number of characters, the pixel ratio, and the number of ruled lines match each item (802 to 805) in the condition part of the threshold setting table 800.

[0043] In step S208, the information processing apparatus 101 determines the threshold 806 of the record collated in the threshold setting table 800 as the threshold, and ends this processing flow.

[0044] Note that in this embodiment, the threshold is determined by collating with the threshold setting table having condition items and determination items, but a function having each feature amount as a variable may be defined, and the threshold may be determined by the function. Also, a table may be used to determine the weighting coefficients for each feature amount in the function.

[0045] This concludes the description of the threshold setting process of FIG. 4. Here, with reference to FIG. 8, the threshold setting table will be described.

[0046] The threshold setting table 800 is a table for determining a threshold value on the condition of the target type or the feature amount obtained by image analysis. In this embodiment, as the condition items related to the target type, there are a target type 801, and as the condition items related to the feature amount, there are a block number 802, a character number 803, a pixel ratio 804, and a ruled line number 805. Each item is set with a value or a range, and when it is free as a condition, "*" is set. In this embodiment, the condition items related to the target type and the condition items related to the feature amount are set separately, but records of conditions combining both may also be set. Further, it has a threshold value 806 as a determination item, and this value shall indicate the number (absolute value) or ratio (relative value) of small regions described later. Also, in order to cope with the case where it does not conform to any condition, a default record in which all condition items are set to "*" may be set.

[0047] Note that in this embodiment, the above condition items are incorporated as feature amounts (feature information) that affect the sharpness determination of the photographed image, but it is not limited to this, and an index indicating the feature (especially complexity) of the photographed image and affecting the sharpness determination of the photographed image may be adopted.

[0048] Return to the description of FIG. 3.

[0049] In step S106, the information processing apparatus 101 divides the photographed image into small regions.

[0050] Here, with reference to FIGS. 10 and 11, the division of the photographed image into small regions will be described.

[0051] In this embodiment, two types of division methods are assumed. FIG. 10 shows a method of dividing with a fixed number of divisions, and FIG. 11 shows a method of dividing with a fixed division size.

[0052] In the method of dividing with a fixed number of divisions in FIG. 10, regardless of the size of the captured image, the vertical and horizontal dimensions of the captured image are equally divided by a fixed number and divided into small regions. Since the number of small regions generated by the division remains the same even when the size of the captured image changes, a threshold value indicating a number can be used. Also, a threshold value indicating a ratio can be used.

[0053] In the method of dividing with a fixed division size in FIG. 11, the number of divisions in the vertical and horizontal directions of the captured image differs depending on the size of the captured image. Since the number of small regions generated by the division differs depending on the size of the captured image, a threshold value indicating a number cannot be used, and a threshold value indicating a ratio will be used.

[0054] Return to the explanation of FIG. 3.

[0055] In steps S107 to S109, the information processing apparatus 101 repeats the process for each of the small regions into which the process is divided.

[0056] In step S108, the information processing apparatus 101 performs a sharpness determination on the small region to be processed. In this process, it is determined whether the small region to be processed is sharp or unsharp using known techniques such as spectral analysis of the image and automatic determination by machine learning. By performing the sharpness determination on the divided small regions, even if there are differences in brightness, etc. within one captured image, the determination can be made according to the determination criteria for each small region, so that the sharpness determination can be carried out more appropriately and efficiently.

[0057] In step S110, the information processing apparatus 101 executes an image sharpness determination process. The image sharpness determination process will be described in detail with reference to FIG. 5.

[0058] FIG. 5 is a flowchart showing an example of the image sharpness determination process.

[0059] In step S301, the information processing apparatus 101 aggregates the clarity / non-clarity determination results for each small area. Specifically, it aggregates the number of small areas determined to be clear and the number of small areas determined to be non-clear, and further divides the number of small areas determined to be clear by the total number of small areas to obtain the ratio of the small areas determined to be clear.

[0060] In step S302, the information processing apparatus 101 determines whether the aggregated result is equal to or greater than the threshold value set in step S105. That is, when the set threshold value is a threshold value indicating a number, it determines whether the number of small areas determined to be clear is equal to or greater than that, and when the threshold value is a threshold value indicating a ratio, it determines whether the ratio of the small areas determined to be clear is equal to or greater than that. If it is determined that the value is equal to or greater than the threshold value, it proceeds to step S303, and if it is determined otherwise (less than the threshold value), it proceeds to step S308.

[0061] In step S303, the information processing apparatus 101 displays a determination result OK screen 1200 shown as an example in FIG. 12. The determination result OK screen 1200 discriminatively displays the clarity / non-clarity determination results for each small area on the captured image image as a determination result preview (1201), and textually displays the clarity / non-clarity determination results together with the basis therefor (1202). Also, it accepts instructions from the user via an image transmission button 1203 and a re-capture button 1204.

[0062] In step S304, the information processing apparatus 101 determines whether it has received an image transmission instruction via the image transmission button 1203. If it has received the instruction, it proceeds to step S305, and if not (if it has received a re-capture instruction), it proceeds to step S306.

[0063] In step S305, the information processing apparatus 101 determines that the clarity determination based on the threshold value and the user's judgment are in agreement, and ends this processing flow with the subsequent processing being "image transmission".

[0064] In step S306, since the sharpness determination based on the threshold value does not match the user's judgment, the information processing apparatus 101 sends a request to update the threshold setting table 800 to the server 102. Specifically, it requests more strictly, that is, to increase the threshold value to be greater than or equal to the current aggregation result. Upon receiving the update request, in step S313, the server 102 updates the threshold setting table 800.

[0065] In step S307, the information processing apparatus 101 ends this processing flow with the subsequent process being "reshooting".

[0066] In step S308, the information processing apparatus 101 displays a determination result NG screen 1300 shown as an example in FIG. 13. The determination result NG screen 1300 discriminately displays the sharpness / non-sharpness determination results for each small area on the captured image image as a determination result preview (1301), and text-displays the sharpness / non-sharpness determination results together with the basis therefor (1302). Further, it receives an instruction from the user via a reshooting button 1303 and an image transmission button 1304.

[0067] In step S309, the information processing apparatus 101 determines whether a reshooting instruction has been received via the reshooting button 1303. If received, it proceeds to step S310; otherwise (if an image transmission instruction has been received), it proceeds to step S311.

[0068] In step S310, the information processing apparatus 101 determines that the non-sharpness determination based on the threshold value matches the user's judgment, and ends this processing flow with the subsequent process being "reshooting".

[0069] In step S311, since the non-sharpness determination based on the threshold value does not match the user's judgment, the information processing apparatus 101 sends a request to update the threshold setting table 800 to the server 102. Specifically, it requests more leniently, that is, to decrease the threshold value to be less than or equal to the current aggregation result. Upon receiving the update request, in step S313, the server 102 updates the threshold setting table 800.

[0070] In step S312, the information processing apparatus 101 ends this processing flow with the subsequent processing being "image transmission".

[0071] This concludes the description of the image sharpness determination process in FIG. 5.

[0072] Return to the description of FIG. 3.

[0073] In step S112, the information processing apparatus 101 determines whether the subsequent processing is "re - shooting". If so, it returns to step S101; otherwise (if it is "image transmission"), it proceeds to step S113.

[0074] In step S113, the information processing apparatus 101 transmits the captured image to the server 102.

[0075] In step S114, the server 102 receives the captured image.

[0076] In step S115, the server 102 executes OCR processing on the captured image, recognizes and obtains the acquired items from the captured image. Regarding the acquired items, the positions in the form image and keyword marks, etc. are preset in advance and obtained according to a predetermined processing procedure.

[0077] In step S116, the server 102 executes OCR result reflection processing. The OCR result reflection processing will be described in detail with reference to FIG. 6.

[0078] FIG. 6 is a flowchart showing an example of the OCR result reflection processing.

[0079] In step S401, the server 102 determines whether the OCR result is OK. Specifically, if all the essential items among the acquired items are recognized and obtained, it is determined as OK; if even one of the essential items is not recognized or obtained, it is determined as NG. The essential items are preset as a classification in the acquired items. If it is OK, it proceeds to step S402; if it is NG, it proceeds to step S403.

[0080] In step S402, the server 102 determines that the determination of image transmission by the information processing device 101 is correct, sets the OCR result to OK, and ends this processing flow.

[0081] In step S403, the server 102 determines that the determination of image transmission by the information processing device 101 is incorrect, and updates the threshold setting table 800. Specifically, it updates it to be stricter, that is, increases the threshold to be greater than or equal to the current aggregation result by the information processing device 101. In step S311, if it is determined by the user as "image transmission" and the threshold is temporarily relaxed, but if the OCR result is NG, the threshold will be set back to the stricter one.

[0082] In step S404, the server 102 sets the OCR result to NG and ends this processing flow.

[0083] Thus, the description of the OCR result reflection process in FIG. 6 is completed.

[0084] Return to the description of FIG. 3.

[0085] In step S117, the server 102 transmits the OCR result set in step S116 to the information processing device 101.

[0086] In step S118, the information processing device 101 receives the OCR result.

[0087] In step S119, the information processing device 101 executes an OCR result confirmation process. The OCR result confirmation process will be described in detail with reference to FIG. 7.

[0088] FIG. 7 is a flowchart showing an example of the OCR result confirmation process.

[0089] In step S501, the information processing device 101 determines whether the OCR result is OK. If it is OK, it proceeds to step S502; if it is NG, it proceeds to step S506.

[0090] In step S502, the information processing apparatus 101 displays an OCR result OK screen 1400 shown as an example in FIG. 14. The OCR result OK screen 1400 displays a transmission image as a transmission image preview (1401) and displays the OCR result in text along with its basis (1402). Further, a separate image capture button 1403 and an end button 1404 are provided to receive an instruction from the user.

[0091] In step S503, the information processing apparatus 101 determines whether a separate image capture instruction has been received by the separate image capture button 1403. If it has been received, in step S504, the subsequent process is set to "separate image capture", and if not (if an end instruction has been received), in step S505, the subsequent process is set to "end" to end this processing flow.

[0092] In step S506, the information processing apparatus 101 displays an OCR result NG screen 1500 shown as an example in FIG. 15. The OCR result NG screen 1500 displays a transmission image as a transmission image preview (1501) and displays the OCR result in text along with its basis (1502). Further, a reshooting button 1503 and an end button 1504 are provided to receive an instruction from the user.

[0093] In step S507, the information processing apparatus 101 determines whether a reshooting instruction has been received by the reshooting button 1503. If it has been received, in step S508, the subsequent process is set to "reshooting", and if not (if an end instruction has been received), in step S509, the subsequent process is set to "end" to end this processing flow.

[0094] This concludes the description of the OCR result confirmation process of FIG. 7.

[0095] Return to the description of FIG. 3.

[0096] In step S120, the information processing apparatus 101 determines whether the subsequent process is "taking a separate image" or "re-taking an image". If so, it returns to step S101. If not, it ends this processing flow.

[0097] This concludes the description of the entire process in Figure 3.

[0098] As described above, according to the characteristics of the captured image, even when there are differences such as brightness and darkness in the image, it becomes possible to appropriately determine whether the image is clear.

[0099] Although several embodiments have been shown above, the present invention can be implemented, for example, as an embodiment of a system, apparatus, method, computer program, or recording medium. Specifically, it may be applied to a system composed of multiple devices, or it may also be applied to an apparatus consisting of a single device.

[0100] Also, the computer program in the present invention is a computer program that can be executed by a computer for the processing methods of each flowchart, and the storage medium of the present invention stores a computer program that can be executed by a computer for the processing methods of each flowchart. Note that the computer program in the present invention may be a computer program for each processing method of each device in each flowchart.

[0101] As described above, it goes without saying that the object of the present invention can also be achieved by supplying a recording medium recording a program that realizes the functions of the above-described embodiments to a system or apparatus, and having a computer (or CPU or MPU) of the system or apparatus read and execute the program stored in the recording medium.

[0102] In this case, the program itself read from the recording medium realizes the novel functions of the present invention, and the recording medium storing the program constitutes the present invention.

[0103] As a recording medium for supplying a program, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a DVD-ROM, a magnetic tape, a non-volatile memory card, a ROM, an EPROM, a silicon disk, etc. can be used.

[0104] In addition, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also based on the instructions of the program, an OS (operating system) or the like running on the computer performs part or all of the actual processing, and it goes without saying that the case where the functions of the above-described embodiments are realized by that processing is also included.

[0105] Furthermore, after the program read from the recording medium is written into the memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instructions of the program code, a CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing, and it goes without saying that the case where the functions of the above-described embodiments are realized by that processing is also included.

[0106] In addition, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. Needless to say, the present invention is also applicable when it is achieved by supplying a program to a system or an apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or the apparatus, the system or the apparatus can enjoy the effects of the present invention.

[0107] The form of the above program may be in the form of object code, program code executed by an interpreter, script data supplied to an OS (operating system), etc.

[0108] Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network by means of a communication program, the system or apparatus can enjoy the effects of the present invention. It should be noted that all configurations combining the above-described respective embodiments and their modifications are also included in the present invention.

Explanation of Signs

[0109] 100 Information processing system 101 Information processing apparatus 102 Server 103 Network

Claims

1. An information processing apparatus for acquiring an image of a document, comprising: determination means for determining a criterion for determining whether the image is clear based on the type of the document; notification means for notifying whether the image is clear based on the determination result of whether each small area into which the image of the document is divided is clear and the criterion; wherein the notification means notifies the determination result of whether each small area in the image of the document is clear by superimposing and displaying information that discriminately indicates a small area determined to be clear and a small area determined to be unclear in the image of the document on the image of the document.

2. An information processing apparatus for acquiring an image of a document, comprising: determination means for determining a criterion for determining whether the image of the document is clear based on a feature amount obtained from the image of the document; notification means for notifying whether the image is clear based on the determination result of whether each small area into which the image of the document is divided is clear and the criterion; wherein the notification means notifies the determination result of whether each small area in the image of the document is clear by superimposing and displaying information that discriminately indicates a small area determined to be clear and a small area determined to be unclear in the image of the document on the image of the document.

3. receiving means for receiving an instruction regarding the notification content by the notification means; update control means for controlling to update the determined criterion based on the notification content by the notification means and the instruction content received by the receiving means; The information processing apparatus according to claim 1 or 2, characterized by comprising the above.

4. The information processing apparatus according to claim 3, wherein the update control means controls to update the determined criterion when the notification content by the notification means indicates that the image is clear and the instruction content received by the receiving means indicates that the image is unclear.

5. The information processing apparatus according to claim 3 or 4, wherein the update control means controls to update the determined criterion to be more stringent when the notification content by the notification means indicates that the image is clear and the instruction content received by the receiving means indicates that the image is unclear.

6. The criterion is a criterion based on a value indicating the clarity of the image. The update control means controls to update the determined criterion so as to be equal to or higher than the sharpness of the image when the content of the notification by the notification means is that the image is sharp and the content of the instruction received by the reception means is that the image is unclear. The information processing apparatus according to any one of claims 3 to 5.

7. The update control means controls to update the determined criterion when the content of the notification by the notification means is that the image is unclear and the content of the instruction received by the reception means is that the image is sharp. The information processing apparatus according to any one of claims 3 to 6.

8. The update control means controls to update the determined criterion so as to be more relaxed when the content of the notification by the notification means is that the image is unclear and the content of the instruction received by the reception means is that the image is sharp. The information processing apparatus according to any one of claims 3 to 7.

9. The criterion is a criterion based on a value indicating the sharpness of the image, The update control means controls to update the determined criterion so as to be equal to or lower than the sharpness of the image when the content of the notification by the notification means is that the image is unclear and the content of the instruction received by the reception means is that the image is sharp. The information processing apparatus according to any one of claims 3 to 8.

10. An OCR means for performing character recognition processing on the image is provided, The update control means controls to return the updated criterion to before the update when the content of the notification by the notification means is that the image is unclear, the content of the instruction received by the reception means is that the image is sharp, and the result of the character recognition processing by the OCR means indicates failure. The information processing apparatus according to any one of claims 7 to 9.

11. The information processing apparatus according to any one of claims 3 to 10, wherein the update control means controls not to update the reference when the content notified by the notification means indicates that the image is clear and the content of the instruction received by the reception means indicates that the image is clear, and when the content notified by the notification means indicates that the image is unclear and the content of the instruction received by the reception means indicates that the image is unclear.

12. The information processing apparatus according to any one of claims 1 to 11, wherein the reference is a conditional value related to the number or ratio of small regions determined to be clear.

13. The information processing apparatus according to any one of claims 1 to 12, wherein the image of the document is divided into small regions with a fixed number or fixed size.

14. An information processing apparatus for acquiring an image of a document, a determination means for determining a reference for determining whether the image of the document is clear based on the type of the document, a notification means for notifying whether the image of the document is clear based on the determination result of whether each small region obtained by dividing the image of the document is clear and the determined reference, a reception means for receiving an instruction for the content notified by the notification means, an update control means for controlling to update the determined reference based on the content notified by the notification means and the content of the instruction received by the reception means, an OCR means for performing character recognition processing on the image, comprising: The information processing apparatus is characterized in that when the content notified by the notification means indicates that the image is unclear, and when the content of the instruction received by the reception means indicates that the image is clear and the character recognition processing by the OCR means shows a failure result, the update control means controls to return the updated reference to before the update.

15. An information processing apparatus for acquiring an image of a document, a determination means for determining a reference for determining whether the image of the document is clear based on the feature amount obtained from the image of the document, a notification means for notifying whether the image of the document is clear based on the determination result of whether each small region obtained by dividing the image of the document is clear and the determined reference, a reception means for receiving an instruction for the content notified by the notification means, Update control means for controlling to update the determined criteria based on the notification content by the notification means and the instruction content received by the reception means; OCR means for performing character recognition processing on the image; Comprising; The update control means controls to return the updated criteria to before the update when the notification content by the notification means is that the image is unclear, the instruction content received by the reception means is that the image is clear, and the result of the character recognition processing by the OCR means indicates failure. An information processing apparatus characterized by this.

16. An information processing system for acquiring an image of a document, Determination means for determining criteria for determining whether the image is clear based on the type of the document; Notification means for notifying whether the image is clear based on the determination result of whether each small area into which the image of the document is divided is clear and the criteria; Comprising; The notification means notifies the determination result of whether each small area in the image of the document is clear by superimposing and displaying information that can distinguish the small areas determined to be clear and the small areas determined to be unclear in the image of the document on the image of the document. An information processing apparatus characterized by this.

17. An information processing system for acquiring an image of a document, Determination means for determining criteria for determining whether the image of the document is clear based on the feature amount obtained from the image of the document; Notification means for notifying whether the image is clear based on the determination result of whether each small area into which the image of the document is divided is clear and the criteria; Comprising; The notification means notifies the determination result of whether each small area in the image of the document is clear by superimposing and displaying information that can distinguish the small areas determined to be clear and the small areas determined to be unclear in the image of the document on the image of the document. An information processing apparatus characterized by this.

18. An information processing system for acquiring an image of a document, Determination means for determining criteria for determining whether the image of the document is clear based on the type of the document; Notification means for notifying whether the image of the document is clear based on the determination result of whether each small area into which the image of the document is divided is clear and the determined criteria; Reception means for receiving an instruction for the notification content by the notification means; Update control means for controlling to update the determined criteria based on the notification content by the notification means and the instruction content received by the reception means; OCR means for performing character recognition processing on the image; Comprising; The update control means, when the notification content by the notification means is that the image is unclear, and the instruction content received by the reception means is that the image is clear, and the result of the character recognition processing by the OCR means indicates failure, controls to return the updated criteria to before the update. An information processing system characterized by this.

19. An information processing system for acquiring an image of a document, Determination means for determining criteria for determining whether the image of the document is clear based on the feature amount acquired from the image of the document; Notification means for notifying whether the image of the document is clear based on the determination result of whether each small area obtained by dividing the image of the document is clear and the determined criteria; Reception means for receiving an instruction for the notification content by the notification means; Update control means for controlling to update the determined criteria based on the notification content by the notification means and the instruction content received by the reception means; OCR means for performing character recognition processing on the image; Comprising; The update control means, when the notification content by the notification means is that the image is unclear, and the instruction content received by the reception means is that the image is clear, and the result of the character recognition processing by the OCR means indicates failure, controls to return the updated criteria to before the update. An information processing system characterized by this.

20. A control method for an information processing apparatus for acquiring an image of a document, A determination step in which determination means determines criteria for determining whether the image is clear based on the type of the document; A notification step in which notification means notifies whether the image is clear based on the determination result of whether each small area obtained by dividing the image of the document is clear and the criteria; Comprising; The notification step notifies the determination result of whether each small area in the image of the document is clear by superimposing and displaying information that can distinguish between the small areas determined to be clear and the small areas determined to be unclear in the image of the document on the image of the document. A control method for an information processing apparatus characterized by this.

21. A control method for an information processing apparatus that acquires an image of a document, a determination step in which a determination means determines a criterion for determining whether the image of the document is clear based on a feature amount acquired from the image of the document; a notification step in which a notification means notifies whether the image is clear based on the determination result of whether each small area into which the image of the document is divided is clear and the criterion; comprising: The notification step notifies the determination result of whether each small area in the image of the document is clear by superimposing and displaying information that discriminately indicates a small area determined to be clear and a small area determined to be unclear in the image of the document on the image of the document. A control method for an information processing apparatus, characterized by the above.

22. A control method for an information processing apparatus that acquires an image of a document, a determination step in which a determination means determines a criterion for determining whether the image of the document is clear based on the type of the document; a notification step in which a notification means notifies whether the image of the document is clear based on the determination result of whether each small area into which the image of the document is divided is clear and the determined criterion; a reception step in which a reception means receives an instruction regarding the notification content by the notification means; an update control step in which an update control means controls to update the determined criterion based on the notification content by the notification step and the instruction content received by the reception step; an OCR step in which an OCR means performs character recognition processing on the image; an update control step in which the update control means controls to return the updated criterion to before the update when the notification content by the notification step indicates that the image is unclear, the instruction content received by the reception step indicates that the image is clear, and the character recognition processing by the OCR step shows a failed result; A control method for an information processing apparatus, characterized by comprising the above.

23. A control method for an information processing apparatus that acquires an image of a document, a determination step in which a determination means determines a criterion for determining whether the image of the document is clear based on a feature amount acquired from the image of the document; a notification step in which a notification means notifies whether the image of the document is clear based on the determination result of whether each small area into which the image of the document is divided is clear and the determined criterion; a reception step in which a reception means receives an instruction regarding the notification content by the notification means; An update control step in which the update control means controls to update the determined criterion based on the notification content in the notification step and the instruction content received in the reception step; An OCR step in which the OCR means performs an optical character recognition process on the image; An update control step in which the update control means controls to return the updated criterion to before the update when the notification content in the notification step indicates that the image is unclear, the instruction content received in the reception step indicates that the image is clear, and the result of the optical character recognition process in the OCR step shows failure; A control method for an information processing apparatus, characterized by comprising the above. [

24. ] A program for causing a computer to function as each of the means described in any one of Claims 1 to 15.

Images