Information processing device, control method, and application

Abstract

The purpose is to display a screen that clearly shows which page of the image data obtained from the scan contains which error. [Solution] The system is controlled to display a screen that lists the image data of multiple pages obtained by scanning. On the screen, if a string is recognized from a pre-specified area within the image data, the recognized string is displayed; if a string is not recognized from the area, a warning is displayed. In the display area where the image data of a page where an error occurred in the scan is displayed, the system is controlled to display the screen with a color corresponding to the type of error around the image data of that page. The display area is characterized in that different colors are applied to correspond to each of the multiple types of errors that occur in the scan.

Description

Technical Field

[0001] The present invention relates to a screen for displaying image data obtained by scanning.

Background Art

[0002] Conventionally, there is a technique of setting a character string obtained by character recognition processing on image data obtained by scanning as a file name or a folder name, and storing a file including the image data in a folder. Patent Document 1 discloses a technique of displaying image data in which an error has occurred and notifying that the character recognition processing has failed when an error occurs in the character recognition processing.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, regarding image data obtained by scanning, various errors can occur, not limited to errors in character recognition processing. For example, there are cases such as folding or double feeding of the original document during scanning. In Patent Document 1, after a list display of image data of a plurality of scanned pages, different displays are not made for each type of error so that it is easy to understand which error has occurred on which page among the plurality of pages.

Means for Solving the Problems

[0005] To achieve the above objective, the present invention provides an application for causing a computer to function as a display control means for controlling a screen to display a list of image data of multiple pages obtained by scanning, wherein the display control means controls the screen to display a recognized string if a string is recognized from a predetermined area within the image data, and to display a warning if a string is not recognized from the area, and controls the screen to display the image data of a page where an error occurred in the scan in a display area where the image data of that page is colored with a color corresponding to the type of error, wherein the display area is colored with different colors corresponding to each of the multiple types of errors that occur in the scan. [Effects of the Invention]

[0006] According to the application of the present invention, it is possible to provide a mechanism that displays a screen that clearly shows which page of the multiple image data obtained by scanning has which error. [Brief explanation of the drawing]

[0007] [Figure 1] This diagram shows the overall configuration of this system. [Figure 2] This is a hardware configuration diagram of scanner 110. [Figure 3] This is a hardware configuration diagram of user terminal 120. [Figure 4] This is a software configuration diagram for scanner 110. [Figure 5] This is a software configuration diagram of user terminal 120. [Figure 6] This is a flowchart showing the processing flow in this system. [Figure 7] This figure shows an example of a UI screen displayed on the user terminal 120 in the first embodiment. [Figure 8]This figure shows an example of a UI screen displayed on the user terminal 120 in the second embodiment. [Figure 9] This figure shows an example of profile information held in the data management unit 524. [Figure 10] This figure shows an example of error information stored in the data management unit 524. [Modes for carrying out the invention]

[0008] The embodiments for carrying out the present invention will be described below with reference to the drawings. Note that the following embodiments are not intended to limit the invention as defined in the claims, and not all combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0009] <First Embodiment> <Overall Structure> Figure 1 shows an example of a system configuration and network configuration for carrying out the present invention.

[0010] Network 100 is a network that serves as a communication path between devices, and can be the internet or an intranet, but is not limited to these; it can also be USB (Universal Serial Bus). It is not limited to a specific communication protocol, and the type of connection (wired or wireless) does not matter.

[0011] Scanner 110 is a device that has the function of reading images, such as a scanner or MFP (Multifunction Peripheral), and has the function of transferring scanned image data to an external device.

[0012] The user terminal 120 is an information processing device for processing and displaying scanned images received via the network 100. Specifically, it can take the form of a personal computer, laptop computer, tablet computer, or smartphone.

[0013] The scanner 110 and the user terminal 120 are communicably connected via the network 100. A plurality of scanners 110 may be connected to the user terminal 120 via the network 100. In the system of this embodiment, the configuration consists of the scanner 110 and the user terminal 120, but is not limited thereto, and the scanner 110 may also have the functions of the user terminal 120.

[0014] <Hardware Configuration of Scanner 110> FIG. 2 is a hardware configuration diagram of the scanner 110. The scanner 110 is composed of a control unit 210, an operation unit 220, and a scanner unit 222.

[0015] The control unit 210 is composed of the following units 211 to 219 and controls the operation of the entire scanner 110. The CPU 211 reads out the control programs stored in the ROM 212 and the HDD 214 and executes and controls various functions of the scanner 110 such as reading / communication. The RAM 213 is used as a temporary storage area such as the main memory and work area of the CPU 211. In this embodiment, it is assumed that one CPU 211 executes each process shown in the following flowchart using one memory (RAM 213 or HDD 214), but it is not limited thereto. For example, a plurality of CPUs, a plurality of RAMs, or HDDs may cooperate to execute each process. The HDD 214 is a large-capacity storage unit that stores image data and various programs.

[0016] The operation unit I / F 215 is an interface that connects the operation unit 220 and the control unit 210. The operation unit 220 is equipped with a touch panel, a keyboard, etc., and receives operations / inputs / instructions from the user.

[0017] Scanner I / F 217 is an interface that connects the scanner unit 222 and the control unit 210. The scanner unit 222 reads a document set on a document table or an ADF (Auto Document Feeder), which is not shown, generates image data, and inputs it to the control unit 210 via the scanner I / F 217. The scanner 110 can transfer the image data generated by the scanner unit 222 to other devices via the network I / F 219.

[0018] Network I / F 219 is an interface that connects the control unit 210 (scanner 110) to the network. The scanner 110 uses the network I / F 219 to transmit image data to other devices on the network and to send and receive various kinds of information.

[0019] <Hardware Configuration of User Terminal 120> Figure 3 is a hardware configuration diagram of the user terminal 120. The user terminal 120 is composed of a control unit 310 and a user interface unit 320.

[0020] The control unit 310 is composed of a CPU 311, a ROM 312, a RAM 313, an HDD 314, a user I / F 316, and a network I / F 315. The CPU 311 reads a control program stored in the ROM 312, executes various processes, and controls the overall operation. The RAM 313 is used as a temporary storage area such as the main memory and work area of the CPU 311. The HDD 314 is a large-capacity storage unit that stores image data and various programs. The network I / F 315 is an interface that connects the user terminal 120 to the network. The user terminal 120 receives image data from other devices such as the scanner 110 via the network I / F 315 and sends and receives various kinds of information.

[0021] The user interface unit 320 handles the input and output of information and signals via a display, keyboard, mouse, buttons, touch panel, etc. Computers that do not have this hardware can be connected to and operated from other computers using remote desktop or remote shell.

[0022] <Scanner 110 Software Configuration> Figure 4 is a software configuration diagram of the scanner according to this embodiment.

[0023] The scanner 110 has a basic function unit 410 and an additional function unit 420. Each function unit is realized when the CPU 211 reads programs stored in the ROM 212 and HDD 214 of the control unit 210 into the RAM 213 and executes them.

[0024] The components included in the basic function unit 410 are standard features of the scanner 110, while the additional function unit 420 consists of applications that are installed on the scanner 110. Note that other additional applications, not shown in the diagram, may also be installed on the scanner 110.

[0025] The basic function unit 410 of the scanner 110 includes a scan execution unit 411 and an image data storage unit 412.

[0026] The additional function unit 420 includes a display control unit 421, a scan instruction unit 422, an image processing unit 423, a data management unit 424, a data conversion unit 426, and an external linkage unit 427.

[0027] The display control unit 421 displays a user interface (UI) screen on the touch panel-enabled liquid crystal display unit of the scanner 110's operation unit 220 to accept user operations. For example, it displays an operation screen that accepts operations such as scan settings, scan start, scan image preview, output settings, and output start.

[0028] The scan instruction unit 422 requests the scan execution unit 411 to perform a scan according to the scan settings entered via the UI screen of the display control unit 421.

[0029] The scan execution unit 411 receives a scan request, including scan settings, from the scan instruction unit 422 or the external linkage unit 427. The scan execution unit 411 generates scanned image data by scanning the document with the scanner 222 via the scanner I / F 217, in accordance with the scan request. The generated scanned image data is sent to the image data storage unit 412. The scan execution unit 411 sends an image identifier, which uniquely identifies the stored scanned image data, to the scan instruction unit 422 or the external linkage unit 427. The image identifier is a number, symbol, or alphabet (not shown) used to uniquely identify the scanned image, etc., by the scanner 110.

[0030] The image data storage unit 412 stores the scanned image data received from the scan execution unit 411 in the HDD 214.

[0031] The external communication unit 427 transmits a scan request, including the scan settings received from the user terminal 120, to the scan instruction unit 422, and transmits the image data obtained from the scan process to the user terminal 120.

[0032] <Software configuration of user terminals> Figure 5 is a software configuration diagram of a user terminal according to this embodiment. The user terminal 120 has an application unit 500. The application unit 500 has a display control unit 521, an image processing unit 523, a data management unit 524, a data conversion unit 526, and an external linkage unit 527.

[0033] The display control unit 521 displays a UI (user interface) screen on the display unit 320 of the user terminal 120 to accept user operations. For example, it displays an operation screen that accepts operations such as scan settings and scan start, preview of scanned images, output settings and output start.

[0034] The image processing unit 523 performs analysis and processing on scanned images. The image processing unit 523 performs various image processing operations, such as character area analysis, OCR (Optical Character Recognition), barcode area analysis, image rotation and tilt correction, and thumbnail image generation, within the image data acquired from the HDD 314.

[0035] The data management unit 524 stores profile information such as coordinates designated as character recognition areas, strings, file names, folder names, and save locations, associating them with image identifiers. It also saves the coordinates designated as character recognition areas, file names, folder names, and save locations as preset profile information on the HDD 314. Furthermore, it stores the page number where an error was detected, associating it with the error type. Finally, it determines whether or not preset profile information exists.

[0036] Figure 9 shows an example of profile information held in the data management unit 524. 900 is the profile information management table. 901 is the button ID for identifying the profile button. 902 is the profile name entered by the user in S604. 903 is an example of default scan settings entered as initial values, storing settings such as paper size, color, and resolution. 904 is the character recognition area information set in S604, storing the field ID, field name, and start and end points of the character recognition area. 905 is information on the storage location settings for scanned image data, storing the root folder, folder naming convention, and file naming convention. The [Company Name] listed in the folder name and file name fields means that the string extracted based on the character recognition area information of FIELD01 is used. Also, [Year][Month][Day] generates a string by concatenating the current year, month, and day information with underscores.

[0037] Figure 10 shows an example of error information held in the data management unit 524. Figure 10(a) is an example of a case where one error occurs. The error information in Figure 10(a) corresponds to the display on the UI screen in Figure 7(b) and is used when displaying a warning on the thumbnail image in S613.

[0038] Table 1000 is a table that manages error information. 1001 is an ID used to identify errors. 1002 is a column for storing the type of error. 1003 is a column for storing the page number on which the error occurred. 1004 is an example of error information, where the error ID E1 stores information that a problem occurred on the first page of the scanned image where "no text" was found.

[0039] Figure 10(a) shows an example of error information when a character string is not detected during character recognition processing. However, errors that occur during scanning are not limited to character recognition failures. Other errors such as double feeding, folding, and blank pages may also be detected. In such cases, there is a problem in that errors are difficult to notice. In such cases, as will be described later, highlighting the thumbnail image with a different color according to the type of error makes it easier to notice the error.

[0040] Figure 10(b) shows an example of error information stored in the data management unit 524 when multiple types of errors occur. Figure 10(b) corresponds to the UI screen display in Figure 8 and is used when displaying errors on the thumbnail image in S613.

[0041] In Figure 8(a), for errors of the type "no string found," a warning is issued in the form of a message indicating that the string was not recognized from a pre-defined area. This is shown in Figure 8(a) as 811 and 812. 811 is a message displayed in correspondence with field 733, which will be described later. 812 is a message displayed on top of the image data within the preview panel 701, which will be described later. Note that while both messages 811 and 812 are displayed in Figure 8(a), this is not the only option. Only one of 811 or 812 may be displayed.

[0042] Furthermore, errors of the "folded paper" and "blank page" types are color-coded according to the "background color legend" of the thumbnail images shown at the bottom of Figure 8(a). Specifically, blue corresponds to "folded paper" and yellow corresponds to "blank page".

[0043] 1011 is an example of error information, where the error ID E1 stores information that a problem occurred on the first page of the scanned image where "no text was found". Based on this error information E1, in S613 the display control unit 521 displays at least one of messages 811 and 812.

[0044] 1012 is an example of error information, where the error ID E2 stores information that a problem called "paper folding" occurred on the second page of the scanned image. Based on this error information E2, in S613, the display control unit 521 displays a warning in blue on 801 on the second page.

[0045] 1013 is an example of error information, where the error ID E3 stores information that a "blank page" problem occurred on the third page of the scanned image. Based on this error information E3, in S613, the display control unit 521 displays a yellow warning on 803 on the third page.

[0046] In Figure 8(b), the "folded paper" and "blank page" errors are the same as in Figure 8(a). For the "no text" error, the colors are assigned according to the "background color legend" of the thumbnail images at the bottom of Figure 8(b). Specifically, red corresponds to the "no text" error.

[0047] In the case shown in Figure 8(b), the display control unit 521 displays a warning in red on page 1, 741, based on the error information in E1. Alternatively, as shown in Figure 8(b), after displaying the warning on 741, at least one of messages 811 and 812 may be displayed.

[0048] The data conversion unit 526 retrieves the image corresponding to the image identifier received from the image processing unit 523 from the HDD 314 and converts it to a file format according to the output settings entered via the UI screen of the user interface unit 320. The data conversion unit 526 retrieves the file name corresponding to the image identifier received from the image processing unit 523 from the data management unit and sets it as the file name of the converted file. The data conversion unit 526 sends the converted file and the corresponding image identifier to the HDD 314, and the data management unit 524 stores the received file associated with the image identifier.

[0049] The external communication unit 527 provides functions for the scanner 110 and the user terminal 120 to operate in cooperation. The external communication unit 527 sends a scan execution processing request containing scan setting information to the scanner 110 and receives scanned image data from the scanner 110, according to instructions received from the user interface unit 320 of the user terminal 120. The scanned image data received from the scanner 110 is stored in the HDD 314 of the user terminal 120.

[0050] <Overall processing flow> The process described below involves the CPU 311 of the user terminal 120 reading control programs stored in the ROM 312 and HDD 314, and executing and controlling various functions and application functions of the user terminal 120.

[0051] Furthermore, while the user terminal 120 is processing, the CPU 211 of the scanner 110 receives instructions from the user terminal 120 and reads the control program stored in the ROM 212 and HDD 214. Then, it executes and controls the various functions and applications of the scanner 110.

[0052] Figure 6 is a flowchart showing the processing flow when an error occurs in the image data scanned by scanner 110 and a warning is displayed. There are several types of errors for which a warning is displayed. For example, it may include a type called "no text", that is, when no text is recognized in the area where pre-specified character recognition processing is performed. It may also include a type called "folded paper", that is, when the document being scanned is folded. It may also include a type called "blank paper", that is, when the document being scanned is blank. In addition, although not shown in Figure 10, it may also include a type called "double feed", that is, when the documents being scanned overlap.

[0053] The application (hereinafter referred to as the scan application) of the present invention, which displays a warning when a character recognition error is detected in scanned image data, can be used by installing it on the user terminal 120.

[0054] The user interface unit 320 of the user terminal 120 displays a screen (not shown) that shows icons, menus, executable files, etc., for running applications provided on the user terminal 120.

[0055] Figure 7(a) shows an example of a screen displayed by the scan application, which is shown by the display control unit 521 of the application unit 500. This screen is used for selecting and creating scan profiles. In Figure 7(a), 700 is the main panel of the scan application.

[0056] Figures 7(b), 8(a), and 8(b) show examples of screens displayed by the scan application, which is displayed by the display control unit 521 of the application unit 500. This screen displays a list of image data of multiple pages obtained by scanning. On this screen, a list of multiple pages is displayed in the thumbnail panel 704. Then, one page specified by the user from among the multiple pages is displayed in the preview panel 701. Figure 7(b) shows how a warning is displayed when there is an error in the character recognition process where a string cannot be extracted. Figures 8(a) and (b) show an example of how a warning is displayed by highlighting the area around the thumbnail image with color even when an error other than the character recognition process is detected. Information regarding the warning display is obtained from the error information in Figure 10(b) held in the data management unit 524.

[0057] The user interface unit 320 of the user terminal 120 starts the flow shown in Figure 6 when it detects an instruction to execute the scan application, such as clicking the scan application icon, menu, or executable file. Then, in S601, the user terminal 120 starts up by reading and executing the scan application program. From this point onward, the application unit 500 of the user terminal 120 performs each process. When the scan application starts up, the display control unit 521 displays the main panel 700 as the initial screen of the scan application.

[0058] When the scan application is launched, the user terminal 120 displays the scan profile panel 705 shown in Figure 7(a) on the S614 to receive user instructions on whether to select a preset scan setting profile or create a new one. The scan profile panel 705 displays profile buttons 753 and 754 for loading existing preset settings, and a profile creation button 752 for creating a new profile. A profile is a function that saves settings such as scan settings, areas for character recognition, and file saving information on the HDD 314 of the user terminal 120 for reuse. Multiple combinations of different settings can be saved by making them identifiable by profile names.

[0059] The display control unit 521 of the user terminal 120 detects that any button on the scan profile panel 705 has been pressed. Then, in S602, the data management unit 524 of the user terminal 120 determines whether the user's instruction is in a preset profile or not.

[0060] If the user instructs to press profile buttons 753 or 754 to load existing preset settings, the system determines that a preset profile is to be used, responds with Yes, and proceeds to S603.

[0061] On the other hand, if the user's instruction is to press the profile creation button 752 to create a new profile, it is determined that a preset profile will not be used, resulting in a "No" response and proceeding to S604.

[0062] If S602 determines that a profile for reading existing preset settings has been selected, the process proceeds to S603, where the data management unit 524 reads the settings of the selected profile from the HDD 314. Existing profiles are those created in advance in S604, as described below. Which profile has been selected is identified by the button ID associated with the profile button, and the settings stored in association with the button ID are used in subsequent processing. The button ID is an ID generated by the data management unit 524 when the profile is created, and is a number, symbol, or alphabet used to uniquely identify the registered set of settings (not shown).

[0063] If it is determined in S602 that a preset profile will not be used, the process proceeds to S604, where the display control unit 521 accepts input for a "profile name" on a pop-up screen (not shown) to create a new profile. Furthermore, it accepts an operation to specify an area for character recognition processing via a UI screen (not shown) and associates a field name and button ID to identify the area specification information.

[0064] In addition, after setting the output destination information for the file, the profile name, scan settings, field name, save location settings, etc. are associated with the button ID generated for the new profile and stored in the data management unit 524, before returning to S614.

[0065] When the S603 accepts the selection of a profile, it proceeds to the S605, where a message (not shown) prompting the user to place the document to be scanned on the platen or ADF is displayed, and the scan command is accepted by pressing the button (not shown) to instruct the user to perform the scan.

[0066] When the display control unit 521 receives a scan execution instruction in S605, the external communication unit 527 proceeds to S606 and sends a scan execution processing request containing scan setting information to the scanner 110.

[0067] The external communication unit 427 of the scanner 110 receives the scan execution processing request sent in S606 in S607. The external communication unit 427 then sends the scan request received from the user terminal 120 to the scan execution unit 411.

[0068] The scan execution unit 411 of the scanner 110 performs a scan of the paper placed on the document glass or ADF in S608, and saves the acquired scanned image data to the image data storage unit 412.

[0069] In S609, the external communication unit 427 transmits the scanned image data stored in the image data storage unit 412 to the external communication unit 527 of the user terminal 120.

[0070] In S610, the external communication unit 527 of the user terminal 120 receives the scanned image data transmitted from the scanner 110 and saves it to the HDD 314 of the user terminal 120.

[0071] In S611, the image processing unit 523 of the user terminal 120 reads scanned image data from the HDD 314 and performs character recognition processing. During character recognition processing, character recognition processing is performed on the rectangular area indicated by the character recognition area information 904 of the profile information 900 acquired via the data management unit 524.

[0072] In S620, the display control unit 521 performs screen display processing on the main panel 700 of the scan application according to the character recognition result. Based on the character recognition result in S611, it determines whether there are any errors, and if there are errors, it displays a thumbnail image with errors on the thumbnail panel 704, or an error-free thumbnail image if there are no errors.

[0073] In S612, the image processing unit 523 of the user terminal 120 determines whether or not an error occurred in the character recognition process performed in S611 to determine if a character string was successfully obtained. If an error is detected, the page number on which the error was detected and the type of error are associated and stored in the data management unit 524.

[0074] If an error is detected in S612, in S613, the display control unit 521 of the user terminal 120 displays the screens illustrated in Figures 7(b), 8(a), and 8(b). 701 in Figure 7(b) is a preview panel that displays a preview image of the scanned image.

[0075] The display control unit 512 displays the rectangular area 712 used in the character recognition process on the preview panel 701, overlaid on the preview image. This example shows a case where the string "XYZ Corporation" was expected to be detected by the character recognition process, but for some reason the string has shifted from its pre-specified coordinate position.

[0076] The display control unit 512 displays a field panel 703 for displaying character recognition results for each character recognition area. The following areas are arranged on the field panel 703: The first is a field name display area 731 for displaying the field name. The second is a character recognition image display area 732 for displaying the image of the target area that has undergone character recognition processing. The third is a field 733 for displaying the string extracted as a result of the character recognition processing.

[0077] In the example shown in Figure 7(b), the character recognition process fails to acquire the character because the character has shifted from its pre-specified coordinate position for some reason. As a result, no image is displayed in 732, and 733 is blank with no character. Furthermore, a button 735 for saving the scanned image and a button 734 for canceling the process are displayed. Pressing 735 saves the scanned image to the save location specified in the save location setting 905 of the profile information 900 and returns to S614, while pressing 734 returns to S614 without saving the scanned image.

[0078] 704 is a thumbnail panel for displaying thumbnail images and errors created by the image processing unit 523. The display control unit 521 displays thumbnail images of the scanned image data one page at a time on the thumbnail panel 704. 742 is a thumbnail image of the scanned image currently displayed on the preview panel 701. The thumbnail images are created by the image processing unit 523.

[0079] The display control unit 521 checks for the presence of error information stored in the data management unit 524 and obtains the error information exemplified in Figures 10(a) and (b). Error information 1000 has an error ID of E1 and stores the page number where the error occurred and the type of error. The error information shown in Figure 10(b) has error IDs of E1, E2, and E3 and stores the page number where the error occurred and the type of error.

[0080] The example in Figure 7(b) shows a case where there is error information indicating that no text was detected on the first page. The display control unit 521 highlights the area around the thumbnail image of the first page with color and displays the error on 741. That is, in the display area where the image data of the page where the error occurred is displayed, the screen is displayed with the area around the image data of that page highlighted in color. Areas represented by diagonal lines around the thumbnail image of the first page indicate that the area is colored.

[0081] In this way, by looking at the list of thumbnails displayed in thumbnail panel 704, users can easily notice that a problem occurred where text could not be retrieved because the first page of the scanned image was colored.

[0082] Figure 8 shows an example of how the thumbnail image is highlighted with color to display a warning even when errors other than those related to character recognition are detected. Further details are as described above.

[0083] As shown in Figure 8(a), error information of the type "no string" may be displayed as a warning in the form of at least one of messages 811 and 812.

[0084] In this way, when scanning images obtained from a scanner are displayed one page at a time on a screen, it becomes easier to notice problems other than those related to character recognition, such as double feeding, folded paper, or blank pages, thus improving usability.

[0085] In this embodiment, it has been explained that the screen is displayed with the area around the page where the error occurred highlighted in color. This can also be achieved by the display control unit 521 displaying the screen with the area behind the image data of the page where the error occurred highlighted in color within the display area where the image data of that page is displayed.

[0086] If no errors are found in S612, the display control unit 521 displays an error-free thumbnail image on the thumbnail panel 704 in S615. In this case, the rectangular area 712 used for character recognition processing on the preview panel 701 contains the string "XYZ Corporation". (Not shown) Furthermore, the image of "XYZ Corporation" is displayed in the character recognition image display area 732 on the field panel 703, and the string "XYZ Corporation" is displayed in the field 733 for displaying the extracted string. (Not shown)

[0087] As described above, in a screen that displays scanned images obtained from a scanner one page at a time, it becomes easier to notice when text recognition processing failed to acquire a string, thus improving usability.

[0088] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of each of the embodiments described above to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC or FPGA) that implements one or more functions. [Explanation of Symbols]

[0089] 120 user terminals 521 Display Control Unit 523 Image Processing Unit 524 Data Management Department

Claims

1. Computers, Display control means for controlling the display of a screen that shows a list of image data of multiple pages obtained by scanning. It is an application designed to function as such. The display control means is In the aforementioned screen, if a string is recognized from a pre-specified area within the image data, the recognized string is displayed; if no string is recognized from that area, a warning is displayed. In the display area where the image data of the page where the scan error occurred is displayed, the system controls the display to show the screen with the area around the image data of the page colored with a color corresponding to the type of error. In the aforementioned display area, different colors are assigned to correspond to each of the multiple types of errors that occur during the scan. An application characterized by the following features.

2. The aforementioned warning is a message indicating that no string was recognized from the pre-specified area. The application according to feature 1.

3. If a string is recognized from a pre-specified area within the image data, the recognized string will be displayed in the field shown on the screen. If no string is recognized from that area, the aforementioned warning will be displayed in that field. The application according to feature 2.

4. The aforementioned multiple types of errors include an error in which a string is not recognized from the predetermined area. The aforementioned warning is displayed by coloring the image data of the page containing the pre-specified area with a color corresponding to the type of error. The application according to feature 1.

5. The aforementioned multiple types of errors include, in the scan, an error in which the document being scanned is folded. The application according to feature 1.

6. The aforementioned multiple types of errors include, in the scan, an error of the type in which the documents being scanned overlap. The application according to feature 1.

7. The aforementioned multiple types of errors include, in the scan, an error of the type in which the document being scanned is blank. The application according to feature 1.

8. Display control means for controlling the display of a screen that shows a list of image data of multiple pages obtained by scanning. An information processing device having, The display control means is In the aforementioned screen, if a string is recognized from a pre-specified area within the image data, the recognized string is displayed; if no string is recognized from that area, a warning is displayed. In the display area where the image data of the page where the scan error occurred is displayed, the system controls the display to show the screen with the area around the image data of the page colored with a color corresponding to the type of error. In the aforementioned display area, different colors are assigned to correspond to each of the multiple types of errors that occur during the scan. An information processing device characterized by the following:

9. A display control process that controls the display to show a screen that lists the image data of multiple pages obtained by scanning. A control method having, In the aforementioned display control process, In the aforementioned screen, if a string is recognized from a pre-specified area within the image data, the recognized string is displayed; if no string is recognized from that area, a warning is displayed. In the display area where the image data of the page where the scan error occurred is displayed, the system controls the display to show the screen with the area around the image data of the page colored with a color corresponding to the type of error. In the aforementioned display area, different colors are assigned to correspond to each of the multiple types of errors that occur during the scan. A control method characterized by the following:

Images