Information processing apparatus, control method, and storage medium

Abstract

The invention discloses an information processing apparatus, a control method, and a storage medium. Control is performed to display a screen in which image data on a plurality of pages obtained by scanning is displayed as a list, in a case where a character string is recognized from a previously specified region in the image data, the recognized character string is displayed on the screen, and in a case where the character string is not recognized from the region, the recognized character string is displayed on the screen. A warning is displayed on a screen in which the screen is displayed in a state in which the periphery of the image data on the page is colored in a color corresponding to the error type in a display region in which the image data on the page on which the error occurs in the scan is displayed, and in which the image data on the page is displayed in a display region in which the image data on the page is colored in a color corresponding to the error type. A plurality of types of errors occurring in the scan are colored in different corresponding colors.

Description

Technical Field

[0001] This invention relates to a screen for displaying image data obtained through scanning. Background Technology

[0002] There is a technique for setting a string obtained by performing character recognition processing on image data obtained from scanning as a filename or folder name, and storing a file including the image data in a folder. Japanese Patent Application Publication No. 2021-005317 describes a technique for displaying erroneous image data in the event of an error in character recognition processing, to notify that the character recognition processing has failed.

[0003] Image data obtained through scanning can contain not only errors in character recognition processing, but also various other errors. Examples of errors include document creases during scanning and repeated document feeds. In the technology described in Japanese Patent Application Publication No. 2021-005317, image data from multiple pages obtained through scanning is not displayed as a list, and no different display is implemented for each type of error to facilitate understanding of which type of error occurred on which page among the multiple pages. Summary of the Invention

[0004] According to embodiments of this disclosure, a non-transitory computer-readable storage medium stores a computer program for performing a method of a control information processing apparatus, the method comprising: displaying a screen in which image data from a plurality of pages obtained by scanning is displayed as a list, wherein, if a string is identified from a previously specified region in the image data, the identified string is displayed on the screen, and if no string is identified from the region, a warning is displayed on the screen, wherein, in a display area of ​​image data on a page where an error occurred during scanning, the screen is displayed with the periphery of the image data on the page colored in a color corresponding to the error type, and wherein, in the display area, various types of errors occurring during scanning are colored in different corresponding colors.

[0005] The features of this disclosure will become apparent from the following description of embodiments with reference to the accompanying drawings. The following description of embodiments is by way of example. Attached Figure Description

[0006] Figure 1 It is a diagram showing the overall configuration of the system.

[0007] Figure 2 This is a diagram showing the hardware configuration of the scanner.

[0008] Figure 3 This is a diagram showing the hardware configuration of the user terminal.

[0009] Figure 4 This is a diagram showing the scanner's software configuration.

[0010] Figure 5 This is a diagram showing the software configuration of the user terminal.

[0011] Figure 6 This is a flowchart illustrating the processing flow of the system.

[0012] Figure 7A and Figure 7B These are diagrams illustrating examples of user interface (UI) screens displayed on a user terminal according to the first embodiment.

[0013] Figure 8A and Figure 8B These are diagrams illustrating examples of UI screens displayed on a user interface according to the second embodiment.

[0014] Figure 9 This is a diagram illustrating an example of the configuration file information maintained by the data management unit.

[0015] Figure 10A and Figure 10B These are diagrams showing examples of error messages maintained by the data management unit. Detailed Implementation

[0016] Some embodiments of this disclosure are described below with reference to the accompanying drawings. These embodiments are not intended to limit the scope of the claims, and not all combinations of the features described in the embodiments are necessarily necessary to resolve the issues of this disclosure.

[0017] <First Embodiment>

[0018] <Full Configuration>

[0019] Figure 1 Examples of system and network configurations for implementing this disclosure are shown.

[0020] Network 100 is a network used as a communication path between devices, and is the Internet or an intranet, but not limited to the Internet or an intranet, and can be a Universal Serial Bus (USB). The communication protocol is not limited to a specific communication protocol, and either wired or wireless connections can be used.

[0021] Scanner 110 is a device that has the function of reading images, such as a scanner and a multifunction peripheral device (MFP), and has the function of transmitting image data obtained by scanning to an external device.

[0022] User terminal 120 is an information processing device that processes and displays scanned images received via network 100. More specifically, user terminal 120 may be a personal computer, laptop computer, tablet computer, smartphone, etc.

[0023] Scanner 110 and user terminal 120 are communicatively connected via network 100. Multiple scanners 110 can be connected to user terminal 120 via network 100. The system according to this embodiment has a configuration including scanner 110 and user terminal 120, but the system configuration is not limited to this example, and scanner 110 may also have the functionality of user terminal 120.

[0024] <Scanner Hardware Configuration>

[0025] Figure 2 This diagram illustrates the hardware configuration of scanner 110. Scanner 110 includes a control unit 210, an operation unit 220, and a scanner unit 222.

[0026] Control unit 210 includes units 211 to 219 described below and controls the overall operation of scanner 110. Central processing unit (CPU) 211 reads control programs stored in read-only memory (ROM) 212 and hard disk drive (HDD) 214 and executes and controls various functions included in scanner 110, such as reading and communication functions. Random access memory (RAM) 213 serves as the main memory and temporary storage area for CPU 211, such as the workspace. In this embodiment, one CPU 211 performs the processing shown in the flowchart described below using one memory (RAM 213 or HDD 214), but the processing is not limited to this example. For example, processing can be performed through the cooperation of multiple CPUs and multiple RAMs or HDDs. HDD 214 is a high-capacity storage unit for storing image data and various programs.

[0027] The operation unit interface (I / F) 215 is the interface connecting the operation unit 220 and the control unit 210. The operation unit 220 includes a touch panel, keyboard, etc., and receives user operations, inputs, and commands.

[0028] Scanner I / F 217 is the interface connecting scanner unit 222 and control unit 210. Scanner unit 222 reads originals placed on a document tray or automatic document feeder (ADF) (neither shown) to generate image data, and inputs the image data to control unit 210 via scanner I / F 217. Scanner 110 can transmit the image data generated by scanner unit 222 to another device via network I / F 219.

[0029] Network I / F 219 is an interface that connects control unit 210 (scanner 110) to network 100. Scanner 110 transmits image data to another device on network 100 via network I / F 219, and transmits and receives various information from another device on network 100.

[0030] <Hardware configuration of the user interface>

[0031] Figure 3 This diagram illustrates the hardware configuration of user terminal 120. User terminal 120 includes a control unit 310 and a user interface unit 320.

[0032] The control unit 310 includes a CPU 311, a ROM 312, a RAM 313, an HDD 314, a user I / F 316, and a network I / F 315. The CPU 311 reads the control program stored in the ROM 312 and executes various processes to control the overall operation. The RAM 313 serves as the main memory and temporary storage area for the CPU 311, as well as its working area. The HDD 314 is a large-capacity storage unit for storing image data and various programs. The network I / F 315 is the interface for connecting the user terminal 120 to the network 100. The user terminal 120 receives image data from another device, such as a scanner 110, and sends / receives various information to / from another device via the network I / F 315.

[0033] The user interface unit 320 performs input / output of information and signals through a display, keyboard, mouse, buttons, touch panel, etc. The computer, excluding the hardware, can be connected to and operated from another computer via remote desktop, remote shell, etc.

[0034] <Scanner Software Configuration>

[0035] Figure 4 This is a diagram illustrating the software configuration of the scanner according to this embodiment.

[0036] The scanner 110 includes a basic functional unit 410 and an additional functional unit 420. The functional unit is implemented when the CPU 211 reads the programs stored in the ROM 212 and HDD 214 of the control unit 210 into the RAM 213 and executes these programs.

[0037] The basic functional unit 410 includes units that are standardly installed in the scanner 110, while the additional functional unit 420 is an application that is additionally installed in the scanner 110. Note that another additional application (not shown) may be installed in the scanner 110.

[0038] The basic functional unit 410 includes a scanning execution unit 411 and an image data storage unit 412.

[0039] The additional functional unit 420 includes a display control unit 421, a scanning command unit 422, and an external cooperation unit 427.

[0040] The display control unit 421 displays a user interface (UI) screen for receiving user operations on a liquid crystal display unit that includes the touch panel function of the operation unit 220 of the scanner 110. The display control unit 421 displays an operation screen for receiving operations such as scan settings and scan start, as well as previews of scanned images, output settings for scanned images, and operations for starting the output of scanned images.

[0041] The scan instruction unit 422 requests the scan execution unit 411 to perform scan processing corresponding to the scan settings input through the UI screen of the display control unit 421.

[0042] The scan execution unit 411 receives a scan request, including scan settings, from the scan instruction unit 422 or the external collaboration unit 427. In response to the scan request, the scan execution unit 411 generates scanned image data by reading the original document using the scanner unit 222 via the scanner I / F 217. The generated scanned image data is sent to the image data storage unit 412. The scan execution unit 411 sends an image identifier, used to uniquely identify the stored scanned image data, to the scan instruction unit 422 or the external collaboration unit 427. The image identifier is a number, symbol, letter, etc. (not shown) used to uniquely identify an image, etc., scanned by the scanner 110.

[0043] The image data storage unit 412 stores the scanned image data received from the scan execution unit 411 in the HDD 214.

[0044] The external collaboration unit 427 sends the scan request, which includes the scan settings, received from the user terminal 120 to the scan instruction unit 422, and sends the image data obtained through the scan processing to the user terminal 120.

[0045] <Software Configuration for User Terminals>

[0046] Figure 5 This diagram illustrates the software configuration of a user terminal according to this embodiment. The user terminal 120 includes an application unit 500. The application unit 500 includes a display control unit 521, an image processing unit 523, a data management unit 524, a data conversion unit 526, and an external collaboration unit 527.

[0047] The display control unit 521 displays a UI screen for receiving user operations on the display unit of the user interface unit 320 of the user terminal 120. The display control unit 521 displays an operation screen for receiving operations such as scan settings and scan start, as well as scan image preview, scan image output settings, and scan image output start.

[0048] The image processing unit 523 performs analysis and modification processing on the scanned image. The image processing unit 523 performs various processing on the image, such as character region analysis, optical character recognition (OCR), barcode region analysis, image rotation and tilt correction, and thumbnail image generation in the image data acquired from the HDD 314.

[0049] The data management unit 524 maintains configuration file information, such as coordinates, strings, filenames, folder names, and storage destinations designated as character recognition areas, associated with image identifiers. Furthermore, the data management unit 524 stores the coordinates, filenames, folder names, and storage destinations designated as character recognition areas as preset configuration file information in the HDD 314. Additionally, the data management unit 524 maintains the page numbers and error types of detected errors in association with each other. Furthermore, the data management unit 524 determines the presence / absence of preset configuration file information.

[0050] Figure 9 An example of the configuration file information maintained by the data management unit 524 is shown. Figure 9 The document shows a configuration file information management table 900, a button identifier (ID) 901 for identifying the configuration file button, a configuration file name 902 entered by the user in step S604, an example 903 of entering default scan settings as initial values ​​and storing settings such as sheet size, color, and resolution, a character recognition area information 904 set in step S604 that stores field IDs, field names, and the start and end points of the character recognition area, and information 905 regarding the storage destination settings for the scanned image data that stores the naming rules for the root folder, folder names, and file names. The [Company_Name] described in the folder name and file name columns means a string extracted using the character recognition area information based on field ID FIELD01. Furthermore, a string obtained by connecting the current date with underscores is generated as [Year][Month][Day].

[0051] Figure 10A and Figure 10B Each example shows an error message held by the data management unit 524. Figure 10A An example was given in the case of an error occurring. Figure 10A The error message shown is Figure 7BThe UI screen shown is associated with the display and is used to display a warning on the thumbnail in step S613.

[0052] Figure 10A Table 1000 for managing error information, ID 1001 for identifying errors, column 1002 for storing error types, column 1003 for storing the page number where the error occurred, and example error information 1004 are shown, including an example where information indicating a “missing string” error occurred on the first page of a scanned image is stored in error ID E1.

[0053] Figure 10A An example of an error message is shown when a string is not detected during character recognition processing. However, errors occurring during scanning are not limited to recognition failures in character recognition processing. Errors such as double feeding of sheets, sheet creases, and blank sheets may be detected. In cases where such errors occur, it can be difficult to identify them. In such cases, highlighting the thumbnail image with a different color corresponding to the error type, as described below, helps in error identification.

[0054] Figure 10B This is a diagram illustrating an example of error information maintained by the data management unit 524 in the event of multiple types of errors. Figure 10B and Figure 8A and Figure 8B The UI screen shown is associated with the display and is used to display errors on the thumbnail image in step S613.

[0055] exist Figure 8A In the context of an error of type "missing string", a warning will be issued in the form of a message indicating that the string was not recognized from the preset area. Figure 8A Messages 811 and 812 are shown. Message 811 is displayed in association with area 733 described below. Message 812 is displayed above the image data shown in preview panel 701 described below. Figure 8A The example displays both messages 811 and 812, but the display is not limited to this example. Either message 811 or 812 can be displayed.

[0056] based on Figure 8A The "background color legend" of the thumbnail images described below uses color coding to distinguish between "sheet crease" and "blank sheet" type errors. More specifically, blue is associated with "sheet crease" type errors, and yellow is associated with "blank sheet" type errors.

[0057] Figure 10BExample 1011 of the error message is shown, which illustrates an example of storing information indicating a "missing string" error in the first page of the scanned image in error ID E1. In step S613, based on the E1 error message, the display control unit 521 displays at least one of messages 811 and 812.

[0058] Figure 10B Example 1012 of the error message is shown, illustrating an example where information indicating a "sheet crease" error has occurred in the second page of the scanned image is stored in error ID E2. In step S613, based on the E2 error message, the display control unit 521 displays a blue warning for the second page 801.

[0059] Figure 10B Example 1013 of the error message is shown, illustrating an example where information indicating a "blank sheet" error has occurred in the third page of the scanned image is stored in error ID E3. In step S613, based on the E3 error message, the display control unit 521 displays a yellow warning for the third page 803.

[0060] exist Figure 8B In the text, errors of the "sheet crease" type and errors of the "blank sheet" type are related to... Figure 8A Processed in a similar manner. Based on Figure 8B The "background color legend" of the thumbnail image described below uses color coding for "missing string" type errors. More specifically, red is associated with "missing string" type errors.

[0061] exist Figure 8B In the scenario shown, the display control unit 521 displays a red warning for page 741 based on the E1 error message. Note that, as Figure 8B As shown, while displaying a warning for the first page 741, at least one of messages 811 and 812 can be displayed.

[0062] The data conversion unit 526 acquires the image corresponding to the image identifier received from the image processing unit 523 from the HDD 314, and converts the image into a file format corresponding to the output settings input through the UI screen of the user interface unit 320. The data conversion unit 526 acquires the filename corresponding to the image identifier received from the image processing unit 523 from the data management unit 524, and sets this filename as the filename of the converted file. The data conversion unit 526 sends the converted file and the corresponding image identifier to the HDD 314, and the data management unit 524 associates the received file with the image identifier.

[0063] The external collaboration unit 527 provides functionality that enables the scanner 110 and the user terminal 120 to operate collaboratively with each other. In response to an instruction received from the user interface unit 320 of the user terminal 120, the external collaboration unit 527 sends a scan execution processing request, including information about scan settings, to the scanner 110 and receives scanned image data from the scanner 110.

[0064] The scanned image data received from the scanner 110 is stored in the HDD 314 of the user terminal 120.

[0065] <Entire Processing Flow>

[0066] In the following process, the CPU 311 of the user terminal 120 reads the control program stored in the ROM 312 and HDD 314, and executes and controls the various functions and applications maintained by the user terminal 120.

[0067] During processing at the user terminal 120, the CPU 211 of the scanner 110, in response to instructions from the user terminal 120, reads the control program stored in the ROM 212 and HDD 214. Furthermore, the CPU 211 of the scanner 110 executes and controls the various functions and applications of the scanner 110.

[0068] Figure 6 This is a flowchart illustrating the processing flow for displaying warnings when errors occur in image data scanned from scanner 110. Warnings are displayed for various error types. For example, the various error types can include a "missing string" type, i.e., a type where a string could not be recognized from a previously specified area that has undergone character recognition processing. The various error types can further include a "sheet crease" type, i.e., a type where the original to be scanned is folded during the scanning process. The various error types can further include a "blank sheet" type, i.e., a type where the original to be scanned is a blank sheet. Furthermore, although... Figure 10A and Figure 10B Not shown in the image, but the various types of errors can further include the "double feed" type, which is the type where the original to be scanned overlaps with another original.

[0069] When the application is installed on the user terminal 120, the application (hereinafter referred to as the scanning application) that displays a warning when a character recognition error is detected from the scanned image data becomes available according to this embodiment.

[0070] The user interface unit 320 of the user terminal 120 displays a screen (not shown) showing icons, menus, executable files, etc., for executing applications provided by the user terminal 120.

[0071] Figure 7AThis is a diagram showing an example of a scan application screen displayed by the display control unit 521 of the application unit 500, used to select and create new scan profiles. Figure 7A The main panel 700 of the scanning application is shown.

[0072] Figure 7B , Figure 8A and Figure 8B Examples of screens displayed by the display control unit 521 of the application unit 500 for the scanning application are shown. The screen displays image data from multiple pages obtained through scanning as a list. In the screen, the list of multiple pages is displayed in the thumbnail panel 704. Among the multiple pages, a user-specified page is displayed in the preview panel 701. Figure 7B This is a diagram showing the state of displaying a warning when an error occurs as a result of character recognition, indicating that a string cannot be extracted. Figure 8A and Figure 8B Examples are shown for each, where warnings are displayed even in cases where errors other than those in the character recognition process are detected, and the edges of the individual thumbnail images are highlighted in the corresponding colors.

[0073] Retained from data management unit 524 Figure 10B Get information about the warning from the error message shown.

[0074] When a scanning application execution command, such as a click on an icon, menu, or executable file, is detected in the scanning application, the user interface unit 320 of the user terminal 120 is activated. Figure 6 The process is shown below. In step S601, the user terminal 120 starts the scanning application by reading and executing the scanning application's program. Subsequent processing is performed by the application unit 500 of the user terminal 120. When the scanning application is started, the display control unit 521 displays the main panel 700 as the initial screen of the scanning application.

[0075] In step S614 after starting the scanning application, the user terminal 120 displays... Figure 7A The scan profile panel 705 shown receives user commands to select a preset scan profile or to recreate a profile. The scan profile panel 705 displays buttons 752 and 753 for reading existing preset profiles, and a profile creation button 751 for creating new profiles. A profile is a function that stores and reuses the scan settings, the area to be recognized, file storage information, etc., once configured, in the HDD 314 of the user terminal 120. Multiple different combinations of settings can be stored for identification by profile name.

[0076] The display control unit 521 of the user terminal 120 detects that any button in the scan profile panel 705 has been pressed. Then, in step S602, the data management unit 524 of the user terminal 120 determines whether the user has selected a preset profile.

[0077] If the user has selected button 752 or 753 to read the configuration file with preset settings, the user confirms that the preset configuration file will be used ("Yes" in step S602), and the process proceeds to step S603.

[0078] Conversely, if the user has already selected the configuration file creation button 751 for creating a new configuration file, it is determined that the preset configuration file will not be used ("No" in step S602), and the process proceeds to step S604.

[0079] If, in step S602, it is determined that a configuration file for reading existing preset settings has been selected, the process proceeds to step S603, and the data management unit 524 reads the setting values ​​of the selected configuration file from the HDD 314. The existing configuration file was pre-created in step S604, described below. The selected configuration file is identified by a button ID associated with the configuration file button, and the setting values ​​stored associated with the button ID are used in subsequent processing. The button ID is an ID generated by the data management unit 524 when the configuration file is created, and is a number, symbol, letter, etc. (not shown) used to uniquely identify the registered setting values.

[0080] If it is determined in step S602 that a preset configuration file is not used, the process proceeds to step S604, and the display control unit 521 receives the input of "configuration file name" in a pop-up screen (not shown) to create a new configuration file. Furthermore, the display control unit 521 receives an operation via a UI screen (not shown) to specify the area to be processed by character recognition, and associates the field name used to identify the specified area information with the button ID.

[0081] Furthermore, after setting the output destination information for the file, the configuration file name, scan settings, field names, storage destination settings, etc., are associated with the button ID created for the new configuration file and stored in the data management unit 524. Then, the process returns to step S614.

[0082] When a selection of a configuration file is received in step S603, the process proceeds to step S605. In step S605, a message (not shown) prompting the user to place the original document to be scanned on the document tray or ADF is displayed. When a button (not shown) indicating that scanning should be performed is pressed, a scan execution command is received.

[0083] When the display control unit 521 receives a scan execution command in step S605, the process proceeds to step S606. In step S606, the external cooperation unit 527 sends a scan execution processing request, including information about the scan settings, to the scanner 110.

[0084] In step S607, the external collaboration unit 427 of the scanner 110 receives the scan execution processing request sent in step S606. The external collaboration unit 427 sends the scan execution processing request received from the user terminal 120 to the scan execution unit 411.

[0085] In step S608, the scanning execution unit 411 of the scanner 110 scans the sheet placed on the original document stage or ADF and stores the acquired scanned image data in the image data storage unit 412.

[0086] In step S609, the external collaboration unit 427 sends the scanned image data stored in the image data storage unit 412 to the external collaboration unit 527 of the user terminal 120.

[0087] In step S610, the external cooperation unit 527 of the user terminal 120 receives the scanned image data sent from the scanner 110 and stores the scanned image data in the HDD 314 of the user terminal 120.

[0088] In step S611, the image processing unit 523 of the user terminal 120 reads the scanned image data from the HDD 314 and performs character recognition processing on the scanned image data. Character recognition processing is performed on the rectangular area represented by the character recognition area information 904 in the configuration file information management table 900 obtained by the data management unit 524.

[0089] In step S620, the display control unit 521 performs screen display processing on the main panel 700 of the scanning application based on the character recognition result. In step S611, it is determined whether an error exists based on the character recognition result. If an error exists, the display control unit 521 displays a thumbnail image with the error on the thumbnail panel 704; otherwise, if no error exists, the display control unit 521 displays a thumbnail image without the error on the thumbnail panel 704.

[0090] In step S612, the image processing unit 523 of the user terminal 120 determines whether there is an error indicating whether a string was acquired in the character recognition processing performed in step S611. If an error is determined to exist, the page number and error type of the detected error are associated with each other and stored in the data management unit 524.

[0091] If an error is determined to exist in step S612 (Yes in step S612), the display control unit 521 of the user terminal 120 displays in step S613. Figure 7B , Figure 8A or Figure 8B The image shown. Figure 7B A preview panel 701 is shown for displaying a preview of the scanned image.

[0092] The display control unit 512 displays a rectangular area 712 used in character recognition processing on the preview panel 701, overlapping with the preview screen. In this case, an example is shown where the string "XYZ Corporation" is expected to be detected in character recognition processing, but due to some factor, the string deviates from the previously specified coordinate position.

[0093] The display control unit 512 displays a field panel 703 for displaying the character recognition results for each character recognition region. The following areas are arranged in the field panel 703: The first area is the field name display area 731, which displays the field name. The second area is the character recognition image display area 732, which displays the image of the target region after character recognition processing. The third area is the area 733, which displays the string extracted as a result of character recognition processing.

[0094] exist Figure 7B In the example shown, due to some factor, the string deviated from the previously specified coordinate position, resulting in an error that the string could not be obtained in the character recognition process.

[0095] Therefore, in Figure 7B In the example shown, no image is displayed in character recognition image display area 732, and no string is displayed in area 733. Furthermore, a button 735 for storing the scan result image and a button 734 for canceling processing are shown. When button 735 is pressed, the scanned image is stored in the storage destination specified in storage destination setting 905 in the configuration file information management table 900, and processing returns to step S614. When button 734 is pressed, processing returns to step S614 without storing the scanned image.

[0096] Thumbnail panel 704 is used to display thumbnail images created by image processing unit 523 and error thumbnail panels. Display control unit 521 displays thumbnail images of scanned image data page by page as a list in thumbnail panel 704. Thumbnail image 742 is a thumbnail image of the scanned image currently displayed in preview panel 701. Thumbnail images are created by image processing unit 523.

[0097] The display control unit 521 checks for the presence of error information stored in the data management unit 524 and retrieves it. Figure 10A and Figure 10B The error message shown. In error message 1000, as error ID E1, the page number where the error occurred and the error type are stored. Figure 10B The error messages shown store the page number and error type for errors with error IDs E1, E2, and E3.

[0098] Figure 7B The example shown is in the case of an error message indicating that no string was detected on the first page. The display control unit 521 displays the error by highlighting the periphery of the thumbnail image of the first page 741 in color. In other words, in the display area showing the image data of the page where the error occurred, a screen is displayed with the periphery of the image data on the corresponding page colored. The shaded area around the thumbnail image of the first page means that the shaded area is colored.

[0099] As a result, since the first page of the scanned image is colored, the user can easily identify the error of being unable to retrieve the string by looking at the list of thumbnails displayed in the thumbnail panel 704.

[0100] Figure 8A and Figure 8B Examples of this are shown, in which a warning is displayed even if an error other than one in the character recognition processing is detected, with the periphery of the thumbnail image highlighted in color. Details are as described above.

[0101] Please note that, as Figure 8A As shown, a warning about an error message of type "missing string" can be displayed in at least one of messages 811 and 812.

[0102] In this way, when errors occur other than those in character recognition processing, such as double feeding, sheet creases, and blank sheets, the errors can be easily identified in the screen that displays the scanned images obtained by the scanner page by page, which improves convenience.

[0103] In this embodiment, a screen is displayed with the periphery of the page where the error occurred colored. This can be achieved in such a way that the display control unit 521 displays a screen in the display area showing image data of the page where the error occurred, with the back of the image data of the corresponding page colored.

[0104] If no error is determined in step S612 (No in step S612), in step S615, the display control unit 521 displays an error-free thumbnail image in the thumbnail panel 704. In this case, the string "XYZ Corporation" (not shown) is included in the rectangular area 712 used in the character recognition processing in the preview panel 701. Furthermore, an image of "XYZ Corporation" is displayed in the character recognition image display area 732 in the field panel 703, and the string "XY Corporation" (not shown) is displayed in the area 733 used to display the extracted string.

[0105] As mentioned above, in a screen that displays scanned images obtained by a scanner page by page, it is easy to identify failures in character recognition processing to obtain strings, which improves convenience.

[0106] <Other Embodiments>

[0107] This disclosure can be implemented by providing a program that implements one or more functions of the above embodiments to a system or device via a network or storage medium, and having one or more processors of the system or device's computer read and execute the program. Alternatively, this disclosure can be implemented by circuitry (e.g., an application-specific integrated circuit (ASIC) or a field-programmable gate array (FPGA)) that implements one or more functions.

[0108] The application according to this embodiment can provide a mechanism that displays a screen that facilitates understanding which page of image data among multiple pages obtained through scanning has what type of error.

[0109] Other implementation methods

[0110] The embodiments of this disclosure can also be implemented by a computer in a system or apparatus that reads and executes computer-executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more fully referred to as a "non-transitory computer-readable storage medium") to perform one or more functions of the above embodiments, and / or includes circuitry (e.g., application-specific integrated circuits (ASICs)) for performing one or more functions of the above embodiments, and by methods executed by the computer in the system or apparatus, such as reading and executing computer-executable instructions from the storage medium to perform one or more functions of the above embodiments and / or controlling one or more circuits to perform one or more functions of the above embodiments. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessor unit (MPU)) and may include separate computers or networks of separate processors to read and execute computer-executable instructions. The computer-executable instructions may be provided to the computer, for example, from a network or storage medium. The storage medium may include, for example, a hard disk, random access memory (RAM), read-only memory (ROM), the memory of a distributed computing system, an optical disk (such as an optical disc (CD), a digital versatile optical disc (DVD), or a Blu-ray disc (BD)). TM One or more of the following: flash memory devices, memory cards, etc.

[0111] While this disclosure has been described with reference to embodiments, it should be understood that this disclosure is not limited to the disclosed embodiments. The scope of the following claims should be given the broadest interpretation to cover all such modifications and equivalent structures and functions.

Claims

1. A non-transitory computer-readable storage medium storing a computer program for performing a method of controlling an information processing apparatus, the method comprising: The screen displays image data from multiple pages obtained through scanning, presented as a list. Specifically, if a string is identified from a previously specified region in the image data, the identified string is displayed on the screen; otherwise, if no string is identified from the region, a warning is displayed on the screen. Specifically, in the display area of ​​the image data on the page where the error occurred during scanning, the screen is displayed with the edges of the image data on the page colored in a color corresponding to the error type. In the display area, various types of errors that occur during scanning are colored with different corresponding colors.

2. The non-transitory computer-readable storage medium according to claim 1, wherein, The warning is a message indicating that a string was not recognized from the previously specified area.

3. The non-transitory computer-readable storage medium according to claim 2, in, If a string is identified from a previously specified region in the image data, the identified string is displayed in a field shown on the screen. In cases where no string is identified from the region, the warning is displayed in association with the field.

4. The non-transitory computer-readable storage medium according to claim 1, in, The various types of errors include errors where the string type is not identified from the previously specified region, and The warning is displayed by coloring the periphery of the image data on the page, which includes the previously specified area, with a color corresponding to the error type.

5. The non-transitory computer-readable storage medium according to claim 1, wherein, The various types of errors include errors where the original document to be scanned is folded during the scan.

6. The non-transitory computer-readable storage medium according to claim 1, wherein, The various types of errors include those where the original being scanned overlaps with another original during scanning.

7. The non-transitory computer-readable storage medium according to claim 1, wherein, The various types of errors include errors where the original document to be scanned is a blank sheet.

8. An information processing apparatus, comprising: The display unit is configured to display a screen in which image data from multiple pages obtained through scanning is displayed as a list. Specifically, if a string is identified from a previously specified region in the image data, the identified string is displayed on the screen; otherwise, if no string is identified from the region, a warning is displayed on the screen. Specifically, in the display area of ​​the image data on the page where the error occurred during scanning, the screen is displayed with the edges of the image data on the page colored in a color corresponding to the error type. In the display area, various types of errors that occur during scanning are colored with different corresponding colors.

9. A method for controlling an information processing device, the method comprising: The screen displays image data from multiple pages obtained through scanning, presented as a list. Specifically, if a string is identified from a previously specified region in the image data, the identified string is displayed on the screen; otherwise, if no string is identified from the region, a warning is displayed on the screen. Specifically, in the display area of ​​the image data on the page where the error occurred during scanning, the screen is displayed with the edges of the image data on the page colored in a color corresponding to the error type. In the display area, various types of errors that occur during scanning are colored with different corresponding colors.

Images