Information Processing Apparatus, Control Method, and Application
Patent Information
- Application Number
- JP2024166281
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-25
- Publication Date
- 2025-05-22
- Estimated Expiration
- 2040-01-21
AI Technical Summary
Users face difficulty in understanding the correspondence between text blocks and setting items on a UI screen with a preview pane and a property pane during document digitization, especially when multiple text blocks and setting items are present.
A user interface system is implemented with a preview pane and a property pane, where a label indicating the associated setting item is displayed for the selected text block, enhancing visibility of the association through visual cues like color or tool tips.
The system allows users to easily understand the correspondence between text blocks and setting items, facilitating efficient document digitization by clearly associating text blocks with their respective metadata fields.
Smart Images
Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a graphical user interface (GUI) for use in digitizing and utilizing documents. [Background technology]
[0002] Conventionally, optical character recognition (OCR) processing is performed on a scanned image obtained by scanning a document such as an order form to extract character strings, which are then used for file names, etc. Patent Document 1 discloses a technology for extracting character strings containing a specific key from character strings contained in a document image, automatically generating a file name, and presenting the file name to a user together with a preview display of the document image. This technology allows a user to easily set a file name while checking the document image. Character strings extracted from a scanned image are also stored and managed as metadata, and used for file names, etc. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2019-115011 A Summary of the Invention [Problem to be solved by the invention]
[0004] A two-pane configuration consisting of a preview pane and a property pane is well known as a UI screen configuration of an application when setting a file name and metadata using a recognized character string obtained by OCR processing. Here, the preview pane is an area for previewing the scanned image to be digitized, and the property pane is an area for displaying a list of the contents of properties such as the file name and metadata. When digitizing documents such as purchase orders and invoices, the scanned image contains multiple character areas (text blocks), and the preview pane allows the user to visually check each text block. In addition, the property pane allows the user to check the contents of various setting items such as "Customer Name", "Date", and "Address". For example, in the above two-pane UI screen, a user selects the text block "XYZ Corporation" in the preview pane for the setting item "Customer Name" in the property pane. As a result, the recognized character string "XYZ Corporation" in the scanned image is saved in association with the setting item "Customer Name". In this case, if there are multiple text blocks in the preview pane and multiple setting items in the property pane, it is difficult for the user to immediately understand which text block is associated with which setting item.
[0005] This invention has been made in consideration of the above-mentioned problems, and aims to enable users to easily understand the correspondence between text blocks and setting items on a UI screen having a preview pane and a property pane. [Means for solving the problem]
[0006] The image processing system for digitizing documents according to the present disclosure comprises a display means for displaying a user interface screen for setting properties for a scanned image obtained by scanning the document, and a control means for controlling the display on the user interface screen, wherein the user interface screen has at least a preview pane which is an area for previewing the scanned image, and a property pane which is an area for inputting setting values for each setting item of the properties, and when an operation event of a selection operation on any text block in the scanned image previewed in the preview pane is detected, the control means displays, for that text block, a label indicating the setting item associated with the text block in which the operation event was detected, among the setting items displayed in the property pane. Effect of the Invention
[0007] According to the technology of the present disclosure, a user can easily grasp the correspondence between text blocks and setting items on a UI screen having a preview pane and a property pane. [Brief description of the drawings]
[0008] [Figure 1] A diagram showing the overall configuration of an image processing system. [Diagram 2] A block diagram showing a hardware configuration of an information processing device. [Diagram 3] A diagram showing the software configuration of the image processing system. [Figure 4] A diagram explaining the state transitions of the UI screen [Diagram 5] A diagram explaining the state transitions of the UI screen [Figure 6] Flowchart showing the flow of UI screen control processing [Figure 7] Flowchart showing the flow of UI screen control processing [Figure 8] A diagram explaining the state transitions of the UI screen [Figure 9]1A to 1C are diagrams showing an example in which unique information associated with a setting item is displayed together with the item name. [Figure 10] A diagram explaining the state transitions of the UI screen [Figure 11] Flowchart showing the flow of UI screen control processing DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. Note that the following embodiments do not limit the invention according to the claims, and all of the combinations of features described in the embodiments are not necessarily essential to the solution of the invention.
[0010] [Embodiment 1] <System configuration> FIG. 1 is a diagram showing the overall configuration of an image processing system for digitizing documents according to this embodiment. The image processing system includes a scanned document processing server 111, a client terminal 121, and a business server 131. The client terminal 121 is communicably connected to the scanned document processing server 111 and the business server 131 via a network 101 such as the Internet or an intranet. The client terminal 121 may be a personal computer, a laptop computer, a tablet computer, a smartphone, or an MFP (Multifunction Peripheral) equipped with a scanner function. The configuration of the image processing system shown in FIG. 1 is an example, and is not limited thereto. For example, the client terminal 121 may also have the function of the scanned document management server 111. In the following description, a scanned image obtained by scanning a document to be processed such as an estimate is called a "scanned document."
[0011] <Hardware configuration> FIG. 2 is a block diagram showing the hardware configuration of the scan document processing server 111, the client terminal 121, and the business server 131 as information processing devices. The user interface (UI) 201 is realized by a display, a keyboard, a mouse, buttons, a touch panel, etc., and inputs and outputs information and signals. A computer that does not have these hardware can be connected and operated from another computer by remote desktop, remote shell, etc. The network interface 202 connects to the network 101 and communicates with other information processing devices and network devices (not shown). The communication method may be either wired or wireless. The CPU 203 is a calculation device that controls the entire device, and executes programs read from the ROM 204, RAM 205, secondary storage device 206, etc. The ROM 204 records the embedded programs and various data. The RAM 205 temporarily stores various data and also functions as a work memory for the CPU 203. The secondary storage device 206 is a large-capacity storage device represented by a HDD or a flash memory. The above-mentioned parts are mutually connected via an input / output interface 207.
[0012] <Software configuration> 3 is a diagram showing the software configuration of the image processing system according to this embodiment. Each software is installed in the above-mentioned scanned document processing server 111, client terminal 121, and business server 131, and executed by each CPU 203. Each software will be described below.
[0013] <Scan document processing server software> The scanned document processing application 311 is a Web application installed in the scanned document processing server 111. However, the application may be implemented in a form other than a Web application. The API 312 is an API (Application Programming Interface) provided by the scanned document processing application 311. The Web UI 313 is a Web user interface provided by the scanned document processing application 311.
[0014] The data store 321 is a storage area for saving and storing data used by the scanned document processing application 311 or the back-end application 331 described later. The data store 321 includes a scanned document storage unit 322, a scanned document job queue 323, a property management unit 324, and a scanned document processing result storage unit 325. The scanned document storage unit 322 converts the data of the scanned document itself into a file and stores it as an image file such as JPEG or a document file such as PDF (Portable Document Format). The scanned document job queue 323 holds a queue for managing jobs waiting for property input processing described later. The property management unit 324 stores information on properties such as file names, folder paths, and metadata that need to be added for each scanned document. Specifically, it manages a list of setting items, the names and value formats (character strings, numbers, etc.) for each setting item, and various information held for each setting item described later. The scanned document processing result storage unit 325 stores the results of OCR processing and the results of form discrimination. Furthermore, the scanned document processing result storage unit 325 stores, for each scanned document, character area information (text block information) associated with the setting items, set values, and the like.
[0015] The back-end application 331 is an application for executing background processing. The back-end application 331 is an application in charge of various processes that may be executed sequentially in the background, specifically, OCR processing, form processing, and communication processing. The OCR processing unit 332 acquires the scanned document to be processed from the scanned document storage unit 322, and executes OCR processing on the acquired scanned document. In the OCR processing, information for identifying each text block (specifically, information on the starting point coordinates, width, and height of a rectangular area) and information on the recognized character string for each text block are extracted. The form processing unit 333 uses the scanned document to be processed and information such as the arrangement pattern of the text block and the recognized character string obtained by the OCR processing to determine the type of the document (form) that was the subject of the scan. This determination processing may be any method such as pattern recognition or machine learning. The communication processing unit 334 executes a process of transmitting the scanned document and the analysis processing result thereof to the business server 131, which is an external device. When it is not necessary to transmit the scanned document and the analysis processing result thereof, the communication processing unit 334 can be omitted.
[0016] <Client terminal software> The client application 351 executes the Web application of the above-mentioned scan document processing application 311. For example, the Web application is executed by displaying the Web UI 313 in a Web browser and transmitting / receiving necessary data to / from the API 312.
[0017] <Business server software> The business application 361 is an application for supporting various business operations in a company, such as file management, document management, order taking, and accounting. The business data storage 362 stores various data used by the business application 361. The business application 361 receives the results of processing by the scanned document processing server 111, performs necessary processing on them, and stores them.
[0018] <Client application UI screen> Next, a description will be given of a user interface screen (hereinafter, referred to as a "UI screen") displayed on the user interface 201 of the client terminal 121. Fig. 4(a) shows an example of a UI screen displayed on the user interface 201 by the client application 351 according to this embodiment.
[0019] The UI screen shown in FIG. 4(a) is made up of two panes: a preview pane 401 and a property pane 411. Currently, a page image 402 of a scanned document of "PURCHASE ORDER" is previewed in the preview pane 401. In the preview pane 401, the page image 402 can be scrolled and zoomed to display any position in the page image 402. The property pane 411 is a pane for displaying and editing properties to be assigned to the scanned document to be processed. Items to be set as properties include parent items such as "file name," "folder path," and "metadata," as well as child items such as "company name," "date," and "address," which are elements that make up the parent items.
[0020] The UI screen in FIG. 4(a) is an example of a case where the form type of the scanned document to be processed is determined to be a "purchase order" in the form discrimination process. In the property pane 411, two setting items (major items) to be assigned to the scanned document are displayed: [FileName] and [Metadata]. For [FileName], two setting items (child items): "Customer Name" and "Date". For [Metadata], two setting items: "Company Name" and "Address". In the following description, a child item of the file name will be referred to as a "file name item", and a child item of the metadata will be referred to as a "metadata item".
[0021] FIG. 4(b) is a diagram for explaining an orthogonal coordinate system showing the relationship between the page image 402 and each text block. In FIG. 4(b), there are four text blocks 421, 422, 423, and 424. There are many more text blocks in the page image 402, but their description is omitted here. The text blocks detected by the OCR process are identified by their starting coordinates, width, and height, as shown by the shaded rectangles. For example, the text block 423 corresponding to the character string "XYZ Corporation" is expressed in units of pixels as "start coordinates (1200, 700)," "width: 720," and "height: 120."
[0022] FIG. 5 is a diagram for explaining a state in which text blocks in the page image 402 are associated with respective small items for each of two major items [FileName] and [Metadata] in the UI screen of FIG. 4(a). Now, a text block 423 corresponding to the character string “XYZ Corporation” in the page image 402 is associated with the file name item “Customer Name”. And, so that the user can easily identify it, for example, a colored rectangle is transparently superimposed and displayed on the text block 423. Note that instead of the transparent superimposed display, a superimposed display of a colored frame line or the like may be performed. The horizontally long rectangles 510a, 510b, 520a, 520b in the property pane 411 are display fields for displaying and editing setting values and the like of each sub-item for each major item such as a file name and metadata. And, the horizontally long rectangles 511a, 511b, 521a, 522b in each display field are areas (cropped image areas) where an image (an image cropped from the page image 402) of a portion corresponding to the text block selected by the user is displayed. In the example of FIG. 5, since the text block 423 is associated with the file name item “Customer Name”, a partial image of the text block 423 is displayed in the cropped image area 511a. At a stage where no text block is associated, a “+” button is displayed as in the cropped image areas 511b, 521a, 521b. The horizontally long rectangles 512a, 512b, 522a, 522b below each cropped image area are editing areas where a recognized character string included in the text block related to the user selection is input, and the user can edit it with a soft keyboard (not shown) or the like.
[0023] <UI Screen Control Process> Next, a control process of associating text blocks with each metadata item on the UI screen, which is performed by the client application 351 of the client terminal 121, will be described with reference to the flowchart of FIG. 6. Prior to the start of execution of the flow shown in FIG. 6, first, a queue of items waiting to be processed is provided to the client application 351 by the scan document processing application 311 of the scan document processing server 111. When a user selects a job of a scan document to be processed using the client application 351, the scan document processing application 311 acquires necessary information corresponding to the selected scan document from the data store 321. Specifically, the scan document processing application 311 acquires a corresponding image file from the scan document storage unit 322, and an associated OCR processing result and a form discrimination processing result from the scan document processing result storage unit 325. Furthermore, the scan document processing application 311 acquires a list of setting items for each form type and assigned color information for identifying a predetermined item color assigned in advance for each sub-item from the property management unit 324. The scan document processing application 311 provides the acquired data to the client application 351, and the flow shown in FIG. 6 starts. In the following description, the symbol "S" represents a step. In S601, data of the page image and OCR processing results (recognized character strings) to be displayed in the preview pane 401 are loaded. In the following S602, a list of setting items and color information assigned to each of their sub-items are loaded. In the next S603, the contents of the data loaded in S601 and S602 are reflected on the UI screen. Specifically, the page image is displayed in the preview pane 401, and the contents of each setting item (major items and minor items) included in the list of setting items are displayed in the property pane 411. The processing of S601 to S603 up to this point results in the UI screen state shown in FIG. 4.
[0024] Then, in S604, an operation event of a selection operation of the "+" button in the cut image area 511b, 521a, 521b in any of the subitems in the property pane 411 is detected. This selection operation is, for example, an operation in which the user touches with a finger or a touch pen, or an operation in which the user clicks with a mouse. In this way, one subitem (here, a file name item or a metadata item) related to the user's selection is determined from the subitems displayed in the property pane 411. Hereinafter, the subitem selected by the user is referred to as the "selected subitem (selected file name item or selected metadata item)". In the following S605, a highlighting process is performed on the display field of the selected subitem determined in S604, for example by changing the background color or thickening the frame. This makes it easier for the user to identify the selected subitem.
[0025] Then, in S606, an operation event of a selection operation on any of the text blocks present in the page image 402 in the preview pane 401 is detected. In this way, any one of one or more text blocks included in the page image is selected. Hereinafter, the text block selected by the user is referred to as a "selected text block." In the following S607, the selected text block determined in S606 is highlighted, for example by adding a colored frame. This makes it easier for the user to identify the selected text block. In S608, a cut image corresponding to the selected text block is displayed in a cut image area in the selected metadata item, and a recognized character string included in the selected text block is displayed in an editing area of the selected metadata item. By the processes in S604 to S608 up to this point, for example, when a text block is selected for the subitem "Customer Name," the UI screen is in a state as shown in FIG. 5. That is, the setting item selected by the user is associated with the text block, and it is determined which text block is used to input the character string to be used for the selected setting item.
[0026] When the above process is completed for all the setting items in the setting item list and the user selects the "Register" button 524, a property registration request such as a file name is sent to the scanned document processing server 111 in S609. This property registration request includes information associating the edited values of all the setting items with the text blocks. In the scanned document processing server 111, the scanned document processing application 311 stores the above information included in the property registration request received from the client terminal 121 in the scanned document processing result storage unit 325. At this time, if the property is to be registered by an external business server 131, the property registration request is transferred to the business server 131 via the communication processing unit 334. After completing all the necessary processes, the scanned document processing application 311 dequeues the queue from the scanned document job queue 323. This ends the process.
[0027] The above is an outline of the flow of the UI screen control process in the client application 351 according to this embodiment.
[0028] <UI control when an associated text block is selected> Next, the UI control process when the user performs a selection operation on a text block in the preview pane before the above-mentioned registration process of S609 is performed will be described with reference to the flowchart in Fig. 7. Now, according to the flow in Fig. 6, the minor item "Customer Name" of the major item "FileName" is associated with text block 423, and the UI screen is in the state shown in Fig. 5.
[0029] With the UI screen in the state shown in Fig. 5, it is assumed that a selection operation has been performed on one of the text blocks in the preview pane 401. The selection operation here may be a touch operation with a finger or the like, a click operation with a mouse, or an operation of hovering a finger or a touch pen directly above the text block or an operation of placing the mouse over it. A hover operation is an operation in which, with the finger removed from the touch panel, it is regarded as touching a button or the like directly below the finger. A mouse over operation is an operation in which the cursor is placed over a button or the like.
[0030] In S701, an operation event of the above-mentioned selection operation by the user is detected. Here, it is assumed that an operation event for the text block 423 of "XYZ Corporation" has been detected. In the following S702, it is determined whether or not there is a setting item already associated with the text block selected by the user. If the determination result is "No", this process ends. On the other hand, if the determination result is "Yes", the process proceeds to S703. Now, setting items (major item "FileName" and minor item "Customer Name") are already associated with the text block 423 of "XYZ Corporation" selected by the user. Therefore, the determination result in this case is "Yes", and the process proceeds to S703.
[0031] In S703, information about the selected text block is obtained. Specifically, the information includes coordinate information that can identify its position (e.g., coordinate information about the start point of the block), size information that can identify its size (e.g., width and height information), and information about the recognized character string obtained by OCR processing. In this case, the information about the text block 423 that is obtained is "start coordinates (1200, 700)", "width: 720", "height: 120", and "recognized character string: XYZ Corporation".
[0032] In the next step S704, information on the start coordinates, width, and height of the text block already associated with each setting item in the property pane 411, and information on the recognition character string are acquired for each setting item. Currently, in the UI screen shown in Fig. 5, the only setting item that has already been associated with a text block and has a character string displayed in the editing area is "Customer Name." Therefore, information on the text block 423 associated with that setting item (i.e., the same information as acquired in S703) is acquired.
[0033] In the next step S705, among the setting items in the property pane 411, setting items that are already associated with the same text block as the selected text block are identified. When identifying the setting items, the information acquired in S703 is compared with the information acquired in S704. Then, setting items that are associated with a text block whose information matches the information acquired in S703 are identified. In this case, the setting item "Customer Name" that is already associated with the text block 423 is identified.
[0034] Then, in S706, a label indicating the setting item identified in S705 is displayed for the selected text block. At this time, if the selection operation detected in S701 is a hover operation or a mouse-over operation, the label is displayed in a so-called tool tip format only while the finger or cursor is staying on the text block. The UI screen shown in FIG. 8 shows a state in which a label is displayed in a balloon shape at a certain distance above the text block 423, which is the selected text block. Since the text block 423 is already associated with the subitem "Customer Name" of the main item "FileName", a label 801 including the character string "Customer Name" is displayed as a label indicating this fact. Note that the display position and shape of the label are arbitrary as long as the user can recognize that it has been performed for the selected text block. In the example of FIG. 8, only the name of the subitem is displayed as the content of the label display, but the content of the main item may be displayed together with the subitem (or instead of the subitem).
[0035] Furthermore, item color areas 1010a, 1010b, 1020a, and 1020b may be provided in each display field 510a, 510b, 520a, and 520b as shown in FIG. 10, and item colors assigned to each item may be displayed. In that case, the label 801 in FIG. 8 may display the setting items associated with the selected text block and their item colors as shown in FIG. 9(a). Also, instead of the item color areas, an identifier (a number indicating a number or an arbitrary character string (ID)) for identifying each item may be displayed for each display field 510a, 510b, 520a, and 520b. In that case, as shown in FIG. 9(b) to (c), the label 801 in FIG. 8 may display unique identifiers associated with each setting item together with the item names. FIG. 9(b) shows a label to which numbers assigned in order to the setting items are added, and FIG. 9(c) shows a label to which a character string (ID) for identifying the setting items is added.
[0036] The UI screen shown in FIG. 10 shows an example of label display when a user selects a text block in a situation where the text block is associated with a plurality of different setting items. In the example of FIG. 10, a text block 1001 including a character string "XYZ Corporation" is associated with two sub-items, "Customer Name" and "Company". Therefore, a label 1002 is displayed indicating that the text block is associated with these two setting items. In addition to the item names of the two setting items, the label 1002 also includes a patch 1003 indicating the unique item color assigned to each setting item. By displaying the label in this manner, the user can easily grasp the correspondence between the text block and the setting items even in the case of 1:N association.
[0037] In addition, in the UI screen shown in FIG. 10, there are item color areas 1010a, 1010b, 1020a, and 1020b in each display field 510a, 510b, 520a, and 520b that display the color (item color) assigned to each setting item so that the user can distinguish it. In the example of FIG. 10, text blocks 1001, 1004, and 1005 are colored by the color assigned to the associated setting item. Note that since the text block 1001 is associated with two setting items ("Customer Name" and "Company Name"), it is colored by the item color of one of the two setting items. In the example of FIG. 10, an example is shown in which the text block 1001 is colored by the item color of the setting item (Customer Name) that is displayed at the top of the list of multiple setting items displayed in the property pane 411, but this is not limited to this. For example, it may be colored by the item color of the setting item displayed at the bottom of the list. Also, the item colors of the associated multiple setting items may be displayed. For example, the text block 1001 may be divided into stripes and colored with the item colors of the corresponding multiple setting items (for example, the upper half of the text block 1001 may be colored with the item color of Customer Name, and the lower half may be colored with the item color of Company Name).
[0038] <UI control when an associated setting item is selected> Next, the UI control process when the user performs a selection operation on a setting item in the property pane before the above-mentioned registration process of S609 is performed will be described with reference to the flowchart of Fig. 11. Here too, it is assumed that the subitem "Customer Name" of the major item "FileName" is associated with text block 423 according to the flow of Fig. 6, and the UI screen is in the state shown in Fig. 5.
[0039] 5, it is assumed that a selection operation is performed on one of the setting items in the property pane 411. The selection operation here may be a touch operation with a finger or the like, a click operation with a mouse, or an operation of hovering a finger or a touch pen directly over the setting item or an operation of placing the mouse over it.
[0040] In S1101, an operation event of the above-mentioned selection operation by the user is detected. Here, it is assumed that an operation event on the cutout image area 511a of the setting item "Customer Name" is detected. In the following S1102, the display field of the selected setting item is highlighted. Here, the display field 501a of the sub-item "Customer Name", which is the selected setting item, is highlighted.
[0041] In S1103, it is determined whether or not there is a text block already associated with the setting item selected by the user. If the determination result is "No", this process ends. On the other hand, if the determination result is "Yes", the process proceeds to S1104. Now, a text block 423 containing the character string "XYZ Corporation" is already associated with the setting item "Customer Name" selected by the user. Therefore, the determination result in this case is "Yes", and the process proceeds to S1104.
[0042] In S1104, information on the text block associated with the selected setting item, specifically, information on the start coordinate, width, height, and recognition character string, is obtained. Here, "start coordinate (1200, 700)", "width: 720", "height: 120", and "recognition character string: XYZ Corporation" are obtained as information on the text block 423.
[0043] In the next step S1105, similar to the above-mentioned step S706, a label indicating the selected setting item is displayed for the text block associated with the selected setting item based on the information acquired in step S1104. At this time, if multiple setting items are associated with the text block associated with the selected setting item, the multiple setting items associated with the text block are displayed, similar to label 1002 in FIG.
[0044] The above is the details of the UI screen control process in the client application 351 according to this embodiment.
[0045] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
Claims
1. A display control means for displaying an image on a display means; A receiving means for receiving, on the image, a designation of an area within the image; having the display control means, when receiving a designation of a first area on the image from the receiving means while displaying the image, displays character strings within the first area in a first field outside the image, and when receiving a designation of a second area on the image from the receiving means, displays character strings within the second area in a second field outside the image; Within the image and outside the image, in addition to the character strings in the first area and the character strings in the second area, an indication indicating that the first area and the first column correspond to each other, and an indication indicating that the second area and the second column correspond to each other are provided.
23. An information processing apparatus comprising:
2. the character string in the first area is a character string recognized from the image by a character recognition process for the first area in the image, the character string in the second region is a character string recognized from the image by a character recognition process for the second region in the image; 2. The information processing apparatus according to claim 1,
3. The first and second fields are used to generate a file name for a file containing an image.
3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.
4. The first and second regions are used to generate metadata about the image.
3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.
5. a display control means for displaying a scanned image obtained by scanning a document on a display means; A receiving means for receiving, on the scanned image, a designation of an area within the scanned image; having the display control means, when the reception means receives a designation of a first area on the scanned image in a state in which the scanned image is displayed, displays character strings within the first area in a first field outside the scanned image, and when the reception means receives a designation of a second area on the scanned image, displays character strings within the second area in a second field outside the scanned image; Within the scanned image and outside the scanned image, in addition to the character strings in the first area and the character strings in the second area, an indication indicating that the first area and the first column correspond to each other and an indication indicating that the second area and the second column correspond to each other are provided.
23. An information processing apparatus comprising:
6. the character string in the first area is a character string recognized from the scanned image by a character recognition process on the first area in the scanned image, the character string in the second area is a character string recognized from the scanned image by a character recognition process for the second area in the scanned image; 6. The information processing apparatus according to claim 5,
7. The first and second fields are used to generate a file name for a file containing a scanned image.
7. The information processing apparatus according to claim 5, wherein the information processing apparatus is a computer.
8. The first and second regions are used to generate metadata about the scanned image.
7. The information processing apparatus according to claim 5, wherein the information processing apparatus is a computer.
9. The indication indicating that the first region and the first column correspond to each other and the indication indicating that the second region and the second column correspond to each other are different indications.
9. The information processing apparatus according to claim 1,
10. The first area and the second area are designated by different user operations.
10. The information processing apparatus according to claim 1,
11. A frame is displayed in each of the first area and the second area.
11. The information processing apparatus according to claim 1,
12. As an indication that the first region and the first column correspond to each other, the same first identification information is displayed in association with the first region and the first column, As an indication that the second area and the second column correspond to each other, the same second identification information is displayed in association with the second area and the second column, respectively.
12. The information processing apparatus according to claim 1,
13. The same first identification information is displayed one near the first region and one near the first column, The same second identification information is displayed one near the second region and one near the second column.
13. The information processing apparatus according to claim 12.
14. the same first identification information is displayed in association with the first area when a user operation is being performed on the first area; The second identification information is displayed in association with the second area when a user operation is performed on the second area.
14. The information processing apparatus according to claim 12 or 13.
15. the first identification information is displayed in a tooltip format in association with the first region; The second identification information is displayed in a tooltip format in association with the second area.
15. The information processing apparatus according to claim 12,
16. As a display indicating that the first region and the first column correspond to each other, the first region and the first column are displayed in a color that is distinguishable from the second region and the second column.
12. The information processing apparatus according to claim 1,
17. a display control procedure for displaying an image on a display means; a receiving step of receiving, on the image, a designation of an area within the image; having In the display control step, when a designation of a first area on the image is accepted in the reception step, while the image is being displayed, a character string within the first area is displayed in a first field outside the image, and when a designation of a second area on the image is accepted in the reception step, a character string within the second area is displayed in a second field outside the image; Within the image and outside the image, in addition to the character strings in the first area and the character strings in the second area, an indication indicating that the first area and the first column correspond to each other, and an indication indicating that the second area and the second column correspond to each other are provided. A control method comprising:
18. a display control procedure for displaying a scanned image obtained by scanning a document on a display means; a receiving step of receiving, on the scanned image, a designation of an area within the scanned image; having In the display control step, when a designation of a first area on the scanned image is accepted in the reception step, while the scanned image is being displayed, a character string within the first area is displayed in a first field outside the scanned image, and when a designation of a second area on the scanned image is accepted in the reception step, a character string within the second area is displayed in a second field outside the scanned image. Within the scanned image and outside the scanned image, in addition to the character strings in the first area and the character strings in the second area, an indication indicating that the first area and the first column correspond to each other and an indication indicating that the second area and the second column correspond to each other are provided. A control method comprising:
19. A display control means for displaying an image on a display means; A receiving means for receiving, on the image, a designation of an area within the image; An application for causing an information processing device to function as the display control means, when receiving a designation of a first area on the image from the receiving means while displaying the image, displays character strings within the first area in a first field outside the image, and when receiving a designation of a second area on the image from the receiving means, displays character strings within the second area in a second field outside the image; Within the image and outside the image, in addition to the character strings in the first area and the character strings in the second area, an indication indicating that the first area and the first column correspond to each other, and an indication indicating that the second area and the second column correspond to each other are provided. An application characterized by:
20. the character string in the first area is a character string recognized from the image by a character recognition process for the first area in the image, the character string in the second region is a character string recognized from the image by a character recognition process for the second region in the image; 20. The application of claim 19 .
21. The first and second fields are used to generate a file name for a file containing an image.
21. Application according to claim 19 or 20.
22. The first and second regions are used to generate metadata about the image.
21. Application according to claim 19 or 20.
23. a display control means for displaying a scanned image obtained by scanning a document on a display means; A receiving means for receiving, on the scanned image, a designation of an area within the scanned image; An application for causing an information processing device to function as the display control means, when the reception means receives a designation of a first area on the scanned image in a state in which the scanned image is displayed, displays character strings within the first area in a first field outside the scanned image, and when the reception means receives a designation of a second area on the scanned image, displays character strings within the second area in a second field outside the scanned image; Within the scanned image and outside the scanned image, in addition to the character strings in the first area and the character strings in the second area, an indication indicating that the first area and the first column correspond to each other and an indication indicating that the second area and the second column correspond to each other are provided. An application characterized by:
24. the character string in the first area is a character string recognized from the scanned image by a character recognition process on the first area in the scanned image, the character string in the second area is a character string recognized from the scanned image by a character recognition process for the second area in the scanned image; 24. The application of claim 23.
25. The first and second fields are used to generate a file name for a file containing a scanned image.
25. Application according to claim 23 or 24.
26. The first and second regions are used to generate metadata about the scanned image.
25. Application according to claim 23 or 24.
27. The indication indicating that the first region and the first column correspond to each other and the indication indicating that the second region and the second column correspond to each other are different indications.
27. An application according to any one of claims 19 to 26.
28. The first area and the second area are designated by different user operations.
28. An application according to any one of claims 19 to 27.
29. A frame is displayed in each of the first area and the second area.
29. An application according to any one of claims 19 to 28.
30. As an indication that the first region and the first column correspond to each other, the same first identification information is displayed in association with the first region and the first column, As an indication that the second area and the second column correspond to each other, the same second identification information is displayed in association with the second area and the second column, respectively.
30. An application according to any one of claims 19 to 29.
31. The same first identification information is displayed one near the first region and one near the first column, The same second identification information is displayed one near the second region and one near the second column.
31. The application of claim 30 .
32. the same first identification information is displayed in association with the first area when a user operation is being performed on the first area; The second identification information is displayed in association with the second area when a user operation is performed on the second area.
32. Application according to claim 30 or 31.
33. the first identification information is displayed in a tooltip format in association with the first region; The second identification information is displayed in a tooltip format in association with the second area.
33. An application according to any one of claims 30 to 32.
34. As a display indicating that the first region and the first column correspond to each other, the first region and the first column are displayed in a color that is distinguishable from the second region and the second column.
30. An application according to any one of claims 19 to 29.
35. A display control means for displaying an image on a display means; A receiving means for receiving, on the image, a designation of an area within the image; An application for causing an information processing device to function as the display control means, when receiving a designation of a first area on the image from the receiving means while displaying the image, displays character strings within the first area in a first field outside the image, and when receiving a designation of a second area on the image from the receiving means, displays character strings within the second area in a second field outside the image; Within the image and outside the image, in addition to the character strings in the first area and the character strings in the second area, an indication indicating that the first area and the first column correspond to each other, and an indication indicating that the second area and the second column correspond to each other are provided. A program characterized by:
36. the character string in the first area is a character string recognized from the image by a character recognition process for the first area in the image, the character string in the second region is a character string recognized from the image by a character recognition process for the second region in the image; 36. The program of claim 35.
37. The first and second fields are used to generate a file name for a file containing an image.
37. The program according to claim 35 or 36.
38. The first and second regions are used to generate metadata about the image.
37. The program according to claim 35 or 36.
39. a display control means for displaying a scanned image obtained by scanning a document on a display means; A receiving means for receiving, on the scanned image, a designation of an area within the scanned image; A program for causing an information processing device to function as the display control means, when the reception means receives a designation of a first area on the scanned image in a state in which the scanned image is displayed, displays character strings within the first area in a first field outside the scanned image, and when the reception means receives a designation of a second area on the scanned image, displays character strings within the second area in a second field outside the scanned image; Within the scanned image and outside the scanned image, in addition to the character strings in the first area and the character strings in the second area, an indication indicating that the first area and the first column correspond to each other and an indication indicating that the second area and the second column correspond to each other are provided. A program characterized by:
40. the character string in the first area is a character string recognized from the scanned image by a character recognition process on the first area in the scanned image, the character string in the second area is a character string recognized from the scanned image by a character recognition process for the second area in the scanned image; 40. The program of claim 39.
41. The first and second fields are used to generate a file name for a file containing a scanned image.
41. The program according to claim 39 or 40.
42. The first and second regions are used to generate metadata about the scanned image.
41. The program according to claim 39 or 40.
43. The indication indicating that the first region and the first column correspond to each other and the indication indicating that the second region and the second column correspond to each other are different indications.
43. A program according to any one of claims 35 to 42.
44. The first area and the second area are designated by different user operations.
44. A program according to any one of claims 35 to 43.
45. A frame is displayed in each of the first area and the second area.
45. A program according to any one of claims 35 to 44.
46. As an indication that the first region and the first column correspond to each other, the same first identification information is displayed in association with the first region and the first column, As an indication that the second area and the second column correspond to each other, the same second identification information is displayed in association with the second area and the second column, respectively.
46. A program according to any one of claims 35 to 45.
47. The same first identification information is displayed one near the first region and one near the first column, The same second identification information is displayed one near the second region and one near the second column.
47. The program of claim 46.
48. the same first identification information is displayed in association with the first area when a user operation is being performed on the first area; The second identification information is displayed in association with the second area when a user operation is performed on the second area.
48. A program according to claim 46 or 47.
49. the first identification information is displayed in a tooltip format in association with the first region; The second identification information is displayed in a tooltip format in association with the second area.
49. A program according to any one of claims 46 to 48.
50. As a display indicating that the first region and the first column correspond to each other, the first region and the first column are displayed in a color that is distinguishable from the second region and the second column.
46. A program according to any one of claims 35 to 45.