Information processing system, computer readable medium, reading device, information processing method, and computer program product

Abstract

The present application provides an information processing system, a computer readable medium, a reading device and an information processing method. The information processing system has a processor that acquires recorded information from a reading image obtained by reading a plurality of recording media, and outputs information about the recording media for which acquisition of the recorded information has failed and / or the recording media for which the acquired recorded information does not satisfy a predetermined condition, the reading image including a plurality of medium images that are images representing each of the recording media, the recorded information being information recorded in each of the recording media.

Description

Technical Field

[0001] This disclosure relates to information processing systems, computer-readable media, reading devices, and information processing methods. Background Technology

[0002] Japanese Patent Application Publication No. 2018-116536 discloses an information analysis system in which an analysis device analyzes data read by a reading device, and displays at least a portion of the illustrations and text data received from the analysis device sequentially on a display device for each invoice.

[0003] Japanese Patent Application Publication No. 2019-145981 discloses a process that acquires one or more object images as the processing object, and selects a preferred service from a plurality of services for each object image as a suitable applicable service. Summary of the Invention

[0004] By reading recording media such as invoices and analyzing the images obtained through this reading, it is possible to acquire the information recorded in each recording medium.

[0005] Here, confirmation of whether information acquisition was appropriate can be made, for example, by the user referring to the reading results of the recording media. However, in this case, this confirmation needs to be made for each recording medium, which increases the user's workload when there are many recording media.

[0006] The purpose of this disclosure is to reduce the user's workload when reading multiple recording media to obtain the information recorded in each recording media, compared to situations where the user needs to refer to the reading results of the recording media to confirm whether the reading was appropriate.

[0007] According to a first aspect of this disclosure, an information processing system is provided, comprising a processor that acquires recorded information from readout images obtained by reading multiple recording media, the readout images comprising multiple medium images representing images of each recording medium in the recording media, the recorded information being information recorded on each recording medium in the recording media, and outputting information relating to the recording media in which recorded information was not acquired and / or the recording media in which the acquired recorded information does not meet predetermined conditions.

[0008] According to the second aspect of this disclosure, the processor outputs information related to the portion of the recording medium in which the acquisition of recording information was attempted but failed, and outputs information related to the portion of the recording medium in which the acquisition of recording information does not meet the predetermined conditions.

[0009] According to the third aspect of this disclosure, the processor outputs information related to the recording medium for which the acquisition of recorded information failed to be performed to the reading device that has read the multiple recording media, and outputs information related to the recording medium for which the acquisition of recorded information does not meet the predetermined conditions to the reading device.

[0010] According to the fourth aspect of this disclosure, information relating to the recording medium in which the acquisition of recorded information has failed is displayed on the reading device, and information relating to the recording medium in which the acquisition of recorded information does not meet the predetermined conditions is displayed on the reading device.

[0011] According to the fifth aspect of this disclosure, as information relating to the recording medium that failed to acquire recorded information, the processor outputs the medium image representing the recording medium to the reading device; as information relating to the recording medium that the acquisition of recorded information did not meet the predetermined conditions, the processor outputs the medium image representing the recording medium to the reading device.

[0012] According to the sixth aspect of this disclosure, the medium image is displayed on the reading device.

[0013] According to the seventh aspect of this disclosure, the reading device displays a screen for the user to input information recorded in the recording medium for which the acquisition of recorded information has failed, and the reading device also displays a screen for the user to input information recorded in the recording medium for which the acquisition of recorded information does not meet the pre-defined conditions.

[0014] According to the eighth aspect of this disclosure, the information processing system is configured to read the recording medium that failed to acquire recorded information using a different reading device than the reading device that has read the multiple recording media. The information processing system is configured to read the recording medium whose acquisition of recorded information does not meet the predetermined conditions using the other reading device. The processor also acquires information obtained by analyzing the reading results obtained by the other reading device on the recording medium whose acquisition of recorded information did not meet the predetermined conditions.

[0015] According to the ninth aspect of this disclosure, the other reading device is a reading device capable of reading at a reading resolution higher than that of the reading device.

[0016] According to the 10th aspect of this disclosure, the processor outputs information related to the recording medium for which the acquisition of recorded information failed to be performed to another reading device different from the reading device that performed the reading of the multiple recording media, and outputs information related to the recording medium for which the acquisition of recorded information does not meet the predetermined conditions to the other reading device.

[0017] According to the 11th aspect of this disclosure, the other reading device is a reading device capable of reading at a higher reading resolution than the reading resolution of the reading device.

[0018] According to the 12th aspect of this disclosure, the other reading device displays a screen for the user to input information recorded in the recording medium for which the acquisition of recorded information failed, and the other reading device displays a screen for the user to input information recorded in the recording medium for which the acquisition of recorded information did not meet the predetermined conditions.

[0019] According to the 13th aspect of this disclosure, the processor outputs information related to the recording medium for which the acquisition of recorded information has failed to be performed to a portable terminal device with a camera. The terminal device is a different device from the reading device that has read the multiple recording media. The processor outputs information related to the recording medium for which the acquisition of recorded information does not meet the predetermined conditions to the portable terminal device with a camera.

[0020] According to the 14th aspect of this disclosure, a computer-readable medium is provided, which stores a program for causing a computer to perform processing, wherein the processing includes the steps of: acquiring recording information from readout images obtained by reading multiple recording media, the readout images comprising multiple medium images representing images of each recording medium in the recording medium, the recording information being information recorded on each recording medium in the recording medium; and outputting information relating to the recording medium in which recording information was not acquired and / or the recording medium in which the acquired recording information does not meet predetermined conditions.

[0021] According to the 15th aspect of this disclosure, a reading device is provided, comprising: a reading unit capable of reading multiple recording media containing information, wherein the reading unit reads the multiple recording media such that, during the reading of the multiple recording media, recording information as the recorded information is acquired for each of the recording media; and a display unit displaying information relating to the following recording media among the multiple recording media read by the reading unit: a recording medium in which recording information was not acquired; and / or a recording medium in which the acquired recording information does not meet predetermined conditions.

[0022] According to the 16th aspect of this disclosure, an information processing method is provided, wherein the following processing is performed in the information processing method: acquiring recorded information from readout images obtained by reading multiple recording media, the readout images comprising multiple media images as images representing each recording medium in the recording media, the recorded information being information recorded on each recording medium in the recording media, and outputting information related to the recording medium in which recorded information was not acquired and / or the recording medium in which the acquired recorded information does not meet a predetermined condition.

[0023] (Effect)

[0024] According to the first or 16th scheme, compared with the situation where the user needs to refer to the reading results of the recording medium to confirm whether the reading is appropriate, the user's workload can be reduced when reading multiple recording media to obtain the information recorded in each recording medium.

[0025] According to the second scheme, the user can be notified of information related to the portion of the recording medium in which recording information was attempted to be acquired when it failed to be acquired, and the user can be notified of information related to the portion of the recording medium in which the acquisition of recording information did not meet the predetermined conditions.

[0026] According to the third scheme, information related to a recording medium in which information was not recorded in a plurality of recording media or information related to a recording medium in a plurality of recording media where the conditions for obtaining recorded information were not met can be provided to a reading device that has read the plurality of recording media.

[0027] According to the fourth scheme, information related to a recording medium in which information could not be recorded or information related to a recording medium in which the recording information could not be recorded according to a predetermined condition can be notified to the user via a reading device that has read the multiple recording media.

[0028] According to the fifth embodiment, a medium image representing a recording medium that failed to acquire recorded information or a medium image representing a recording medium whose acquisition of recorded information did not meet predetermined conditions can be provided to a reading device that has read the recording medium.

[0029] According to the sixth scheme, a media image of a recording medium indicating that the acquisition of recorded information failed or a media image of a recording medium indicating that the acquisition of recorded information did not meet the predetermined conditions can be notified to the user via a reading device that has read the recording medium.

[0030] According to the seventh scheme, it is possible to obtain information recorded in a recording medium in which the acquisition of recorded information has failed, and it is possible to obtain information recorded in a recording medium in which the acquisition of recorded information does not meet the pre-defined conditions.

[0031] According to the eighth scheme, the possibility of obtaining accurate recorded information can be improved compared to the following two cases: obtaining information by analyzing the reading results, which is obtained by using a reading device that has read a recording medium that failed to obtain recorded information; or obtaining information by analyzing the reading results, which is obtained by using a reading device that has read a recording medium that did not meet the predetermined conditions for recorded information.

[0032] According to the ninth solution, compared to other reading devices that read at a lower reading resolution than the reading resolution of the reading device, the possibility of obtaining accurate recorded information can be increased.

[0033] According to the 10th solution, information relating to a recording medium in which information was not recorded in a plurality of recording media or information relating to a recording medium in a plurality of recording media where the conditions for recording information was not met can be provided to a reading device other than the reading device that reads the plurality of recording media.

[0034] According to the 11th solution, information relating to a recording medium in which information was not recorded in a plurality of recording media or information relating to a recording medium in a plurality of recording media where the conditions for recording information was not met can be provided to another reading device different from the reading device that reads the plurality of recording media, wherein the other reading device can read at a higher reading resolution than the reading resolution of the reading device.

[0035] According to the 12th scheme, the user can input information recorded in a recording medium that failed to acquire recorded information via another reading device, and can input information recorded in a recording medium where the acquisition of recorded information does not meet the pre-defined conditions.

[0036] According to the 13th solution, information relating to a recording medium on which information was not recorded on a plurality of recording media or information relating to a recording medium on a plurality of recording media where the conditions for recording information was not met can be provided to a portable terminal device having a camera, wherein the terminal device is different from a reading device that reads the plurality of recording media.

[0037] According to the 14th scheme, compared with the situation where the user needs to refer to the reading results of the recording medium to confirm whether the reading is appropriate, the user's workload can be reduced when reading multiple recording media to obtain the information recorded in each recording medium.

[0038] According to the 15th scheme, compared with the situation where the user needs to refer to the reading results of the recording medium to confirm whether the reading is appropriate, the user's workload can be reduced when reading multiple recording media to obtain the information recorded in each recording medium. Attached Figure Description

[0039] Figure 1 This is a diagram showing the overall structure of the information processing system.

[0040] Figure 2 This is a diagram illustrating an example of the hardware structure of a management server.

[0041] Figure 3 This is a diagram illustrating an example of the hardware structure of a user terminal.

[0042] Figure 4 This diagram illustrates the functional components of an image forming apparatus.

[0043] Figure 5 This is the front view of the image forming apparatus.

[0044] Figure 6 This is a timing diagram illustrating the process executed by the information processing system, and is the timing diagram in the first embodiment.

[0045] Figure 7 This is a diagram showing an example of a display in the display section of an image forming apparatus.

[0046] Figure 8 This is a diagram illustrating the processing flow when user terminals are also used for invoice processing.

[0047] Figure 9 This is a diagram showing an example of a display in a user terminal.

[0048] Figure 10 This is a diagram showing an example of a display in the display section of an image forming apparatus. Detailed Implementation

[0049] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0050] Figure 1 This is a diagram showing the overall structure of the information processing system 1 according to this embodiment.

[0051] The information processing system 1 includes a management server 300, which is an example of an information processing device. Furthermore, an external server 400 is provided to receive information obtained through the management server 300. Additionally, the information processing system 1 includes user terminals 500 for each user and an image forming apparatus 600 with image reading capabilities.

[0052] exist Figure 1 The illustration is omitted, but multiple user terminals 500 and image forming apparatus 600 are respectively provided.

[0053] User terminal 500 may be, for example, a smartphone. Furthermore, user terminal 500 may be any device with a camera (photography function, image reading function), and may be, in addition to a smartphone, a tablet terminal with a camera, a camera with communication function, or a game console with both camera and communication function.

[0054] In this embodiment, the user terminal 500, the image forming apparatus 600, and the management server 300 are connected to each other via a communication line 310 such as an Internet line. Furthermore, the management server 300 and the external server 400 are also connected to each other via a communication line 320 such as an Internet line.

[0055] Figure 2 This is a diagram illustrating an example of the hardware structure of the management server 300.

[0056] The management server 300 includes: a control unit 101 that controls the operation of the entire device; a hard disk drive 102, which is an example of an information storage device for storing information; and a network interface 103 that enables communication via a LAN (Local Area Network) cable or the like.

[0057] The control unit 101 includes: a CPU (Central Processing Unit) 111, which is an example of a processor; a ROM (Read Only Memory) 112, which stores basic software or BIOS (Basic Input Output System); and a RAM (Random Access Memory) 113, which is used as a working area.

[0058] CPU 111 can also be multi-core. Furthermore, ROM 112 can be a rewritable non-volatile semiconductor memory. Control unit 101 is what is known as a computer.

[0059] In this embodiment, the CPU 111 executes the processing described later by executing a program stored in the ROM 112 or the like.

[0060] The hard disk drive 102 is a device for reading and writing data on a non-volatile storage medium on which a magnetic material is coated on the surface of a disk-shaped substrate. However, the non-volatile storage medium may also be a semiconductor memory or magnetic tape.

[0061] In addition, the management server 300 may also have input devices such as a keyboard and mouse, and display devices such as an LCD monitor, as needed.

[0062] The control unit 101, hard disk drive 102, and network interface 103 are connected via bus 104 or signal lines not shown.

[0063] Here, the program executed by CPU111 can be provided to management server 300 in the state stored in computer-readable recording media such as magnetic recording media (magnetic tape, disk, etc.), optical recording media (optical disc, etc.), optical-magnetic recording media, semiconductor memory, etc.

[0064] Furthermore, the program executed by CPU111 can also be provided to the management server 300 via communication means such as the Internet.

[0065] In addition, in this embodiment, processor refers to processor in a broad sense, including general-purpose processors (such as CPU: Central Processing Unit, etc.) and special-purpose processors (such as GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0066] Furthermore, the actions of the processor can be completed not only by a single processor, but also by multiple processors located in physically separate positions working together. Moreover, the order of the processor's actions is not limited to the order described in this embodiment and can be changed.

[0067] exist Figure 1 The diagram shows the functional units implemented via the CPU 111 of the management server 300. Additionally, in this... Figure 1 The diagram shows the functionalities related to reading invoices.

[0068] like Figure 1 As shown, the management server 300 has an invoice registration department 351, a failure location determination department 352, and an information acquisition department 353.

[0069] The invoice registration department 351 performs invoice-related processing, such as registering information obtained from the invoice (described later) to the external server 400.

[0070] The failure location determination unit 352 determines the location where the acquisition of information recorded in the invoice failed.

[0071] The information acquisition unit 353 includes an image separation unit 353A, an image rotation unit 353B, and an OCR unit 353C, which analyzes the images obtained by reading multiple invoices (described later) and extracts the information contained in each invoice.

[0072] Here, the invoice registration unit 351, the failure location determination unit 352, and the information acquisition unit 353 are implemented by the CPU 111 of the management server 300 executing a program stored in the ROM 112 or the like. Furthermore, the management server 300 of this embodiment has a plug-in for acquiring information from invoices, and in this embodiment, the information acquisition unit 353 is implemented using this plug-in.

[0073] In this embodiment, the processes performed by the management server 300 described below are performed by the CPU 111, which is an example of a processor. In other words, in this embodiment, the processes described below are performed by the CPU 111, which is an example of a processor, executing a program stored in the ROM 112, etc.

[0074] In other words, in this embodiment, the program stored in ROM 112 or the like is executed by CPU 111, which is an example of a processor. Figure 1 The invoice registration unit 351, the failure location determination unit 352, and the information acquisition unit 353 shown are all functional units. Furthermore, in this embodiment, the processing described below is performed by these functional units.

[0075] Figure 3This is a diagram illustrating an example of the hardware structure of the user terminal 500. Figure 3 The structure shown assumes that the user terminal 500 is a smartphone.

[0076] User terminal 500 includes: a control unit 201 for controlling the overall operation of the device; a memory card 202 for storing various data; various communication interfaces 203 according to wireless communication standards; input devices such as touch sensors 204; display devices such as liquid crystal displays or organic EL (Electro Luminescence) displays 205; a GPS (Global Positioning System) sensor 206; and a camera 207.

[0077] The control unit 201 includes a CPU 211, a ROM 212 storing firmware or BIOS, and a RAM 213 used as a working area. The CPU 211 may also be multi-core. Furthermore, the ROM 212 may be a rewritable non-volatile semiconductor memory.

[0078] Communication interface 203 is, for example, an interface used in a connection with a mobile communication system and an interface used in a connection with a wireless LAN.

[0079] GPS sensor 206 is a sensor that receives radio waves from GPS satellites to measure the location of user terminal 500. The latitude, longitude, and altitude information output from GPS sensor 206 provides the current location of user terminal 500. Additionally, GPS sensor 206 can also be used with indoor positioning systems.

[0080] The camera 207 is composed of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) and takes pictures of objects located around the user terminal 500.

[0081] Figure 4 This diagram shows the functional units of the image forming apparatus 600. Figure 5 This is the front view of the image forming apparatus 600.

[0082] The image forming apparatus 600 of this embodiment has the function of reading images on original documents such as invoices, and the image forming apparatus 600 of this embodiment can be used as a reading device.

[0083] like Figure 4 As shown, each functional unit of the image forming apparatus 600 constituting this embodiment is connected to the bus 601 and performs data transmission and reception via the bus 601.

[0084] The display unit 606 displays an image and notifies the operator of the image forming apparatus 600 of the information. For example... Figure 5 As shown, the display unit 606 is formed in a rectangular shape. This display unit 606 is, for example, a liquid crystal display or an organic EL display, and notifies the user operating the image forming apparatus 600 of information.

[0085] Operation receiving unit 607 (see reference) Figure 4 , Figure 5 The operation receiving unit 607 accepts operations from the user. Specifically, the operation receiving unit 607 accepts operations from the user on the display content displayed through the display unit 606.

[0086] Here, the display unit 606 and the operation receiving unit 607 are configured as a touch panel display, for example, with the display unit 606 and the operation receiving unit 607 arranged in an overlapping state.

[0087] In addition, in this embodiment, the operation receiving unit 607 is described as being composed of a touch panel display, but the operation receiving unit 607 may also be composed of a pointing device such as a mouse.

[0088] Display unit 606 (see reference) Figure 4 The control unit 660 controls the operation. Furthermore, in this embodiment, the operation receiving unit 607 receives user operations on the content displayed on the display unit 606.

[0089] Furthermore, in this embodiment, processing corresponding to the user's operation is performed based on the user's operation received in the operation receiving unit 607.

[0090] As an example of a reading unit, the image reading unit 608 is composed of a so-called scanning device, which reads the image on the set original and generates a reading image (image data) of the original. In this embodiment, as described later, multiple invoices are read by the image reading unit 608.

[0091] The image forming unit 609 forms a toner image corresponding to the image data onto paper, which is a recording material, for example, using an electronic photographic method. Alternatively, the image forming unit 609 may also use other methods such as an inkjet head to form the image.

[0092] Communications Department 610 and Communication Line 310 (refer to) Figure 1 The connection serves as a communication interface for communication with the management server 300.

[0093] The image processing unit 611 performs image processing such as color correction or grayscale correction on the image represented by the image data.

[0094] The storage unit 605 is composed of a hard disk device or the like, and stores, for example, data received by the communication unit 610 or read images (image data) generated by the image reading unit 608.

[0095] The control unit 660 controls each part of the image forming apparatus 600. The control unit 660 consists of a CPU (Central Processing Unit) 602, a ROM (Read Only Memory) 603, and a RAM (Random Access Memory) 604.

[0096] ROM603 stores the program executed by CPU602. CPU602 reads the program stored in ROM603 and uses RAM604 as the working area to execute the program.

[0097] Here, the program executed by the CPU 602 can be provided to the image forming apparatus 600 in a state stored in a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disc, etc.), an optical-magnetic recording medium, or a semiconductor memory.

[0098] Furthermore, the program executed by the CPU 602 can also be downloaded to the image forming apparatus 600 using communication means such as the Internet.

[0099] [First Embodiment]

[0100] Figure 6 This is a timing diagram showing the process flow executed by the information processing system 1 of this embodiment, and it is a timing diagram in the first embodiment.

[0101] In this embodiment, firstly, multiple invoices, as an example of multiple recording media, are arranged by the user in the image reading unit 608 of the image forming apparatus 600 (see reference). Figure 4 ).

[0102] Next, the user presses the start button (not shown) provided in the image forming apparatus 600 to instruct the user to begin reading the multiple invoices (step S101). In other words, the user instructs the user to begin reading the information recorded in the multiple invoices.

[0103] Thus, the image reading unit 608, as an example of a reading unit, reads multiple invoices (step S102) and obtains a read image. More specifically, the image reading unit 608 obtains a read image containing multiple invoice images, wherein the invoice images are images representing the individual invoices in the invoices.

[0104] In other words, the image representing each invoice in the invoice is an example of a media image, and the image reading unit 608 obtains a reading image containing multiple such media images.

[0105] Subsequently, in this embodiment, the management server 300 sends a read image, and the management server 300 obtains the read image.

[0106] Next, the management server 300 retrieves the recorded information from the read image, which is the information recorded on each invoice.

[0107] Specifically, firstly, the invoice registration department 351 extracts the rectangular image contained in the above-mentioned reading image (hereinafter referred to as "rectangular image") (step S103).

[0108] Next, the image separation unit 353A of the information acquisition unit 353 separates each rectangular image from other images located around the rectangular image (step S104). Next, the image rotation unit 353B rotates each rectangular image to make each rectangular image upright (step S105).

[0109] Next, the OCR unit 353C performs OCR (Optical Character Recognition) processing (step S106) to obtain the information contained in each upright rectangular image.

[0110] In other words, the OCR unit 353C obtains the recorded information from each invoice as an upright document.

[0111] Specifically, the OCR unit 353C acquires textual information recorded in the invoice, such as the date and amount, as recorded information. This recorded information is the information recorded in each invoice. In this embodiment, the recorded information, which is the information recorded in the invoice, is acquired for each invoice.

[0112] Subsequently, in this embodiment, the information acquisition unit 353 outputs a state in which the images of each invoice (rectangular images in an upright state) (hereinafter referred to as "invoice images") are matched with the recorded information obtained from each invoice image in the invoice images.

[0113] In addition, in this embodiment, there is also a case where the acquisition of recorded information based on the OCR unit 353C fails. For the part where the acquisition of recorded information fails, the information acquisition unit 353 supplements it using a pre-defined default value.

[0114] In other words, the information acquisition unit 353 outputs a pre-defined default value as the recorded information for the part that failed to acquire the recorded information. In this case, the output recorded information is different from the actual recorded information.

[0115] More specifically, there are cases where the printing on the invoice is faint, or where the invoice is bent or folded, making it difficult to read.

[0116] In this case, a situation arises where the information cannot be acquired. In this case, the information acquisition unit 353, as described above, supplements the information for the part where the information cannot be acquired using a pre-defined default value and outputs the default value.

[0117] Furthermore, in this embodiment, the failure location determination unit 352 extracts an image (hereinafter referred to as "failure location image") of the location where acquisition failed based on the recorded information of the OCR unit 353C. Then, in this embodiment, the information acquisition unit 353 outputs the extracted failure location image in a state corresponding to the invoice image.

[0118] As a result, in this embodiment, the invoice image, recorded information, and image of the failed part are output from the information acquisition unit 353 (step S107).

[0119] More specifically, for invoices where the information acquisition failed, the information acquisition unit 353 outputs an invoice image, the recorded information, and an image of the failed portion. Conversely, for invoices where the information acquisition was successful, the information acquisition unit 353 outputs an invoice image and the recorded information.

[0120] Next, in this embodiment, the invoice registration unit 351 determines whether the OCR processing was successful (step S108).

[0121] More specifically, the invoice registration unit 351 determines, for example, whether the information output from the information acquisition unit 353 contains an image of the failed part.

[0122] Then, in the case of an image containing a failed portion, the invoice registration unit 351 determines that the OCR processing related to the invoice on which the failed portion image was obtained has failed.

[0123] Then, if the OCR processing is determined to have failed, in other words, if the information to be recorded is determined to have failed to be obtained, the invoice registration unit 351 outputs information related to the invoice for which the information to be recorded was not obtained to the image forming apparatus 600.

[0124] More specifically, in this case, the invoice registration unit 351 outputs the invoice image, the recorded information (default value), and the image of the failed part related to the invoice for which the recorded information could not be obtained to the image forming apparatus 600 (step S109).

[0125] Here, the failed area image is an example of information related to the area in an invoice where the attempt to obtain recording information failed. In this embodiment, the invoice registration unit 351 outputs information related to the area where the attempt to obtain recording information was made to the image forming apparatus 600.

[0126] Here, the image forming apparatus 600 is an image forming apparatus 600 that reads the aforementioned multiple invoices that are the objects of acquiring recorded information. In this embodiment, information such as images of failed parts is output to the image forming apparatus 600 that reads the invoices.

[0127] Furthermore, in this embodiment, the invoice image and recorded information are also sent to the image forming apparatus 600 along with the image of the failed part.

[0128] That is, in this embodiment, in addition to outputting the image of the failed part, the invoice image and the recorded information are also output as information related to the invoice for which the recorded information could not be obtained.

[0129] As an example of a media image, this invoice image is an image representing the entire invoice. Furthermore, as mentioned above, the recorded information in this case is pre-defined by default values.

[0130] Subsequently, in this embodiment, in the display unit 606 of the image forming apparatus 600 (refer to...) Figure 4 , Figure 5 The information related to the aforementioned invoice for which the information could not be recorded is displayed in the (step S110).

[0131] Specifically, in this embodiment, the display unit 606 displays an invoice image, recorded information, and an image of the failed portion as information related to an invoice for which recorded information could not be obtained.

[0132] Figure 7 This is a diagram showing an example of a display in the display unit 606 of the image forming apparatus 600.

[0133] As described above, the display unit 606 in this embodiment displays an invoice image G1, recorded information G2, and a failure area image G3.

[0134] Here, the invoice image G1 is a read image obtained by reading the invoice through the image forming apparatus 600, and as described above, it is an image representing the entire invoice.

[0135] Furthermore, in this embodiment, the image shown by symbol 7A represents the failure area image G3, which represents the area in the invoice where the recorded information G2 (the actual accurate recorded information G2) could not be obtained.

[0136] Here, Figure 7 The information displayed in section G2 is not an illustration image, but text information obtained by the OCR unit 353C or a default value obtained by the above supplement.

[0137] More specifically, in this example, the information such as "total," "receipt date," and "month × day" in the recorded information G2 is text information obtained through the OCR unit 353C. Furthermore, in this example, the information "¥10,000" in the recorded information G2 is a default value obtained through the aforementioned supplement.

[0138] In this example, the display area of ​​the failure image G3 shows the recorded information G2 obtained by supplementing using the default value.

[0139] Specifically, in this example, the display area of ​​the failure image G3 shows "Total" as an example of monetary information and "Date of Receipt" as an example of date information. However, in this example, the amount "¥10,000" displayed in the Total section is not an accurate value, but a default value as described above.

[0140] In addition, this embodiment describes the case of supplementing and displaying the default value as an example, but it is also possible not to display the default value and set the part where the default value is displayed to a blank column.

[0141] Furthermore, the display unit 606 displays a screen G4 (hereinafter referred to as "input screen G4") for users to input information recorded in the invoice as part of the screen.

[0142] In other words, the display unit 606 of the image forming apparatus 600 displays an input screen G4 for the user to input accurate recorded information G2.

[0143] In this embodiment, the user operates the input screen G4 to input the accurate information recorded on the invoice (see reference). Figure 6 (Step S111). In other words, in this embodiment, the default value obtained by the user through the management server 300 is corrected.

[0144] Specifically, in this example, as described above, the amount is incorrect, and the user operates the display unit 606 to input information related to the accurate amount.

[0145] In addition, Figure 7 The screen shown displays information related to the first of three invoices for which information G2 could not be recorded.

[0146] More specifically, in this embodiment, an example is illustrated where the recorded information G2 could not be obtained from three invoices. Figure 7 The screen shown displays information related to the first of three invoices for which information G2 could not be recorded.

[0147] If the user enters information related to the accurate amount for the first invoice, then select... Figure 7 The part indicated by symbol 7B. This causes a screen transition, displaying information related to the second invoice.

[0148] Then, the user operates the display unit 606 and enters accurate information related to the second invoice.

[0149] After that, the user also chose Figure 7 The part indicated by symbol 7B. This also triggers a screen transition, displaying information related to the third invoice.

[0150] Then, the user operates the display unit 606 and enters accurate information related to the third invoice.

[0151] Subsequently, in this embodiment, the input information input by the user through the image forming apparatus 600 is sent to the management server 300 (see reference). Figure 6 In step S112), the management server 300 obtains the input information sent from the user. In other words, the management server 300 obtains the accurate recorded information G2 input by the user.

[0152] Then, the management server 300 replaces the incorrect record information G2 with the accurate record information G2. In other words, the management server 300 replaces the above default value with the accurate record information G2.

[0153] Subsequently, in this embodiment, the invoice registration unit 351 of the management server 300 sends the invoice image G1 and the recording information G2 (the recording information G2 reflecting the accurate recording information G2 after the invoice) obtained for each of the multiple invoices to the external server 400 (refer to...). Figure 6 Step S113).

[0154] Therefore, the invoice image G1 and the recorded information G2 obtained from each of the multiple invoices are registered in the external server 400.

[0155] When the record information G2 is sent to the external server 400, the record information G2 is sent to the external server 400 with the invoice for the initial accurate acquisition of the record information G2.

[0156] Furthermore, regarding the invoice that replaces the default value with the accurate record information G2, the accurate record information G2 is sent to the external server 400.

[0157] In addition, the above describes an example of displaying the failed region image G3 in the display unit 606 of the image forming apparatus 600 as information related to the region where the recorded information G2 was attempted to be acquired.

[0158] However, the information related to the area where the recorded information G2 was acquired is not limited to the failed area image G3.

[0159] As information related to the part that attempted to obtain recorded information G2, for example, the information "Failed to read the amount field of the invoice with title 〇〇." can also be listed.

[0160] Furthermore, information such as "The date field of the third invoice from the top in the invoices that failed to be sorted" can also be listed.

[0161] Information related to the location where the recorded information G2 was acquired is not limited to image information such as the failed location image G3, but can also be textual information.

[0162] In this case, determining whether each invoice was successfully read could also be done by notifying the user of the reading results and allowing the user to make their own judgment. However, this requires the user to spend time and effort determining the success or failure of all invoices.

[0163] In contrast, in this embodiment, the user is notified after the part of the reading failure is determined. Therefore, the user does not need to determine the success or failure of all invoices, reducing the user's burden.

[0164] Furthermore, in this embodiment, the user can input accurate information via the image forming apparatus 600, thereby reducing the user's workload.

[0165] Here, we also consider a scenario where the user places an invoice for which the recording information G2 could not be obtained again on the image forming apparatus 600 and attempts to obtain the recording information G2 again. However, in this case, it is necessary to select the invoice to be used from multiple invoices before placing it on the image forming apparatus 600.

[0166] In contrast, in this embodiment, the recorded information G2 can be acquired without placing the invoice back into the image forming apparatus 600, reducing the user's workload.

[0167] [Second Implementation]

[0168] The above describes the process of using the image forming apparatus 600 and the management server 300 to process invoices.

[0169] Invoice processing is not limited to the image forming apparatus 600 and the management server 300; it can also be performed using devices other than these.

[0170] Figure 8 This is a diagram illustrating the processing flow when user terminal 500 is also used for invoice processing.

[0171] Figure 8 The processing steps S201 to S208 in the shown process are the same as those described above. Figure 6 The processes shown are the same for steps S101 to S108.

[0172] The following describes the processing after step S209. Also, similarly to the above, the following describes the processing in the event that the retrieval of recorded information 2 from the three invoices fails.

[0173] Similarly, in step S209, the management server 300 outputs the invoice image G1, the recorded information G2, and the failure area image G3 to the image forming apparatus 600.

[0174] Therefore, similarly as described above, the image is displayed in the display unit 606 of the image forming apparatus 600. Figure 7 The screen shown. That is, the display unit 606 displays information related to the invoice for which the recording information 2 could not be obtained (step S210).

[0175] Next, in this processing example, the user makes the selection. Figure 7 The option to "Scan again with mobile device" is displayed on the screen using button 800.

[0176] If button 800 is selected, it is displayed on user terminal 500, which is an example of another reading device. Figure 9 The screen shown is an example of a display in user terminal 500.

[0177] More specifically, if button 800 is selected, the application pre-stored in user terminal 500 is launched and displayed. Figure 9 The image shown.

[0178] The screen displays instructions for reading the invoice. In this example, the instructions are displayed on multiple lines. Furthermore, in one portion of these multiple lines, the message "Please take a close-up photo of the area where the photo was not taken" is displayed.

[0179] Then, the user operates user terminal 500 to visually search for and Figure 7 The first invoice image G1 displayed in the image corresponds to the physical copy of the first invoice. Based on this, the camera 207 of the user terminal 500 (see reference) is used. Figure 3 Read the physical item of the first invoice.

[0180] More specifically, the portion of the physical invoice shown in image G3, which is the failed part, is captured by the user using camera 207 in close-up. Figure 8 Step S211).

[0181] In this embodiment, the user terminal 500 is a portable terminal device with a camera 207. In this embodiment, the physical image of the first invoice is captured by the portable terminal device.

[0182] Furthermore, the user terminal 500 is a reading device capable of reading at a resolution higher than that of the image reading unit 608 provided in the image forming apparatus 600.

[0183] In this embodiment, the physical copy of the first invoice is read by a user terminal 500, which reads a resolution higher than that of the image reading unit 608 of the image forming apparatus 600.

[0184] In recent years, there have also been smartphones and other devices with higher reading resolutions than the image reading unit 608 provided in the image forming apparatus 600.

[0185] In this embodiment, by using a user terminal 500, such as a smartphone, the physical invoice of the first invoice can be read at a resolution higher than that of the image reading unit 608 of the image forming apparatus 600.

[0186] Furthermore, the user terminal 500 is capable of close-up photography; in other words, the user terminal 500 is capable of taking photos after magnifying the object being photographed. In this embodiment, the user takes a photo of the failed part (the part shown as the failed part image G3 in the physical document of the first invoice) in a magnified state.

[0187] Based on the above, in this embodiment, images are captured at a resolution higher than the readout resolution of the image forming apparatus 600. Figure 7 The portion of the physical invoice represented by image G1, which is the first invoice, is shown as the failed part in image G3.

[0188] Furthermore, in this embodiment, the portion shown as the failure area image G3 is captured in a magnified state.

[0189] In addition, as mentioned above, in Figure 7The system displays information related to the first of three invoices for which information G2 could not be recorded. If the user operates the user terminal 500 to photograph the physical invoice of the first invoice, then the system selects... Figure 7 The part indicated by symbol 7B.

[0190] Therefore, the screen is switched, and information about the second invoice is displayed on the display unit 606.

[0191] Then, the user operates the user terminal 500 to photograph the physical invoice of the second invoice. More specifically, the user takes a close-up photograph of the portion of the second invoice identified by the failure area image G3.

[0192] Similarly, if the user finishes taking photos of the physical invoice for the second invoice, the user selects... Figure 7 The part indicated by symbol 7B is used to switch screens.

[0193] This displays information about the third invoice. Then, the user operates the user terminal 500 to photograph the physical invoice. More specifically, similarly to the above, the user takes a close-up photograph of the portion of the third invoice identified by the failure area image G3.

[0194] In addition, this embodiment describes the case where the user manually switches the screen by operating the display unit 606, but the screen in the display unit 606 can also be switched automatically each time the user takes a picture using the user terminal 500.

[0195] Then, in this embodiment, if all three physical invoices are photographed via the user terminal 500, the user performs a pre-defined operation on the application launched via the user terminal 500. Figure 8 Step S212).

[0196] More specifically, the user performs pre-defined operations on the screen displayed by the application launched through the user terminal 500.

[0197] Therefore, in this embodiment, the application analyzes the photographic images of the three invoices respectively and obtains the recorded information G2 contained in the photographic images (step S213).

[0198] In other words, in this embodiment, the reading results obtained by the user terminal 500, which is a device other than the image forming apparatus 600, are analyzed. Then, the user terminal 500 acquires the recorded information G2 obtained through this analysis.

[0199] Then, in this embodiment, if the user presses... Figure 9 The "send button" indicated by symbol 9A indicates that information G2 is sent from user terminal 500 to management server 300. Figure 8 Step S214).

[0200] Therefore, the invoice registration department 351 of the management server 300 obtains the recorded information G2 obtained by analyzing the above-mentioned photographic images through the user terminal 500.

[0201] Then, the application launched through user terminal 500 outputs a completion notification indicating that the processing is complete to user terminal 500 (step S215). Then, user terminal 500 outputs a completion notification indicating that the processing is complete to user (step S216).

[0202] Then, the user operates the display unit 606 of the image forming apparatus 600 by pressing the "information update button (not shown)" displayed on the display unit 606 to indicate information update (step S217).

[0203] Therefore, the image forming apparatus 600 accesses the management server 300 and obtains the recorded information G2 obtained by the above reading through the user terminal 500 (step S218).

[0204] Specifically, the image forming apparatus 600 acquires the recorded information G2 obtained through the analysis performed by the user terminal 500 and sends it to the management server 300.

[0205] Then, the recorded information G2 is displayed on the display unit 606 of the image forming apparatus 600. In other words, the recorded information G2 obtained by taking a close-up photo of the physical invoice using the user terminal 500 is displayed on the display unit 606 of the image forming apparatus 600 (step S219).

[0206] Figure 10 This is a diagram showing an example of a display in the display unit 606 of the image forming apparatus 600.

[0207] In this example, the display unit 606 of the image forming apparatus 600 displays the recorded information G2 obtained by the user terminal 500 regarding each of the three invoices.

[0208] Pressing the areas indicated by symbol 10A on the screen of display unit 606 sequentially switches the screen to display the recorded information G2 obtained by user terminal 500 regarding each of the three invoices.

[0209] Then, if there is an error, the user should input the accurate recording information G2 at the location indicated by user operation symbol 10B. Finally, if the user presses the OK button (not shown)... Figure 8In step S220), the image forming apparatus 600 sends a confirmation notification to the management server 300 (step 221) to confirm the recorded information G2 obtained from the multiple invoices respectively.

[0210] In this embodiment, after the determination, the recorded information G2 stored in the management server 300 is sent to the external server 400 (step S222).

[0211] In this embodiment, as Figure 7 As shown, an example is given where information related to an invoice for which the recording information G2 could not be obtained is output to the image forming apparatus 600 that has read the invoice.

[0212] However, it is not limited to this. Information related to invoices for which the recorded information G2 could not be obtained can also be output to a user terminal 500, which is an example of a reading device that is different from the image forming apparatus 600.

[0213] In this case, the display on user terminal 500 is the same as... Figure 7 The same image shown.

[0214] Additionally, the display in user terminal 500 is the same as... Figure 7 In cases where the displayed image is the same as the one shown, the image may sometimes be displayed in a display layout that is different from the display layout in the image forming apparatus 600.

[0215] Here, the display in user terminal 500 is the same as Figure 7 In the case of the same screen shown, in the same manner as described above, the invoice image G1, the recorded information G2, and the failure area image G3 are displayed on the user terminal 500.

[0216] In other words, in the context of... Figure 7 When the same screen as shown is displayed on the user terminal 500, information related to the invoice for which the invoice could not be accurately recorded (G2) is output to the user terminal 500, and the information related to the invoice is displayed on the user terminal 500.

[0217] Here, similarly as above, as information related to an invoice for which the recorded information G2 could not be obtained, an invoice image G1 representing the entire invoice is displayed on the screen of the user terminal 500.

[0218] Furthermore, similarly as described above, information related to the location where the attempt to acquire the recorded information G2 was made is displayed on the screen of the user terminal 500. Specifically, as information related to the location where the attempt to acquire the recorded information G2 was made, for example, an image of the failed location G3 is displayed.

[0219] Similarly, an input screen G4 for the user to input the information recorded in the invoice is displayed on the screen of the user terminal 500.

[0220] (other)

[0221] The above describes the situation where information related to an invoice for which the recording information G2 could not be obtained is output to the image forming apparatus 600 or the user terminal 500.

[0222] However, it is not limited to this. Information related to an invoice whose recorded information G2 obtained from the invoice (hereinafter, sometimes referred to as "acquiring recorded information G2") does not meet the pre-defined conditions may also be output to the image forming apparatus 600 or the user terminal 500.

[0223] In other words, information related to an invoice from which recorded information G2 can be obtained but which recorded information G2 does not meet the pre-defined conditions can also be output to the image forming apparatus 600 or the user terminal 500.

[0224] Furthermore, it is envisioned that a plurality of invoices may include both invoices in which the information G2 was not obtained and invoices in which the obtained information G2 does not meet the pre-defined conditions.

[0225] In this case, information related to invoices for which the recording information G2 could not be obtained, and information related to invoices for which the recorded information G2 obtained did not meet the pre-defined conditions, can also be output to the image forming apparatus 600 or the user terminal 500.

[0226] Here, when outputting information related to an invoice where the acquired recorded information G2 does not meet the pre-defined conditions, the same as above, for example, the invoice image G1, the recorded information G2 (the recorded information G2 supplemented using the default value), and the failure area image G3 (information related to the area where the acquired recorded information G2 is located) are output to the image forming apparatus 600 or the user terminal 500.

[0227] In addition, regarding the recorded information G2, the recorded information G2 obtained by the OCR unit 353C itself, rather than the recorded information G2 supplemented by the default value, can be output to the image forming apparatus 600 or the user terminal 500.

[0228] Furthermore, when outputting information related to an invoice whose acquired recorded information G2 does not meet the pre-defined conditions, the invoice image G1 and the failure area image G3 may be output to the image forming apparatus 600 or the user terminal 500, for example.

[0229] In this case, the recorded information G2 is not displayed in the image forming apparatus 600 or the user terminal 500, and the area where the recorded information G2 is displayed becomes a blank column.

[0230] Furthermore, similarly as described above, an input screen G4 for the user to input the information recorded in the invoice is displayed in the image forming apparatus 600 or the user terminal 500.

[0231] Here, "failed to obtain recorded information G2" means that although information such as numerical values ​​or strings could actually be obtained, the information was not obtained.

[0232] For example, such as Figure 7 As shown, sometimes the invoice is marked with information such as "total" or "receipt date". However, if the information related to the "total" or "receipt date" is obtained but the information representing the number cannot be obtained from the part next to this information, it is equivalent to "failure to obtain the recorded information G2".

[0233] Furthermore, the phrase "the acquired recorded information G2 does not meet the pre-defined conditions" refers to a state in which, although recorded information G2 is acquired, the acquired recorded information G2 does not meet the pre-defined conditions.

[0234] For example, if a value is obtained as recorded information G2, and the number of digits of the value exceeds the predetermined number of digits or is smaller than the predetermined number of digits, it is equivalent to "the obtained recorded information G2 does not meet the predetermined conditions".

[0235] Furthermore, for example, if information other than the numerical value is actually obtained when the state of obtaining the numerical value is in effect, it is equivalent to "the obtained recorded information G2 does not meet the pre-defined conditions".

[0236] Furthermore, machine learning can also be used to improve the accuracy of invoice reading.

[0237] Specifically, machine learning can be performed sequentially based on the image of the failed area and the accurate information subsequently input by the user to improve reading accuracy. More specifically, machine learning can be performed each time accurate information is input by the user, based on the image of the failed area and that accurate information, to improve reading accuracy.

[0238] More specifically, in this case, the accuracy of reading is improved by changing the parameters used when reading invoices, based on the results of machine learning, for example.

Claims

1. An information processing system having a processor, The processor acquires recording information from read images obtained by reading multiple recording media by a reading device, wherein the read images include multiple medium images representing various recording media in the recording medium, and the recording information is information recorded on each recording medium in the recording medium. The output is related to the recording medium that failed to acquire recorded information, i.e., the non-acquisition recording medium, and / or the recorded information acquired does not meet the predetermined conditions, i.e., the non-acquisition recording medium. Information is generated by reading the non-acquisition recording medium and / or the non-satisfaction recording medium through other reading devices, wherein the other reading device is different from one of the reading devices that has performed reading of the multiple recording media. The information recorded in the non-acquisition recording medium and / or the non-satisfaction recording medium, namely the recorded information, which is obtained by the other reading device through analyzing the reading results obtained by the other reading device reading the non-acquisition recording medium and / or the non-satisfaction recording medium, is displayed on the display unit provided by the reading device that has read the multiple recording media.

2. The information processing system according to claim 1, wherein, The processor outputs information relating to the portions of the non-acquisition recording medium in which attempts to acquire recording information failed. The processor outputs information related to the location of the acquired recorded information in the non-satisfied recording medium where the acquired recorded information does not meet the pre-defined conditions.

3. The information processing system according to claim 1, wherein, The processor outputs information related to the non-acquisition recording medium for which recording information could not be acquired to the reading device that has read the multiple recording media. The processor outputs information related to the non-satisfied recording medium whose acquired recorded information does not meet the pre-defined conditions to the reading device.

4. The information processing system according to claim 3, wherein, The information relating to the non-acquisition recording medium for which the recorded information could not be acquired is displayed on the reading device. Information relating to the non-satisfied recording medium whose acquired recorded information does not meet the pre-defined conditions is displayed on the reading device.

5. The information processing system according to claim 3, wherein, As information relating to the non-acquisition recording medium for which recording information could not be acquired, the processor outputs a medium image representing the non-acquisition recording medium to the reading device. As information relating to a non-satisfied recording medium that does not meet the pre-defined conditions for acquiring recorded information, the processor outputs a medium image representing the non-satisfied recording medium to the reading device.

6. The information processing system according to claim 5, wherein, The medium image is displayed on the reading device.

7. The information processing system according to claim 3, wherein, The reading device displays a screen for user input of information recorded on the non-recording medium for which no recorded information could be retrieved. The reading device displays a screen for the user to input information recorded in the non-satisfied recording medium when the information to be obtained does not meet the pre-defined conditions.

8. The information processing system according to claim 1, wherein, The processor also acquires the recorded information obtained by analyzing the reading results obtained by the other reading device on the non-acquisition recording medium from which recorded information was not acquired. The processor also acquires the recorded information obtained by analyzing the reading results obtained by the other reading device on the non-satisfied recording medium in which the acquired recorded information does not meet the pre-defined conditions.

9. The information processing system according to claim 8, wherein, The other reading device is a reading device capable of reading at a higher reading resolution than the reading resolution of the first reading device.

10. The information processing system according to claim 1, wherein, The processor outputs information related to the non-acquisition recording medium for which it failed to acquire recorded information to another reading device, which is different from the one reading device that has read the multiple recording media. Information relating to the non-satisfied recording medium whose acquired recorded information does not meet the predefined conditions is output to another reading device, which is different from the one reading device that has read the multiple recording media.

11. The information processing system according to claim 10, wherein, The other reading device is a reading device capable of reading at a higher reading resolution than the reading resolution of the first reading device.

12. The information processing system according to claim 10, wherein, The other reading device displays a screen for user input of information recorded on the non-recording medium for which no recorded information could be retrieved. The other reading device displays a screen for the user to input information recorded in the non-satisfied recording medium when the information to be obtained does not meet the pre-defined conditions.

13. The information processing system according to claim 1, wherein, The processor outputs information related to the non-acquisition recording medium for which it failed to acquire recorded information to a portable terminal device with a camera, which is a different reading device from the one reading device that read the multiple recording media. The processor outputs information related to the non-satisfied recording medium, which does not meet the pre-defined conditions for acquiring recorded information, to the portable terminal device with a camera.

14. A computer-readable medium storing a program that causes a computer to perform the following processes: Recorded information is obtained from read images obtained by reading multiple recording media by a reading device, wherein the read images include multiple medium images representing various recording media in the recording medium, and the recorded information is information recorded on each recording medium in the recording medium; and The output is related to the recording medium that failed to acquire recorded information, i.e., the non-acquisition recording medium, and / or the recorded information acquired does not meet the predetermined conditions, i.e., the non-acquisition recording medium. Information is generated by reading the non-acquisition recording medium and / or the non-satisfaction recording medium through other reading devices, wherein the other reading device is different from one of the reading devices that has performed reading of the multiple recording media. The information recorded in the non-acquisition recording medium and / or the non-satisfaction recording medium, namely the recorded information, which is obtained by the other reading device through analyzing the reading results obtained by the other reading device reading the non-acquisition recording medium and / or the non-satisfaction recording medium, is displayed on the display unit provided by the reading device that has read the multiple recording media.

15. A reading device capable of reading a recording medium, the reading device comprising: The reading unit is capable of reading multiple recording media containing information. The reading unit reads the multiple recording media as follows: in reading the multiple recording media, the unit acquires the recorded information as the information recorded on each recording medium. A display unit displays information relating to the following recording media among the plurality of recording media read by the reading unit: recording media that failed to acquire recorded information (i.e., non-acquisition recording media); and / or recording media whose acquired recorded information does not meet predetermined conditions (i.e., non-satisfying recording media); and The acquisition unit acquires recorded information contained in the non-acquisition recording medium and / or the non-satisfaction recording medium, which is obtained by analyzing the reading results obtained by another reading device reading the non-acquisition recording medium and / or the non-satisfaction recording medium. The display unit displays information related to the non-acquisition recording medium and / or the non-satisfaction recording medium, and displays the recording information when the acquisition unit acquires the recording information.

16. An information processing method, wherein, The following processing is performed in this information processing method: Recorded information is obtained from read images obtained by reading multiple recording media by a reading device, wherein the read images include multiple medium images representing various recording media in the recording medium, and the recorded information is information recorded on each recording medium in the recording medium. The output is related to the recording medium that failed to acquire recorded information, i.e., the non-acquisition recording medium, and / or the recorded information acquired does not meet the predetermined conditions, i.e., the non-acquisition recording medium. Information is generated by reading the non-acquisition recording medium and / or the non-satisfaction recording medium through other reading devices, wherein the other reading device is different from one of the reading devices that has performed reading of the multiple recording media. The information recorded in the non-acquisition recording medium and / or the non-satisfaction recording medium, namely the recorded information, which is obtained by the other reading device through analyzing the reading results obtained by the other reading device reading the non-acquisition recording medium and / or the non-satisfaction recording medium, is displayed on the display unit provided by the reading device that has read the multiple recording media.

17. A computer program product comprising a program that causes a computer to perform the following processes: Recorded information is obtained from read images obtained by reading multiple recording media by a reading device, wherein the read images include multiple medium images representing various recording media in the recording medium, and the recorded information is information recorded on each recording medium in the recording medium. The output is related to the recording medium that failed to acquire recorded information, i.e., the non-acquisition recording medium, and / or the recorded information acquired does not meet the predetermined conditions, i.e., the non-acquisition recording medium. Information is generated by reading the non-acquisition recording medium and / or the non-satisfaction recording medium through other reading devices, wherein the other reading device is different from one of the reading devices that has performed reading of the multiple recording media. The information recorded in the non-acquisition recording medium and / or the non-satisfaction recording medium, i.e., the recorded information, which is obtained by the other reading device through analyzing the reading results obtained by the other reading device reading the non-acquisition recording medium and / or the non-satisfaction recording medium, is displayed on the display unit provided by the reading device that has read the multiple recording media.

Images