Information processing system, program, and reading device

Abstract

To reduce a workload of a user more in acquiring information entered on each recording medium by reading a plurality of recording media than when the user needs to perform verification by referring to reading results of the recording media by himself / herself whether reading has been appropriately performed.SOLUTION: An information processing system includes a processor, and the processor acquires, from read images obtained by reading a plurality of recording media and including a plurality of medium images being images representing respective recording media, entry information being information entered on each of the recording media, and outputs information about a recording medium of which the acquisition of the entry information has been unsuccessful and / or a recording medium of which the acquisition entry information being the acquired information does not satisfy a predetermined condition.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to an information processing system, a program, and a reading device.

Background Art

[0002] Patent Document 1 discloses an information analysis system in which an analysis device analyzes data read by a reading device, and sequentially displays at least a part of an image and text data received from the analysis device on a display device for each receipt. Patent Document 2 discloses a process of acquiring one or a plurality of target images to be processed, and selecting a suitable service that is suitable for application from among a plurality of services for each of them.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] By reading a recording medium such as a receipt and analyzing the image obtained by this reading, it is possible to acquire the information described on each recording medium. Here, confirmation of whether the information has been properly acquired can be performed, for example, by the user referring to the result of reading the recording medium by himself / herself. By the way, in this case, it is necessary to perform this confirmation for each recording medium, and if there are a large number of recording media, the work burden on the user increases. The object of the present invention is to reduce the user's workload when acquiring information described on each of a plurality of recording media by reading the plurality of recording media, compared to the case where the user needs to check by himself / herself whether the reading of the recording media is properly performed with reference to the result of reading the recording media.

Means for Solving the Problem

[0005] The invention according to claim 1 includes a processor, and the processor obtains description information, which is information described on each of the recording media, from a reading image including a plurality of media images, which are images representing each of the plurality of recording media, obtained by a reading device reading the plurality of recording media, outputs information about a non-acquired recording media, which is the recording media for which the description information could not be obtained, and / or a non-satisfactory recording media, which is the recording media for which the acquired description information does not satisfy a predetermined condition, and generates information for causing a reading device different from a first reading device, which is the reading device that has read the plurality of recording media, to read the non-acquired recording media and / or the non-satisfactory recording media. The described information, which is the information recorded on the non-acquisition recording medium and / or the non-satisfaction recording medium, and the Non-acquired recording media and / or said The reading result obtained by reading the non-satisfactory recording media by the other reading device description obtained by analyzing the same by the other reading device The information is displayed on a display unit provided in the first reading device that has read the plurality of recording media. The information processing system is such that. The invention according to claim 2 is the information processing system according to claim 1, wherein the processor outputs information about a location where an attempt was made to obtain the description information among the non-acquired recording media for which the description information could not be obtained, and outputs information about a location where the acquired description information is located among the non-satisfactory recording media for which the acquired description information does not satisfy the predetermined condition. The invention according to claim 3 is the information processing system according to claim 1, wherein the processor outputs information about the non-acquired recording medium for which acquisition of the described information has failed to the one reading device that has read the plurality of recording media, and outputs information about the non-satisfying recording medium for which the acquired described information does not satisfy the predetermined condition to the one reading device. The invention according to claim 4 is the information processing system according to claim 3, wherein the information about the non-acquired recording medium for which acquisition of the described information has failed is displayed on the one reading device, and the information about the non-satisfying recording medium for which the acquired described information does not satisfy the predetermined condition is displayed on the one reading device. The invention according to claim 5 is the information processing system according to claim 3, wherein the processor outputs, as the information about the non-acquired recording medium for which acquisition of the described information has failed, the medium image representing the non-acquired recording medium to the one reading device, and outputs, as the information about the non-satisfying recording medium for which the acquired described information does not satisfy the predetermined condition, the medium image representing the non-satisfying recording medium to the one reading device. The invention according to claim 6 is the information processing system according to claim 5, wherein the medium image is displayed on the one reading device. The invention according to claim 7 is the information processing system according to claim 3, wherein a screen for receiving input of information recorded on the non-acquired recording medium for which acquisition of the described information has failed from the user is displayed on the one reading device, and a screen for receiving input of information recorded on the non-satisfying recording medium for which the acquired described information does not satisfy the predetermined condition from the user is displayed on the one reading device. The invention according to claim 8 is that the processor the other reading device obtained by analyzing the read result obtained when the non-acquired recording medium for which acquisition of the described information has failed is read by the other reading device said description information takeobtained by reading, by the other reading device, the non-satisfactory recording medium for which the obtained description information does not satisfy the predetermined conditions, the obtained reading result the other reading device obtained by analyzing said description information take The information processing system according to claim 1, which is obtained The invention according to claim 9 is the information processing system according to claim 8, wherein the other reading device is a reading device capable of reading at a reading resolution higher than the reading resolution of the one reading device In the invention according to claim 10, the processor outputs information about the non-acquired recording medium for which the description information could not be acquired to another reading device different from the one reading device that has read the plurality of recording media, and outputs information about the non-satisfactory recording medium for which the obtained description information does not satisfy the predetermined conditions to another reading device different from the one reading device that has read the plurality of recording media. The information processing system according to claim 1 said The invention according to claim 10, wherein the other reading device is a reading device capable of reading at a reading resolution higher than the reading resolution of the one reading device said The information processing system according to claim 1 The invention according to claim 11 is the information processing system according to claim 10, wherein the other reading device is a reading device capable of reading at a reading resolution higher than the reading resolution of the one reading device In the invention according to claim 12, a screen for receiving input of information described on the non-acquired recording medium for which the description information could not be acquired from the user is displayed on the other reading device, and a screen for receiving input of information described on the non-satisfactory recording medium for which the obtained description information does not satisfy the predetermined conditions from the user is displayed on the other reading device. The information processing system according to claim 10 In the invention according to claim 13, the processor outputs information about the non-acquired recording medium for which the description information could not be acquired to another reading device different from the one reading device that has read the plurality of recording media said other readingOutput to a portable terminal device equipped with a camera, and output information about the non-satisfactory recording medium for which the acquired description information does not satisfy the predetermined conditions to the portable terminal device equipped with a camera. The information processing system according to claim 1. The invention according to claim 14 has a function of acquiring description information, which is information described on each of the recording media, from a read image including a plurality of media images that are images representing each of the plurality of recording media obtained by a reading device reading the plurality of recording media; a function of outputting information about a non-acquired recording medium, which is the recording medium for which the description information could not be acquired, and / or a non-satisfactory recording medium, which is the recording medium for which the acquired description information does not satisfy the predetermined conditions; and a function of generating information for causing the non-acquired recording medium and / or the non-satisfactory recording medium to be read by another reading device different from the one reading device that has read the plurality of recording media. The described information, which is the information recorded on the non-acquisition recording medium and / or the non-satisfaction recording medium, and the Non-acquired recording medium and / or said The reading result obtained by reading the non-satisfactory recording medium by the other reading device description obtained by analyzing the same by the other reading device A program for causing a computer to realize a function of displaying the information on a display unit provided in the one reading device that has read the plurality of recording media. The invention according to claim 15 is a reading device capable of reading a recording medium, including reading means capable of reading a plurality of recording media on which information is described, and the reading means reads the plurality of recording media such that the acquisition of the description information, which is the described information, is performed for each of the recording media; a display unit that displays information about a non-acquired recording medium, which is the recording medium for which the description information could not be acquired, and / or a non-satisfactory recording medium, which is the recording medium for which the acquired description information does not satisfy the predetermined conditions, among the plurality of recording media read by the reading means; The described information, which is the information recorded on the non-acquisition recording medium and / or the non-satisfaction recording medium, By another reading device said Non-acquired recording medium and / or said The reading result obtained by reading the non-satisfactory recording mediumdescription information obtained by analyzing the same by the other reading device An acquisition means for acquiring, and the display unit displays information about the non-acquisition recording medium and / or the non-satisfaction recording medium, and when the Description information is acquired by the acquisition means, the Description information is displayed, which is a reading device. [Effect of the Invention]

[0006] According to the invention of claim 1, compared with the case where the user needs to check by himself whether the reading of the recording medium is properly performed by referring to the result of the reading of the recording medium, when reading a plurality of recording media and acquiring the information described in each recording medium, the work load of the user can be reduced. According to the invention of claim 2, it is possible to notify the user of information about the location where the acquisition of the described information was attempted among the recording media for which the acquisition of the described information could not be performed, and also to notify the user of information about the location where the acquired described information is located among the recording media that do not satisfy the predetermined conditions. According to the invention of claim 3, information about the recording media for which the acquisition of the described information could not be performed among the plurality of recording media, and information about the recording media that do not satisfy the predetermined conditions among the plurality of recording media can be provided to the reading device that has read the plurality of recording media. According to the invention of claim 4, information about the recording media for which the acquisition of the described information could not be performed among the plurality of recording media, and information about the recording media that do not satisfy the predetermined conditions among the plurality of recording media can be notified to the user via the reading device that has read the plurality of recording media. According to the invention of claim 5, a medium image representing the recording medium for which the acquisition of the described information could not be performed, and a medium image representing the recording medium that does not satisfy the predetermined conditions of the acquired described information can be provided to the reading device that has read the recording medium. According to the invention of claim 6, a media image representing a recording medium for which description information could not be acquired, or a media image representing a recording medium for which the acquired description information does not satisfy a predetermined condition, can be notified to the user via a reading device that has read this recording medium. According to the invention of claim 7, it becomes possible to acquire the information recorded on a recording medium for which description information could not be acquired, and it becomes possible to acquire the information recorded on a recording medium for which the acquired description information does not satisfy a predetermined condition. According to the invention of claim 8, when acquiring information obtained by analyzing a reading result obtained by using again a reading device that has read a recording medium for which description information could not be acquired, or when acquiring information obtained by analyzing a reading result obtained by using again a reading device that has read a recording medium for which the acquired description information does not satisfy a predetermined condition, the possibility of acquiring accurate description information can be increased as compared to other cases. According to the invention of claim 9, the possibility of acquiring accurate description information can be increased as compared to the case where another reading device is a device that performs reading at a reading resolution lower than the reading resolution of the reading device. According to the invention of claim 10, information about a recording medium among a plurality of recording media for which description information could not be acquired, or information about a recording medium among a plurality of recording media for which the acquired description information does not satisfy a predetermined condition, can be provided to another reading device different from the reading device that has read these plurality of recording media. According to the invention of claim 11, information about a recording medium among a plurality of recording media for which description information could not be acquired, or information about a recording medium among a plurality of recording media for which the acquired description information does not satisfy a predetermined condition, can be provided to another reading device different from the reading device that has read these plurality of recording media, and this other reading device can perform reading at a reading resolution higher than the reading resolution of this reading device. According to the invention of claim 12, a user can input information described on a recording medium for which information acquisition could not be performed via another reading device, and can also input information described on a recording medium for which the acquired and described information does not satisfy a predetermined condition. According to the invention of claim 13, information about a recording medium for which information acquisition could not be performed among a plurality of recording media, or information about a recording medium for which the acquired and described information does not satisfy a predetermined condition among a plurality of recording media, can be provided to a portable terminal device different from the reading device that has read the plurality of recording media and equipped with a camera. According to the invention of claim 14, the work load on the user when reading a plurality of recording media to acquire the information described on each recording medium can be reduced as compared with the case where the user needs to check by himself / herself whether the reading has been properly performed by referring to the result of reading the recording medium. According to the invention of claim 15, the work load on the user when reading a plurality of recording media to acquire the information described on each recording medium can be reduced as compared with the case where the user needs to check by himself / herself whether the reading has been properly performed by referring to the result of reading the recording medium.

Brief Description of Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Embodiments for Carrying Out the Invention

[0008] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a diagram showing the overall configuration of the information processing system 1 according to the present embodiment. The information processing system 1 is provided with a management server 300 as an example of an information processing apparatus. Further, an external server 400 to which the information obtained by the management server 300 is transmitted is provided. Further, the information processing system 1 is provided with user terminals 500 each owned by a user and an image forming apparatus 600 having an image reading function. In FIG. 1, although not shown, a plurality of each of the user terminal 500 and the image forming apparatus 600 are provided.

[0009] The user terminal 500 is constituted by, for example, a smartphone. In addition, the user terminal 500 may be other than a smartphone as long as it is a device having a camera (photographing function, image reading function), such as a tablet terminal having a camera, a camera having a communication function, or a game machine having a camera and a communication function. In the present embodiment, the user terminal 500, the image forming apparatus 600, and the management server 300 are mutually connected via a communication line 310 such as an Internet line. Also, the management server 300 and the external server 400 are mutually connected via a communication line 320 such as an Internet line.

[0010] FIG. 2 is a diagram showing an example of the hardware configuration of the management server 300. The management server 300 includes a control unit 101 that controls the operation of the entire device, a hard disk drive 102 as an example of an information storage device for storing information, and a network interface 103 that realizes communication via a LAN (= Local Area Network) cable or the like.

[0011] The control unit 101 includes a CPU (= Central Processing Unit) 111 as an example of a processor, a ROM (= Read Only Memory) 112 in which basic software, BIOS (= Basic Input Output System), etc. are stored, and a RAM (= Random Access Memory) 113 used as a work area. The CPU 111 may be multi-core. Also, the ROM 112 may be a rewritable non-volatile semiconductor memory. The control unit 101 is a so-called computer. In this embodiment, the CPU 111 executes a program stored in the ROM 112 or the like, thereby executing the processes described later.

[0012] The hard disk drive 102 is a device that reads and writes data to a non-volatile storage medium in which a magnetic substance is applied to the surface of a disk-shaped substrate. However, the non-volatile storage medium may be a semiconductor memory or a magnetic tape. In addition, the management server 300 may include input devices such as a keyboard and a mouse, and display devices such as a liquid crystal display, as necessary. The control unit 101, the hard disk drive 102, and the network interface 103 are connected through a bus 104 and signal lines (not shown).

[0013] Here, the program executed by the CPU 111 can be provided to the management server 300 in a state of being stored in a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), a magneto-optical recording medium, or a semiconductor memory. Also, the program executed by the CPU 111 may be provided to the management server 300 using communication means such as the Internet.

[0014] In this embodiment, the processor refers to a processor in a broad sense and includes a general-purpose processor (e.g., CPU: Central Processing Unit, etc.) and a dedicated processor (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.). Also, the operation of the processor may be achieved not only by one processor but also by a plurality of physically separated processors cooperating with each other. Also, the order of each operation of the processor is not limited to the order described in this embodiment and may be changed.

[0015] FIG. 1 shows a functional unit realized by the CPU 111 of the management server 300. Note that in this FIG. 1, a functional unit related to the reading of receipts is displayed. As shown in FIG. 1, the management server 300 includes a receipt registration unit 351, a failure location specifying unit 352, and an information acquisition unit 353. The receipt registration unit 351 performs processing related to receipts, such as registration processing of information obtained from a receipt (described later) to an external server 400. The failure location specifying unit 352 specifies a location where the acquisition of the described information in the receipt has failed.

[0016] The information acquisition unit 353 includes an image separation unit 353A, an image rotation unit 353B, and an OCR unit 353C, analyzes images obtained by reading a plurality of receipts (described later), and extracts information included in each receipt. Here, the receipt registration unit 351, the failure location identification unit 352, and the information acquisition unit 353 are realized by the CPU 111 of the management server 300 executing programs stored in the ROM 112 and the like. Note that the management server 300 of the present embodiment has a plugin for acquiring information from receipts, and in the present embodiment, the information acquisition unit 353 is realized by this plugin.

[0017] In the present embodiment, each process executed by the management server 300 described below is performed by the CPU 111 as an example of a processor. In other words, in the present embodiment, the CPU 111 as an example of a processor executes a program stored in the ROM 112 and the like, thereby executing the processes described below. In other words, in the present embodiment, the CPU 111 as an example of a processor executes a program stored in the ROM 112 and the like, thereby realizing each functional unit of the receipt registration unit 351, the failure location identification unit 352, and the information acquisition unit 353 shown in FIG. 1. And in the present embodiment, each of these functional units executes the processes described below.

[0018] FIG. 3 is a diagram showing an example of the hardware configuration of the user terminal 500. The configuration shown in FIG. 3 assumes the case where the user terminal 500 is a smartphone. The user terminal 500 includes a control unit 201 that controls the operation of the entire device, a memory card 202 that stores various data, various communication interfaces 203 that comply with wireless communication standards, an input device 204 such as a touch sensor, a display device 205 such as a liquid crystal display or an organic EL (Electro Luminescence) display, a GPS (Global Positioning System) sensor 206, and a camera 207.

[0019] The control unit 201 includes a CPU 211, a ROM 212 in which firmware, BIOS, etc. are stored, and a RAM 213 used as a work area. The CPU 211 may be a multi-core. Also, the ROM 212 may be a rewritable non-volatile semiconductor memory.

[0020] The communication interface 203 is, for example, an interface used for connection to a mobile communication system and an interface used for connection to a wireless LAN. The GPS sensor 206 is a sensor that receives radio waves from GPS satellites and measures the position of the user terminal 500. The latitude, longitude, and altitude information output from the GPS sensor 206 gives the current position of the user terminal 500. Note that the GPS sensor 206 may support an indoor positioning system. The camera 207 is composed of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and captures an object to be photographed located around the user terminal 500.

[0021] FIG. 4 is a diagram showing the functional units of the image forming apparatus 600. FIG. 5 is a front view of the image forming apparatus 600. The image forming apparatus 600 of the present embodiment has a function of reading an image on a document such as a receipt, and the image forming apparatus 600 of the present embodiment can be regarded as a reading device. As shown in FIG. 4, each functional unit constituting the image forming apparatus 600 of the present embodiment is connected to a bus 601, and data is exchanged via this bus 601.

[0022] The display unit 606 displays an image and notifies information to an operator who operates the image forming apparatus 600. The display unit 606 is formed in a rectangular shape as shown in FIG. 5. This display unit 606 is composed of, for example, a liquid crystal display or an organic EL display, and notifies information to a user who operates the image forming apparatus 600. The operation reception unit 607 (see FIGS. 4 and 5) receives operations from the user. Specifically, the operation reception unit 607 receives the user's operations on the display content displayed on the display unit 606.

[0023] Here, the display unit 606 and the operation reception unit 607 are constituted by, for example, a touch panel type display, and are arranged in a state where the display unit 606 and the operation reception unit 607 overlap. In addition, in the present embodiment, the case where the operation reception unit 607 is constituted by a touch panel type display has been described, but the operation reception unit 607 may be constituted by a pointing device such as a mouse.

[0024] The display unit 606 (see FIG. 4) is controlled by the control unit 660. Further, in the present embodiment, the user's operation on the display content in the display unit 606 is received by the operation reception unit 607. Then, in the present embodiment, according to the user's operation received by the operation reception unit 607, processing corresponding to this operation is executed.

[0025] The image reading unit 608 as an example of the reading means is constituted by a so-called scanner device, reads an image on a set document, and generates a read image (image data) of the document. In the present embodiment, as will be described later, a plurality of receipt documents are read by the image reading unit 608. The image forming unit 609 forms a toner image corresponding to the image data on a sheet which is an example of a recording material, using, for example, an electrophotographic method. Note that the image forming unit 609 may perform image formation using other methods such as an inkjet head method. The communication unit 610 is connected to the communication line 310 (see FIG. 1) and functions as a communication interface for communicating with the management server 300.

[0026] The image processing unit 611 performs image processing such as color correction and gradation correction on the image represented by the image data. The storage unit 605 is constituted by a hard disk drive or the like, and stores, for example, data received by the communication unit 610 and read images (image data) generated by the image reading unit 608. The control unit 660 controls each part of the image forming apparatus 600. The control unit 660 is constituted by a CPU (Central Processing Unit) 602, a ROM (Read Only Memory) 603, and a RAM (Random Access Memory) 604. The ROM 603 stores programs to be executed by the CPU 602. The CPU 602 reads out the programs stored in the ROM 603, uses the RAM 604 as a working area, and executes the programs.

[0027] Here, the programs executed by the CPU 602 can be provided to the image forming apparatus 600 in a state of being stored in a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), a magneto-optical recording medium, or a semiconductor memory. Also, the programs executed by the CPU 602 may be downloaded to the image forming apparatus 600 using communication means such as the Internet.

[0028] 〔First Embodiment〕 FIG. 6 is a sequence diagram showing the flow of processing executed in the information processing system 1 of the present embodiment, and is a sequence diagram in the first embodiment. In the present embodiment, first, a plurality of receipt forms, which are an example of a plurality of recording media, are arranged and set on the image reading unit 608 (see FIG. 4) of the image forming apparatus 600 by the user. Next, the user presses a start button (not shown) provided on the image forming apparatus 600 to give an instruction to start reading of the plurality of receipt forms (step S101). In other words, the user gives an instruction to start reading the information described on the plurality of receipt forms.

[0029] As a result, an image reading unit 608 as an example of a reading unit reads a plurality of receipts (step S102) to obtain a read image. More specifically, the image reading unit 608 obtains a read image that includes a plurality of receipt images, which are images representing each of the receipts. In other words, the image representing each of the receipts is an example of a medium image, and the image reading unit 608 obtains a read image that includes a plurality of these medium images. Thereafter, in this embodiment, the read image is sent by the management server 300, and the management server 300 obtains this read image. Next, the management server 300 obtains described information, which is the information described in each of the receipts, from the read image.

[0030] Specifically, first, a receipt registration unit 351 extracts a rectangular image (hereinafter referred to as a "rectangular image") included in the above-described read image from the read image (step S103). Next, an image separation unit 353A of an information acquisition unit 353 separates each of the rectangular images from other images located around the rectangular images (step S104). Next, an image rotation unit 353B rotates each of the rectangular images to make each of the rectangular images upright (step S105).

[0031] Next, an OCR unit 353C performs OCR (Optical Character Recognition) processing (step S106) to obtain the information included in each of the upright rectangular images. In other words, the OCR unit 353C obtains described information, which is the information described in each of the upright receipts. Specifically, the OCR unit 353C obtains character information described in the receipt, such as a date, an amount, etc., as described information, which is the information described in each of the receipts. In this embodiment, the described information, which is the information described in the receipt, is obtained for each receipt.

[0032] After that, in the present embodiment, the information acquisition unit 353 outputs the images of the respective receipts (rectangular images in an upright state) (hereinafter referred to as "receipt images") and the above-described description information acquired from each of these receipt images in an associated state. Note that in the present embodiment, the acquisition of the description information by the OCR unit 353C may fail, and for the portions where the acquisition of the description information fails, the information acquisition unit 353 complements them with predetermined default values. In other words, for the portions where the acquisition of the description information cannot be performed, the information acquisition unit 353 outputs a predetermined default value as the description information. In this case, description information different from the original description information will be output.

[0033] More specifically, there are cases where it is difficult to read the receipt, such as when the printing on the receipt is faint, or when the receipt is curved or folded. In this case, a situation where the acquisition of the description information cannot be performed occurs. In this case, as described above, for the portions where the acquisition of the description information cannot be performed, the information acquisition unit 353 complements the information with predetermined default values and outputs these default values.

[0034] Also, in the present embodiment, the failure location specifying unit 352 extracts an image of the portion where the acquisition of the description information by the OCR unit 353C fails (hereinafter referred to as "failure location image"). Then, in the present embodiment, the information acquisition unit 353 outputs the extracted failure location image in an associated state with the receipt image. As a result, in the present embodiment, the receipt image, the description information, and the failure location image are output from the information acquisition unit 353 (step S107). More specifically, for the receipt for which the acquisition of the description information fails, the receipt image, the description information, and the failure location image are output from the information acquisition unit 353. Also, for the receipt for which the acquisition of the description information succeeds, the receipt image and the description information are output from the information acquisition unit 353.

[0035] After that, in this embodiment, the receipt registration unit 351 determines whether or not the OCR process has succeeded (step S108). More specifically, the receipt registration unit 351 determines, for example, whether or not the information output from the information acquisition unit 353 includes a failed portion image. Then, when the failed portion image is included, the receipt registration unit 351 determines that the OCR process has failed for the receipt from which this failed portion image was obtained. Then, when the receipt registration unit 351 determines that the OCR process has failed, in other words, when it determines that the description information could not be acquired, the receipt registration unit 351 outputs information about the receipt for which the description information could not be acquired to the image forming apparatus 600.

[0036] More specifically, in this case, the receipt registration unit 351 outputs the receipt image, the description information (default value), and the failed portion image for the receipt for which the description information could not be acquired to the image forming apparatus 600 (step S109). Here, the failed portion image is an example of information about the portion where an attempt was made to acquire the description information in the receipt for which the description information could not be acquired. In this embodiment, the receipt registration unit 351 outputs information about the portion where an attempt was made to acquire the description information to the image forming apparatus 600. Here, the image forming apparatus 600 is the image forming apparatus 600 that has read the plurality of receipts that are the targets of acquisition of the description information. In this embodiment, information such as the failed portion image is output to this image forming apparatus 600 that has read the receipt.

[0037] Also, in this embodiment, together with this failed portion image, the receipt image and the description information are also transmitted to the image forming apparatus 600. That is, in this embodiment, as information about the receipt for which the description information could not be acquired, in addition to the failed portion image, the receipt image and the description information are output. This receipt image as an example of the medium image is an image representing the entire receipt. Also, the description information in this case is a value predetermined as the default as described above.

[0038] After that, in this embodiment, information about the above receipt for which acquisition of description information could not be performed is displayed on the display unit 606 (see FIGS. 4 and 5) of the image forming apparatus 600 (step S110). Specifically, in this embodiment, on the display unit 606, as information about the receipt for which acquisition of description information could not be performed, a receipt image, description information, and a failure location image are displayed.

[0039] FIG. 7 is a diagram showing an example of display on the display unit 606 of the image forming apparatus 600. On the display unit 606 of this embodiment, as described above, a receipt image G1, description information G2, and a failure location image G3 are displayed. Here, the receipt image G1 is a read image obtained by reading the receipt with the image forming apparatus 600, and is an image representing the entire receipt as described above. Also, in this embodiment, the image indicated by reference numeral 7A shows the failure location image G3, and this failure location image G3 indicates a location where acquisition of the description information G2 (original correct description information G2) in the receipt could not be performed.

[0040] Here, the portion of the description information G2 displayed in FIG. 7 is not an image image, but text information obtained by the OCR unit 353C or a default value obtained by the above complement. More specifically, in this example, for the information of "total", "receiving date", and "● month × day" in the description information G2, it is text information obtained by the OCR unit 353C. Also, in this example, for the information of "￥10,000" in the description information G2, it is a default value obtained by the above complement.

[0041] In this example, the description information G2 obtained by being complemented with a default value is displayed at the display location of the failure location image G3. Specifically, in this example, at the display location of the failure location image G3, "Total" as an example of amount information and "Receipt Date" as an example of date information are displayed. However, in this example, the amount of "￥10,000" displayed in the total part is not the correct value and is the default value as described above. Note that in this embodiment, the case where the default value is used for complementing and the default value is displayed has been described as an example. However, the default value may not be displayed, and the location where the default value is displayed may be left blank.

[0042] Furthermore, on the display unit 606, a screen G4 (hereinafter, "input screen G4") for the user to input the information described in the receipt is displayed as a part of the screen. In other words, on the display unit 606 of the image forming apparatus 600, an input screen G4 for the user to input the correct description information G2 is displayed.

[0043] In this embodiment, this input screen G4 is operated by the user, and the user inputs the correct description information described in the receipt (see step S111 in FIG. 6). In other words, in this embodiment, the default value obtained by the management server 300 is corrected by the user. Specifically, in this example, as described above, the amount is incorrect, and the user inputs information about the correct amount by operating the display unit 606.

[0044] Note that in the screen shown in FIG. 7, the display of the first receipt among the three receipts for which the description information G2 could not be obtained is performed. More specifically, in this embodiment, the case where the description information G2 could not be obtained from three receipts is exemplified, and in the screen shown in FIG. 7, the display of the first receipt among the three receipts for which the description information G2 could not be obtained is performed.

[0045] When the user inputs information about the correct amount for the first receipt, the user selects the part indicated by reference numeral 7B in FIG. 7. As a result, the screen is switched, and information about the second receipt is displayed. Then, the user operates the display unit 606 to input correct information about this second receipt.

[0046] After that, the user further selects the part indicated by reference numeral 7B in FIG. 7. As a result, the screen is further switched, and information about the third receipt is displayed. Then, the user operates the display unit 606 to input correct information about this third receipt.

[0047] After that, in this embodiment, the input information input by the user in the image forming apparatus 600 is transmitted to the management server 300 (see step S112 in FIG. 6), and the management server 300 acquires the transmitted input information. In other words, the management server 300 acquires the correct description information G2 input by the user. Then, the management server 300 replaces the incorrect description information G2 with this correct description information G2. In other words, the management server 300 replaces the above default value with this correct description information G2.

[0048] After that, in this embodiment, the receipt registration unit 351 of the management server 300 transmits the receipt image G1 and the description information G2 (description information G2 after the correct description information G2 is reflected) obtained for each of the plurality of receipts to the external server 400 (see step S113 in FIG. 6). As a result, the receipt image G1 and the description information G2 obtained for each of the plurality of receipts are registered in the external server 400. When transmitting the description information G2 to the external server 400, for a receipt for which the description information G2 has been correctly acquired from the beginning, this description information G2 is transmitted to the external server 400. In addition, for the receipt replaced with the correct description information G2 from the default value, this correct description information G2 is transmitted to the external server 400.

[0049] In the above, the case where the failure location image G3 is displayed as an example of information about the location where the acquisition of the description information G2 was attempted has been described for the display unit 606 of the image forming apparatus 600. By the way, the information about the location where the acquisition of the description information G2 was attempted is not limited to this failure location image G3.

[0050] Examples of the information about the location where the acquisition of the description information G2 was attempted include, for example, "The amount column of the receipt with the title of 〇〇 could not be read." In addition, examples include, for example, "The date column of the third receipt from the top among the arranged and set receipts could not be read." The information about the location where the acquisition of the description information G2 was attempted is not limited to image information such as the failure location image G3, and may be character information like this.

[0051] Here, the determination of the success or failure of each reading of the receipt can also be made, for example, by notifying the user of the result of the reading and having the user make the determination. By the way, in this case, the user has to determine the success or failure for all receipts, which is troublesome. On the other hand, in this embodiment, after the location where the reading failed is specified, it is notified to the user. As a result, the user does not need to determine the success or failure for all receipts, and the burden on the user is reduced.

[0052] In addition, in this embodiment, the user can input correct information via the image forming apparatus 600, which also reduces the work burden on the user. Here, there is also a mode in which the user sets the receipt for which the description information G2 could not be acquired again in the image forming apparatus 600 to re-acquire the description information G2. By the way, in this case, it is necessary to select the target receipt from among a plurality of receipts and then set it in the image forming apparatus 600. On the other hand, in the present embodiment, the description information G2 can be acquired without resetting the receipt in the image forming apparatus 600, and the work load of the user is reduced.

[0053] 〔Second Embodiment〕 Above, the case where the processing for the receipt is performed using the image forming apparatus 600 and the management server 300 has been described. The processing for the receipt is not limited to the image forming apparatus 600 and the management server 300, and may be performed using an apparatus other than these apparatuses. FIG. 8 is a diagram showing the flow of processing when the processing for the receipt is also performed using the user terminal 500.

[0054] In the processing shown in FIG. 8, the processing of steps S201 to S208 is the same as the processing of steps S101 to S108 in the processing shown in FIG. 6 above. Hereinafter, the processing after step S209 will be described. Also, hereinafter, the processing in the case where the acquisition of the description information 2 has failed for three receipts will be described in the same manner as above.

[0055] In the processing of step S209, in the same manner as above, the receipt image G1, the description information G2, and the failure location image G3 are output from the management server 300 to the image forming apparatus 600. As a result, in the same manner as above, the screen shown in FIG. 7 is displayed on the display unit 606 of the image forming apparatus 600. That is, information about the receipt for which the acquisition of the description information 2 could not be performed is displayed on the display unit 606 (step S210). Next, in this processing example, the selection button 800 labeled "Rescan on Mobile" displayed on the screen of FIG. 7 is selected by the user.

[0056] When the selection button 800 is selected, a screen shown in FIG. 9 (a diagram showing a display example on the user terminal 500), which is an example of another reading device, is displayed on the user terminal 500. More specifically, when the selection button 800 is selected, an application pre-stored in the user terminal 500 is launched, and the screen shown in FIG. 9 is displayed. On this screen, an explanation is displayed for reading the receipt. In this display example, the explanation is displayed over a plurality of lines. Also, in this display example, a display saying "Please photograph the failed part by copying" is made in a part of the plurality of lines.

[0057] Then, the user operates the user terminal 500 to visually search for the actual copy of the first receipt corresponding to the receipt image G1 of the first receipt displayed in FIG. 7, and then reads the actual copy of the first receipt using the camera 207 (see FIG. 3) of the user terminal 500. More specifically, the user photographs the part of the actual copy of the first receipt that is displayed as the failed part image G3 by copying using the camera 207 (step S211 in FIG. 8).

[0058] In the present embodiment, the user terminal 500 is a portable terminal device equipped with a camera 207, and in the present embodiment, the actual copy of the first receipt is photographed with this portable terminal device. Also, the user terminal 500 is a reading device that can perform reading at a resolution higher than the reading resolution of the image reading unit 608 provided in the image forming apparatus 600. In the present embodiment, the actual copy of the first receipt is read with the user terminal 500 having a higher reading resolution than the image reading unit 608 of the image forming apparatus 600.

[0059] In recent years, there are also smartphones and the like that have a higher reading resolution than the reading resolution of the image reading unit 608 provided in the image forming apparatus 600. In this embodiment, by using the user terminal 500 configured by a smartphone or the like, the actual receipt of the first copy can be read at a resolution higher than that of the image reading unit 608 of the image forming apparatus 600.

[0060] In addition, the user terminal 500 is capable of performing close-up shooting. In other words, the user terminal 500 is capable of shooting an object to be photographed after magnifying it. In this embodiment, the user shoots the failure portion (the portion displayed as the failure portion image G3 among the actual receipts of the first copy) in a magnified state. From the above, in this embodiment, the portion of the actual receipt of the first copy represented by the receipt image G1 shown in FIG. 7 and displayed as the failure portion image G3 is photographed at a resolution higher than the reading resolution in the image forming apparatus 600. Furthermore, in this embodiment, this portion displayed as the failure portion image G3 is photographed in a magnified state.

[0061] In FIG. 7, as described above, the display of the first receipt among the three receipts for which the described information G2 could not be obtained is shown. When the user operates the user terminal 500 to photograph the actual receipt of the first copy, the portion indicated by reference numeral 7B in FIG. 7 is selected. Thereby, the screen is switched, and information about the second receipt is displayed on the display unit 606. Then, the user operates the user terminal 500 to photograph the actual receipt of the second copy. More specifically, the user photographs the portion specified by the failure portion image G3 among the second receipts by close-up shooting.

[0062] Similarly, when the user finishes photographing the actual receipt of the second copy, the user selects the portion indicated by reference numeral 7B in FIG. 7 to switch the screen. As a result, information about the third receipt is displayed. Then, the user operates the user terminal 500 to take a picture of the actual third receipt. More specifically, similar to the above, the user takes a picture of the portion specified by the failure location image G3 of this third receipt by close-up shooting. In this embodiment, a case where the user manually switches the screen by operating the display unit 606 has been described as an example. However, each time the user takes a picture using the user terminal 500, the screen on the display unit 606 may be automatically switched.

[0063] And in this embodiment, when the user terminal 500 takes pictures of all of the three actual receipts, the user performs a predetermined operation on the application launched on the user terminal 500 (step S212 in FIG. 8). More specifically, the user performs a predetermined operation on the screen displayed by the application launched on the user terminal 500. As a result, in this embodiment, this application analyzes the captured images of the three receipts and acquires the description information G2 included in this captured image (step S213).

[0064] In other words, in this embodiment, the reading result obtained by reading with the user terminal 500, which is another device different from the image forming apparatus 600, is analyzed by this user terminal 500. And the user terminal 500 acquires the description information G2 obtained by this analysis. And in this embodiment, when the "transmission button" indicated by reference numeral 9A in FIG. 9 is pressed by the user, the description information G2 is transmitted from the user terminal 500 to the management server 300 (step S214 in FIG. 8).

[0065] As a result, the receipt registration unit 351 of the management server 300 acquires the description information G2 obtained by the user terminal 500 analyzing the above captured image. After that, a completion notice indicating that the process has been completed is output from the application running on the user terminal 500 to the user terminal 500 (step S215). Then, a completion notice indicating that the process has been completed is output from this user terminal 500 to the user (step S216).

[0066] After that, the user operates the display unit 606 of the image forming apparatus 600 and presses an "information update button (not shown)" displayed on the display unit 606 to instruct information update (step S217). Thereby, the image forming apparatus 600 accesses the management server 300 and acquires the description information G2 obtained by the above reading by the user terminal 500 (step S218).

[0067] Specifically, the image forming apparatus 600 acquires the description information G2 obtained by the above analysis by the user terminal 500 and transmitted to the management server 300. Then, this description information G2 is displayed on the display unit 606 of the image forming apparatus 600. In other words, the description information G2 obtained by photographing the actual receipt using the user terminal 500 is displayed on the display unit 606 of the image forming apparatus 600 (step S219).

[0068] FIG. 10 is a diagram showing a display example on the display unit 606 of the image forming apparatus 600. In this example, the description information G2 acquired by the user terminal 500 for each of the above three receipts is displayed on the display unit 606 of the image forming apparatus 600. On this screen of the display unit 606, when the portion indicated by reference numeral 10A is sequentially pressed, the screen is switched, and the description information G2 acquired by the user terminal 500 for each of the three receipts is displayed.

[0069] If there is an error, the part indicated by the code 10B is operated by the user, and the user inputs the correct description information G2. Then, finally, when the confirmation button (not shown) is pressed (step S220 in FIG. 8), a confirmation notice is sent from the image forming apparatus 600 to the management server 300 (step 221), and the description information G2 obtained from each of the plurality of receipts is confirmed. In this embodiment, after this confirmation, the description information G2 stored in the management server 300 is transmitted to the external server 400 (step S222).

[0070] Here, in this embodiment, as shown in FIG. 7, a case where information about a receipt for which the description information G2 could not be obtained is output to the image forming apparatus 600 that has read the receipt is described as an example.

[0071] By the way, not limited to this, the information about the receipt for which the description information G2 could not be obtained may be output to the user terminal 500, which is an example of another reading device different from the image forming apparatus 600. In this case, a screen similar to the screen shown in FIG. 7 is displayed on the user terminal 500. Note that when a screen similar to the screen shown in FIG. 7 is displayed on the user terminal 500, the screen may be displayed in a display layout different from the display layout in the image forming apparatus 600.

[0072] Here, when a screen similar to the screen shown in FIG. 7 is displayed on the user terminal 500, the receipt image G1, the description information G2, and the failure location image G3 are displayed on the user terminal 500 in the same manner as described above. In other words, when displaying a screen similar to the screen shown in FIG. 7 on the user terminal 500, information about a receipt for which the correct description information G2 could not be obtained is output to the user terminal 500, and the information about this receipt is displayed on the user terminal 500.

[0073] Here, on the screen displayed on the user terminal 500, similar to the above, as information about the receipt for which the described information G2 could not be obtained, a receipt image G1 representing the entire receipt is displayed. Also, on the screen displayed on the user terminal 500, similar to the above, information about the location where an attempt was made to obtain the described information G2 is displayed. Specifically, as information about the location where an attempt was made to obtain the described information G2, for example, a failure location image G3 is displayed. Also, on the screen displayed on the user terminal 500, similar to the above, an input screen G4 for having the user input the information described in the receipt is displayed.

[0074] (Others) In the above, the case of outputting information about the receipt for which the described information G2 could not be obtained to the image forming apparatus 600 and the user terminal 500 has been described. By the way, the image forming apparatus 600 and the user terminal 500 are not limited to this, and information about the receipt for which the described information G2 (hereinafter, may be referred to as "acquired described information G2") obtained from the receipt does not satisfy a predetermined condition may be output. In other words, the image forming apparatus 600 and the user terminal 500 may output information about the receipt for which the described information G2 could be obtained from the receipt but the described information G2 does not satisfy a predetermined condition.

[0075] Also, it is assumed that both a receipt for which the described information G2 could not be obtained and a receipt for which the acquired described information G2 does not satisfy a predetermined condition are included among a plurality of receipts. In this case, both information about the receipt for which the described information G2 could not be obtained and information about the receipt for which the acquired described information G2 does not satisfy a predetermined condition may be output to the image forming apparatus 600 and the user terminal 500.

[0076] Here, when outputting information about a receipt for which the acquired description information G2 does not satisfy a predetermined condition, similar to the above, for example, the receipt image G1, the description information G2 (description information G2 supplemented with default values), and the failure location image G3 (information about the location where the acquired description information G2 is located) are output to the image forming apparatus 600 or the user terminal 500. Note that, regarding the description information G2, instead of the description information G2 supplemented with default values, the description information G2 itself obtained by the OCR unit 353C may be output to the image forming apparatus 600 or the user terminal 500.

[0077] Also, in addition, when outputting information about a receipt for which the acquired description information G2 does not satisfy a predetermined condition, for example, the receipt image G1 and the failure location image G3 may be output to the image forming apparatus 600 or the user terminal 500. In this case, in the image forming apparatus 600 or the user terminal 500, the description information G2 is not displayed, and the location where the description information G2 is to be displayed becomes a blank. Also, at this time, in the image forming apparatus 600 or the user terminal 500, similar to the above, an input screen G4 for allowing the user to input the information described in this receipt is displayed.

[0078] Here, "the acquisition of the description information G2 could not be performed" refers to a state where, although information such as numerical values or character strings should originally be obtained, this information could not be obtained. For example, as shown in FIG. 7, information such as "total" or "receiving date" may be attached to a receipt. Although information about this "total" or "receiving date" has been obtained, if information representing numbers cannot be obtained from the location located beside this information, it corresponds to "the acquisition of the description information G2 could not be performed".

[0079] Also, "the acquired description information G2 does not satisfy a predetermined condition" refers to a state where the description information G2 has been acquired, but this acquired description information G2 does not satisfy a predetermined condition. For example, when a numerical value is obtained as the described information G2, if the number of digits of this numerical value exceeds the assumed number of digits determined in advance or is smaller than the assumed number of digits, it corresponds to "the obtained described information G2 does not satisfy the predetermined conditions". Also, for example, when information other than a numerical value is obtained in a situation where a numerical value should originally be obtained, it also corresponds to "the obtained described information G2 does not satisfy the predetermined conditions".

[0080] In addition, other than that, machine learning may be performed to improve the reading accuracy of the receipt. Specifically, based on the image of the failure location and the correct information subsequently input by the user, machine learning may be sequentially performed to improve the reading accuracy. More specifically, each time correct information is input by the user, machine learning may be performed based on the image of the failure location and this correct information to improve the reading accuracy. More specifically, in this case, based on the result of the machine learning, for example, the parameters used when reading the receipt are changed to improve the reading accuracy.

Explanation of Reference Numerals

[0081] 1... Information processing system, 111... CPU, 207... Camera, 500... User terminal, 600... Image forming apparatus, G1... Receipt image, G2... Described information, G3... Failure location image, G4... Input screen

Claims

1. A processor is provided, wherein the processor obtains description information, which is information described on each of the recording media, from a read image including a plurality of media images that are images representing each of the plurality of recording media obtained by a reading device reading the plurality of recording media, outputs information about a non-acquired recording media, which is a recording media for which the description information could not be obtained, and / or a non-satisfactory recording media, which is a recording media for which the acquired description information does not satisfy a predetermined condition, generates information for causing a different reading device other than the one reading device that has read the plurality of recording media to read the non-acquired recording media and / or the non-satisfactory recording media, such that description information, which is information described on the non-acquired recording media and / or the non-satisfactory recording media and is obtained by analyzing a reading result obtained when the non-acquired recording media and / or the non-satisfactory recording media are read by the other reading device, is displayed on a display unit provided in the one reading device that has read the plurality of recording media, an information processing system.

2. The processor outputs information about a location where an attempt was made to obtain description information among the non-acquired recording media for which the description information could not be obtained, and outputs information about a location where the acquired description information is located among the non-satisfactory recording media for which the acquired description information does not satisfy the predetermined condition. The information processing system according to claim 1.

3. The processor outputs information about the non-acquired recording media for which the description information could not be obtained to the one reading device that has read the plurality of recording media, and outputs information about the non-satisfactory recording media for which the acquired description information does not satisfy the predetermined condition to the one reading device. The information processing system according to claim 1.

4. The information about the non-acquired recording media for which the description information could not be obtained is displayed on the one reading device, and the information about the non-satisfactory recording media for which the acquired description information does not satisfy the predetermined condition is displayed on the one reading device. The information processing system according to claim 3.

5. The processor As the information about the non-acquired recording medium for which the recorded information could not be acquired, output the medium image representing the non-acquired recording medium to the one reading device. The information processing system according to claim 3, wherein, as the information about the non-satisfying recording medium for which the acquired recorded information does not satisfy the predetermined condition, output the medium image representing the non-satisfying recording medium to the one reading device. **Claim 6** The information processing system according to claim 5, wherein the medium image is displayed on the one reading device. **Claim 7** On the one reading device, a screen for having a user input the information recorded on the non-acquired recording medium for which the recorded information could not be acquired is displayed. The information processing system according to claim 3, wherein on the one reading device, a screen for having a user input the information recorded on the non-satisfying recording medium for which the acquired recorded information does not satisfy the predetermined condition is displayed. **Claim 8** The processor acquires the recorded information obtained by the other reading device analyzing the reading result obtained by the non-acquired recording medium for which the recorded information could not be acquired being read by the other reading device; The information processing system according to claim 1, wherein the processor acquires the recorded information obtained by the other reading device analyzing the reading result obtained by the non-satisfying recording medium for which the acquired recorded information does not satisfy the predetermined condition being read by the other reading device. **Claim 9** The information processing system according to claim 8, wherein the other reading device is a reading device capable of performing reading at a reading resolution higher than the reading resolution of the one reading device. **Claim 10** The processor outputs the information about the non-acquired recording medium for which the recorded information could not be acquired to another reading device different from the one reading device that has read the plurality of recording media; The information processing system according to claim 1, wherein the processor outputs the information about the non-satisfying recording medium for which the acquired recorded information does not satisfy the predetermined condition to another reading device different from the one reading device that has read the plurality of recording media. **Claim 11** The information processing system according to claim 10, wherein the other reading device is a reading device capable of performing reading at a reading resolution higher than the reading resolution of the one reading device.

12. A screen for having a user input information described on the non-acquisition recording medium for which acquisition of the described information could not be performed is displayed on the other reading device, The information processing system according to claim 10, wherein a screen for having a user input information described on the non-satisfaction recording medium for which the acquired described information does not satisfy the predetermined conditions is displayed on the other reading device.

13. The processor, Outputs information about the non-acquisition recording medium for which acquisition of the described information could not be performed to a portable terminal device equipped with a camera, which is another reading device different from the one reading device that has read the plurality of recording media, The information processing system according to claim 1, wherein information about the non-satisfaction recording medium for which the acquired described information does not satisfy the predetermined conditions is output to the portable terminal device equipped with a camera.

14. A function of acquiring described information, which is information described on each of the recording media, from a reading image that includes a plurality of media images, which are images representing each of the recording media obtained by a reading device reading a plurality of recording media; A function of outputting information about a non-acquisition recording medium, which is the recording medium for which acquisition of the described information could not be performed, and / or a non-satisfaction recording medium, which is the recording medium for which the acquired described information does not satisfy the predetermined conditions; A function of generating information for causing the non-acquisition recording medium and / or the non-satisfaction recording medium to be read by another reading device different from the one reading device that has read the plurality of recording media; A function of causing the described information, which is the information described on the non-acquisition recording medium and / or the non-satisfaction recording medium, and which is the reading result obtained by the other reading device analyzing the reading result obtained by the other reading device reading the non-acquisition recording medium and / or the non-satisfaction recording medium, to be displayed on a display unit provided in the one reading device that has read the plurality of recording media; A program for causing a computer to realize the above.

15. A reading device capable of reading a recording medium, a reading means capable of reading a plurality of recording media on which information is described, the reading means reading the plurality of recording media for which acquisition of the described information, which is the information described, is performed for each of the recording media, a display unit that displays information about a non-acquisition recording medium that is a recording medium for which acquisition of the described information could not be performed among the plurality of recording media read by the reading means, and / or a non-satisfaction recording medium that is a recording medium for which the acquired described information, which is the acquired described information, does not satisfy a predetermined condition, an acquisition means for acquiring the described information, which is the information described on the non-acquisition recording medium and / or the non-satisfaction recording medium, and which is obtained by analyzing the reading result obtained by reading the non-acquisition recording medium and / or the non-satisfaction recording medium by another reading device, comprising, the display unit displays information about the non-acquisition recording medium and / or the non-satisfaction recording medium, and when the described information is acquired by the acquisition means, the display unit displays the described information, a reading device.

Images