Information processing device, information processing system, information processing method and program

Abstract

To make it possible to notify a user of an error of contents of facsimile reception.SOLUTION: An information processing device includes an extraction unit for executing character recognition of image data received by a facsimile, and extracting a character string of a prescribed area in the image data, a determination unit for determining whether the extracted character string satisfies a condition set to the prescribed area, and an output unit for performing a prescribed output if the extracted character sting does not satisfy the condition.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing system, an information processing method, and a program. [Background technology]

[0002] Conventionally, information contained in image data received by fax has been automatically extracted by applying OCR processing to the image data.

[0003] For example, Patent Document 1 discloses extracting data indicating an order from a customer from image data received by fax. Summary of the Invention [Problem to be solved by the invention]

[0004] However, the contents of a fax are not always correct. For example, a document containing an error may be sent by fax due to a sender's mistake. With conventional technology, it has been difficult to automatically detect such errors and notify the user (fax recipient).

[0005] The present invention has been made in view of the above-mentioned points, and an object of the present invention is to make it possible to notify a user of an error in the contents of a received fax. [Means for solving the problem]

[0006] In order to solve the above problem, the information processing apparatus includes an extracting unit that executes character recognition on image data received by fax and extracts a character string in a predetermined area of the image data, and an extracting unit that sets the extracted character string in the predetermined area. Matches a string a determination unit that determines whether the extracted character string is Matches the set string If not, Indicates that the image data is invalid and an output unit for performing output. [Effects of the Invention]

[0007] It is possible to notify the user of any errors in the contents of the received fax. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of a hardware configuration of an image forming apparatus 10 according to an embodiment of the present invention. [Figure 2] 1 is a diagram illustrating an example of a functional configuration of an image forming apparatus 10 according to an embodiment of the present invention. [Figure 3] 10 is a sequence diagram illustrating an example of a processing procedure executed by the image forming apparatus 10. FIG. [Figure 4] FIG. 2 is a diagram illustrating an example of the configuration of a condition storage unit 132. [Figure 5] FIG. 10 is a diagram showing an example of a feedback screen display notifying that the received image is fraudulent. [Figure 6] FIG. 10 is a diagram showing an example of a feedback screen display notifying that the authenticity of a received image is unknown. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a diagram showing an example of the hardware configuration of an image forming apparatus 10 according to an embodiment of the present invention. In Fig. 1, the image forming apparatus 10 has hardware such as a controller 11, a scanner 12, a printer 13, a modem 14, an operation panel 15, a network interface 16, and an SD card slot 17.

[0010] The controller 11 has a CPU 111, a RAM 112, a ROM 113, a HDD 114, an NVRAM 115, etc. The ROM 113 stores various programs, data used by the programs, etc. The RAM 112 is used as a storage area for loading programs, a work area for the loaded programs, etc. The CPU 111 realizes various functions by processing the programs loaded into the RAM 112. The HDD 114 stores programs, various data used by the programs, etc. The NVRAM 115 stores various setting information, etc.

[0011] The scanner 12 is hardware (image reading means) for reading image data from an original. The printer 13 is hardware (printing means) for printing print data on printing paper. The modem 14 is hardware for connecting to a telephone line and is used to send and receive image data via FAX communication. The operation panel 15 is hardware equipped with input means such as buttons for receiving user input and display means such as an LCD panel. The LCD panel may have a touch panel function. In this case, the LCD panel also functions as an input means. The network interface 16 is hardware for connecting to a network (whether wired or wireless) such as a LAN. The SD card slot 17 is used to read programs stored on the SD card 80. In other words, in the image forming apparatus 10, not only programs stored in the ROM 113 but also programs stored on the SD card 80 can be loaded into the RAM 112 and executed. Note that the SD card 80 may be replaced with another recording medium (e.g., a CD-ROM or a USB (Universal Serial Bus) memory). That is, the type of recording medium corresponding to the position of the SD card 80 is not limited to a predetermined one. In this case, the SD card slot 17 may be replaced by hardware that corresponds to the type of recording medium.

[0012] Fig. 2 is a diagram showing an example of the functional configuration of image forming apparatus 10 according to the embodiment of the present invention. In Fig. 2, image forming apparatus 10 has fax application 121, fax control unit 122, reception control unit 123, print control unit 124, and OCR unit 125. Each of these units is realized by processing executed by CPU 111 of one or more programs installed in image forming apparatus 10. Image forming apparatus 10 also uses image storage unit 131 and condition storage unit 132. Each of these storage units can be realized using, for example, HDD 114 or RAM 112, or a storage device connected to image forming apparatus 10 via a network.

[0013] The reception control unit 123 controls the reception of image data transmitted by fax (fax reception). The print control unit 124 controls the printing of image data received by fax and stores the image data in the image storage unit 131. The OCR unit 125 applies optical character recognition (OCR) to a predetermined area of the image data to extract character strings and the coordinate values of each character included in the predetermined area. The fax control unit 122 controls processing executed in response to fax reception by the reception control unit 123. During this processing, the fax control unit 122 determines whether the character string extracted by the OCR unit 125 satisfies a predetermined condition for a predetermined area of the image data received by fax. The condition is stored in the condition storage unit 132. The fax application 121 controls the display of a screen for accepting user operations, a screen showing the results of the determination by the fax control unit 122, and the like.

[0014] The following describes the processing procedure executed by the image forming apparatus 10. Fig. 3 is a sequence diagram for explaining an example of the processing procedure executed by the image forming apparatus 10.

[0015] When the reception control unit 123 receives a fax (S101), it notifies the fax control unit 122 of the image data received by fax (hereinafter referred to as the "received image") and the fax number of the sender (hereinafter referred to as the "sender number") (S102).

[0016] Next, the fax control unit 122 requests the print control unit 124 to save the received image and the sender number (S103). In response to the request from the fax control unit 122, the print control unit 124 associates the received image with the sender number and saves it in the image storage unit 131 (S104). Next, the print control unit 124 notifies the fax control unit 122 that saving of the received image is complete (S105). Note that in parallel with saving the received image, or before or after saving the received image, the print control unit 124 controls printing of the received image. As a result, paper on which the received image is printed is ejected from the image forming apparatus 10.

[0017] Next, the fax control unit 122 requests the OCR unit 125 to perform OCR processing on the received image (S106). In response to the request from the fax control unit 122, the OCR unit 125 obtains the received image and the sender number from the image storage unit 131 (S107, S108).

[0018] Next, the OCR unit 125 applies OCR processing (character recognition) to the received image to extract character strings from predetermined areas of the received image (S109). The predetermined areas are defined in the format data. The format data is data that defines each area (each range) to be subjected to OCR processing and the meaning (item name) of the character strings extracted from each area. In this embodiment, the format data is defined for each sender fax number, and the association between the fax number and the format data is stored in the condition storage unit 132.

[0019] Fig. 4 is a diagram showing an example of the configuration of condition storage unit 132. As shown in Fig. 4, condition storage unit 132 stores format names and the like in association with sender numbers. The contents stored in condition storage unit 132 are set in advance by, for example, an administrator or the like.

[0020] The sender number is the fax number of the sender. The format name is identification information for the format data corresponding to the sender. In other words, in this embodiment, the format data (the area from which the character string is extracted) can be made different depending on the sender. As a result, the format of the order form can be made different depending on the sender.

[0021] The OCR unit 125 identifies the format name of the format data to be used (hereinafter referred to as the "target format") based on the sender number associated with the received image. The actual format data is stored, for example, in the HDD 114. The OCR unit 125 extracts one or more character strings from one or more areas of the received image based on the format data (hereinafter referred to as the "target format") corresponding to the sender number associated with the received image. In this embodiment, a fax transmitted from each sender is an order form for a product ordered by the fax recipient, and is a document containing items such as the sender's address, the name of the person in charge, and the number of orders. However, the layout of each of these items differs depending on the sender, and this layout is defined in the format data. Therefore, the OCR unit 125 extracts character strings indicating the contents of each of these items from the received image based on the target format associated with the sender. However, if the target format (i.e., format data corresponding to the sender number) does not exist, the OCR processing unit does not perform OCR processing.

[0022] Note that multiple format data may be associated with the same sender number. FIG. 4 shows an example in which two format data (format names) are associated with the same sender number ("001"). In this case, the OCR unit 125 extracts a group of character strings from the received image based on each of the multiple format data and adopts the best extraction result. For example, if using one format data makes it impossible to extract character strings from some areas, but using the other format data makes it possible to extract character strings from all areas, the OCR unit 125 may adopt the extraction result obtained using the other format data.

[0023] Next, the OCR unit 125 notifies the fax control unit 122 of information indicating the group of character strings extracted from the received image by the OCR process and the item name of each character string (hereinafter referred to as the "OCR result") (S110). Note that if the OCR process is not executed, the content of the OCR result is empty.

[0024] Next, the fax control unit 122 compares the OCR result with the conditions that a correct order form must satisfy, which are stored in the condition storage unit 132, to determine whether the order form associated with the received image is correct (S111).

[0025] The conditions are stored in association with the sender number in the condition storage unit 132 shown in FIG. 4. That is, among the items associated with the sender number in FIG. 4, the address, the name of the person in charge, and the number of orders correspond to the conditions. The address is the address of the sender associated with the sender number. The name of the person in charge is the name of the person in charge at the sender who is scheduled to send the purchase order. The number of orders is the range of the number of orders for the sender (thresholds indicating the lower and upper limits). That is, in this embodiment, the conditions can be made different depending on the sender. As a result, the conditions can be made different depending on the order status of the sender.

[0026] The fax control unit 122 determines whether the address, person in charge, and number of orders included in the OCR results satisfy the conditions (hereinafter referred to as "target conditions") stored in the condition storage unit 132 in association with the sender number. Specifically, the fax control unit 122 determines that the address in the OCR results is correct if it matches the address in the target conditions, and determines that it is incorrect if it does not match. The fax control unit 122 also determines that the name in the OCR results is correct if it matches the name in the target conditions, and determines that it is incorrect if it does not match. The fax control unit 122 also determines that the number of orders in the OCR results is correct if it is within the range indicated by the number of orders in the target conditions, and determines that it is incorrect if it is outside that range.

[0027] If the fax control unit 122 determines that one or more of the address, the name of the person in charge, and the number of orders in the OCR result are incorrect, it sends a notification to the fax application 121 indicating that the order form related to the received image is invalid (S112). At this time, the fax control unit 122 includes the received image, the target format, the OCR result, and the target conditions in the notification.

[0028] In response to the notification, the fax application 121 displays a feedback screen on the operation panel 15 to notify the user that the received image is invalid (S113).

[0029] FIG. 5 is a diagram showing an example of a feedback screen display notifying a user that a received image is fraudulent. In the example of FIG. 5, the feedback screen 510 includes the received image, the target format, and a comparison result 511. The comparison result 511 is information showing the results of comparing the OCR results for each item (address, name of person in charge, and number of orders) that make up the target conditions with the target conditions. FIG. 5 shows an example in which neither the address nor the name of person in charge matches the target conditions, and the number of orders is also outside the range of the target conditions. By displaying the target format, the user can visually confirm the format data applied to the received image.

[0030] By referring to this feedback screen 510, if the user determines that a fax with an incorrect address or contact person has been received, the user can suspect that the fax is fake and confirm with the sender whether the order is authentic. Also, if the user determines that the number of orders is incorrect, the user can confirm with the sender whether the number of orders is authentic, assuming that the sender may have made a mistake. As a result, it is possible to avoid unnecessary work being performed in response to an incorrect order.

[0031] If the OCR result is empty (i.e., if the target format does not exist), the target condition does not exist. In this case, the fax control unit 122 sends a notification to the fax application 121 indicating that the authenticity of the order form related to the received image is unknown (S114). At this time, the fax control unit 122 includes the received image in the notification.

[0032] In response to the notification, the fax application 121 displays a feedback screen on the operation panel 15 to notify the user that the authenticity of the received image is unknown (S115).

[0033] 6 is a diagram showing an example of a feedback screen display notifying that the authenticity of the received image is unknown. In the example of FIG. 6, feedback screen 520 includes the received image and a message indicating that the format data has not been registered. In this case, the user can know that the order is from a new customer, or that an existing customer has started using a new format of order form.

[0034] As described above, according to this embodiment, it is determined whether a character string extracted from image data received by fax satisfies the conditions set for the area from which the character string was extracted, and if the character string does not satisfy the conditions, a message to that effect is output to the user, thereby making it possible to notify the user of an error in the content of the fax reception.

[0035] In the above, an example has been described in which the image forming apparatus 10 has all of the functional configuration shown in FIG. 2, but some of the functional configuration may be possessed, for example, by an information processing apparatus connected to the image forming apparatus 10 via a network. As an example, the OCR 125 may be possessed by the information processing apparatus. Also, some of the processing performed by the fax control unit 122 (e.g., step S111 in FIG. 3) may be performed by the information processing apparatus or another information processing apparatus (hereinafter, these information processing apparatuses are collectively referred to as "external apparatus"). In other words, the image forming apparatus 10 may be realized as an information processing system composed of multiple apparatuses.

[0036] In this case, the external device is not limited to an image forming device as long as it has a communication function. The external device may be, for example, a PJ (Projector), an IWB (Interactive White Board: a white board with an electronic blackboard function that allows mutual communication), an output device such as digital signage, a HUD (Head Up Display) device, industrial machinery, an imaging device, a sound collection device, a medical device, a network home appliance, a notebook PC (Personal Computer), a mobile phone, a smartphone, a tablet terminal, a game console, a PDA (Personal Digital Assistant), a digital camera, a wearable PC, a desktop PC, or the like.

[0037] Furthermore, each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), and conventional circuit modules designed to perform each of the above-described functions.

[0038] In the present embodiment, the image forming apparatus 10 is an example of an information processing apparatus. The OCR unit 125 is an example of an extraction unit. The fax control unit 122 is an example of a determination unit. The fax application 121 is an example of an output unit.

[0039] Although the embodiments of the present invention have been described in detail above, the present invention is not limited to such specific embodiments, and various modifications and variations are possible within the scope of the gist of the present invention as described in the claims. [Explanation of symbols]

[0040] 10 Image forming device 11 Controller 12 Scanner 13 Printers 14 Modem 15 Operation panel 16 Network Interfaces 17 SD card slot 80 SD cards 111 CPU 112 RAM 113 ROM 114 HDD 115 NVRAM 121 Fax App 122 Fax control section 123 Reception control section 124 Printing control unit 125 OCR section 131 Image storage unit 132 Condition memory section [Prior art documents] [Patent documents]

[0041] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-214992

Claims

1. an extraction unit that performs character recognition on image data received by fax and extracts character strings in a predetermined area of the image data; a determination unit that determines whether the extracted character string matches a character string set for the predetermined area; an output unit that outputs a signal indicating that the image data is invalid when the extracted character string does not match the set character string; An information processing device comprising:

2. The predetermined area varies depending on the sender of the fax.

2. The information processing apparatus according to claim 1, wherein:

3. The character string set in the predetermined area varies depending on the sender of the fax.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

4. An information processing system including a plurality of devices, an extraction unit that performs character recognition on image data received by fax and extracts character strings in a predetermined area of the image data; a determination unit that determines whether the extracted character string matches a character string set for the predetermined area; an output unit that outputs a signal indicating that the image data is invalid when the extracted character string does not match the set character string; An information processing system comprising:

5. The computer an extraction step of performing character recognition on image data received by fax and extracting a character string in a predetermined area of the image data; a determination step of determining whether the extracted character string matches a character string set for the predetermined area; an output step of outputting an indication that the image data is invalid if the extracted character string does not match the set character string; An information processing method comprising:

6. On the computer, an extraction step of performing character recognition on image data received by fax and extracting a character string in a predetermined area of the image data; a determination step of determining whether the extracted character string matches a character string set for the predetermined area; an output step of outputting an indication that the image data is invalid if the extracted character string does not match the set character string; A program characterized by executing the following.

Images