Receipt processing device, receipt processing method, and program

Abstract

Previously, the inspection of receipt images was insufficient. [Solution] A receipt processing device 1 comprises an image receiving unit 121 that receives receipt images, a number acquisition means 1321 that obtains a registration number from the receipt images received by the image receiving unit 121, a number inspection means 1331 that checks whether or not the registration number exists in the registration number database, and a receipt processing unit 134 that performs processing according to the inspection result of the number inspection means 1331, thereby enabling appropriate inspection of receipt images.

Description

Technical Field

[0001] The present invention relates to a receipt processing device that inspects a receipt image and the like.

Background Art

[0002] Conventionally, there has been a technique for inspecting whether there is no duplicate receipt in a received receipt image (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, the inspection of the receipt image was insufficient.

Means for Solving the Problems

[0005] The receipt processing device of the first invention includes an image reception unit that receives a receipt image, a number acquisition unit that acquires a registration number from the receipt image received by the image reception unit, a number inspection unit that inspects whether the registration number exists in the registration number database, and a receipt processing unit that performs processing according to the inspection result of the number inspection unit.

[0006] With such a configuration, it is possible to inspect the registration number of the receipt image.

[0007] Furthermore, the receipt processing device of the second invention is a receipt processing device that, compared to the first invention, further comprises an amount acquisition means for acquiring the product price and consumption tax amount using a receipt image, and the receipt processing device comprises a price change means for acquiring a modified product price by adding part or all of the consumption tax amount acquired by the amount acquisition means to the product price if the number acquisition means fails to acquire a registration number from the receipt image, or if the number inspection means obtains an inspection result indicating that the registration number does not exist in the registration number database.

[0008] This configuration allows for appropriate processing based on the inspection results regarding the registration number of the receipt image.

[0009] Furthermore, the receipt processing device of this third invention, in contrast to the second invention, is a receipt processing device that includes a product price storage means for storing the changed product price.

[0010] This configuration allows for appropriate processing based on the inspection results regarding the registration number of the receipt image.

[0011] Furthermore, the receipt processing device of the fourth invention is a receipt processing device that, in addition to the first invention, further comprises an image inspection unit that performs an inspection of the receipt image received by the image reception unit, and a result output unit that outputs the results of the inspection performed by the image inspection unit.

[0012] This configuration allows for the inspection of receipt images.

[0013] Furthermore, the receipt processing device of the fifth invention, in contrast to the fourth invention, is a receipt processing device in which the image inspection unit is equipped with a corner inspection means that inspects whether or not the four corners of a receipt are present in the receipt image received by the image receiving unit.

[0014] This configuration allows for checking whether the receipt image contains all the details of the receipt.

[0015] In addition, the receipt processing apparatus of the sixth invention further includes, with respect to the fourth invention, an issue date acquisition means for acquiring the issue date of the receipt from the receipt image received by the image reception unit, and a period inspection means for acquiring the elapsed period from the issue date acquired by the issue date acquisition means and inspecting whether the elapsed period satisfies an improper condition.

[0016] With such a configuration, it is possible to inspect whether the issue date obtained from the receipt image is appropriate.

[0017] In addition, the receipt processing apparatus of the seventh invention further includes, with respect to the first invention, a type acquisition means for acquiring an image type indicating whether the receipt image received by the image reception unit is an image of an electronic receipt or an image of a paper receipt imaged, and a type storage means for storing the image type acquired by the type acquisition means.

[0018] With such a configuration, the type of the receipt image can be acquired.

Advantages of the Invention

[0019] According to the receipt processing apparatus of the present invention, appropriate inspection of the receipt image can be performed.

Brief Description of the Drawings

[0020] [Figure 1] Conceptual diagram of the receipt system A in Embodiment 1 [Figure 2] Block diagram of the receipt system A [Figure 3] Block diagram of the receipt processing apparatus 1 [Figure 4] Flowchart for explaining an operation example of the receipt processing apparatus 1 [Figure 5] Flowchart for explaining an example of the image inspection process [Figure 6] Flowchart for explaining an example of the information acquisition process [Figure 7] Flowchart for explaining an example of the content inspection process [Figure 8]Flowchart for explaining an example of receipt processing [Figure 9] Diagram showing an example of a receipt management table [Figure 10] Diagram showing an example of a receipt image [Figure 11] Diagram showing an example of the screen [Figure 12] Block diagram of the computer system

Mode for Carrying Out the Invention

[0021] Hereinafter, embodiments of a receipt processing apparatus and the like will be described with reference to the drawings. In the embodiments, components denoted by the same reference numerals perform the same operations, and thus the description may be omitted again.

[0022] (Embodiment 1) In the present embodiment, a receipt processing apparatus that acquires a registration number from a receipt image and confirms the authenticity of the registration number will be described.

[0023] In the present embodiment, a receipt processing apparatus that performs different processes depending on whether there is a description of a registration number and whether the registration number exists, or whether there is no description of the registration number or the registration number does not exist will be described.

[0024] In the present embodiment, a receipt processing apparatus that processes a receipt by using part or all of the consumption tax as the commodity price when there is no description of the registration number or the registration number does not exist will be described.

[0025] In the present embodiment, a receipt processing apparatus that inspects a receipt image as an image will be described. The inspection as an image is, for example, an inspection of the resolution or an inspection of whether the four corners of the receipt exist.

[0026] In the present embodiment, a receipt processing apparatus that inspects the elapsed period from the issue date of the receipt will be described.

[0027] This embodiment describes a receipt processing device that checks whether a receipt image is an electronic image or a scanned image of paper, stores the image type, and manages it.

[0028] In this specification, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is irrelevant. Information X and information Y may be linked, may reside in the same buffer, may information X be contained in information Y, or information Y may be contained in information X, and so on.

[0029] Furthermore, in this specification, selecting or determining information Z means obtaining information Z, obtaining a pointer to information Z, obtaining the ID of information Z, setting a flag on information Z, etc., and it is sufficient to be able to access information Z.

[0030] Figure 1 is a conceptual diagram of the receipt system A in this embodiment. The receipt system A comprises a receipt processing device 1 and a terminal device 2.

[0031] Figure 2 is a block diagram of the receipt system A in this embodiment. Figure 3 is a block diagram of the receipt processing device 1.

[0032] The receipt processing device 1 comprises a storage unit 11, a reception unit 12, a processing unit 13, and an output unit 14. The storage unit 11 comprises a receipt management unit 111. The reception unit 12 comprises an image reception unit 121 and an instruction reception unit 122. The processing unit 13 comprises an image inspection unit 131, an information acquisition unit 132, a content inspection unit 133, and a receipt processing unit 134. The image inspection unit 131 comprises a resolution inspection means 1311 and a four-corner inspection means 1312. The information acquisition unit 132 comprises a number acquisition means 1321, an amount acquisition means 1322, an issue date acquisition means 1323, and a type acquisition means 1324. The content inspection unit 133 comprises a number inspection means 1331 and a period inspection means 1332. The receipt processing unit 134 includes an image storage means 1341, a price change means 1342, a product price storage means 1343, a consumption tax storage means 1344, and a type storage means 1345. The output unit 14 includes a result output unit 141.

[0033] The terminal device 2 includes a terminal storage unit 21, a terminal receiving unit 22, a terminal processing unit 23, a terminal transmission unit 24, a terminal receiving unit 25, and a terminal output unit 26.

[0034] The storage unit 11, which constitutes the receipt processing device 1, stores various types of information. These types of information include, for example, receipt information, which will be described later.

[0035] The receipt management unit 111 stores one or more receipt information. Receipt information refers to information about a receipt. Receipt information preferably includes a receipt image, but does not have to. Receipt information includes, for example, one or more elemental information written on the receipt. Receipt information includes, for example, one or more elemental information obtained by character recognition processing on the receipt image. Elemental information may also be information obtained based on information obtained by character recognition processing on the receipt image. Receipt information is associated with, for example, one or more inspection results. Elemental information may include, for example, the issue date, product price, consumption tax amount, registration number, payee, and image type.

[0036] The inspection results are the results of the inspection process performed by the image inspection unit 131 or the content inspection unit 133, which will be described later. The inspection process may also be a judgment process. The inspection results may also be judgment results.

[0037] The reception unit 12 receives various instructions and information. For example, the reception unit 12 receives various instructions and information from the terminal device 2. These instructions and information include, for example, the receipt image, the receipt application instruction, and the acquisition instruction, which will be described later.

[0038] The image receiving unit 121 receives receipt images. For example, the image receiving unit 121 receives receipt images from the terminal device 2. For example, the image receiving unit 121 receives receipt application instructions.

[0039] A receipt request instruction is an instruction to request a receipt. A receipt request instruction includes a receipt image. Preferably, a receipt request instruction includes a user identifier. A user identifier is information that identifies a user. A user identifier may be, for example, a user ID, email address, telephone number, or name.

[0040] Here, "reception" typically refers to the reception of information transmitted via wired or wireless communication lines, but it may also be a concept that includes the reception of information input from input devices such as keyboards, mice, and touch panels, as well as the reception of information read from recording media such as optical discs, magnetic discs, and semiconductor memory.

[0041] The instruction receiving unit 122 receives various instructions. The instruction receiving unit 122 receives various instructions from the terminal device 2. These instructions include, for example, acquisition instructions. An acquisition instruction is an instruction to acquire receipt information.

[0042] The processing unit 13 performs various processes. These processes include, for example, those performed by the image inspection unit 131, the information acquisition unit 132, the content inspection unit 133, and the receipt processing unit 134.

[0043] The image inspection unit 131 performs inspections of receipt images received by the image reception unit 121. Such inspections are called image inspections. Image inspections include, for example, resolution inspections, corner inspections, and type inspections, which will be described later.

[0044] The resolution inspection means 1311 performs a resolution inspection on the receipt image received by the image receiving unit 121. Resolution inspection is an inspection to determine whether the receipt image meets the resolution conditions. Resolution conditions are conditions related to the resolution of the receipt image. For example, the resolution conditions are that the resolution is equal to or greater than a threshold, or that the resolution is greater than a threshold. In this case, if the resolution conditions are met, the resolution inspection means 1311 obtains an inspection result indicating that the resolution of the receipt image is normal, and if the resolution conditions are not met, it obtains an inspection result indicating that the resolution of the receipt image is not normal (abnormal).

[0045] The corner inspection means 1312 performs a corner inspection on the receipt image received by the image receiving unit 121. In other words, the corner inspection means 1312 checks whether the four corners of the receipt are present in the receipt image received by the image receiving unit 121. The corner inspection means 1312 obtains an inspection result indicating that the receipt image is normal if the four corners of the receipt are present, and abnormal if the four corners of the receipt are not present.

[0046] The corner inspection means 1312 performs corner inspection by, for example, an image processing method, a machine learning method, or a generative AI method. The method of corner inspection is not limited. Corner inspection can also be described as an inspection of whether the receipt image contains the entirety of the receipt. (1) Image processing method

[0047] The four-corner inspection means 1312, for example, extracts the outline of a rectangle in the receipt image, and determines that the four corners of the receipt exist in the receipt image if none of the pixels constituting the outline of the extracted rectangle are pixels at the edges of the receipt image, and determines that the four corners of the receipt do not exist in the receipt image if any of the pixels are pixels at the edges of the receipt image.

[0048] The four-corner inspection means 1312, for example, extracts the outline of a rectangle within the receipt image. If it can detect the outline of a rectangle within the receipt image, it determines that the four corners of the receipt are present in the receipt image. If it cannot detect the outline of a rectangle within the receipt image, it determines that the four corners of the receipt are not present in the receipt image.

[0049] The four-corner inspection means 1312 may perform character recognition on the receipt image, obtain one or more character strings, and if it detects that the character strings are truncated, it may determine that the receipt image does not contain the entire receipt. (2) Methods using machine learning

[0050] The corner inspection means 1312, for example, provides the receipt image received by the image receiving unit 121 and the learning model to a machine learning prediction processing module, executes the module, and obtains a prediction result that either the four corners of the receipt are present in the receipt image ("true") or the four corners of the receipt are not present in the receipt image ("false").

[0051] The above-mentioned learning model is a model obtained by providing a machine learning learning module with a set of training data consisting of one or more positive examples of receipt images where all four corners of the receipt are present (images showing the entire receipt) and one or more negative examples of receipt images where all four corners are absent (images where part of the receipt is cut off), and then running that module.

[0052] The learning model is the information obtained by the learning unit (not shown in the diagram) performing the above-mentioned machine learning learning process, and is used for the prediction process of machine learning. The learning model can also be called a learner, classifier, or classification model. The machine learning algorithm can be deep learning, random forest, decision tree, SVM, etc. Furthermore, various machine learning functions and various existing libraries can be used for machine learning, such as the TensorFlow® library, the R language's random forest module, fastText, TinySVM, etc. (3) Method using a generative AI

[0053] The corner inspection means 1312 performs corner inspection using, for example, a generating AI. The corner inspection means 1312 provides the generating AI with a receipt image and prompts such as "Please answer whether the four corners of the receipt are present in the receipt image" or "Please answer whether the entire receipt is visible in the receipt image," and obtains the corner inspection results from the generating AI.

[0054] The information acquisition unit 132 acquires the strings displayed in the receipt image. These strings may include, for example, the registration number, product price, consumption tax amount, and receipt issuance date. The product price is usually the price of the product, but it may also be the price of a service.

[0055] The information acquisition unit 132 acquires one or more strings displayed in the receipt image, for example, by a method using character recognition processing, a method using machine learning, or a method using generative AI. (1) Method using character recognition processing

[0056] The information acquisition unit 132 performs character recognition processing on the receipt image received by the image reception unit 121, for example, and obtains one or more character strings.

[0057] If the information acquisition unit 132 acquires two or more strings, the information acquisition unit 132 acquires, for example, the class of each of the two or more strings. The class is the type of string. Examples of classes include issue date, product price, consumption tax amount, registration number, and payee. (2) Methods using machine learning

[0058] The information acquisition unit 132, for example, provides the receipt image received by the image reception unit 121 and the learning model to a machine learning prediction processing module, executes the module, and obtains a string that is the prediction result from the receipt image.

[0059] The above-described learning model is obtained by providing a set of training data, consisting of receipt images and one or more strings to be extracted, to a machine learning learning module, executing the module, and then obtaining the model. The machine learning algorithm used is not limited to deep learning, random forest, decision tree, SVM, etc. (3) Method using a generative AI

[0060] The information acquisition unit 132, for example, passes the receipt image received by the image reception unit 121 to the generation AI, gives the generation AI a prompt (for example, "Please extract <string> from the image"), and obtains the string corresponding to <string> from the generation AI. <string> may be, for example, the registration number, product price, or consumption tax amount.

[0061] The number acquisition means 1321 acquires the registration number from the receipt image received by the image reception unit 121. The registration number is a number that is notified to a business that wishes to register as a qualified invoice issuer when it submits an "Application for Registration as a Qualified Invoice Issuer" to the head of the tax office having jurisdiction over its tax domicile and is registered by the head of the tax office.

[0062] Furthermore, if the receipt image does not contain the registration number, the number acquisition method 1321 cannot acquire the registration number.

[0063] The number acquisition means 1321 acquires the registration number displayed in the receipt image by, for example, a method using character recognition processing, a method using machine learning, or a method using generative AI. The algorithm used by the number acquisition means 1321 to acquire the registration number is not limited. (1) Method using character recognition processing

[0064] The number acquisition means 1321, for example, performs character recognition on a receipt image and obtains a string of characters in the format "T" + 13 digits. This string is the registration number. Alternatively, the number acquisition means 1321 may obtain the string "T" + 13 digits from the string obtained by the information acquisition unit 132.

[0065] The number acquisition means 1321, for example, acquires a string whose class is "registration number" from the strings obtained from the receipt image. (2) Methods using machine learning

[0066] The number acquisition means 1321 uses machine learning prediction processing to acquire the registration number from the receipt image.

[0067] The number acquisition means 1321 acquires, for example, coordinate information (e.g., the top-left coordinates (x1, y1) and bottom-right coordinates (x2, y2) of a rectangle) or the registration number from the receipt image by machine learning prediction processing.

[0068] The number acquisition means 1321 provides, for example, a receipt image and a learning model to a machine learning prediction processing module, executes the module, and obtains coordinate information or a registration number. The coordinate information refers to one or more coordinates that identify a rectangle within the receipt image.

[0069] The learning model used here is a model obtained by providing two or more training data sets to a machine learning learning module. As mentioned above, the machine learning algorithm used here can be deep learning, random forest, decision tree, SVM, etc.

[0070] The training data here, for example, includes a receipt image and coordinate information where the registration number is displayed, or a receipt image and a registration number.

[0071] When the number acquisition means 1321 acquires coordinate information through machine learning prediction processing, it acquires the registration number, which is a string representing the location indicated by the coordinate information, from the receipt image. (3) Method using a generative AI

[0072] The number acquisition means 1321 uses a generation AI to obtain the registration number from the receipt image. The type acquisition means 1324, for example, passes the receipt image to the generation AI and gives the generation AI a prompt such as "Please provide the registration number in the receipt image! Note that the registration number is a string that begins with the letter "T" followed by a 13-digit number." and obtains the registration number from the generation AI. Note that the prompt may also contain the receipt image.

[0073] The amount acquisition means 1322 acquires the product price and consumption tax amount from the receipt image. The processing of the amount acquisition means 1322 is possible by publicly known technology. The amount acquisition means 1322 acquires the amount expressed in the receipt image by, for example, a method using character recognition, a method using machine learning, or a method using generative AI. The amount is, for example, the consumption tax amount and the payment price or product price. The algorithm used by the amount acquisition means 1322 to acquire the amount is not limited. (1) Method using character recognition processing

[0074] The amount acquisition means 1322 obtains, for example, from the result of character recognition processing on the receipt image, the sequence of numbers following "¥" or the largest sequence of numbers as the numerical value of "product price + consumption tax amount (payment price)". The amount acquisition means 1322 obtains, for example, from the result of character recognition processing on the receipt image, the sequence of numbers closest to the string "consumption tax" and not the payment price as the consumption tax amount.

[0075] The amount acquisition means 1322 obtains, for example, one or more character classes obtained as a result of character recognition processing on a receipt image, and acquires two strings (in this case, numbers) whose class is "amount". Then, it acquires the consumption tax amount, which is the smaller number of the two strings, and the payment price or product price, which is the larger number. (2) Methods using machine learning

[0076] The amount acquisition means 1322 obtains the consumption tax amount and payment price from the receipt image, for example, through machine learning prediction processing. Alternatively, the amount acquisition means 1322 may obtain the product price instead of the payment price.

[0077] The amount acquisition means 1322, for example, provides a receipt image and a learning model to a machine learning prediction processing module, executes the module, and obtains the coordinate information where the consumption tax amount is displayed in the receipt image (for example, the top-left coordinate (x3, y3) and bottom-right coordinate (x4, y4) of the rectangle). Next, the amount acquisition means 1322 obtains the consumption tax amount, which is a string of characters at the position indicated by the coordinate information, from the receipt image. The learning model here is a model obtained by providing two or more training data sets, each containing a receipt image and the coordinate information of the consumption tax amount, to a machine learning learning processing module.

[0078] The amount acquisition means 1322, for example, provides a receipt image and a learning model to a machine learning prediction processing module, executes the module, and obtains coordinate information (for example, the top-left coordinates (x5, y5) and bottom-right coordinates (x6, y6) of a rectangle) where the payment price is expressed from the receipt image. Next, the amount acquisition means 1322 obtains the payment price, which is a string of characters at the position indicated by the coordinate information, from the receipt image. The learning model is a model obtained by providing two or more training data sets having a receipt image and coordinate information of the payment price to a machine learning learning processing module.

[0079] The amount acquisition means 1322 provides a receipt image and a learning model to a machine learning prediction processing module, executes the module, and obtains the consumption tax amount from the receipt image. The learning model here is a model obtained by providing two or more training data sets, each containing a receipt image and a consumption tax amount, to a machine learning learning processing module.

[0080] The amount acquisition means 1322 provides a receipt image and a learning model to a machine learning prediction processing module, executes the module, and obtains the payment price from the receipt image. The learning model here is a model obtained by providing two or more training data sets, each containing a receipt image and a payment price, to a machine learning learning processing module.

[0081] Furthermore, as mentioned above, the machine learning algorithms used here are not limited to deep learning, random forests, decision trees, SVMs, etc. (3) Method using a generative AI

[0082] The amount acquisition means 1322, for example, uses a generating AI to obtain the payment price or consumption tax amount from the receipt image. The amount acquisition means 1322, for example, passes the receipt image to the generating AI and gives the generating AI a prompt such as "Please provide the 'payment price' and 'consumption tax amount' in the receipt image!", and obtains the 'payment price' and 'consumption tax amount' from the generating AI.

[0083] The issue date acquisition means 1323 acquires the issue date of the receipt from the receipt image received by the image reception unit 121. The issue date acquisition means 1323 acquires the registration number displayed in the receipt image by, for example, a method using character recognition processing, a method using machine learning, or a method using generative AI. The algorithm used by the issue date acquisition means 1323 to acquire the issue date is not limited. (1) Method using character recognition processing

[0084] The issue date acquisition means 1323 obtains, for example, the issue date of the receipt, which is a string corresponding to the date type, from one or more strings obtained as a result of character recognition processing on the receipt image. (2) Methods using machine learning

[0085] The issue date acquisition means 1323 obtains the issue date of a receipt from the receipt image, for example, by machine learning prediction processing. The number acquisition means 1321 provides the receipt image and a learning model to a machine learning prediction processing module, executes the module, and obtains coordinate information or the issue date. The coordinate information here refers to the coordinates where the issue date of the receipt is displayed.

[0086] The learning model used here is obtained by providing a machine learning module with two or more training data sets containing receipt images and coordinate information or issue dates. As mentioned above, the machine learning algorithm used here does not matter, including deep learning, random forests, decision trees, SVMs, etc.

[0087] When the issue date acquisition means 1323 acquires coordinate information through machine learning prediction processing, it acquires the issue date, which is the string representing the location indicated by the coordinate information, from the receipt image. (3) Method using a generative AI

[0088] The issue date acquisition means 1323 obtains the issue date of a receipt from a receipt image, for example, by using a generation AI. The issue date acquisition means 1323 provides the generation AI with a receipt image and a prompt such as "Please tell me the issue date of the receipt in the receipt image!", and obtains the issue date of the receipt from the generation AI.

[0089] The type acquisition means 1324 performs a type check on the receipt image received by the image reception unit 121 and acquires the image type. The image type is information that identifies the type of receipt image. The image type indicates whether the receipt image is an image of an electronic receipt (e.g., "1") or an image of a paper receipt (e.g., "0"). The image type is, for example, a flag.

[0090] The type acquisition means 1324 acquires the image type of the receipt image, for example, by an image recognition method, a machine learning method, or a generative AI method. The algorithm used by the type acquisition means 1324 to acquire the image type is not limited. (1) Method using image recognition processing

[0091] The type acquisition means 1324 performs image recognition processing on the receipt image to acquire the image type.

[0092] The type acquisition means 1324, for example, performs character recognition processing on the receipt image, and if handwritten characters are detected, it checks that the receipt image is a digital image of a paper receipt.

[0093] The type acquisition means 1324, for example, performs contour extraction on the receipt image. If the contour is a undistorted rectangle (rectangle or square), it checks that the receipt image is an image of an electronic receipt. If the contour is distorted, it checks that it is an image of a paper receipt. (2) Methods using machine learning

[0094] The type acquisition means 1324 performs type inspection and acquires the image type through machine learning prediction processing.

[0095] The type acquisition means 1324, for example, provides a receipt image and a learning model to a machine learning prediction processing module, executes the module, and acquires the image type.

[0096] The learning model used here is a model obtained by providing a machine learning module with two or more training data sets containing receipt images and image types. As mentioned above, the machine learning algorithm used here can be deep learning, random forest, decision tree, SVM, etc. (3) Method using a generative AI

[0097] The type acquisition means 1324 uses a generation AI to acquire the image type from the receipt image. For example, the type acquisition means 1324 passes the receipt image to the generation AI and gives the generation AI a prompt (for example, "If the receipt image is an image of an electronic receipt, answer "1", and if it is an image of a paper receipt, answer "0"), and acquires the image type (in this case, "1" or "0") from the generation AI.

[0098] The content inspection unit 133 checks whether the content of one or more strings obtained from the receipt image is valid. These strings may be, for example, a registration number or the date the receipt was issued. These one or more strings are usually information obtained by the information acquisition unit 132.

[0099] The number inspection means 1331 checks whether the registration number acquired by the number acquisition means 1321 exists in the registration number database (hereinafter referred to as "DB" as appropriate), and obtains the inspection result. The inspection result is, for example, "the registration number exists (e.g., "1")" or "the registration number does not exist (e.g., "0")".

[0100] The registration number database is typically located on a server not shown in the diagram. This server is an external device to the receipt processing device 1. The receipt processing device 1 and the server can communicate via a network such as the Internet. The server, for example, could be a server belonging to the National Tax Agency and would contain a registration number database managing two or more registration numbers.

[0101] The period inspection means 1332 obtains the elapsed period from the issue date obtained by the issue date acquisition means 1323 and checks whether the elapsed period satisfies the fraud conditions. The fraud conditions are the conditions for fraud related to the application date of the receipt. For example, the fraud conditions are that the elapsed period is equal to or longer than a threshold. The threshold is, for example, 68 days or 2 months, but is not limited to that. The elapsed period is usually the period from the issue date of the receipt to today.

[0102] The receipt processing unit 134 processes the received receipt image. The receipt processing unit 134 processes the receipt corresponding to the received receipt image. The content of the processing can vary.

[0103] The receipt processing unit 134 performs processing according to the inspection result of the number inspection means 1331. If the inspection result of the number inspection means 1331 is different, the receipt processing unit 134 performs different processing.

[0104] The receipt processing unit 134 outputs an error message indicating that the registration number does not exist if, for example, the inspection result of the number inspection means 1331 is "the registration number does not exist" or "there is no registration number written on the receipt image". The output of the error message is, for example, sent to the terminal device 2. "The registration number does not exist" means that the registration number written on the receipt does not exist in the database.

[0105] For example, if the inspection result of the number inspection means 1331 is "a registration number exists", the receipt processing unit 134 constructs receipt information that includes various information acquired by the information acquisition unit 132 and the receipt image, and stores the receipt information in the receipt management unit 111. "A registration number exists" means that the registration number written on the receipt exists in the database.

[0106] The image storage means 1341 stores the receipt images received by the image reception unit 121 in the receipt management unit 111. It is preferable for the image storage means 1341 to store the receipt images in the receipt management unit 111 in association with a user identifier associated with the receipt images received by the image reception unit 121.

[0107] If the number verification means 1331 obtains a result indicating that the registration number does not exist in the registration number database or that the receipt does not contain a registration number, the price change means 1342 obtains a revised product price by adding part or all of the consumption tax amount obtained by the amount acquisition means 1322 to the product price. In such a case, the price change means 1342 obtains a revised consumption tax amount by subtracting part or all of the consumption tax amount obtained by the amount acquisition means 1322 from the consumption tax amount.

[0108] If the number verification means 1331 obtains, for example, a result indicating that the registration number does not exist in the registration number database or that the receipt does not contain a registration number, the price change means 1342 obtains a revised product price by adding a certain percentage of the consumption tax amount obtained by the amount acquisition means 1322 to the product price. The certain percentage is, for example, 20%, 50%, or 100%. In such a case, the price change means 1342 obtains a revised consumption tax amount by subtracting a certain percentage of the consumption tax amount obtained by the amount acquisition means 1322 from the consumption tax amount.

[0109] If, for example, the number verification means 1331 obtains an inspection result indicating that the registration number does not exist in the registration number database or that the receipt does not contain a registration number, the price change means 1342 obtains a revised product price by adding the first percentage of the consumption tax amount obtained by the amount acquisition means 1322 to the product price if the receipt is issued before or after the first threshold deadline, and if the receipt is issued after or after the first threshold deadline, the price change means 1342 obtains a revised product price by adding the second percentage of the consumption tax amount obtained by the amount acquisition means 1322 to the product price. The first threshold deadline is, for example, January 1, 2025. In such a case, the price change means 1342 obtains a revised consumption tax amount by subtracting the amount of consumption tax amount obtained by the amount acquisition means 1322 that has been passed on to the product price from the consumption tax amount.

[0110] The product price storage means 1343 stores the changed product price obtained by the price change means 1342 if the number inspection means 1331 obtains an inspection result indicating that the registration number does not exist in the registration number database or that the registration number is not written on the receipt. In the case where the number inspection means 1331 obtains an inspection result indicating that the registration number is not written on the receipt, this usually means that the number acquisition means 1321 did not obtain the registration number from the receipt image.

[0111] The product price storage means 1343 stores the product price obtained by the amount acquisition means 1322 when the number inspection means 1331 obtains a result indicating that the registration number exists in the registration number database. The product price storage means 1343 stores the product price in the receipt management unit 111, for example.

[0112] If the number inspection means 1331 obtains a result indicating that the registration number does not exist in the registration number database or that the receipt does not contain a registration number, the consumption tax accumulation means 1344 accumulates the consumption tax amount obtained by subtracting the amount added to the changed product price obtained by the price change means 1342 from the consumption tax amount obtained by the amount acquisition means 1322. If the number inspection means 1331 obtains a result indicating that the registration number exists in the registration number database, the consumption tax accumulation means 1344 accumulates the consumption tax amount obtained by the amount acquisition means 1322. For example, the consumption tax accumulation means 1344 stores the consumption tax amount in the receipt management unit 111.

[0113] The type storage means 1345 stores the image types acquired by the type acquisition means 1324. The type storage means 1345 stores the image types in the receipt management unit 111, for example. It is preferable for the type storage means 1345 to store the image types in association with receipt images.

[0114] The output unit 14 outputs various types of information. These types of information include, for example, inspection results and receipt information.

[0115] Here, output refers to, for example, transmission to terminal device 2, but may also be a concept that includes display on a screen, projection using a projector, printing with a printer, sound output, transmission to devices other than terminal device 2, storage on a recording medium, and delivery of processing results to other processing devices or other programs.

[0116] The result output unit 141 outputs the results of the inspection performed by the image inspection unit 131. The result output unit 141 also outputs the results of the inspection performed by the content inspection unit 133.

[0117] The terminal storage unit 21, which constitutes the terminal device 2, stores various types of information. These types of information include, for example, a user identifier and a receipt image.

[0118] The terminal reception unit 22 receives various types of information and instructions. These types of information and instructions include, for example, receipt images, receipt application instructions, and acquisition instructions.

[0119] The means of inputting various information and instructions can be anything, such as a touch panel, keyboard, mouse, or menu screen.

[0120] The terminal processing unit 23 performs various processes. These processes include, for example, converting received information and instructions into information and instructions for transmission. Other processes include, for example, converting received information into information for output.

[0121] The terminal transmission unit 24 transmits various information and instructions to the receipt processing device 1. These various information and instructions include, for example, a receipt image, a receipt application instruction, and an acquisition instruction.

[0122] The terminal receiving unit 25 receives various types of information from the receipt processing device 1. These types of information include, for example, receipt information, inspection results, or various screen information. Screen information refers to information used to construct a screen. The screen information is written in, for example, HTML or XML, but the means of implementation is not limited.

[0123] The terminal output unit 26 outputs various types of information. These types of information include, for example, receipt information, inspection results, and various screens.

[0124] Here, "output" is a concept that includes display on a screen, projection using a projector, printing with a printer, sound output, transmission to an external device, storage on a recording medium, and transfer of processing results to other processing devices or other programs.

[0125] The storage unit 11, the receipt management unit 111, and the terminal storage unit 21 are preferably made of non-volatile recording media, but can also be made of volatile recording media.

[0126] The process by which information is stored in the storage unit 11, etc. is not relevant. For example, information may be stored in the storage unit 11, etc. via a recording medium, information transmitted via a communication line, etc. may be stored in the storage unit 11, etc., or information input via an input device may be stored in the storage unit 11, etc.

[0127] The reception unit 12, the image reception unit 121, and the instruction reception unit 122 are preferably implemented by wireless or wired communication means, but may also be implemented by means of receiving broadcasts, device drivers for input means such as touch panels and keyboards, or control software for menu screens.

[0128] The processing unit 13, image inspection unit 131, information acquisition unit 132, content inspection unit 133, receipt processing unit 134, resolution inspection means 1311, corner inspection means 1312, type acquisition means 1324, number acquisition means 1321, amount acquisition means 1322, issue date acquisition means 1323, number inspection means 1331, period inspection means 1332, image storage means 1341, price change means 1342, product price storage means 1343, consumption tax storage means 1344, and type storage means 1345 can usually be implemented using a processor, memory, etc. The processing procedures of the processing unit 13, etc., are usually implemented in software, and this software is recorded on a recording medium such as ROM. However, it may also be implemented in hardware (dedicated circuitry). The processor can be a CPU, MPU, GPU, etc., and the type is not specified.

[0129] The output unit 14 and the result output unit 141 are preferably implemented by wireless or wired communication means, but may also be implemented by driver software for an output device such as a display or speaker, or by driver software for an output device and the output device itself.

[0130] The terminal reception unit 22 can be implemented using device drivers for input means such as touch panels and keyboards, or control software for menu screens, etc.

[0131] The terminal transmission unit 24 is usually implemented by wireless or wired communication means, but it may also be implemented by broadcasting means.

[0132] The terminal receiving unit 25 is usually implemented by wireless or wired communication means, but it may also be implemented by means of receiving broadcasts.

[0133] The terminal output unit 26 may or may not be considered to include output devices such as a display or speakers. The terminal output unit 26 can be implemented using driver software for an output device, or driver software for an output device and an output device.

[0134] Next, an example of the operation of the receipt processing device 1 will be explained using the flowchart in Figure 4.

[0135] (Step S401) The image receiving unit 121 determines whether or not it has received a receipt request instruction containing a receipt image. If a receipt request instruction has been received, the process proceeds to step S402; if a receipt request instruction has not been received, the process proceeds to step S410. Note that the receipt request instruction here is associated with a user identifier.

[0136] (Step S402) The processing unit 13 obtains a receipt image from the receipt request instruction.

[0137] (Step S403) The processing unit 13 obtains a user identifier corresponding to the receipt request instruction.

[0138] (Step S404) The image inspection unit 131 performs an inspection on the receipt image. An example of such image inspection processing will be explained using the flowchart in Figure 5.

[0139] (Step S405) The processing unit 13 determines whether the result of the image inspection process is an error or not. If it is an error, the process goes to step S406; otherwise, the process goes to step S407.

[0140] (Step S406) The processing unit 13 obtains an error message indicating that the image inspection process has resulted in an error. The result output unit 141 outputs the error message. The process returns to step S401. The error message may be, for example, "The resolution is insufficient," or "The four corners of the receipt are not visible. Please take another picture so that all four corners are visible."

[0141] (Step S407) The information acquisition unit 132 acquires two or more pieces of information from the receipt image. An example of such information acquisition process will be explained using the flowchart in Figure 6.

[0142] (Step S408) The content inspection unit 133 inspects the information obtained in step S407. An example of such content inspection processing will be explained using the flowchart in Figure 7.

[0143] (Step S409) The receipt processing unit 134 processes the receipt request received in step S401. The process returns to step S401. An example of receipt processing will be explained using the flowchart in Figure 8.

[0144] (Step S410) The instruction receiving unit 122 determines whether or not it has received an acquisition instruction. If it has received an acquisition instruction, it proceeds to step S411; otherwise, it returns to step S401.

[0145] (Step S411) The processing unit 13 retrieves one or more receipt information from the receipt management unit 111 that matches the conditions of the acquisition instruction received in step S410. The processing unit 13 searches for receipt information from the receipt management unit 111 using the conditions of the acquisition instruction.

[0146] (Step S412) The output unit 14 outputs one or more receipt information obtained in step S411. Return to step S401.

[0147] In the flowchart shown in Figure 4, processing is terminated by power-off or processing termination interrupts.

[0148] Next, an example of the image inspection process in step S404 will be explained using the flowchart in Figure 5.

[0149] (Step S501) The resolution inspection means 1311 obtains the resolution of the receipt image.

[0150] (Step S502) The resolution inspection means 1311 determines whether the resolution obtained in step S501 meets the resolution conditions. If it meets the resolution conditions, proceed to step S503; if it does not meet the resolution conditions, proceed to step S508.

[0151] (Step S503) The corner inspection means 1312 checks whether the receipt image has the four corners of a receipt. An example of such corner inspection processing is described above. As described above, the method of corner inspection processing can be, for example, an image processing method, a machine learning method, a generative AI method, etc., and the method of corner inspection is not limited.

[0152] (Step S504) As a result of the corner inspection process in step S503, if the entire receipt is visible in the receipt image, proceed to step S505; otherwise, proceed to step S507.

[0153] (Step S505) The image inspection unit 131 obtains information that the result of the image inspection was "normal".

[0154] (Step S506) The type acquisition means 1324 acquires the image type of the receipt image. It returns to the higher-level processing. As mentioned above, examples of methods for acquiring the image type include methods using image recognition processing, machine learning, and generative AI, and the algorithm is not limited.

[0155] (Step S507) The image inspection unit 131 obtains an error message indicating that the entire receipt is not visible in the receipt image. Proceed to step S509.

[0156] (Step S508) The image inspection unit 131 obtains an error message indicating that the resolution of the receipt image is inappropriate.

[0157] (Step S509) The image inspection unit 131 obtains information indicating that the image inspection result was "abnormal". It returns to the higher-level processing unit.

[0158] Next, an example of the information acquisition process in step S407 will be explained using the flowchart in Figure 6.

[0159] (Step S601) The number acquisition means 1321 acquires the registration number written on the receipt image. As mentioned above, examples of the process for acquiring the registration number written on the receipt image include methods using character recognition, machine learning, and generative AI, and the algorithm is not limited.

[0160] (Step S602) The amount acquisition means 1322 acquires the amount stated in the receipt image. In this case, the amount is the product price and the consumption tax amount. When the amount acquisition means 1322 acquires the payment price and consumption tax amount stated in the receipt image, it is preferable to calculate the product price using the calculation formula "payment price - consumption tax amount". As mentioned above, examples of the process for acquiring the amount stated in the receipt image include methods using character recognition, machine learning, and generative AI, and the algorithm is not limited.

[0161] (Step S603) The issue date acquisition means 1323 acquires the issue date written on the receipt image. Examples of the process for acquiring the issue date written on the receipt image are as described above, for example, methods using character recognition, machine learning, or generative AI, and the algorithm is not limited. The issue date is the date the receipt was issued.

[0162] Step S604 retrieves other information contained in the receipt image. The process returns to the higher-level process. An example of the process for retrieving other information contained in the receipt image is the same as the process described above. Other information may include, for example, the payee.

[0163] Next, an example of the content inspection process in step S408 will be explained using the flowchart in Figure 7.

[0164] (Step S701) The number inspection means 1331 searches the registration number database (DB) using the registration number acquired by the number acquisition means 1321 as a key, and determines whether or not the registration number exists in the DB.

[0165] If the number acquisition method 1321 fails to acquire the registration number, proceed to step S704.

[0166] (Step S702) If the registration number exists in the database, proceed to step S703; otherwise, proceed to step S704.

[0167] (Step S703) The number inspection means 1331 assigns "OK (for example, "1")" to the variable "number inspection result".

[0168] (Step S704) The number inspection means 1331 assigns "NG (for example, "0")" to the variable "number inspection result".

[0169] (Step S705) The period inspection means 1332 obtains today's date from a clock (not shown).

[0170] (Step S706) The period inspection means 1332 obtains the elapsed period from the issue date, which is the difference between the issue date obtained by the issue date acquisition means 1323 and today's date.

[0171] (Step S707) The period inspection means 1332 determines whether the elapsed period satisfies the fraud conditions. If the fraud conditions are met, proceed to step S709; otherwise, proceed to step S708.

[0172] (Step S708) The period check means 1332 assigns "OK" (for example, "1") to the variable "period check result". It returns to the higher-level process.

[0173] (Step S709) The period inspection means 1332 assigns "NG (for example, "0")" to the variable "period inspection result". It returns to the higher-level process.

[0174] Next, an example of receipt processing in step S409 will be explained using the flowchart in Figure 8.

[0175] (Step S801) The price change means 1342 obtains the amount obtained by the amount acquisition means 1322. The amount includes the consumption tax. The amount is the sum of the product price and the consumption tax or includes the product price.

[0176] (Step S802) If the number check result is "NG", proceed to step S803; if the number check result is "OK", proceed to step S806.

[0177] (Step S803) The price change means 1342 obtains a consumption tax amount obtained by changing the consumption tax amount obtained in step S801. The changed consumption tax amount is, for example, a certain percentage (for example, 0.8 times, 0.5 times, or 0 times) of the consumption tax obtained in step S801.

[0178] (Step S804) The price change means 1342 uses the sum of the product price and the amount of consumption tax obtained in step S801, or the product price, to obtain a product price increased by the amount by which the consumption tax has been reduced.

[0179] (Step S805) The result output unit 141 outputs an error message indicating that the registration number does not exist. Note that the absence of a registration number usually means that the registration number listed on the receipt does not exist in the database, but it may also mean that the receipt does not contain a registration number.

[0180] (Step S806) If the period test result is "NG", proceed to step S807; if the period test result is "OK", proceed to step S808.

[0181] (Step S807) The result output unit 141 outputs an error message indicating that the receipt is invalid because the issue date is too old.

[0182] (Step S808) The receipt processing unit 134 determines whether the conditions for storing receipt information are met. If the conditions for storage are met, the process proceeds to step S809; otherwise, it returns to the higher-level processing unit. The storage conditions are, for example, that the period inspection result is "OK". Alternatively, step S808 may be omitted, and the process may proceed from step S807 to S809.

[0183] (Step S809) The receipt processing unit 134 acquires the receipt image.

[0184] (Step S810) The receipt processing unit 134 obtains the image type.

[0185] (Step S811) The receipt processing unit 134 obtains the product price, consumption tax amount, etc.

[0186] (Step S812) The receipt processing unit 134 configures receipt information that includes a receipt image, image type, product price, consumption tax amount, etc.

[0187] (Step S813) The receipt processing unit 134 stores the receipt information configured in step S812 in the receipt management unit 111, associating it with the user identifier.

[0188] (Step S814) The result output unit 141 outputs a message indicating that the receipt has been registered. The process returns to the higher level.

[0189] The following describes a specific example of the operation of receipt system A in this embodiment.

[0190] The receipt management unit 111 of the receipt processing device 1 stores the receipt management table shown in Figure 9. The receipt management table is a table for managing receipt information. The receipt management table has "ID", "User Identifier", "Receipt Information", and "Receipt Date". The "Receipt Information" has "Issuance Date", "Product Price", "Consumption Tax Amount", "Registration Number", "Payee", "Receipt Image", "Image Type", and "Issuance Date Error". A "-" in "Registration Number" indicates "NULL" as no data is entered. The "Issuance Date Error" is a flag indicating whether the elapsed time since the receipt issuance date meets the conditions for fraud. An issue date error of "1" indicates that the elapsed time meets the conditions for fraud (it is fraudulent). An issue date error of "0" indicates that the elapsed time does not meet the conditions for fraud. The "Receipt Date" is the date the receipt image was received. The "Receipt Image" is the file name of the receipt image stored in the receipt management unit 111.

[0191] In the above situation, the following two specific examples will be explained. Specific example 1 is the case when a photograph (receipt image) in which the four corners of the receipt are not visible is uploaded from terminal device 2 to receipt processing device 1. Specific example 2 is the case when a receipt image with a non-existent registration number printed on it is uploaded from terminal device 2 to receipt processing device 1.

[0192] (Specific example 1) User U, identified by user identifier "U003," took a photograph of Figure 10 and sent a receipt request instruction including the photograph (receipt image) from terminal device 2 to receipt processing device 1.

[0193] The image receiving unit 121 of the receipt processing device 1 receives a receipt application instruction having a receipt image (Figure 10).

[0194] Next, the image inspection unit 131 performs the image inspection process described above. That is, the resolution inspection means 1311 obtains the resolution of the receipt image (Figure 10) and determines that the resolution satisfies the resolution condition. On the other hand, the corner inspection means 1312 performs the corner inspection described above on the receipt image (Figure 10) and determines that the corners are not included.

[0195] The corner inspection means 1312 then obtains an error message indicating that the four corners are not included.

[0196] Next, the result output unit 141 sends the error message to the terminal device 2.

[0197] Terminal device 2 receives and outputs the error message. An example of this screen is shown in Figure 11. In Figure 11, error message 1101 is output.

[0198] (Specific example 2) Next, let's assume that user U took a photograph showing the four corners of the receipt in Figure 10. Then, let's assume that user U clicked the "Re-upload" button 1102 in Figure 11 and uploaded the photograph showing the four corners to the receipt processing device 1.

[0199] Next, the image receiving unit 121 of the receipt processing device 1 receives a receipt application instruction that has a receipt image, which is a photograph.

[0200] Next, the image inspection unit 131 performs the image inspection process described above. Specifically, the resolution inspection means 1311 obtains the resolution of the receipt image and determines that the resolution satisfies the resolution conditions. The corner inspection means 1312 then performs the corner inspection described above on the received receipt image and determines that all four corners are included.

[0201] Furthermore, the number acquisition means 1321 obtains the registration number "T1234567890123" from the receipt image. Next, the amount acquisition means 1322 obtains "2900" for the "payment price (product price + consumption tax)" printed on the receipt image, and "263" for the "consumption tax amount" printed on the receipt image. In addition, the issue date acquisition means 1323 obtains the issue date "June 14, 2024" printed on the receipt image. Furthermore, the information acquisition unit 132 obtains other information (for example, the payee).

[0202] Next, the number inspection means 1331 searches the registration number database (DB) using the registration number obtained by the number acquisition means 1321 as a key, and determines that the registration number does not exist in the DB. Then, the number inspection means 1331 assigns "NG (for example, "0")" to the variable "number inspection result".

[0203] The period check means 1332 obtains the elapsed period "0" from the issue date, which is the difference between the issue date (June 14, 2024) obtained by the issue date acquisition means 1323 and today's date (in this case, "June 14, 2024"). Next, the period check means 1332 determines that the elapsed period "0" does not satisfy the invalid condition (elapsed period >= 68 days). The period check means 1332 assigns "OK" (for example, "1") to the variable "period check result".

[0204] Next, the price change means 1342 obtains the total amount of the product price and consumption tax, "2900", and the consumption tax amount, "263", obtained by the amount acquisition means 1322. Next, the price change means 1342 obtains the consumption tax amount "210", which is the acquired consumption tax amount "263". Note that the changed consumption tax amount is assumed to be a certain percentage of the consumption tax (in this case, 0.8 times). Next, the price change means 1342 obtains the changed product price "2690", which is the total amount of the product price and consumption tax, "2900", minus the consumption tax amount "210".

[0205] Furthermore, the result output unit 141 sends an error message to the terminal device 2 indicating that the registration number does not exist.

[0206] Terminal device 2 receives and outputs the error message.

[0207] Next, the receipt processing unit 134 acquires the receipt image. The type acquisition means 1324 acquires the image type "0", which is the type of the receipt image. The receipt processing unit 134 also acquires the product price "2690", the consumption tax amount "210", the payee "XX Company", etc. Next, the receipt processing unit 134 constructs receipt information that includes the receipt image, image type, product price, consumption tax amount, etc. Next, the receipt processing unit 134 stores the receipt information in the receipt management table (Figure 9) in association with the user identifier "U003". This receipt information is the record with "ID=401" in Figure 9.

[0208] As described above, according to this embodiment, it is possible to inspect receipt images. In particular, according to this embodiment, it is possible to inspect the registration number of the receipt image. Furthermore, according to this embodiment, it is possible to inspect whether or not the receipt image contains all of the receipt. Furthermore, according to this embodiment, it is possible to inspect whether or not the issue date obtained from the receipt image is correct.

[0209] Furthermore, according to this embodiment, appropriate processing can be performed according to the inspection results regarding the registration number of the receipt image.

[0210] Furthermore, according to this embodiment, the type of receipt image can be obtained.

[0211] In this embodiment, the receipt processing device 1 may perform only some of the two or more checks. That is, the receipt processing device 1 may perform only the check related to the registration number of the receipt image. The receipt processing device 1 may perform only the check to determine whether or not the receipt image contains the entire receipt.

[0212] Furthermore, according to this embodiment, the receipt processing device 1 may acquire the image type of the receipt image without performing an inspection, and store the image type in conjunction with the receipt image or information that can be obtained from the receipt image.

[0213] Furthermore, the processing in this embodiment may be implemented in software. This software may be distributed by software download or the like. Alternatively, this software may be recorded on a recording medium such as a CD-ROM and distributed. This also applies to other embodiments in this specification. The software that implements the receipt processing device 1 in this embodiment is the following program. In other words, this program is a program that causes a computer to function as an image receiving unit that receives a receipt image, a number acquisition means that obtains a registration number from the receipt image received by the image receiving unit, a number inspection means that checks whether or not the registration number exists in a registration number database, and a receipt processing unit that performs processing according to the inspection result of the number inspection means.

[0214] Figure 12 is a block diagram of a computer system 300 that executes the program described herein to realize the receipt processing device 1 and other devices of the various embodiments described above.

[0215] In Figure 12, the computer system 300 includes a computer 301 with a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

[0216] In Figure 12, the computer 301 includes, in addition to the CD-ROM drive 3012, an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012, a ROM 3015 for storing programs such as boot-up programs, a RAM 3016 connected to the MPU 3013 for temporarily storing instructions for application programs and providing temporary storage space, and a hard disk 3017 for storing application programs, system programs, and data. Although not shown here, the computer 301 may further include a network card for providing connectivity to a LAN.

[0217] The program that causes the computer system 300 to execute the functions of the receipt processing device 1, etc., as described above, may be stored on the CD-ROM 3101, inserted into the CD-ROM drive 3012, and then transferred to the hard disk 3017. Alternatively, the program may be transmitted to the computer 301 via a network (not shown) and stored on the hard disk 3017. The program is loaded into the RAM 3016 when executed. The program may also be loaded directly from the CD-ROM 3101 or the network.

[0218] The program does not necessarily have to include an operating system (OS) or third-party program that causes the computer 301 to execute functions such as the receipt processing device 1 of the above-described embodiment. The program only needs to include the instruction portion that calls appropriate functions (modules) in a controlled manner and obtains the desired result. How the computer system 300 operates is well known, so a detailed explanation is omitted.

[0219] In the above program, steps such as sending information and receiving information do not include hardware-based processing, such as processing performed by a modem or interface card in the transmission step (processing that can only be performed by hardware).

[0220] Furthermore, the computer running the above program may be a single computer or multiple computers. In other words, it may perform centralized processing or distributed processing.

[0221] Furthermore, it goes without saying that in each of the above embodiments, two or more communication means present in a single device may be physically implemented in a single medium.

[0222] Furthermore, in each of the above embodiments, each process may be implemented by centralized processing by a single device, or by distributed processing by multiple devices.

[0223] It goes without saying that the present invention is not limited to the embodiments described above, and various modifications are possible, all of which are also included within the scope of the present invention. [Industrial applicability]

[0224] As described above, the receipt processing device 1 according to the present invention has the effect of being able to perform appropriate inspections on receipt images and is useful as a server for managing receipt information. [Explanation of Symbols]

[0225] A Receipt System 1. Receipt Processing Device 2 Terminal devices 11 Storage Unit 12 Reception Department 13 Processing Unit 14 Output section 21 Terminal storage section 22 Terminal Reception Section 23 Terminal Processing Unit 24 Terminal transmission unit 25 Receiving part of the terminal 26 Terminal output section 111 Receipt Management Department 121 Image Reception Department 122 Instruction Reception Department 131 Imaging Inspection Department 132 Information Acquisition Department 133 Content Inspection Department 134 Receipt Processing Department 141 Result Output Section 1311 Resolution Inspection Method 1312 Corner inspection method 1321 Number acquisition method 1322 Amount acquisition means 1323 Method for obtaining the issue date 1324 type acquisition means 1331 Number Inspection Method 1332 Period Inspection Method 1341 Image storage means 1342 Price change methods 1343. Means of accumulating commodity prices 1344 Consumption tax accumulation means 1345 types of storage means

Claims

1. The image reception section accepts images of receipts, A number acquisition means for obtaining a registration number from the receipt image received by the image receiving unit, A number verification means for checking whether the aforementioned registration number exists in the registration number database, A receipt processing device comprising a receipt processing unit that performs processing according to the inspection result of the number inspection means.

2. The system further provides a means for obtaining the product price and consumption tax amount using the aforementioned receipt image, The aforementioned receipt processing unit, The receipt processing device according to claim 1, further comprising a price change means that, if the number acquisition means fails to acquire the registration number from the receipt image, or if the number inspection means obtains an inspection result indicating that the registration number does not exist in the registration number database, acquires a revised product price by adding part or all of the consumption tax amount acquired by the amount acquisition means to the product price.

3. The aforementioned receipt processing unit, The receipt processing device according to claim 2, further comprising a product price storage means for storing the changed product prices.

4. An image inspection unit performs an inspection of the receipt image received by the image reception unit, The receipt processing device according to claim 1, further comprising a result output unit that outputs the results of the inspection in the image inspection unit.

5. The aforementioned image inspection unit is The receipt processing device according to claim 4, further comprising a corner inspection means for inspecting whether or not the four corners of a receipt are present in the receipt image received by the image receiving unit.

6. The image receiving unit obtains the receipt issuance date from the receipt image, and The receipt processing device according to claim 4, further comprising: a period inspection means for obtaining the elapsed period from the issue date obtained by the issue date acquisition means, and for inspecting whether the elapsed period satisfies the conditions for fraud.

7. The image receiving unit acquires an image type that indicates whether the receipt image it receives is an image of an electronic receipt or an image of a paper receipt. The receipt processing device according to claim 1, further comprising a type storage means for storing the image type acquired by the type acquisition means.

8. A receipt processing method in a receipt processing device comprising an image receiving unit, a number acquisition means, a number inspection means, and a receipt processing unit, The aforementioned image receiving unit includes an image receiving step in which it receives an image of a receipt, The number acquisition means includes a number acquisition step in which the image receiving unit acquires a registration number from the receipt image, The number inspection means includes a number inspection step of checking whether the registration number exists in the registration number database, A receipt processing method comprising: a receipt processing step in which the receipt processing unit performs processing according to the inspection result of the number inspection means.

9. Computers, The image reception section accepts images of receipts, A number acquisition means for obtaining a registration number from the receipt image received by the image receiving unit, A number verification means for checking whether the aforementioned registration number exists in the registration number database, A program for functioning as a receipt processing unit that performs processing according to the inspection results of the aforementioned number inspection means.

Images