Information processing device, information processing method, and information processing program

Abstract

Provides technology to properly process payments via self-checkout registers. [Solution] An information processing device is provided that includes a product image acquisition unit that acquires an image of a product that a customer intends to purchase via a camera, a quality condition inspection unit that inspects the quality condition of the product based on the captured image, and a notification unit that, if an inappropriate quality condition is detected, notifies the customer and / or product provider that the product is inappropriate in quality.

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program, and more particularly to an information processing device, an information processing method, and an information processing program for transaction processing via a self-checkout. [Background technology]

[0002] In retail stores such as convenience stores, automated accounting systems known as self-checkouts have been introduced. Patent Document 1 discloses a technology that, when a product that has passed its expiration date is detected, transitions to an error state and prompts a store clerk to replace the product. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-061044 A Summary of the Invention [Problem to be solved by the invention]

[0004] The following analysis has been made from the perspective of the present invention, and the disclosures of the above-mentioned prior art documents are incorporated herein by reference.

[0005] In Patent Document 1, the judgement is made as to whether the expiration date has passed or not based on the product information stored in the database. Therefore, there is a problem that it cannot deal with inappropriate quality conditions other than the expiration date.

[0006] Therefore, an object of the present invention is to provide an information processing device, an information processing method, and an information processing program for appropriately carrying out transaction processing via a self-checkout register. [Means for solving the problem]

[0007] According to a first aspect of the present invention, a product image acquisition unit that acquires, via a camera, an image of a product that the customer intends to purchase; a quality condition inspection unit that inspects the quality condition of the product based on the captured image; a notification unit that notifies the customer and / or the product provider that the product is in an inappropriate quality state when an inappropriate quality state of the product is detected; An information processing device comprising:

[0008] According to a second aspect of the present invention, A product image acquisition step of acquiring an image of a product that the customer intends to purchase via a camera; a quality condition inspection step of inspecting the quality condition of the product based on the captured image; a notification step of notifying the customer and / or the product provider that the product is in an inappropriate quality state when an inappropriate quality state is detected; An information processing method is provided, comprising:

[0009] According to a third aspect of the present invention, A product image acquisition process for acquiring an image of a product that the customer intends to purchase via a camera; A quality condition inspection process for inspecting the quality condition of the product based on the captured image; a notification process for notifying the customer and / or the product provider that the product is in an inappropriate quality state when an inappropriate quality state is detected; An information processing program that causes a computer to execute the above is provided. Effect of the Invention

[0010] According to each aspect of the present invention, an information processing device, an information processing method, and an information processing program are provided that contribute to appropriately carrying out checkout processing via self-checkouts. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram for explaining an overview of the present invention. [Diagram 2] FIG. 1 is a diagram illustrating an example of a system according to the present invention. [Diagram 3] 11 is a flowchart illustrating an example of a flow of processing by an information processing device. [Figure 4] FIG. 1 is a diagram illustrating an example of a system according to the present invention. [Diagram 5] FIG. 1 is a diagram illustrating an example of a system according to the present invention. [Figure 6] FIG. 1 is a diagram illustrating an example of a system according to the present invention. [Figure 7] FIG. 1 illustrates an example of a computer according to the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] A preferred embodiment of the present invention will be described in detail with reference to the drawings. Note that the reference symbols in the drawings are added to each element for convenience as an example to aid in understanding, and are not intended to limit the present invention to the illustrated embodiment. Furthermore, the connection lines between blocks in each drawing include both bidirectional and unidirectional. A unidirectional arrow is a schematic representation of the flow of a main signal (data), and does not exclude bidirectionality. Furthermore, although not explicitly shown, in the circuit diagrams, block diagrams, internal configuration diagrams, connection diagrams, etc. shown in the present disclosure, input ports and output ports exist at the input and output ends of each connection line. The same is true for input / output interfaces.

[0013] First, an overview of the present invention will be described. As shown in Fig. 1, an information processing device 100 of the present invention includes a product image acquisition unit 10, a quality condition inspection unit 20, and a notification unit 30. The product image acquisition unit 10 acquires an image of a product that a customer intends to purchase via a camera. The quality condition inspection unit 20 inspects the quality condition of the product based on the captured image. When an inappropriate quality condition is detected, the notification unit 30 notifies the customer and / or the product provider that the product is in an inappropriate quality condition.

[0014] Here, the inappropriate quality state includes a state in which the package is damaged or dirty. In addition, in the case of a food product, it includes a state in which excessive discoloration or dripping occurs. In the present invention, such an inappropriate quality state is notified to the customer and / or the product provider, so that the possibility of the customer making a complaint about the purchased product after the checkout is reduced. In other words, according to the present invention, the checkout process can be properly performed via the self-checkout, and as a result, the customer can purchase the appropriate product, and the product provider can reduce the effort required to deal with complaints.

[0015] [Embodiment 1] In the following, as a first embodiment, a case where the information processing device 100 of the present invention is introduced in a convenience store will be described as a specific example of a system. In particular, in the following, it is assumed that a customer places the products he or she intends to purchase in a shopping cart, checks out at a self-checkout, and then places the products in a bag to take home. In the following, the "product provider" will be read as a "store clerk" at the convenience store. As shown in FIG. 2, the information processing device 100 is connected to a camera 200 and a self-checkout 300.

[0016] Camera 200 captures an image of a product that a customer intends to purchase. Camera 200 may be installed at any location, capture any image, or have any number of cameras, as long as it can capture an image for inspecting the quality of the product. For example, camera 200 may be integrated with a barcode reading configuration in self-checkout 300 so as to capture an image of a product presented to the self-checkout.

[0017] Existing technology can be applied to the self-checkout 300. One example of the self-checkout 300 is a configuration in which a product is identified by reading a barcode attached to a package and the price of the identified product is displayed on a monitor.

[0018] The information processing device 100 includes a product image acquisition unit 10, a quality condition inspection unit 20, and a notification unit 30, similar to the overview above.

[0019] The product image acquisition unit 10 acquires an image of a product that a customer intends to purchase via the camera 200. Specifically, when the product that the customer intends to purchase is presented to the self-checkout by the customer, the product image acquisition unit 10 acquires an image of the product via the camera 200. Here, since the image that the product image acquisition unit 10 should acquire is an image of the product that the customer intends to purchase, it may be an image of the product when the customer picks up the product from a shelf or an image of the product when the customer puts the product in a shopping cart. Of course, it may be an image of the product that the customer takes out of the shopping cart to check out at the self-checkout, or an image of the product when the customer puts the purchased product in a personal bag.

[0020] The quality condition inspection unit 20 inspects the quality condition of the product based on the captured image. Specifically, the quality condition inspection unit 20 inspects the quality condition of the product that the customer intends to purchase by comparing the captured image with a product image of a product in a suitable state for serving that is stored in advance in a storage unit (not shown). For example, if the quality condition inspection unit 20 detects damage to the package or excessive dirt on the package, it determines that the product is in an inappropriate quality condition. Furthermore, if the quality condition inspection unit 20 detects a state in which excessive discoloration or dripping has occurred in the food product, it determines that the food product is in an inappropriate quality condition.

[0021] When an inappropriate quality state is detected, the notification unit 30 notifies the customer and / or the store clerk that the product is in an inappropriate quality state. The notification to the customer may be made via a monitor of the self-register 300 or may be made by audio notification. The notification to the store clerk may be made by an in-store announcement or by a flashing lamp provided on the self-register 300.

[0022] An example of the flow of processing by the information processing device 100 will be described. As shown in FIG. 3, when a customer presents a product to the self-checkout 300 (step S01, Yes), the product image acquisition unit 10 acquires an image of the product via the camera 200 (step S02). Next, the quality state inspection unit 20 inspects the quality state of the product based on the captured image (step S03). If an inappropriate quality state is detected (step S03, Yes), the notification unit 30 notifies the customer and / or the store clerk that the product is in an inappropriate quality state (step S04). After that, the customer or the store clerk needs to take action, so the processing as the information processing device 100 is temporarily terminated (i.e., an error state occurs). On the other hand, if an inappropriate quality state is not detected (step S03, No), the information processing device 100 waits for the customer to present the next product (return to step S01). The rest of the processing flow is the same as that of a general self-checkout automated accounting system, and a series of accounting-related processes are performed.

[0023] As described above, according to the present invention, the customer and / or the store clerk are notified of the inappropriate quality state, so the possibility that the customer will make a complaint about the purchased product after the transaction is completed is reduced. In other words, according to the present invention, the transaction process can be properly performed using the self-checkout, so that the customer can purchase the appropriate product and the store clerk can reduce the effort required to deal with complaints.

[0024] [Embodiment 2] In the information processing device 100 of the first embodiment, the price discount rate of the product may be determined according to the quality state of the product.

[0025] Specifically, the information processing device 100 further includes an agreement request unit 40 as shown in Fig. 4. The quality condition inspection unit 20 determines a price discount rate for the product based on the quality condition of the product, and the notification unit 30 notifies the customer of the determined price discount rate. Then, the agreement request unit 40 presents the customer with an image showing the inappropriateness of the quality condition of the product and the price discount rate determined based on the inappropriateness, and requests the customer to agree to purchase the product at the determined price discount rate.

[0026] As an example, a case will be described in which the damage to the package is minor and the customer is not satisfied with purchasing the product at the regular price, but would be willing to compromise if the price is discounted. The information processing device 100 displays an image showing the damaged part of the package and a price discount rate determined based on the extent of the damage on the monitor of the self-checkout 300. The information processing device 100 then displays an "OK button" on the monitor (touch panel) of the self-checkout 300, for example, to prompt the customer to decide whether or not to agree to purchase the product at the discount rate.

[0027] If the customer agrees, the information processing device 100 proceeds with the payment at the discount rate. On the other hand, if the customer does not agree, the information processing device 100 notifies the customer and / or the store clerk that the product needs to be replaced. The information processing device 100 then saves the image presented to the customer, the discount rate, and the customer's agreement in a storage unit (not shown).

[0028] In the above example, the customer agreed to the price discount rate according to the extent of the damage to the package, so this can be said to be an appropriate accounting procedure. In addition, the image showing the damage to the package, the price discount rate, and the customer's agreement are saved as evidence of the response record. The saved data can be used as a countermeasure when a customer complains.

[0029] [Embodiment 3] There are types of self-checkout registers that identify products by reading the barcodes attached to the products. In these types of self-checkout registers, customers must present the location where the barcode is attached to the barcode reader of the self-checkout register. In such cases, some customers may not be able to find the location where the barcode is attached.

[0030] Therefore, the product may be identified based on the captured image, and the customer may be informed of the location of the product to be presented at the self-checkout (i.e., the location of the barcode). Specifically, as shown in Fig. 5, the information processing device 100 further includes a guidance unit 50 that identifies the product based on the captured image, and informs the customer of the location of the product to be presented at the self-checkout.

[0031] The guide unit 50 allows for more appropriate accounting via the self-checkout register. That is, even if a customer thinks that he or she has registered a product at the self-checkout register, if the product is not registered correctly, it will result in fraudulent accounting. The occurrence of such unintentional fraudulent accounting is suppressed. In addition, there are fewer cases where customers ask for assistance from store clerks, and as a result, product providers can reduce the effort required to deal with customers.

[0032] [Embodiment 4] Since self-checkouts are accounting systems that are based on the premise of customers providing self-service in good faith, malicious customers can easily commit fraudulent acts such as shoplifting by intentionally omitting to present products to the self-checkout. Therefore, measures should be taken to prevent fraudulent acts by customers.

[0033] Specifically, the information processing device 100 includes a fraud determination unit 60 that determines whether or not a customer has engaged in fraudulent accounting based on the pre-registration weight of an item before it is registered in the self-register and the post-registration weight of an item after it is registered in the self-register, as shown in Fig. 6. The fraud determination unit 60 obtains the pre-registration weight from a pre-registration weight scale 400 on which a shopping basket containing an item before it is registered in the self-register is placed. The fraud determination unit 60 also obtains the post-registration weight from a post-registration weight scale 500 on which a personal bag containing an item after it is registered in the self-register is placed.

[0034] If a difference occurs between the pre-registration weight and the post-registration weight, fraudulent behavior such as putting the product in a customer's bag without registering it at the self-checkout is anticipated, so the information processing device 100 reports this to the store clerk.

[0035] Incidentally, fraudulent acts by customers may be found in conjunction with information on products registered in the self-checkout register or images captured by a camera. In other words, it is considered that products are placed in a My Bag after they have been registered. Therefore, if a product is not registered in the self-checkout register but its weight increases after registration, it can be determined that shoplifting has been committed by intentionally omitting to register the product in the self-checkout register. Such shoplifting may be determined based on images captured by a camera.

[0036] The present invention can also be developed as a guidance program that causes a computer serving as an information processing device 100 to execute the above-mentioned processes. For example, as shown in Fig. 7, the computer serving as the information processing device 100 includes a memory, a CPU (Central Processing Unit), and an interface. The CPU reads out the guidance program of the present invention from the memory and executes it, thereby realizing processing modules corresponding to the product image acquisition unit 10, the quality condition inspection unit 20, and the notification unit 30.

[0037] A part or all of the above-described embodiments may be described as, but is not limited to, the following supplementary notes.

[0038] (Appendix 1) a product image acquisition unit that acquires, via a camera, an image of a product that the customer intends to purchase; a quality condition inspection unit that inspects the quality condition of the product based on the captured image; a notification unit that notifies the customer and / or the product provider that the product is in an inappropriate quality state when an inappropriate quality state of the product is detected; An information processing device comprising: (Appendix 2) The product image acquisition unit acquires an image of a product presented to the self-checkout. 2. An information processing device according to claim 1. (Appendix 3) the quality condition inspection unit determines a price discount rate for the product based on the quality condition of the product; the notification unit notifies the customer of the determined price discount rate; 3. The information processing device according to claim 1 or 2. (Appendix 4) an agreement request unit that presents to a customer an image showing the inappropriateness of the quality state of the product and a price discount rate determined based on the inappropriateness, and requests the customer to agree to purchase the product at the determined price discount rate; 4. The information processing device according to claim 3, further comprising: (Appendix 5) A product image acquisition step of acquiring an image of a product that the customer intends to purchase via a camera; a quality condition inspection step of inspecting the quality condition of the product based on the captured image; a notification step of notifying the customer and / or the product provider that the product is in an inappropriate quality state when an inappropriate quality state is detected; An information processing method comprising: (Appendix 6) A product image acquisition process for acquiring an image of a product that the customer intends to purchase via a camera; A quality condition inspection process for inspecting the quality condition of the product based on the captured image; a notification process for notifying the customer and / or the product provider that the product is in an inappropriate quality state when an inappropriate quality state is detected; An information processing program that causes a computer to execute the above.

[0039] The disclosures of the above cited patent documents are incorporated herein by reference and may be used as the basis or part of the present invention as necessary. Within the scope of the entire disclosure of the present invention (including the scope of claims), modifications and adjustments of the embodiments and examples are possible based on the basic technical ideas. Furthermore, within the scope of the entire disclosure of the present invention, various combinations or selections (including partial deletions) of various disclosed elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible. In other words, the present invention naturally includes various modifications and corrections that a person skilled in the art would be able to make according to the entire disclosure including the scope of claims and the technical ideas. In particular, with regard to the numerical ranges described in this document, any numerical value or small range included in the range should be interpreted as being specifically described even if not otherwise specified. Furthermore, the disclosures of the above cited documents may be used in part or in whole in combination with the disclosures of this document as part of the disclosure of the present invention in accordance with the spirit of the present invention as necessary, and are deemed to be included in the disclosures of this application. [Explanation of symbols]

[0040] 10 Product image acquisition section 20 Quality Inspection Department 30 Notification Department 40 Agreement request section 50 Information Department 60 Fraud Judgment Department 100 Information processing device 200 Cameras 300 Self-checkout 400 Pre-registered weight scale 500 Registered weight scale

Claims

1. a product image acquisition unit that acquires, via a camera, an image of a product that the customer intends to purchase; a quality condition inspection unit that inspects the quality condition of the product based on the captured image; a notification unit that notifies the customer and / or the product provider that the product is in an inappropriate quality state when an inappropriate quality state is detected; a pre-registration weighing scale on which a shopping basket containing the product is placed before the product is registered in the self-checkout; a post-registration weight scale on which the bag containing the product is placed after the product is registered in the self-checkout; a fraud determination unit that determines whether or not a customer has engaged in fraudulent accounting based on a pre-registration weight of the product before the product is registered in the self-registering register and a post-registration weight of the product after the product is registered in the self-registering register; A guidance unit that identifies the product based on the captured image and guides the customer to a barcode attachment location on the product that should be presented to the self-checkout; An information processing device comprising:

2. the quality condition inspection unit determines a price discount rate for the product based on the quality condition of the product; the notification unit notifies the customer of the determined price discount rate; The information processing device according to claim 1 .

3. an agreement request unit that presents to a customer an image showing the inappropriateness of the quality state of the product and a price discount rate determined based on the inappropriateness, and requests the customer to agree to purchase the product at the determined price discount rate; The information processing apparatus according to claim 2 , further comprising:

4. A product image acquisition step of acquiring an image of a product that the customer intends to purchase via a camera; a quality condition inspection step of inspecting the quality condition of the product based on the captured image; a notification step of notifying the customer and / or the product provider that the product is in an inappropriate quality state when an inappropriate quality state is detected; a fraud determination step of determining whether or not there is fraudulent accounting by a customer based on a pre-registration weight of the product before it is registered in the self-registering register and a post-registration weight of the product after it is registered in the self-registering register; A guidance step of identifying the product based on the captured image and informing the customer of a location where a barcode is attached as a location of the product that should be presented at the self-checkout; An information processing method comprising:

5. A product image acquisition process for acquiring an image of a product that the customer intends to purchase via a camera; A quality condition inspection process for inspecting the quality condition of the product based on the captured image; a notification process for notifying the customer and / or the product provider that the product is in an inappropriate quality state when an inappropriate quality state is detected; a fraud determination process for determining whether or not a customer has engaged in fraudulent accounting based on a pre-registration weight of the product before the product is registered in the self-registering register and a post-registration weight of the product after the product is registered in the self-registering register; A guidance process of identifying the product based on the captured image and informing the customer of the location of the barcode that should be presented to the self-checkout; An information processing program that causes a computer to execute the above.

Images