Information processor and method of preventing false positive detection of shoplifting

Abstract

To provide an information processor that prevents false positive detection of shoplifting.SOLUTION: An information processor includes: a detection unit that detects that an article has been removed from a first article stand on which the article is placed before an article code is scanned; a determination unit that determines that shoplifting has occurred when the article detected by the detection unit is placed without being scanned on a second article stand on which the article is placed after the product code has been scanned. When the article detected by the detection unit is returned to the first article stand without being scanned, the determination unit treats the article as if the detection unit did not detect the article.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and a method for suppressing shoplifting misdetection.

Background Art

[0002] In recent years, due to the reduction of labor costs for store clerks in retail stores and the like, the popularity of self-checkout has been rapidly progressing. In self-checkout, since the customer himself / herself scans the barcode of the product, measures against shoplifting are important.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] As a method for determining shoplifting, a method based on detection of products by a camera and the presence or absence of barcode scanning is assumed. For example, self-checkout detects products taken out by a customer from a product placement table (or a shopping basket in the store) before scanning with a camera. After self-checkout detects a product with a camera, if barcode scanning is executed, it determines that no shoplifting has occurred. On the other hand, if self-checkout detects a product with a camera but barcode scanning is not executed and the product is moved to the product placement table (or the customer's shopping basket) after scanning, it determines that shoplifting has occurred.

[0005] However, in the above-described method, shoplifting may be misdetected. For example, a customer may take out a product from the product placement table before scanning, approach the barcode reader trying to scan the barcode of the product, then cancel the barcode scanning, and return the product to the product placement table before scanning. In this case, self-checkout misdetects shoplifting as the barcode scanning has not been executed despite the product being detected by the camera.

[0006] Non-limiting embodiments of the present disclosure contribute to providing an information processing apparatus and a method for suppressing false detection of shoplifting that can suppress false detection of shoplifting.

Means for Solving the Problem

[0007] An information processing apparatus according to an embodiment of the present disclosure includes a detection unit that detects that a product has been taken out from a first product placement table on which the product is placed before the product code is scanned, and a second product placement table on which the product is placed after the product code is scanned. When the product detected by the detection unit is placed without being scanned, a determination unit that determines that a shoplifting act has occurred, and when the product detected by the detection unit is not scanned and is returned to the first product placement table, the determination unit treats it as if the detection unit did not detect the product.

[0008] A method for suppressing false detection of shoplifting according to an embodiment of the present disclosure includes a detection unit that detects that a product has been taken out from a first product placement table on which the product is placed before the product code is scanned, and a determination unit that determines that a shoplifting act has occurred when the product detected by the detection unit is placed without being scanned on a second product placement table on which the product is placed after the product code is scanned. When the product detected by the detection unit is not scanned and is returned to the first product placement table, the determination unit treats it as if the detection unit did not detect the product.

[0009] These general or specific aspects may be implemented in a system, apparatus, method, integrated circuit, computer program, or recording medium, or may be implemented in any combination of a system, apparatus, method, integrated circuit, computer program, and recording medium.

Advantages of the Invention

[0010] According to an embodiment of the present disclosure, false detection of shoplifting can be suppressed.

[0011] Further advantages and effects in one embodiment of the present disclosure will be clarified from the specification and the drawings. Such advantages and / or effects are respectively provided by several embodiments and the features described in the specification and the drawings, but not all of them are necessarily provided in order to obtain one or more identical features.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Modes for Carrying Out the Invention

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with appropriate reference to the drawings. However, a more detailed description than necessary may be omitted. For example, a detailed description of already well-known matters or a redundant description of substantially the same configuration may be omitted. This is to avoid making the following description unnecessarily redundant and to facilitate the understanding of those skilled in the art.

[0014] Note that the attached drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and it is not intended to limit the subject matter described in the claims thereby.

[0015] <The First Embodiment> (System Configuration) FIG. 1 is a diagram showing a configuration example of a self-checkout system including an information processing apparatus 1 according to a first embodiment. As shown in FIG. 1, the self-checkout system includes the information processing apparatus 1, scanners 2a and 2b, a camera 3, weight sensors 4a and 4b, and a display 5. In FIG. 1, in addition to the self-checkout system, merchandise stands A1a and A1b and a stand A2 are shown.

[0016] The merchandise stand A1a is a stand on which merchandise before being scanned by the scanners 2a and 2b is placed. The merchandise before being scanned placed on the merchandise stand A1a may include a shopping basket of the store where the merchandise before being scanned is located.

[0017] The merchandise stand A1b is a stand on which merchandise after being scanned by the scanners 2a and 2b is placed. The merchandise after being scanned placed on the merchandise stand A1b may include a customer's shopping basket into which the merchandise after being scanned is placed.

[0018] The information processing apparatus 1 is a computer such as a personal computer or a server, for example. In FIG. 1, the information processing apparatus 1 is placed outside the stand A2, but it may be placed inside the stand A2 or inside the store office. The information processing apparatus 1 performs, for example, settlement processing of merchandise and monitoring processing of shoplifting.

[0019] The scanner 2a is a handy-type scanner. The scanner 2b is a fixed-type scanner fixed to the stand A2. Hereinafter, when the scanners 2a and 2b are not distinguished, they are simply referred to as the scanner 2.

[0020] The scanner 2 is connected to the information processing apparatus 1. The scanner 2 scans a merchandise code attached to the merchandise. The scanner 2 transmits the scanned merchandise code to the information processing apparatus 1. The merchandise code is a barcode such as a JAN (Japanese Article Number) code, for example. The scanner 2 may be referred to as a barcode reader or a reader.

[0021] The camera 3 is connected to the information processing apparatus 1. The camera 3 transmits the image data of the captured image to the information processing apparatus 1.

[0022] The camera 3 is installed so as to capture the vicinity where the customer scans the product with the scanner 2 (see the dotted frame A3 in FIG. 1). For example, the camera 3 is installed above the display 5 or above the stand A2, and the angle of view is set to include between the product stands A1a and A1b, that is, the vicinity where the customer scans the product with the scanner 2.

[0023] The weight sensor 4a is connected to the information processing apparatus 1. The weight sensor 4a is installed, for example, inside the product stand A1a, and transmits a signal corresponding to the weight of the product placed on the product stand A1a (or a shopping basket of the store containing the product, etc.) to the information processing apparatus 1.

[0024] The weight sensor 4b is connected to the information processing apparatus 1. The weight sensor 4b is installed, for example, inside the product stand A1b, and transmits a signal corresponding to the weight of the product placed on the product stand A1b (or a customer's shopping basket containing the product, etc.) to the information processing apparatus 1.

[0025] The display 5 is connected to the information processing apparatus 1. The display 5 displays, for example, the product information of the product scanned by the customer using the scanner 2. The product information may be, for example, the name, price, and quantity of the product.

[0026] The display 5 may be provided with a touch panel on the screen surface. The touch panel receives the operations of the customer. The customer inputs, for example, the information of products without product codes such as vegetables and fruits via the touch panel and registers them as purchased products. Note that the device for receiving the operations of the customer is not limited to the touch panel. The device for receiving the operations of the customer may be, for example, a key input device separate from the display 5.

[0027] The display 5 displays a screen for deterring shoplifting based on the control of the information processing device 1. For example, when a product is moved from the product stand A1a to the product stand A1b without being scanned by the scanner 2, the display 5 displays a screen prompting the product to be scanned by the scanner 2.

[0028] (Operation Timing) 1. Operation Timing in Case of Shoplifting FIG. 2 is a diagram for explaining the operation timing of the information processing device 1 in the case of shoplifting. First, each flag shown in FIG. 2 will be explained, and then the operation timing will be explained.

[0029] The product code scan flag is a signal output from the scanner 2 to the information processing device 1. The product code scan flag becomes the H state for a certain period of time when the scanner 2 scans the product code.

[0030] Note that the product code scan flag shown in FIG. 2 remains in the L state. That is, at the operation timing of FIG. 2, the customer has not scanned the product code of the product with the scanner 2.

[0031] The product detection flag, product return flag, product movement flag, and shoplifting flag shown in FIG. 2 are set to the H state and L state by the information processing device 1.

[0032] · Product Detection Flag The information processing device 1 sets the product detection flag to the H state while the image of the product is included in the image of the image data received from the camera 3. That is, the information processing device 1 detects the product taken out from the product stand A1a (for example, the product taken by the customer) based on the image data of the camera 3.

[0033] However, after the information processing device 1 sets the product detection flag to the H state, if the product code scan flag becomes the H state, the information processing device 1 sets the product detection flag to the L state. After the information processing device 1 sets the product detection flag to the H state, if the product return flag (described later) becomes the H state, the information processing device 1 sets the product detection flag to the L state. After the information processing device 1 sets the product detection flag to the H state, if the product movement flag (described later) becomes the H state, the information processing device 1 sets the product detection flag to the L state.

[0034] · Product return flag When a product is taken out from the product stand A1a and then returned to the product stand A1a, the information processing device 1 sets the product return flag to the H state for a certain period of time.

[0035] Based on the signal of the weight sensor 4a, the information processing device 1 detects that a product has been taken out from the product stand A1a and then returned to the product stand A1a. For example, when the weight calculated based on the signal of the weight sensor 4a decreases and then increases again (returns to the original state), the information processing device 1 detects that a product has been taken out from the product stand A1a and then returned to the product stand A1a.

[0036] Note that the product return flag shown in FIG. 2 remains in the L state. That is, at the operation timing of FIG. 2, the product has been taken out from the product stand A1a and not returned to the product stand A1a. The operation timing when the product return flag becomes the H state will be described in "3. Operation Timing When There Is No Shoplifting #2".

[0037] · Product movement flag When a product is moved to the product stand A1b, the information processing device 1 sets the product movement flag to the H state for a certain period of time.

[0038] Based on the signal of the weight sensor 4b, the information processing device 1 detects that a product has been moved (placed) to the product stand A1b. For example, when the weight calculated based on the signal of the weight sensor 4b increases, the information processing device 1 detects that a product has been moved to the product stand A1b.

[0039] · Shoplifting flag After setting the merchandise detection flag to the H state, if the information processing device 1 sets the merchandise movement flag to the H state without receiving the merchandise code scan flag in the H state, the shoplifting flag is set to the H state for a certain period of time. That is, after detecting a merchandise based on the image of the camera 3, if the information processing device 1 detects that the merchandise has been moved to the merchandise stand A1b without receiving the merchandise code scan flag from the scanner 2, the shoplifting flag is set to the H state for a certain period of time. In other words, if the customer moves the merchandise from the merchandise stand A1a to the merchandise stand A1b without scanning the merchandise using the scanner 2, the information processing device 1 determines that shoplifting has occurred.

[0040] Each flag described above has been explained as a positive logic (active high), but it may also be a negative logic (active low). For example, while the merchandise is included in the image of the image data received from the camera 3, the information processing device 1 may set the merchandise detection flag to the L state.

[0041] Next, the operation timing will be described. In the description of the operation timing in FIG. 2, it is assumed that the customer performs a shoplifting act. The customer takes out the merchandise from the merchandise stand A1a and moves it to the merchandise stand A1b without scanning the merchandise code of the taken-out merchandise with the scanner 2.

[0042] As shown in FIG. 2, based on the image data of the camera 3, the information processing device 1 detects the merchandise taken out from the merchandise stand A1a and sets the merchandise detection flag to the H state. Thereafter, the information processing device 1 sets the merchandise movement flag to the H state and sets the merchandise detection flag to the L state.

[0043] After setting the merchandise detection flag to the H state, if the information processing device 1 sets the merchandise movement flag to the H state without receiving the merchandise code scan flag in the H state, the shoplifting flag is set to the H state. That is, if the customer takes out the merchandise from the merchandise stand A1a and moves it to the merchandise stand A1b without scanning the merchandise with the scanner 2, the information processing device 1 determines (detects) the occurrence of shoplifting.

[0044] In addition, when the information processing device 1 detects a shoplifting act by a customer, it displays on the display 5 a message for suppressing the shoplifting act, such as "Please scan the item", for example. Alternatively, the information processing device 1 notifies the occurrence of the shoplifting act to the mobile terminal possessed by the store clerk.

[0045] 2. Operation Timing #1 When There is No Shoplifting Act FIG. 3 is a diagram for explaining the operation timing of the information processing device 1 when there is no shoplifting act. The operation of the flag shown in FIG. 3 is the same as the operation of the flag explained in FIG. 2, and the explanation thereof is omitted.

[0046] In the explanation of the operation timing in FIG. 3, it is assumed that the customer does not commit a shoplifting act. The customer takes out an item from the item stand A1a and scans the item code of the taken-out item with the scanner 2. Then, the customer moves the item with the scanned item code to the item stand A1b.

[0047] As shown in FIG. 3, based on the image data of the camera 3, the information processing device 1 detects the item taken out from the item stand A1a and sets the item detection flag to the H state. After that, when the information processing device 1 receives the item code scan flag from the scanner 2, it sets the item detection flag to the L state as shown in FIG. 2.

[0048] The item scanned by the scanner 2 is moved to the item stand A1b. Therefore, the information processing device 1 sets the item movement flag to the H state as shown in FIG. 2.

[0049] After setting the item detection flag to the H state, when the information processing device 1 receives the item code scan flag in the H state and sets the item movement flag to the H state, it does not set the shoplifting flag to the H state.

[0050] That is, when the customer takes out an item from the item stand A1a, scans the item with the scanner 2, and moves it to the item stand A1b, the information processing device 1 determines that the customer has performed an appropriate item purchase act.

[0051] Operation Timing #2 When There Is No Shoplifting Act FIG. 4 is a diagram for explaining the operation timing of the information processing apparatus 1 when there is no shoplifting act. The operation of the flag shown in FIG. 3 is the same as the operation of the flag explained in FIG. 2, and the explanation thereof is omitted.

[0052] In the explanation of the operation timing in FIG. 4, it is assumed that the customer does not perform a shoplifting act. The customer takes out a product from the product stand A1a, does not scan the product code of the taken-out product with the scanner 2, and returns it to the product stand A1a.

[0053] Note that, as a case where the customer does not scan the product code and returns it to the product stand A1a, for example, the product taken out from the product stand A1a may be light. This is because products stored in the customer's shopping basket are generally stored with heavier products at the bottom.

[0054] As shown in FIG. 4, based on the image data of the camera 3, the information processing apparatus 1 detects the product taken out from the product stand A1a and sets the product detection flag to the H state. After that, when the information processing apparatus 1 sets the product return flag to the H state, as shown in FIG. 4, it sets the product detection flag to the L state and invalidates (resets) the product detection. By invalidating the product detection, that is, by assuming that no product has been taken out from the product stand A1a, the information processing apparatus 1 does not set the shoplifting flag to the H state.

[0055] That is, even if the customer takes out a product from the product stand A1a and does not scan the taken-out product with the scanner 2, if the customer returns the product to the product stand A1a, the information processing apparatus 1 does not determine that shoplifting has occurred (does not misdetect that shoplifting has occurred).

[0056] (Block Diagram) FIG. 5 is a diagram showing an example of the block configuration of the information processing apparatus 1. As shown in FIG. 5, the information processing apparatus 1 includes a control unit 11, a storage unit 12, and a communication unit 13.

[0057] The control unit 11 controls the entire information processing apparatus 1. The control unit 11 may be configured by a processor such as a CPU (central processing unit), for example.

[0058] The control unit 11 includes a merchandise detection unit 11a, a merchandise movement monitoring unit 11b, a shoplifting determination unit 11c, and an alarm generation unit 11d. The control unit 11 may realize the functions of the foregoing respective units according to the programs stored in the storage unit 12.

[0059] Based on the image data of the camera 3, the merchandise detection unit 11a detects whether an image of a merchandise is included in the image captured by the camera 3. When an image of a merchandise is included in the image captured by the camera 3, the merchandise detection unit 11a outputs, for example, a merchandise detection flag in the H state to the shoplifting determination unit 11c.

[0060] The merchandise detection unit 11a may detect whether an image of a merchandise is included in the image captured by the camera 3 by using a technology such as the image recognition service of Azure (registered trademark), for example. The merchandise detection unit 11a only needs to be able to detect whether a merchandise is included in the image of the image data received from the camera 3, and does not need to detect merchandise information such as the name and price of the merchandise.

[0061] Based on the signal of the weight sensor 4a, the merchandise movement monitoring unit 11b calculates the weight of the merchandise on the merchandise stand A1a. Based on the calculated weight, the merchandise movement monitoring unit 11b monitors whether the merchandise is taken out from the merchandise stand A1a and returned to the merchandise stand A1a. When the merchandise is taken out from the merchandise stand A1a and returned to the merchandise stand A1a, the merchandise movement monitoring unit 11b outputs, for example, a merchandise return flag in the H state to the shoplifting determination unit 11c for a certain period of time.

[0062] In addition, the merchandise movement monitoring unit 11b calculates the weight of the merchandise on the merchandise stand A1b based on the signal from the weight sensor 4b. The merchandise movement monitoring unit 11b monitors whether the merchandise is placed on the merchandise stand A1b based on the calculated weight. When merchandise is placed on the merchandise stand A1b, the merchandise movement monitoring unit 11b outputs, for example, an H-state merchandise movement flag to the shoplifting determination unit 11c for a certain period of time.

[0063] The shoplifting determination unit 11c determines the occurrence of shoplifting based on the scanner information (merchandise code scan flag) of the scanner 2, the merchandise detection information (merchandise detection flag) of the merchandise detection unit 11a, and the merchandise movement information (merchandise return flag and merchandise movement flag).

[0064] For example, when the shoplifting determination unit 11c receives an H-state merchandise movement flag without receiving an H-state merchandise code scan flag after receiving an H-state merchandise detection flag, it determines that shoplifting has occurred.

[0065] For example, when the shoplifting determination unit 11c receives an H-state merchandise code scan flag after receiving an H-state merchandise detection flag, it determines that the customer has performed an appropriate merchandise purchase action.

[0066] For example, when the shoplifting determination unit 11c receives an H-state merchandise return flag after receiving an H-state merchandise detection flag, it sets the H-state merchandise detection flag to the L state (invalidated). Since the shoplifting determination unit 11c invalidates the merchandise detection flag and assumes that the merchandise has not been detected, it determines that the customer has performed an appropriate merchandise purchase action even without receiving an H-state merchandise code scan flag. In this case, although the customer has returned the merchandise without scanning the merchandise code and the purchase by the customer is not finalized, the shoplifting determination unit 11c determines that an appropriate merchandise purchase action has been performed in the sense that a series of actions related to the purchase of the merchandise does not include any actions suspected of fraud such as shoplifting.

[0067] When the shoplifting determination unit 11c determines the occurrence of shoplifting, the alarm generation unit 11d generates alarm information. For example, the alarm generation unit 11d generates image data of an image including characters such as "Please scan the item". The image data is transmitted to the display 5 via the communication unit 13.

[0068] Also, the alarm generation unit 11d generates, for example, an alarm signal. The alarm signal is transmitted to the mobile terminal carried by the store clerk via the communication unit 13. The mobile terminal that has received the alarm signal notifies the store clerk of the occurrence of shoplifting by sound, for example.

[0069] The storage unit 12 stores an OS (operating system) program and application programs to be executed by the control unit 11. For example, the storage unit 12 stores an application program that performs settlement processing of self-checkout and monitoring processing of shoplifting behavior. Also, the storage unit 12 stores various data necessary for the processing by the control unit 11. The storage unit 12 may be, for example, an SSD (solid state drive), a RAM (Random Access Memory), a flash memory, a ROM (Read Only Memory), and / or an HDD (hard disk drive).

[0070] The communication unit 13 communicates with the scanner 2, the camera 3, the weight sensors 4a, 4b, and the display 5 by wire or wirelessly. Also, the communication unit 13 communicates wirelessly with the mobile terminal carried by the store clerk.

[0071] (Operation flow) FIG. 6 is a flowchart showing an operation example of the information processing apparatus 1.

[0072] The information processing apparatus 1 determines whether or not all the items placed on the product stand A1a by the customer have been scanned by the scanner 2 (S1). The information processing apparatus 1 may determine whether or not all the items placed on the product stand A1a have been scanned by the scanner 2 based on, for example, the signal of the weight sensor 4a.

[0073] When the information processing device 1 determines that the customer has scanned all the products placed on the product stand A1a with the scanner 2 (Yes in S1), it performs accounting processing (S2). Then, the information processing device 1 ends the processing of the flowchart in FIG. 6.

[0074] When the information processing device 1 determines that the customer has not scanned all the products placed on the product stand A1a with the scanner 2 (No in S1), it determines whether a product image is included in the image of the camera 3 (whether a product is detected) (S3). That is, the information processing device 1 determines, for example, whether the customer has taken out a product from the product stand A1a (whether the customer has picked up a product).

[0075] When the information processing device 1 determines that no product image is included in the image of the camera 3 (No in S3), it repeatedly executes the processing of S3.

[0076] When the information processing device 1 determines that a product image is included in the image of the camera 3 (Yes in S3), it determines whether the customer has returned the product to the product stand A1a based on the signal of the weight sensor 4a (S4). For example, the information processing device 1 determines that the customer has returned the product to the product stand A1a based on the signal of the weight sensor 4a.

[0077] When the information processing device 1 determines that the customer has returned the product to the product stand A1a (Yes in S4), it invalidates product detection (S5). Then, the information processing device 1 transfers the processing to S3 and determines whether a product image is included in the image of the camera 3.

[0078] When the information processing device 1 determines that the customer has not returned the product to the product stand A1a (No in S4), it determines whether the customer has moved the product to the product stand A1b (S6). For example, the information processing device 1 determines whether the customer has moved the product to the product stand A1b based on the signal of the weight sensor 4b.

[0079] When the information processing apparatus 1 determines that the customer has not moved the product to the product stand A1b (No in S6), the process proceeds to S4, and it is determined whether the customer has returned the product to the product stand A1a.

[0080] When the information processing apparatus 1 determines that the customer has moved the product to the product stand A1b (Yes in S6), it determines whether the product has been scanned (S7).

[0081] When the information processing apparatus 1 determines that the product has been scanned (Yes in S7), that is, when it determines that the product moved to the product stand A1b has been scanned, the process proceeds to S1, and it is determined whether the customer has scanned all the products placed on the product stand A1a with the scanner 2.

[0082] When the information processing apparatus 1 determines that the product has not been scanned (No in S7), that is, when it determines that the product moved to the product stand A1b has not been scanned, it determines that shoplifting has occurred (S8). When the information processing apparatus 1 determines that shoplifting has occurred, it generates alarm information and an alarm signal, and proceeds to the determination (S1) of whether the customer has scanned all the products placed on the product stand A1a with the scanner 2. Thereby, the customer who has been notified of the alarm can be given an opportunity to rescan the products with the scanner 2.

[0083] Note that when giving the customer no opportunity to rescan the products during shoplifting determination, the cash register operation may be abnormally terminated, an alarm or the like may be displayed on the cash register screen, and the subsequent cash register operation may be stopped. In this case, the terminal or base station held by the store clerk may be notified that shoplifting has occurred.

[0084] When the information processing apparatus 1 determines that the product has been scanned (Yes in S7), the process proceeds to S1, and it is determined whether the customer has scanned all the products placed on the product stand A1a with the scanner 2.

[0085] (Summary of the First Embodiment) The information processing device 1 detects that a product has been taken out from the product placement table A1a where the product is placed before the product code is scanned. If the product code of the detected product is not scanned and is placed on the product placement table A1b where the product is placed after the product code is scanned, the information processing device 1 determines that a shoplifting act has occurred. If the product code of the detected product is not scanned and the product is returned to the product placement table A1a, the information processing device 1 invalidates the product detection. By this operation, the information processing device 1 can suppress false detection of shoplifting. For example, even if a customer takes out a product from the product placement table A1a and does not scan the product, if the product is returned to the product placement table A1a, the information processing device 1 invalidates the product detection. Therefore, even though the information processing device 1 has detected a product, it will not determine that a shoplifting act has occurred on the assumption that the scan has not been executed, and false detection of shoplifting can be suppressed.

[0086] <Second Embodiment> There may be a case where a customer tries to scan a product with the scanner 2 but cancels, and does not return the product to the product placement table A1a and does not place it on the product placement table A1b either. For example, a customer may take out a product from the product placement table A1a and place the taken-out product on a table between the product placement table A1a and the product placement table A1b. Also, for example, a customer may take out a product from the product placement table A1a and keep the taken-out product in hand. In the second embodiment, when a product is taken out from the product placement table A1a and not placed on the product placement table A1b, it is ensured that shoplifting is not determined to have occurred.

[0087] Below, the parts different from the first embodiment will be described. Note that the self-checkout system in the second embodiment is the same as the self-checkout system in the first embodiment.

[0088] (Operation Timing) FIG. 7 is a diagram for explaining the operation timing of the information processing device 1 according to the second embodiment. The operations of the product code scan flag, product detection flag, product return flag, product movement flag, and shoplifting flag shown in FIG. 7 are the same as the operations of the flags described in FIG. 2, and the description thereof is omitted.

[0089] In FIG. 7, in addition to the above flag, a shoplifting enable flag is shown. After the information processing apparatus 1 sets the merchandise detection flag to the H state, if the scanned merchandise return flag is in the L state and the merchandise movement flag is in the L state, the information processing apparatus 1 sets the shoplifting enable flag to the L state. When the shoplifting enable flag of the information processing apparatus 1 is in the L state, the information processing apparatus 1 does not determine the occurrence of shoplifting (does not set the shoplifting flag to the H state).

[0090] In the description of the operation timing in FIG. 7, it is assumed that the customer takes out a product from the product stand A1a and places the taken-out product on the stand between the product stand A1a and the product stand A1b. Then, it is assumed that the customer places the product on the product stand A1b without scanning the product with the scanner 2.

[0091] As described above, after the information processing apparatus 1 sets the merchandise detection flag to the H state, if the scanned merchandise return flag is in the L state and the merchandise movement flag is in the L state, the information processing apparatus 1 sets the shoplifting enable flag to the L state. When the shoplifting enable flag of the information processing apparatus 1 is in the L state, the information processing apparatus 1 does not set the shoplifting flag to the H state.

[0092] That is, for example, when the product is placed on the stand between the product stand A1a and the product stand A1b, or when the customer is holding the product in hand, the information processing apparatus 1 sets the shoplifting enable flag to the L state. When the shoplifting enable flag of the information processing apparatus 1 is in the L state, the information processing apparatus 1 does not set the shoplifting flag to the H state. By this operation, the information processing apparatus 1 can suppress, for example, misjudging that shoplifting has occurred when the customer places the product on the stand between the product stand A1a and the product stand A1b or when the customer is holding the product in hand.

[0093] (Block Diagram) The block configuration of the information processing apparatus 1 in the second embodiment is the same as the block configuration shown in FIG. 5. However, the function of the shoplifting determination unit 11c is different. The shoplifting determination unit 11c in the second embodiment does not determine the occurrence of shoplifting after the merchandise detection flag is set to the H state if the scanned merchandise return flag is in the L state and the merchandise movement flag is in the L state.

[0094] (Summary of the Second Embodiment) The information processing apparatus 1 detects a product taken out from the product placement stand A1a, and does not determine that shoplifting has occurred while the detected product is not returned to the product placement stand A1a and is not placed on the product placement stand A1b. By this operation, the information processing apparatus 1 can suppress false detection of shoplifting.

[0095] (Modification) A modification will be described. Unless otherwise explicitly stated, the modification is applicable to the first embodiment and the second embodiment.

[0096] (Modification 1) The detection of the removal of a product from the product placement stand A1a, the return of the product to the product placement stand A1a, and the movement of the product to the product placement stand A1b is not limited to the method using the signals of the weight sensors 4a and 4b. The information processing apparatus 1 may detect the removal of a product from the product placement stand A1a, the return of the product to the product placement stand A1a, and the movement of the product to the product placement stand A1b based on a camera image.

[0097] The camera for detecting the removal of a product from the product placement stand A1a, the return of the product to the product placement stand A1a, and the movement of the product to the product placement stand A1b may be the camera 3 or may be a camera different from the camera 3. When using a camera different from the camera 3, for example, one of the two cameras may be installed above the product placement stand A1a so as to photograph the periphery of the product placement stand A1a, and the other camera may be installed above the product placement stand A1b so as to photograph the periphery of the product placement stand A1b. When using the camera 3, a wide-angle camera is desirable for photographing the product placement stands A1a and A1b.

[0098] The sensor for detecting the removal of a product from the product placement stand A1a, the return of the product to the product placement stand A1a, and the movement of the product to the product placement stand A1b is not limited to a weight sensor or a camera.

[0099] (Modification 2) When the information processing device 1 determines that it is not necessary to determine that shoplifting has occurred if the scanned item is returned to the item stand A1a after being scanned by the scanner 2. When the information processing device 1 determines that the scanned item is returned to the item stand A1a after being scanned by the scanner 2, the information processing device 1 may display a screen indicating that the item has been returned to the item stand A1a on the display 5. Alternatively, when the information processing device 1 determines that the scanned item is returned to the item stand A1a after being scanned by the scanner 2, the information processing device 1 may display a screen on the display 5 prompting the movement of the scanned item to the item stand A1b.

[0100] (Modification Example 3) Although the information processing device 1 detects an item based on the image of the camera 3, if the item is not scanned by the scanner 2 and the information processing device 1 does not detect that the item has been placed on the item stand A1b, the information processing device 1 may determine that shoplifting has occurred. The case where the item is not scanned by the scanner 2 and the item is not placed on the item stand A1b may be considered as a case where none of the following three conditions are satisfied. ·Condition 1: It is detected that the item has been returned to the item stand A1a ·Condition 2: It is detected that the item has been placed on the item stand A1b ·Condition 3: Any of the following is detected based on the image of the camera 3 ··Condition 3a: It is detected that the item has been placed on the stand for item scanning (for example, the stand between the item stand A1a and the item stand A1b) ··Condition 3b: It is detected that the item is being held in the hand

[0101] (Modification Example 4) A weight sensor may be provided on the cart. The weight sensor provided on the cart wirelessly transmits a signal corresponding to the weight of the item placed in the cart to the information processing device 1.

[0102] When a weight sensor is provided on the cart, the customer can take out the item from the cart and scan it with the scanner 2 without placing it on the item stand A1a.

[0103] In addition, a camera (or camera 3) that photographs the periphery of the product stand A1a described in Modification Example 1 may photograph a cart placed near the product stand A1a. The information processing apparatus 1 may determine the removal of a product from the cart and the return of the product to the cart based on an image from the camera (or camera 3).

[0104] That is, the configuration of this modification example can be said to be a configuration in which the product stand A1a is arranged on the cart.

[0105] In addition, the product stand A1a may be provided on both the stand A2 and the cart. In this case, the product stand A1a provided on the stand A2 and the product stand A1a provided on the cart may be handled without distinction. For example, when a product is taken out from the product stand A1a provided on the cart and moved to the product stand A1a provided on the stand A2, although the product is moving between the cart and the stand A2, it may be handled as if the product has been returned to the product stand A1a without distinguishing between the cart and the stand A2.

[0106] (Modification Example 5) The information processing apparatus 1 may cancel the invalidation of product detection and re-enable product detection on the occasion of the following. · After the product has been returned to the product stand A1a, it is detected based on the signal of the weight sensor 4a that the next product has been taken out from the product stand A1a · After the product has been returned to the product stand A1a, it is detected based on the image of the camera (or camera 3) that the next product has been taken out from the product stand A1a

[0107] (Modification Example 6) When the information processing apparatus 1 does not perform product detection based on the image of the camera 3 and a product is placed on the product stand A1b without being scanned by the scanner 2, the information processing apparatus 1 may determine that shoplifting has occurred. That is, when a customer places a product on the product stand A1b so as not to be photographed by the camera 3, the information processing apparatus 1 may determine that shoplifting has occurred.

[0108] (Modification Example 7) When the information processing device 1 detects that a product has been placed on the product stand A1a, but does not detect the product based on the image of the camera 3 and the product is not scanned by the scanner 2, it may be determined that no shoplifting has occurred. This is because when a product is placed on the product stand A1a but not detected and not scanned by the scanner 2, it is assumed that the customer has moved to another cash register.

[0109] (Modification Example 8) The information processing device 1 may determine whether a product has been moved from the product stand A1a to the product stand A1b based on the signals of the weight sensors 4a and 4b. For example, when the increase in weight at the product stand A1b is the same (including approximately the same) as the decrease in weight at the product stand A1a, the information processing device 1 may determine that the product has been moved from the product stand A1a to the product stand A1b.

[0110] Note that the present invention can also prevent false detection of shoplifting even when an object other than a product, such as a wallet, a card, a smartphone or a mobile terminal, a receipt, or a customer's shoes, is detected by a camera. Even when these objects other than the product are not detected by barcode scanning but are detected as objects, if they are not placed on the product stand A1b, false detection of shoplifting can be prevented.

[0111] In addition, the monitoring of the product stand A1a, the barcode scanning operation, and the product stand A1b may be performed with a wide-angle view using a single camera.

[0112] Also, the determination of shoplifting may be performed using the movement history information of the product moving to the product stand A1a, the barcode scanning operation, and the product stand A1b. For example, when it is detected that a product taken from the product stand A1a is detected as an object without being detected by barcode scanning and has moved to the product stand A1b, it is determined as shoplifting. In this case, if it is not detected that the product has moved to the product stand A1b, it is not determined as shoplifting.

[0113] The embodiments have been described above with reference to the drawings, but the present disclosure is not limited to such examples. It is obvious that those skilled in the art can conceive various modification examples or correction examples within the scope described in the claims. Such modification examples or correction examples are also understood to belong to the technical scope of the present disclosure. Also, within the scope not departing from the gist of the present disclosure, the components in the embodiments may be arbitrarily combined.

[0114] In the above-described embodiments, the notation “... part” used for each component may be replaced with other notations such as “... circuitry”, “... assembly”, “... device”, “... unit”, or “... module”.

[0115] The present disclosure can be realized by software, hardware, or software in cooperation with hardware. Each functional block used in the description of the above embodiments is realized, partially or entirely, as an LSI which is an integrated circuit, and each process described in the above embodiments may be controlled, partially or entirely, by one LSI or a combination of LSIs. The LSI may be composed of individual chips, or may be composed of one chip so as to include a part or all of the functional blocks. The LSI may have data input and output. Depending on the degree of integration, the LSI may also be referred to as an IC, a system LSI, a super LSI, or an ultra LSI.

[0116] The method of integrating into a circuit is not limited to LSI, and it may be realized by a dedicated circuit, a general-purpose processor, or a dedicated processor. Also, after manufacturing the LSI, an FPGA (Field Programmable Gate Array) that can be programmed, or a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used. The present disclosure may be realized as digital processing or analog processing.

[0117] Furthermore, if a technology for integrating circuits that replaces LSI emerges due to the progress of semiconductor technology or another derived technology, it is natural that the integration of functional blocks may be performed using such technology. The application of biotechnology and the like may be possible.

Industrial Applicability

[0118] The present disclosure is useful for suppressing shoplifting in self-checkout.

Explanation of Signs

[0119] 1 Information processing device 2, 2a, 2b Scanner 3 Camera 4a, 4b Weight sensor 5 Display A4a, A4b Product placement stand

Claims

1. a detection unit that detects that a product has been removed from a first product placement table on which a product is placed before its product code is scanned; a determination unit that determines that shoplifting has occurred when a product detected by the detection unit is placed without being scanned on a second product placement table on which a product is placed after its product code has been scanned; Equipped with When a product detected by the detection unit is returned to the first product stand without being scanned, the determination unit treats the product as not having been detected by the detection unit. Information processing device.

2. the determination unit does not determine that shoplifting has occurred while the product detected by the detection unit is not returned to the first product placement table and is not placed on the second product placement table. The information processing device according to claim 1 .

3. The determination unit detects that the product removed from the first product placement stand has been returned to the first product placement stand based on a signal from a weight sensor provided on the first product placement stand or image data from a camera. The information processing device according to claim 1 .

4. The first product placement table is provided on a cart containing products whose product codes have not yet been scanned. The information processing device according to claim 1 .

5. The determination unit is Detecting that the product removed from the first product placement stand has been returned to the first product placement stand based on a signal from a weight sensor provided on the cart or image data from a camera; When a product detected by the detection unit is returned to the first product stand without being scanned, the product is treated as not having been detected by the detection unit. The information processing device according to claim 4.

6. The determination unit detects that a product has been placed on the second product placement table based on a signal from a weight sensor provided on the second product placement table or image data from a camera. The information processing device according to claim 1 .

7. the determination unit determines that shoplifting has occurred when the detection unit does not detect a product and a product whose product code has not been scanned is placed on the second product placement table. The information processing device according to claim 1 .

8. The detection unit detects that a product has been removed from a first product placement table on which a product before the product code is scanned is placed, a determination unit that determines that shoplifting has occurred when the product detected by the detection unit is placed without being scanned on a second product placement table on which a product is placed after its product code has been scanned; When a product detected by the detection unit is returned to the first product stand without being scanned, the determination unit treats the product as not having been detected by the detection unit. A method for suppressing false shoplifting detections.

Images