Self-checkout system and program

The self-checkout system addresses false fraud detection by using a detection unit, management server, and terminal device to track and display fraudulent points, improving fraud management and customer comfort.

JP7583639B2Active Publication Date: 2024-11-14TOSHIBA TEC KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2021024921
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-02-19
Publication Date
2024-11-14
Estimated Expiration
2041-02-19

AI Technical Summary

Technical Problem

Conventional self-checkout systems struggle with false positives in fraud detection, leading to unnecessary discomfort for customers and challenges in managing fraudulent activities effectively.

Method used

A self-checkout system and program that includes a product registration device with a detection unit to identify fraudulent activities, a management server for accumulating fraudulent points, and a terminal device for displaying cumulative fraud points, enabling store clerks to monitor and respond to fraudulent behavior more effectively.

Benefits of technology

The system allows for accurate detection and tracking of fraudulent activities, providing store clerks with actionable information to manage customer behavior, reducing false positives and enhancing customer comfort by enabling targeted responses.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007583639000001
    Figure 0007583639000001
  • Figure 0007583639000002
    Figure 0007583639000002
  • Figure 0007583639000003
    Figure 0007583639000003
Patent Text Reader

Abstract

To provide a self-checkout system and a program that can detect a fraudulent activity performed by a customer and assist handling in a case where the fraudulent activity is detected.SOLUTION: A self-checkout system of an embodiment has a commodity registration device and an administrative server. The commodity registration device includes: a detection unit that detects a fraudulent activity based on an image captured by imaging a customer who operates the device itself or operation content of the operation; and a first transmission unit that when the fraudulent activity is detected, transmits, to the administrative server, first information including a fraudulent point in accordance with the fraudulent activity and customer identification information for identifying the customer. The administrative server includes: a first receiving unit that receives the first information transmitted from the first transmission unit; a recording unit that accumulates and records the fraudulent point per the customer identification information based on the first information received by the first receiving unit; and a first providing unit that provides a terminal device operated by a shop clerk with an accumulation result of the fraudulent point recorded by the recording unit.SELECTED DRAWING: Figure 7
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] FIELD OF THE INVENTION An embodiment of the present invention relates to a self-checkout system and a program. [Background technology]

[0002] Traditionally, supermarkets and other retail stores have been equipped with POS (Point of Sales) terminals where store clerks perform product registration and transaction processes. In recent years, an increasing number of retail stores have been installing self-service POS terminals where customers can register products to be purchased and perform transaction processes by operating them.

[0003] However, at self-service POS terminals, customers may commit fraud, such as by not properly registering products. Although various security measures have been implemented to prevent fraud by customers, false positives cannot be eliminated.

[0004] When fraudulent activity by a customer is detected, store clerks may have to assume that the customer has committed fraud, even if it is a false positive. In such a situation, the store clerk may cause the customer to feel uncomfortable. Therefore, there is a need for technology that can support countermeasures when fraudulent activity is detected. Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the present invention is to provide a self-checkout system and program that can detect fraudulent behavior by customers and provide support for dealing with fraudulent behavior when it is detected. [Means for solving the problem]

[0006] The self-checkout system of the embodiment includes a product registration device, a management server, Terminal device andThe product registration device includes a detection unit that detects fraudulent activity based on an image of a customer operating the product registration device or the operation content of the operation, and a first transmission unit that, when the fraudulent activity is detected, transmits first information to the management server, the first information including fraud points corresponding to the fraudulent activity and customer identification information that identifies the customer, and the management server includes a first reception unit that receives the first information transmitted by the first transmission unit, a recording unit that accumulates and records the fraud points for each piece of customer identification information based on the first information received by the first reception unit, and a provision unit that provides the accumulated fraud points recorded by the recording unit to a terminal device operated by a store clerk. The terminal device is equipped with a display control unit that displays the accumulated result of the fraudulent points provided by the management server on a display device, and the accumulated result of the fraudulent points includes the customer identification information included in the first information, and the display control unit superimposes the customer identification information included in the accumulated result of the fraudulent points and the accumulated result of the fraudulent points corresponding to the customer identification information on an image captured of the product registration device. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is an explanatory diagram illustrating an example of a self-checkout system according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of a hardware configuration of the self-checkout POS terminal according to the first embodiment. [Figure 3] FIG. 3 is an explanatory diagram illustrating an example of the data configuration of the fraud point master according to the first embodiment. [Figure 4] FIG. 4 is a block diagram illustrating an example of the hardware configuration of the management server according to the first embodiment. [Figure 5] FIG. 5 is an explanatory diagram illustrating an example of the data configuration of the accumulated point DB according to the first embodiment. [Figure 6] FIG. 6 is a block diagram showing an example of the hardware configuration of the store clerk terminal according to the first embodiment. [Figure 7] FIG. 7 is a block diagram showing an example of the characteristic functional configuration of various devices included in the self-checkout system according to the first embodiment. [Figure 8] FIG. 8 is a sequence diagram showing an example of processing of the self-checkout system according to the first embodiment. [Figure 9]FIG. 9 is a block diagram showing an example of the characteristic functional configuration of various devices included in the self-checkout system according to the second embodiment. [Figure 10] FIG. 10 is a sequence diagram showing an example of processing of the self-checkout system according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment of a self-checkout system and a program will be described in detail with reference to the accompanying drawings. Note that the embodiment described below is one embodiment of a self-checkout system and a program, and is not intended to limit the configuration, specifications, etc. of the self-checkout system and program.

[0009] (First embodiment) <Configuration of the Self-Checkout System According to the First Embodiment> 1 is an explanatory diagram showing an example of a self-checkout system 1 according to the first embodiment. The self-checkout system 1 includes a self-POS terminal 10, a management server 20, and a store clerk terminal 30.

[0010] These devices are connected to each other via a network 40 such as a LAN (Local Area Network) or a VPN (Virtual Private Network). The self-checkout system 1 shown in Fig. 1 includes multiple self-POS terminals 10, one management server 20, and multiple store clerk terminals 30, but the number of each device is arbitrary.

[0011] The self-checkout terminal 10 is, for example, a self-checkout device that executes, by a customer's operation, a product registration process for registering products to be purchased and a checkout process for the products registered by the product registration process. The self-checkout terminal 10 is an example of a product registration device. A detailed description of the self-checkout terminal 10 will be given later.

[0012] The management server 20 is a server device that stores various information, such as information necessary for monitoring customers. The management server 20 may be formed by a plurality of server devices. Furthermore, the management server 20 may be provided by a cloud service or the like that provides computer resources such as hardware and software. A detailed description of the management server 20 will be given later.

[0013] The store clerk terminal 30 is a terminal device used by a store clerk when performing a task such as monitoring a customer who uses the self-service POS terminal 10, for example.

[0014] An example of the clerk terminal 30 is an attendant terminal. The attendant terminal is a device for monitoring the status of each self-service POS terminal 10. The clerk terminal 30 may be a mobile terminal such as a smartphone or tablet. The clerk terminal 30 is an example of a terminal device. A detailed description of the clerk terminal 30 will be given later.

[0015] <Hardware configuration of the self-service POS terminal according to the first embodiment> Next, a description will be given of the hardware configuration of each device included in the self-checkout system 1. Fig. 2 is a block diagram showing an example of the hardware configuration of the self-checkout POS terminal 10.

[0016] The self-service POS terminal 10 comprises a control unit 101, a memory unit 102, a communication interface 103, a display unit 104, an operation unit 105, a printing unit 106, a cash deposit / withdrawal unit 107, a scanner 108, a camera 109, a card reader / writer 110, and a patrol lamp 111. These units are interconnected via a system bus 112 such as a data bus or an address bus.

[0017] The control unit 101 is a computer that controls the overall operation of the self-service POS terminal 10 and realizes various functions of the self-service POS terminal 10. The control unit 101 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory).

[0018] The CPU comprehensively controls the operation of the self-service POS terminal 10. The ROM is a storage medium that stores various programs and data. The RAM is a storage medium that temporarily stores various programs and data. The CPU uses the RAM as a work area to execute programs stored in the ROM or the storage unit 102, etc.

[0019] The storage unit 102 is a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage unit 102 stores a control program 113, a product master 114, a registered product table 115, and a fraudulent point master 116. The product master 114, the registered product table 115, and the fraudulent point master 116 may be stored in a store server (not shown) that manages various devices including the self-service POS terminal 10 installed in the store.

[0020] The control program 113 is a program for implementing an operating system and functions of the self-checkout POS terminal 10. The control program 113 includes a program for implementing characteristic functions according to this embodiment.

[0021] The product master 114 stores product information for various products sold in the store. For example, the product information includes a product code that can identify the product, a product name, a price, etc. When a product is recognized by object recognition, the product information may be a feature quantity of the product's appearance.

[0022] The registered product table 115 is an information table that stores product information of products registered through product registration processing.

[0023] The fraudulent point master 116 stores fraud information indicating various fraudulent acts committed by customers. Here, Fig. 3 is an explanatory diagram illustrating an example of the data configuration of the fraudulent point master. The fraudulent point master 116 stores a fraud code, a fraud name, a fraudulent point, and an action / operation in association with each other.

[0024] The fraud code is identification information that can identify various fraudulent acts committed by customers. The fraud name is the name of the fraud. The fraud points are information that indicates the number of points (hereinafter referred to as fraud points) that will be awarded when a fraud corresponding to the fraud code is detected. The action / operation is information that indicates the action or operation for detecting the fraud.

[0025] For example, the first line in Figure 3 indicates that if a customer performs the action / operation "YYY1," it will be detected as having performed "XXX1," which is identified by the fraudulent activity code "001," and the customer will be awarded "5" fraud points. A detailed explanation of fraudulent activities will be provided later.

[0026] The communication interface 103 is an interface for communicating with the management server 20 and the store clerk terminal 30 via the network 40 .

[0027] The display unit 104 is, for example, a liquid crystal display, etc. The operation unit 105 is, for example, a touch panel laminated on the display unit 104.

[0028] The printing unit 106 is, for example, a printer that prints a receipt showing the details of a transaction.

[0029] The deposit / withdrawal unit 107 is, for example, an automatic change machine that deposits and dispenses coins, banknotes, etc. The deposit / withdrawal unit 107 accepts deposits of currency such as coins and banknotes as payment for merchandise. Furthermore, if there is change, the deposit / withdrawal unit 107 dispenses the amount of change.

[0030] The scanner 108 is a device that reads information necessary for product registration processing from a product, and includes a solid-state imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor).

[0031] For example, the scanner 108 photographs a code symbol attached to a product and reads the product code from the code symbol. Also, the scanner 108 photographs an image of a product that does not have a code symbol attached, and acquires (reads) product information of the photographed product through object recognition processing.

[0032] Note that object recognition is also called generic object recognition. The various recognition technologies used in generic object recognition are explained in detail in the following literature, so a detailed explanation will be omitted here.

[0033] Keiji Yanai, "Current Status and Future of General Object Recognition," Transactions of the Information Processing Society of Japan, Vol. 48, No. SIG16 [Retrieved February 10, 2021], Internet<URL: http: / / mm.cs.uec.ac.jp / IPSJ-TCVIM-Yanai.pdf>

[0034] Jamie Shotton et al., “Semantic Texton Forests for Image Categorization and Segmentation,” [Retrieved February 10, 2021], Internet <URL: http: / / mi.eng.cam.ac.uk / ~cipolla / publications / inproceedings / 2008-CVPR-semantic-texton-forests.pdf>

[0035] The camera 109 is a device that captures images of customer behavior. The camera 109 includes a solid-state imaging element such as a CCD or CMOS. The camera 109 is provided, for example, at a high position on the self-service POS terminal 10 so as to capture images of customer behavior operating the self-service POS terminal 10. A plurality of cameras 109 may be provided. The camera 109 may be separate from the self-service POS terminal 10.

[0036] The video (image) captured by the camera 109 is transmitted to the store clerk terminal 30 by the communication control unit 1001, which will be described later, as a self-POS video associated with a self-POS terminal code that can identify the self-POS terminal 10. In this embodiment, the self-POS video is transmitted to the store clerk terminal 30 in real time. The destination of the self-POS video may also be the management server 20.

[0037] The card reader / writer 110 is a device that reads and writes information stored in a storage medium attached to a card. The card reader / writer 110 reads and writes various types of information from and to the storage medium of a credit card.

[0038] The patrol lamp 111 is a warning light that notifies a store clerk that an abnormality or the like has occurred in the self-service POS terminal 10.

[0039] <Hardware configuration of management server according to the first embodiment> 4 is a block diagram showing an example of the hardware configuration of the management server 20. The management server 20 includes a control unit 201, a storage unit 202, a communication interface 203, a display unit 204, and an operation unit 205. These units are connected to each other via a system bus 206 such as a data bus or an address bus.

[0040] The control unit 201 is a computer that controls the overall operation of the management server 20 and realizes the various functions of the management server 20. The control unit 201 includes a CPU, a ROM, and a RAM.

[0041] The CPU comprehensively controls the operation of the management server 20. The ROM is a storage medium that stores various programs and data. The RAM is a storage medium that temporarily stores various programs and data. The CPU uses the RAM as a work area to execute programs stored in the ROM or the storage unit 202, etc.

[0042] The storage unit 202 is a storage device such as an HDD or SSD. The storage unit 202 stores a control program 207 and an accumulated point DB 208. The storage unit 202 may also store self-POS video transmitted from the self-POS terminal 10.

[0043] The control program 207 is a program for implementing the functions of the operating system and the management server 20. The control program 207 includes a program for implementing the characteristic functions according to this embodiment.

[0044] The accumulated point DB 208 is a database that accumulates and records fraudulent points for each customer code. Here, Fig. 5 is an explanatory diagram illustrating an example of the data configuration of the accumulated point DB 208. The accumulated point DB 208 stores, for each customer code, a fraudulent activity code, accumulated points (category), and accumulated points (total) in association with each other.

[0045] The customer code is identification information that can identify a customer. The customer code is an example of customer identification information. The accumulated points (category) is information that indicates the accumulated value of fraud points for each fraud code. The accumulated points (total) is information that indicates the accumulated value of all fraud points. In other words, the accumulated points (total) is the sum of the accumulated values ​​of fraud points for each fraud code.

[0046] For example, in the example of FIG. 5, a customer identified by customer code "0001" has accumulated "5" fraud points due to fraudulent acts identified by fraudulent act code "001."

[0047] Similarly, the cumulative value of the fraud code "002" is "3," the cumulative value of the fraud code "003" is "2," the cumulative value of the fraud code "004" is "4," and the cumulative value of the fraud code "005" is "1." Note that in this example, the fraud codes go up to "0005," but the types of fraud are not limited to five. There may be four or fewer types, or six or more types.

[0048] In addition, the example of FIG. 5 indicates that the cumulative value of all fraudulent points for the customer identified by the customer code "0001" is "15."

[0049] The communication interface 203 is an interface for communicating with the self-POS terminal 10 and the store clerk terminal 30 via the network 40.

[0050] The display unit 204 is, for example, a liquid crystal display, etc. The operation unit 205 is, for example, an input device such as a keyboard or a mouse.

[0051] <Hardware configuration of the store clerk terminal according to the first embodiment> 6 is a block diagram showing an example of the hardware configuration of the clerk terminal 30. The clerk terminal 30 comprises a control unit 301, a storage unit 302, a communication interface 303, a display unit 304, and an operation unit 305. These units are interconnected via a system bus 306 such as a data bus or an address bus.

[0052] The control unit 301 is a computer that controls the overall operation of the clerk terminal 30 and realizes the various functions that the clerk terminal 30 has.

[0053] The control unit 301 includes a CPU, a ROM, and a RAM. The CPU comprehensively controls the operation of the store clerk terminal 30. The ROM is a storage medium that stores various programs and data. The RAM is a storage medium that temporarily stores various programs and data. The CPU uses the RAM as a work area to execute programs stored in the ROM or the storage unit 302, etc.

[0054] The storage unit 302 is a storage device such as an HDD or SSD, and stores a control program 307.

[0055] The control program 307 is a program for implementing the operating system and functions of the store clerk terminal 30. The control program 307 includes a program for implementing the characteristic functions according to this embodiment.

[0056] The communication interface 303 is an interface for communicating with the self-service POS terminal 10 and the management server 20 via the network 40.

[0057] The display unit 304 is, for example, a liquid crystal display, etc. The display unit 304 is an example of a display device, and the operation unit 305 is, for example, an input device such as a touch panel.

[0058] <Functional Configuration of Self-Checkout System According to First Embodiment> Next, a description will be given of the characteristic functions of the various devices included in the self-checkout system 1. Here, Fig. 7 is a block diagram showing an example of the characteristic functional configuration of the various devices included in the self-checkout system 1.

[0059] The control unit 101 of the self-checkout POS terminal 10 loads the control program 113 in the storage unit 102 into the RAM, and operates in accordance with the control program 113 to generate the respective functional units shown in FIG.

[0060] Specifically, the control unit 101 of the self-service POS terminal 10 has, as functional units, a communication control unit 1001, an operation control unit 1002, a customer code input unit 1003, a detection unit 1004, a calculation unit 1005, a product registration unit 1006, an accounting processing unit 1007, and a display control unit 1008.

[0061] The communication control unit 1001 controls the communication interface 103 to control communication via the network 40. For example, the communication control unit 1001 transmits self-POS video to the store clerk terminal 30.

[0062] An operation control unit 1002 controls the operation unit 105 to accept various operations.

[0063] The customer code input unit 1003 receives input of a customer code stored in a customer card, for example, by controlling the card reader / writer 110. The customer code input unit 1003 is an example of a first input unit.

[0064] Furthermore, the customer code input unit 1003 may store in advance in the storage unit 202 of the management server 20 a data table associating the facial image of each customer with the customer code, and input the corresponding customer code from the facial image of the customer captured by the camera 109. The facial image of the customer itself may also be used as identification information.

[0065] After the customer code is input, the customer code input unit 1003 controls the communication control unit 1001 to associate the customer code with the self-service POS terminal identification code and transmit the associated information as input information to the management server 20. In this case, the communication control unit 1001 is an example of a second transmission unit, and the input information is an example of second information. Note that the customer code input to the self-service POS terminal 10 is cleared when the transaction process is completed.

[0066] The detection unit 1004 detects fraudulent behavior by a customer based on an image of the customer or operation information of the self-service POS terminal 10. Here, fraudulent behavior refers to behavior that is detrimental to the retail store. For example, fraudulent behavior includes the act of taking away a product without completing the transaction. In addition, fraudulent behavior includes the act of selecting a product with a lower price than the actual product when multiple candidate products are presented in object recognition.

[0067] In addition to obvious fraudulent acts such as taking away products, fraudulent acts also include actions that are suspected to be fraudulent, such as actions that are not performed in normal product registration processing.

[0068] The detection unit 1004 detects fraudulent activity based on images captured by the camera 109. More specifically, the detection unit 1004 recognizes (analyzes) the actions and behaviors of the customer operating the self-service POS terminal 10 from the images captured by the camera 109, and when it recognizes an action that satisfies predetermined conditions for fraudulent activity, it detects the action as fraudulent activity. In this embodiment, the actions that satisfy the conditions for fraudulent activity are specified in the actions / operations in the fraud point master 116.

[0069] For example, when the detection unit 1004 analyzes an image captured by the camera 109 and recognizes that a customer has put items into a shopping bag without paying, it detects this behavior as fraudulent. At this time, the detection unit 1004 also detects what kind of fraudulent behavior the customer has committed (for example, taking away unpaid items) based on the results of the image analysis.

[0070] The detection unit 1004 also detects fraudulent activity based on operation information of the self-checkout POS terminal 10 by a customer. More specifically, the detection unit 1004 acquires and analyzes operation information of the self-checkout POS terminal 10 by a customer, and when it recognizes an operation that satisfies predetermined conditions for fraudulent activity, it detects the operation as fraudulent activity. In this embodiment, the operation that satisfies the conditions for fraudulent activity is specified in the behavior / operation of the fraud point master 116.

[0071] For example, when there are multiple candidate products in object recognition, and the customer selects a product other than the first candidate product, which is the product with the highest probability, and which is cheaper than the first candidate product, twice in a row, the detection unit 1004 detects the operation as fraudulent. In this case, the detection unit 1004 detects "fraud related to object recognition" as fraudulent activity.

[0072] The condition of two consecutive times given here is just an example, and the detection unit 1004 may detect fraudulent activity after a single occurrence, or may set a threshold for a single transaction and detect fraudulent activity if the number of occurrences exceeds the threshold. Furthermore, fraud in object recognition is an example of fraudulent activity, and the detection unit 1004 may also detect fraudulent activity related to other processes.

[0073] The calculation unit 1005 calculates fraud points based on the fraud point master 116 that associates the fraud detected by the detection unit 1004 with fraud points that indicate the degree of fraud.

[0074] Specifically, the calculation unit 1005 refers to the fraud point master 116 and calculates the fraud points corresponding to the fraudulent activity detected by the detection unit 1004 as the fraud points. For example, in the example of Fig. 4, when the detection unit 1004 recognizes the action / operation "YYY1", it first detects "XXX1" identified by the fraud code "001". The calculation unit 1005 calculates the fraud points "5" corresponding to the fraud code "001" as the fraud points.

[0075] The calculation unit 1005 controls the communication control unit 1001, associates the calculated fraud points with the customer code input by the customer code input unit 1003, the fraud code, and the self-POS terminal code of the device itself, and transmits the information as fraud detection information to the management server 20. In this case, the fraud detection information is an example of first information, and the communication control unit 1001 is an example of a first transmission unit.

[0076] The product registration unit 1006 executes a product registration process for registering products purchased by a customer through an operation by the customer. The product registration unit 1006 receives input of a product code by, for example, reading a code symbol attached to the product with the scanner 108. The product registration unit 1006 extracts product information for the input product code from the product master 114. The product registration unit 1006 then registers the extracted product information in the registered product table 115.

[0077] The accounting processing unit 1007 controls the deposit / withdrawal unit 107 to perform accounting. For example, the accounting processing unit 1007 calculates the total price of the products registered in the registered product table 115 by the product registration unit 1006. The accounting processing unit 1007 compares the currency deposited in the deposit / withdrawal unit 107 with the calculated total price to determine whether or not change is due. If change is due, the accounting processing unit 1007 causes the deposit / withdrawal unit 107 to dispense the change.

[0078] The display control unit 1008 controls the display of various screens on the display unit 104. For example, the display control unit 1008 displays a product registration screen that is displayed when a customer registers a product to be purchased. The display control unit 1008 also displays a checkout processing screen that is displayed during checkout processing.

[0079] The control unit 201 of the management server 20 loads the control program 207 in the storage unit 202 into the RAM and operates in accordance with the control program 207, thereby generating the respective functional units shown in Fig. 7 on the RAM. Specifically, the control unit 201 of the management server 20 includes a communication control unit 2001 and a master management unit 2002 as functional units.

[0080] The communication control unit 2001 controls the communication interface 203 to control communication via the network 40. For example, the communication control unit 2001 receives input information transmitted by the communication control unit 1001. In this case, the communication control unit 2001 is an example of a second receiving unit.

[0081] Also, for example, the communication control unit 2001 receives the fraud detection information transmitted by the communication control unit 1001. In this case, the communication control unit 2001 is an example of a first receiving unit.

[0082] The master data management unit 2002 controls the storage unit 202 to manage the accumulated points DB 208. For example, the master data management unit 2002 identifies the accumulated fraudulent points recorded by the master data management unit 2002 corresponding to the customer code input by the customer code input unit 1003, based on the input information received by the communication control unit 2001. In this case, the master data management unit 2002 is an example of an identification unit.

[0083] Specifically, when the communication control unit 2001 receives input information, the master management unit 2002 identifies the accumulated points (total) corresponding to the customer code included in the input information. The master management unit 2002 associates the identified accumulated points (total), the customer code, and the self-service POS terminal code to generate latest point information.

[0084] The master management unit 2002 controls the communication control unit 2001 to transmit (provide) the most recent point information to the store clerk terminal 30. In this case, the communication control unit 2001 is an example of a providing unit.

[0085] Here, for example, it is assumed that the accumulated point DB 208 is in the state shown in FIG. 5, and the communication control unit 2001 receives input information that associates the customer code "0002" with the self-service POS terminal code "POS001."

[0086] In this case, the master data management unit 2002 refers to the accumulated point DB 208 and identifies the accumulated points (total) "20" associated with the customer code "0002." The master data management unit 2002 associates the identified accumulated points (total) "20" with the customer code "0002" and the self-service POS terminal code "POS001" included in the input information, and generates the most recent point information.

[0087] The master management unit 2002 controls the communication control unit 2001 to transmit (provide) the generated latest point information to the store clerk terminal 30.

[0088] Furthermore, for example, the master management unit 2002 accumulates and records fraud points for each customer code based on fraud detection information received by the communication control unit 2001. In this case, the master management unit 2002 is an example of a recording unit.

[0089] The master management unit 2002 controls the communication control unit 2001 to transmit (provide) the accumulated result of fraudulent points to the store clerk terminal 30. In this case, the communication control unit 2001 is an example of a providing unit.

[0090] Specifically, when the communication control unit 2001 receives fraud detection information, the master management unit 2002 refers to the cumulative point DB 208 and extracts the fraud code, cumulative points (category), and cumulative points (total) associated with the customer code included in the fraud detection information.

[0091] Next, the master data management unit 2002 extracts the cumulative points (category) and cumulative points (total) associated with the fraudulent activity code included in the fraud detection information from the extracted fraudulent activity code, cumulative points (category), and cumulative points (total).The master data management unit 2002 then adds the fraudulent activity points included in the fraud detection information to the extracted cumulative points (category) and cumulative points (total), records them, and updates the cumulative points DB 208.

[0092] Here, for example, assume that the cumulative point DB 208 is in the state shown in Figure 5, and the communication control unit 2001 receives fraud detection information that associates customer code "0001," fraud code "001," fraud points "5," and self-POS terminal code "POS001."

[0093] In this case, the master data manager 2002 refers to the accumulated points DB 208 and extracts the accumulated points (category) "5" and the accumulated points (total) "15" associated with the customer code "0001" and the fraudulent activity code "001."

[0094] Next, the master management unit 2002 adds the fraud points "5" included in the fraud detection information to the cumulative points (category) "5", making the cumulative points (category) "10". The master management unit 2002 also adds the fraud points "5" included in the fraud detection information to the cumulative points (total) "15", making the cumulative points (total) "20".

[0095] The master management unit 2002 controls the communication control unit 2001, associates the accumulated points (total) "20" (accumulation result of fraudulent points), customer code "0001", and self-POS terminal code "POS001", and sends this as updated point information to the clerk terminal 30.

[0096] The control unit 301 of the clerk terminal 30 loads the control program 307 in the storage unit 302 into the RAM and operates in accordance with the control program 307, thereby generating the functional units shown in Fig. 7 on the RAM. Specifically, the control unit 301 of the clerk terminal 30 includes, as functional units, a communication control unit 3001, an operation control unit 3002, an acquisition unit 3003, and a display control unit 3004.

[0097] The communication control unit 3001 controls the communication interface 303 to control communication via the network 40. For example, the communication control unit 3001 receives the latest point information and updated point information transmitted by the communication control unit 2001. Also, for example, the communication control unit 3001 receives the self-POS video transmitted by the communication control unit 1001 of the self-POS terminal 10.

[0098] An operation control unit 3002 controls the operation unit 305 to accept various operations.

[0099] The acquisition unit 3003 acquires a surrounding image showing the state of the surroundings of the self-POS terminal 10. Specifically, the acquisition unit 3003 acquires, as the surrounding image, the self-POS image received by the communication control unit 3001. Note that the acquisition unit 3003 may acquire the self-POS image via the management server 20.

[0100] The display control unit 3004 controls the display of various screens on the display unit 304. For example, the display control unit 3004 displays the accumulated result of fraudulent points provided by the management server 20 on the display unit 304. Note that the display format of the accumulated result is not particularly limited, and various display formats can be adopted. Below, an example of processing when the accumulated result is displayed together with the self-POS video will be described.

[0101] The display control unit 3004 first controls the display of the self POS video acquired by the acquisition unit 3003 on the display unit 304. The display control unit 3004 may simultaneously display multiple self POS videos transmitted from the respective self POS terminals 10 on one screen. In this embodiment, the display control unit 3004 continues to display the self POS video in real time.

[0102] As described above, the self-service POS video contains the self-service POS terminal code, so even when multiple self-service POS videos are displayed, the display control unit 3004 can identify which self-service POS terminal 10 each self-service POS video corresponds to.

[0103] When the communication control unit 3001 receives the most recent point information, the display control unit 3004 identifies the self-POS terminal 10 that entered the customer code included in the most recent point information from the self-POS terminal code included in the most recent point information.

[0104] Then, the display control unit 3004 superimposes the customer code and accumulated points (total) included in the most recent point information on the self-service POS video of the identified self-service POS terminal 10 and displays it on the display unit 304.

[0105] The display control unit 3004 may analyze the self-service POS video, recognize the customer in the self-service POS video, and display the accumulated points (total) above the customer's head. The display control unit 3004 may also perform processing to simply display the self-service POS terminal code, customer code, and accumulated points (total) side by side without displaying the surrounding video.

[0106] In addition, when the communication control unit 3001 receives updated point information, the display control unit 3004 identifies the self-POS terminal 10 used by the customer who committed the fraudulent act from the self-POS terminal code included in the updated point information.

[0107] Then, the display control unit 3004 superimposes the customer code and the accumulated points (total) included in the updated point information on the self-service POS image of the identified self-service POS terminal 10 and displays it on the display unit 304.

[0108] Furthermore, if the accumulated points (total) included in the updated point information exceeds a predetermined threshold, the display control unit 3004 controls to highlight the customer who holds the fraudulent points. In this case, the display control unit 3004 highlights the customer code and accumulated points (total) superimposed on the self-service POS image by, for example, surrounding them in a red frame.

[0109] Two or more thresholds may be set. In this case, the display control unit 3004 performs processing such as highlighting the customer code and accumulated points (total) superimposed on the self-service POS image by surrounding them with a yellow frame when the first threshold is exceeded, and highlighting the customer code and accumulated points (total) superimposed on the self-service POS image by surrounding them with a red frame when the second threshold is exceeded.

[0110] In this way, when the fraudulent points exceed a predetermined threshold, the display highlights the customer who holds the fraudulent points, allowing store staff to visually identify customers who need attention. In other words, it is possible to reduce the possibility that store staff will overlook fraudulent activity.

[0111] The display control unit 3004 also controls the display of detailed information on the accumulated points on the display unit 304 .

[0112] The detailed information display process will be described in detail below. The display control unit 3004 starts the detailed information display process when it receives an instruction to display detailed information from a store clerk. For example, when the store clerk touches the self-service POS video displayed on the display unit 304, the display control unit 3004 displays a menu such as "display details." At this time, the display control unit 3004 identifies the self-service POS terminal 10 from the self-service POS terminal code included in the self-service POS video.

[0113] When the store clerk touches "display details," the display control unit 3004 receives an instruction from the store clerk to display detailed information.

[0114] When the display control unit 3004 receives an instruction from a store clerk to display detailed information, it controls the communication control unit 3001 to associate the customer code of the customer requesting detailed information, the store clerk terminal code that identifies the store clerk terminal 30, the self-POS terminal code, and information requesting detailed information, and transmits the resulting request to the management server 20 as a detailed information request.

[0115] The customer code of the customer requesting the detailed information is the customer code accepted by the customer code input unit 1003 of the identified self-service POS terminal 10. The self-service POS terminal code is the identified self-service POS terminal code of the identified self-service POS terminal 10.

[0116] The communication control unit 2001 of the management server receives the detailed information request sent by the communication control unit 3001. The master management unit 2002 references the accumulated point DB 208 and extracts the fraud code, accumulated points (category), and accumulated points (total) associated with the customer code included in the detailed information request sent by the communication control unit 3001. The master management unit 2002 controls the communication control unit 2001 to send the extracted information to the store clerk terminal as detailed information.

[0117] The communication control unit 3001 of the store clerk terminal 30 receives the detailed information sent by the communication control unit 2001. Then, the display control unit 3004 controls the display of the detailed information received by the communication control unit 3001 on the display unit 304.

[0118] Here, for example, assume that the communication control unit 2001 receives a detailed information request including the customer code "0001" when the accumulated point DB 208 is in the state shown in Fig. 5. In this case, the master management unit 2002 refers to the accumulated point DB 208 and extracts information associated with the customer code "0001."

[0119] Specifically, the master management unit 2002 extracts the cumulative points (category) "5" for fraudulent activity code "001," the cumulative points (category) "3" for fraudulent activity code "002," the cumulative points (category) "2" for fraudulent activity code "003," the cumulative points (category) "4" for fraudulent activity code "004," the cumulative points (category) "1" for fraudulent activity code "005," and the cumulative points (total) "15."

[0120] The master management unit 2002 controls the communication control unit 2001 to associate the extracted information with the customer code included in the detailed information request and the self-POS terminal code included in the detailed information request, and transmits the resulting information as detailed information to the store clerk terminal 30 identified by the store clerk terminal code included in the detailed information request.

[0121] The communication control unit 3001 of the store clerk terminal 30 receives the detailed information sent by the communication control unit 2001. The display control unit 3004 displays the above information and the customer code included in the detailed information by superimposing them on the self-POS image of the self-POS terminal 10 identified by the self-POS terminal code included in the detailed information.

[0122] In this way, by displaying the breakdown of fraudulent points, it becomes easier for store staff to determine what customer behavior they should pay attention to.

[0123] <Processing of the Self-Checkout System According to the First Embodiment> Next, a description will be given of the processing of the self-checkout system 1 according to the first embodiment. Fig. 8 is a sequence diagram showing an example of the processing of the self-checkout system 1 according to the first embodiment.

[0124] First, the acquisition unit 3003 of the store clerk terminal 30 acquires self-checkout POS video (step S1).

[0125] The customer code input unit 1003 of the self-checkout POS terminal 10 controls the card reader / writer 110 to accept input of the customer code stored in the customer card (step S2).

[0126] The communication control unit 1001 associates the customer code received by the customer code input unit 1003 with the self-POS terminal code of the self-POS terminal 10 that received the customer code, and transmits the result as input information to the management server 20 (step S3).

[0127] The communication control unit 2001 of the management server 20 transmits the input information transmitted by the communication control unit 1001 to the store clerk terminal 30 (step S4).

[0128] The master data management unit 2002 refers to the accumulated point DB 208 and extracts the accumulated points (total) corresponding to the customer code included in the input information. The master data management unit 2002 associates the extracted accumulated points (total) with the customer code and self-service POS terminal code included in the input information to generate latest point information (step S5).

[0129] The communication control unit 2001 transmits the latest point information generated by the master management unit 2002 to the store clerk terminal 30 (step S6).

[0130] The communication control unit 3001 of the store clerk terminal 30 receives the latest point information transmitted by the communication control unit 2001 (step S7).

[0131] The display control unit 3004 displays the self-checkout POS video acquired by the acquisition unit 3003 on the display unit 304. The display control unit 3004 further superimposes and displays the customer code and accumulated points (total) included in the most recent point information on the self-checkout POS video (step S8).

[0132] The detection unit 1004 detects fraudulent behavior by the customer based on the image captured by the camera 109 or the operation information of the self-checkout POS terminal 10 (step S8).

[0133] The calculation unit 1005 calculates fraud points based on the fraudulent activity detected by the detection unit 1004 and the fraud point master 116 (step S9).

[0134] The communication control unit 1001 associates the fraud points calculated by the calculation unit 1005 with the customer code and the self-service POS terminal code, and transmits the result as fraud detection information to the management server 20 (step S10).

[0135] The communication control unit 2001 of the management server 20 receives the fraud detection information transmitted by the communication control unit 1001 (step S11).

[0136] The master data management unit 2002 updates the accumulated points DB 208 based on the fraud detection information (step S12). In other words, the master data management unit 2002 accumulates and records the fraud points for each customer code.

[0137] The communication control unit 2001 associates the updated accumulated points (total) (accumulation result of fraudulent points), the customer code, and the self-service POS terminal code, and transmits the updated points information to the store clerk terminal 30 (step S13).

[0138] The communication control unit 3001 of the store clerk terminal 30 receives the updated point information sent by the communication control unit 2001 (step S14).

[0139] The display control unit 3004 displays the self-checkout POS image acquired by the acquisition unit 3003 on the display unit 304. The display control unit 3004 further controls the display of the customer code and accumulated points (total) included in the updated point information superimposed on the self-checkout POS image, and ends this process (step S15).

[0140] <Effects of the self-checkout system according to the first embodiment> Next, the effects of the self-checkout system 1 according to the first embodiment will be described. The self-checkout system 1 according to the first embodiment includes a self-checkout POS terminal 10 and a management server 20. The self-checkout POS terminal 10 includes a detection unit 1004 that detects fraudulent activity based on an image of a customer operating the self-checkout terminal 10 or the details of the operation, and a communication control unit 1001 that, when fraudulent activity is detected, transmits fraud detection information to the management server 20, the fraud points corresponding to the fraudulent activity and a customer code that identifies the customer.

[0141] The management server 20 comprises a communication control unit 2001 that receives fraud detection information sent by the communication control unit 1001, a master management unit 2002 that accumulates and records fraud points for each customer code based on the fraud detection information received by the communication control unit 2001, and a provision unit that provides the accumulated results of fraud points recorded by the master management unit 2002 to a store clerk terminal 30 operated by a store clerk.

[0142] This allows store clerks to be provided with fraud points for each customer, and they can determine whether or not a customer should be watched based on the customer's past behavior, making it easier to monitor customers. For example, even if a non-fraudulent act is mistakenly detected as fraudulent, if the fraud points are low, the store clerk can flexibly decide not to take any particular action, thereby avoiding situations such as causing inconvenience to customers.

[0143] In this way, the self-checkout system 1 according to this embodiment can provide a store clerk with information (such as the cumulative fraud points) that can be used as an indicator for determining how to deal with fraudulent activity when fraudulent activity is detected. Therefore, the self-checkout system 1 can detect fraudulent activity by customers and support the store clerk in dealing with the situation when fraudulent activity is detected.

[0144] (Second embodiment) Next, a self-checkout system 1 according to a second embodiment will be described. In the second embodiment, a configuration will be described in which notification (input) of fraudulent activity can be performed from the store clerk terminal 30. In the description of the second embodiment, parts that show the same operations as those in the first embodiment described above will be given the same reference numerals in the drawings etc., and detailed description thereof will be omitted.

[0145] <Functional Configuration of Self-Checkout System According to Second Embodiment> 9 is a block diagram showing an example of the characteristic functional configuration of various devices included in the self-checkout system 1 according to the second embodiment. The clerk terminal 30 of the self-checkout system 1 according to the second embodiment includes a fraudulent activity input unit 3005 as a functional unit.

[0146] The fraudulent activity input unit 3005 inputs fraud confirmation information indicating information that fraudulent activity has been confirmed. The fraudulent activity input unit 3005 is an example of a second input unit. Specifically, the fraudulent activity input unit 3005 receives input of the fraud confirmation information from a store clerk via the operation unit 305.

[0147] For example, when a store clerk confirms fraudulent activity by a customer, the store clerk first selects the self-service POS terminal 10 used by the fraudulent customer using the operation unit 305 of the store clerk terminal 30. The store clerk selects the self-service POS terminal 10 by, for example, touching the self-service POS image displayed on the display unit 304.

[0148] At this time, the operation control unit 3002 identifies the customer code input by the customer code input unit 1003 of the self-service POS terminal 10. When the customer code is identified, the display control unit 3004 displays on the display unit 304 a menu from which users can select actions such as "display details" and "report fraud."

[0149] In addition, if the customer code has not been entered, that is, if the selected self-service POS terminal 10 is not currently in use, it is preferable that the display control unit 3004 controls so that the menu is not displayed.

[0150] When the store clerk touches "Report fraud" displayed on display unit 304, fraudulent activity input unit 3005 accepts input of fraud confirmation information. Note that before inputting the fraud confirmation information, a confirmation message such as "Are you sure you want to report fraud?" may be displayed.

[0151] Furthermore, the "Fraud Report" may be ranked according to the degree of suspicion of the customer. In this case, the display control unit 3004 displays a menu such as "Fraud Report (Rank 1)," "Fraud Report (Rank 2)," and "Fraud Report (Rank 3)" on the display unit 304.

[0152] After accepting the input of fraud confirmation information, the fraud input unit 3005 controls the communication control unit 3001 to associate the fraud confirmation information with the customer code of the customer who committed the fraud (the customer code input to the selected self-service POS terminal 10) and transmits the result as a fraud report to the self-service POS terminal 10 selected by the store clerk. In this case, the communication control unit 3001 is an example of a third transmission unit.

[0153] The communication control unit 1001 of the self POS terminal 10 receives the fraud report transmitted by the communication control unit 3001. In this case, the communication control unit 1001 is an example of a third receiving unit.

[0154] The detection unit 1004 detects fraudulent activity based on the fraud report received by the communication control unit 1001. Specifically, when the communication control unit 1001 receives a fraud report, the detection unit 1004 detects the fraudulent activity called a "fraud report." Note that the detection unit 1004 can also detect fraudulent activity based on an image captured by the camera 109 or operation information of the self-service POS terminal 10, as in the first embodiment.

[0155] Here, it is assumed that "fraud reports" are registered in association with "fraud points (numerical values)" in the fraud point master 116. If the "fraud reports" are ranked, different numerical values ​​are associated with each of them as "fraud points."

[0156] The subsequent processing is the same as in the first embodiment, and therefore a detailed description thereof will be omitted.

[0157] <Processing of the Self-Checkout System According to the Second Embodiment> Next, a description will be given of the processing of the self-checkout system 1 according to the second embodiment. Fig. 10 is a sequence diagram showing an example of the processing of the self-checkout system 1 according to the second embodiment.

[0158] First, the acquisition unit 3003 of the store clerk terminal 30 acquires self-checkout POS video (step S21).

[0159] The customer code input unit 1003 of the self-checkout POS terminal 10 controls the card reader / writer 110 to accept input of the customer code stored in the customer card (step S22).

[0160] The communication control unit 1001 associates the customer code received by the customer code input unit 1003 with the self-POS terminal code of the self-POS terminal 10 that received the customer code, and transmits the result as input information to the management server 20 (step S23).

[0161] The communication control unit 2001 of the management server 20 transmits the input information transmitted by the communication control unit 1001 to the store clerk terminal 30 (step S24).

[0162] The master management unit 2002 refers to the accumulated point DB 208 and extracts the accumulated points (total) corresponding to the customer code included in the input information. The master management unit 2002 associates the extracted accumulated points (total) with the customer code and self-service POS terminal code included in the input information to generate latest point information (step S25).

[0163] The communication control unit 2001 transmits the latest point information generated by the master management unit 2002 to the store clerk terminal 30 (step S26).

[0164] The communication control unit 3001 of the store clerk terminal 30 receives the latest point information transmitted by the communication control unit 2001 (step S27).

[0165] The display control unit 3004 displays the self-checkout POS video acquired by the acquisition unit 3003 on the display unit 304. The display control unit 3004 further superimposes and displays the customer code and accumulated points (total) included in the most recent point information on the self-checkout POS video (step S28).

[0166] The fraudulent activity input unit 3005 of the store clerk terminal 30 accepts input of fraud confirmation information from the store clerk (step S29).

[0167] The communication control unit 3001 associates the fraud confirmation information received by the fraud input unit 3005 with the identification code of the customer who committed the fraud, and transmits the result as a fraud report to the self-checkout POS terminal 10 (step S30).

[0168] The communication control unit 1001 of the self POS terminal 10 receives the fraud report transmitted by the communication control unit 3001 (step S31).

[0169] The detection unit 1004 detects fraudulent behavior by a customer based on the image captured by the camera 109, the operation information of the self-service POS terminal 10, or the fraud report received by the communication control unit 1001 (step S32).

[0170] The calculation unit 1005 calculates fraud points based on the fraudulent activity detected by the detection unit 1004 and the fraud point master 116 (step S33).

[0171] The communication control unit 1001 associates the fraud points calculated by the calculation unit 1005 with the customer code and the self-service POS terminal code, and transmits the result as fraud detection information to the management server 20 (step S34).

[0172] The communication control unit 2001 of the management server 20 receives the fraud detection information sent by the communication control unit 1001 (step S35).

[0173] The master data management unit 2002 updates the accumulated points DB 208 based on the fraud detection information (step S36). In other words, the master data management unit 2002 accumulates and records the fraud points for each customer code.

[0174] The communication control unit 2001 associates the updated accumulated points (total) (accumulation result of fraudulent points), the customer code, and the self-service POS terminal code, and transmits the updated points information to the store clerk terminal 30 (step S37).

[0175] The communication control unit 3001 of the store clerk terminal 30 receives the updated point information sent by the communication control unit 2001 (step S38).

[0176] The display control unit 3004 displays the self-checkout POS video acquired by the acquisition unit 3003 on the display unit 304. The display control unit 3004 further controls the display of the customer code and accumulated points (total) included in the updated point information superimposed on the self-checkout POS video, and ends this process (step S39).

[0177] <Effects of the self-checkout system according to the second embodiment> Next, the effects of the self-checkout system 1 according to the second embodiment will be described. The clerk terminal 30 of the self-checkout system 1 according to the second embodiment includes a fraudulent activity input unit 3005 that inputs fraud confirmation information indicating that fraudulent activity has been confirmed. The communication control unit 3001 then transmits the fraud confirmation information input by the fraudulent activity input unit 3005 to the self-POS terminal 10.

[0178] Furthermore, the communication control unit 1001 of the self POS terminal 10 functions as a third receiving unit that receives the fraud confirmation transmitted by the communication control unit 3001, and the detecting unit 1004 detects fraud based on the fraud confirmation information.

[0179] This allows the store clerk to award fraud points at his / her own discretion when he / she finds a customer suspected of committing fraud. Therefore, even if fraud cannot be detected from the images of the camera 109 or the operation information of the self-service POS terminal 10, fraud points are awarded to customers who appear suspicious to the store clerk, making it easier to monitor such customers.

[0180] From here on, modifications of the above-described embodiments will be described. Note that the same reference numerals will be used to designate the same components as those in the above-described embodiments, and the description thereof will be omitted.

[0181] (Variation 1) In the above-described first and second embodiments, the product registration device is the self-service POS terminal 10. However, the product registration device may be a cart POS, which is a device that stores products purchased while moving around the store.

[0182] With a cart POS, customers can register products and process payments anywhere in the store, making it difficult for store staff to keep an eye on them. In contrast, with this variation, even when a cart POS is used, the fraud points of each customer are made visible, making it easier for store staff to monitor customer behavior.

[0183] (Variation 2) In the first and second embodiments described above, when the fraudulent points exceed a predetermined threshold, the clerk terminal 30 is controlled to highlight the customer who has the fraudulent points. However, the clerk terminal 30 may be provided with a speaker and a notification control unit, and the notification control unit may control the speaker to sound an alarm when the fraudulent points exceed the threshold. Note that the alarm may be sounded in addition to the highlighting, or only the alarm may be sounded.

[0184] When there are many self-checkout POS terminals 10 to monitor, there is a possibility that a store clerk may overlook a customer who needs attention even if the customer is highlighted. However, according to this modification, an alarm sounds, so that a customer who needs attention is less likely to be overlooked.

[0185] (Variation 3) In the first and second embodiments described above, the fraud points are added without being subtracted. However, if a certain period of time has passed since the last fraudulent activity was detected, the fraud points may be reset.

[0186] For example, if no fraudulent activity is detected for a certain customer for a certain period of time, even if fraudulent points are awarded to that customer, it is highly likely that the fraudulent points were awarded due to a false positive. In this case, store clerks must pay a certain level of attention to customers who may actually be given a lower level of attention, which may make it difficult to identify customers who need attention. According to this variation, fraudulent points are reset after a certain period of time has passed, making it easier to identify customers who need attention.

[0187] (Variation 4) In the above-described first and second embodiments, the self-service POS terminal 10 includes the detection unit 1004 and the calculation unit 1005. However, the management server 20 may include the detection unit 1004 and the calculation unit 1005. Below, a configuration example of the self-service POS terminal 10 and the management server 20 according to this modification will be described.

[0188] First, the self POS terminal 10 according to this modification transmits a self POS video to the management server 20. Furthermore, the self POS terminal 10 according to this modification transmits operation information of the self POS terminal 10 to the management server 20.

[0189] Meanwhile, the storage unit 202 of the management server 20 according to this modification stores the fraudulent point master 116. The detection unit 1004 of the management server 20 according to this modification detects fraudulent behavior by customers based on the fraudulent point master 116 and the self-POS video or operation information transmitted from each of the self-POS terminals 10.

[0190] Then, based on the detection result of the detection unit 1004, the management server 20 accumulates and records fraud points for each customer code based on the fraud points corresponding to the fraudulent acts detected by the detection unit 1004 and the customer code.

[0191] Specifically, similarly to the first and second embodiments, first, the communication control unit 2001 receives input information including the customer code transmitted by the communication control unit 1001. Then, when the detection unit 1004 detects fraudulent activity, the calculation unit 1005 calculates the fraud points.

[0192] The master management unit 2002 refers to the accumulated points DB and extracts the fraud code, accumulated points (category), and accumulated points (total) associated with the customer code included in the input information received by the communication control unit 2001.

[0193] Next, the master management unit 2002 extracts the cumulative points (category) and cumulative points (total) associated with the fraudulent activity code corresponding to the fraudulent activity detected by the detection unit 1004 from the extracted fraudulent activity code, cumulative points (category), and cumulative points (total).

[0194] Then, the master management unit 2002 accumulates and records the fraud points calculated by the calculation unit 1005 in the extracted accumulated points (category) and accumulated points (total), and updates the accumulated points DB 208.

[0195] When this modification is applied to the second embodiment described above, the communication control unit 3001 of the store clerk terminal 30 transmits the fraud report to the management server 20, not to the self-checkout POS terminal 10.

[0196] According to this modification, the load on the self-checkout POS terminal 10 can be reduced.

[0197] (Variation 5) In the above-described first and second embodiments, the master management unit 2002 of the management server 20 provides the accumulated fraud points to the clerk terminal 30, and the display control unit 3004 of the clerk terminal 30 displays the accumulated fraud points. However, the management server 20, rather than the clerk terminal 30, may be provided with the display control unit 3004.

[0198] In this modification, the display control unit 3004 of the management server 20 controls the display of the accumulated fraud points by the master management unit 2002 on the display unit 304 of the store clerk terminal 30.

[0199] According to this modification, the load on the store clerk terminal 30 can be reduced.

[0200] The programs executed by each device in the above-described embodiments and modifications are provided by being pre-installed in a storage medium (ROM or storage unit) included in each device, but this is not limitative. For example, the programs may be provided by being recorded in an installable or executable format on a computer-readable storage medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD).

[0201] Furthermore, the storage medium is not limited to a medium independent of a computer or an embedded system, but also includes a storage medium that stores or temporarily stores a program downloaded via a LAN, the Internet, or the like.

[0202] In addition, the programs executed by each device in the above embodiments and variants may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network, or may be provided or distributed via a network such as the Internet.

[0203] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0204] 1. Self-checkout system 10 Self-service POS terminals 20 Management Server 30 Store clerk terminal 114 Product Master 115 Registered Product Table 116 Fraudulent Point Master 208 Accumulated Points DB 1001, 2001, 3001 Communication control unit 1002, 3002 Operation control section 1003 Customer code input section 1004 Detection unit 1005 Calculation unit 1006 Product Registration Department 1007 Accounting Department 1008, 3004 Display control unit 2002 Master Management Department 3003 Acquisition Department 3005 Fraudulent Activity Input Unit [Prior art documents] [Patent documents]

[0205] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-67834

Claims

1. A self-checkout system having a product registration device, a management server, and a terminal device, The product registration device includes: a detection unit that detects fraudulent activity based on an image of a customer operating the device or the content of the operation; a first transmission unit configured to transmit, when the fraudulent act is detected, first information including fraud points corresponding to the fraudulent act and customer identification information for identifying the customer to the management server; The management server includes: a first receiving unit that receives the first information transmitted by the first transmitting unit; a recording unit that accumulates and records the fraud points for each of the customer identification information based on the first information received by the first receiving unit; a providing unit that provides the accumulated result of the fraudulent points recorded by the recording unit to a terminal device operated by a store clerk, The terminal device a display control unit that displays the accumulated result of the fraudulent points provided by the management server on a display device; The accumulated result of the fraudulent points includes the customer identification information included in the first information, The display control unit of this self-checkout system superimposes the customer identification information contained in the accumulated fraudulent points and the accumulated fraudulent points corresponding to the customer identification information on an image captured of the product registration device.

2. The fraudulent activities are classified into a number of categories; The recording unit accumulates and records the fraud points for each of the classifications, The providing unit provides the terminal device with an accumulation result of the fraud points for each of the classifications. The self-checkout system of claim 1 .

3. Computer, A detection unit that detects fraudulent activity based on an image of a customer operating the product registration device or the content of the operation; a recording unit that accumulates and records the fraudulent points for each piece of customer identification information based on the fraudulent points corresponding to the fraudulent acts detected by the detection unit and customer identification information that identifies the customer; a providing unit that provides the accumulated result of the fraudulent points recorded by the recording unit to a terminal device operated by a store clerk; a display control unit that causes a display device to display the accumulated result of the fraudulent points; A program that functions as The accumulated fraudulent points include the customer identification information, the display control unit superimposes the customer identification information included in the accumulated result of the fraudulent points and the accumulated result of the fraudulent points corresponding to the customer identification information on an image captured of the product registration device. program.

Citation Information

Patent Citations

  • System and method for self-checkout, self-checking device and merchandise sale data processor

    JP2003067834A

  • Simulation apparatus and program

    JP2008067834A

  • Injustice degree recording device, method for controlling injustice degree recording device and program

    JP2011118653A