Information processing apparatus, storage medium, and information processing system

Abstract

The invention discloses an information processing apparatus, a storage medium, and an information processing system, and aims to reduce the risk of false detection notification to a purchaser and effectively prevent or suppress unauthorized behaviors with effectiveness. The information processing apparatus includes a detection unit, an acquisition unit, and a notification unit. The detection unit detects a notification-requiring behavior of a purchaser with respect to the transaction processing device. The acquisition unit acquires the type of the behavior to be reported detected by the detection unit. The notification unit performs notification when a plurality of types of actions requiring notification are acquired by the acquisition unit during a transaction.

Description

[0001] This application claims priority from Japanese Application No. JP 2024-070012, filed April 23, 2024, and the contents of the aforementioned application are incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] Embodiments of the present application relate to an information processing apparatus and storage medium, and an information processing system. BACKGROUND

[0003] In recent years, due to a shortage of manpower or a rise in labor costs, a self-checkout system in which a purchaser who has made a purchase performs self-checkout from registration of a purchased product to payment of transaction money is becoming widespread. On the other hand, in the self-checkout system, there is a concern that improper behavior such as bagging is performed without scanning a product. Therefore, a system that performs analysis of an image using AI (Artificial Intelligence) by capturing an action of a purchaser with a camera, and reports in the case where improper behavior is detected has been developed.

[0004] However, in a system using image analysis based on such AI, it is possible that a behavior that is not improper is mistakenly detected as improper. Therefore, when reporting is performed every time improper behavior is detected, the risk of reporting of a mistaken detection increases, resulting in complaints from a purchaser. SUMMARY

[0005] In view of the above problem, the present application aims to provide an information processing apparatus and storage medium, and an information processing system that can reduce the risk of mistaken detection reporting to a purchaser and can effectively prevent or suppress effective improper behavior.

[0006] To solve the above problem, an information processing apparatus according to an embodiment includes a detection unit, an acquisition unit, and a reporting unit. The detection unit detects a behavior of a purchaser that requires reporting with respect to a transaction processing apparatus. The acquisition unit acquires a kind of the behavior that requires reporting detected by the detection unit. The reporting unit reports when a plurality of kinds of the behavior that requires reporting is acquired by the acquisition unit in one transaction.

[0007] According to the above information processing apparatus, it is possible to provide an information processing apparatus that can reduce the risk of mistaken detection reporting to a purchaser and can effectively prevent or suppress effective improper behavior.

[0008] In the above information processing apparatus, the reporting unit reports to the transaction processing apparatus with respect to the purchaser who has performed the plurality of kinds of the behavior that requires reporting.

[0009] According to the above information processing apparatus, it is possible to report to a transaction processing apparatus operated by a purchaser.

[0010] In the information processing apparatus described above, the notification section notifies at the point in time when the plurality of types of behaviors requiring the notification are acquired.

[0011] According to the information processing apparatus described above, when the plurality of types of behaviors requiring the notification are acquired, the transaction processing apparatus operated by the purchaser can be promptly notified.

[0012] In the information processing apparatus described above, the notification section notifies at the point in time when the purchaser gives an instruction to the transaction processing apparatus to complete the purchase.

[0013] According to the information processing apparatus described above, the transaction processing apparatus operated by the purchaser can be notified at the time of completion of one transaction.

[0014] In the information processing apparatus described above, further comprising a second notification section that notifies a terminal for a monitor at the point in time when the detection section detects a behavior requiring the notification.

[0015] According to the information processing apparatus described above, the behavior requiring the notification to the terminal for the monitor can be notified.

[0016] Another aspect of the information processing apparatus of the present application includes a detection section that detects a behavior requiring a notification by a purchaser with respect to a transaction processing apparatus, an acquisition section that acquires a type of behavior requiring the notification detected by the detection section, and a third notification section that notifies when a combination of types acquired by the acquisition section satisfies a condition set in advance in one transaction.

[0017] According to the information processing apparatus described above, an information processing apparatus that can reduce the risk of false detection notification to the purchaser while effectively preventing or suppressing effective fraudulent behavior can be provided.

[0018] In the information processing apparatus described above, the detection section detects a behavior requiring the notification by category based on a first event identified based on an output of a sensor that detects an action of the purchaser and a second event that indicates a content of the action of the purchaser notified by the transaction processing apparatus.

[0019] According to the information processing apparatus described above, a behavior requiring the notification can be detected based on two events.

[0020] In the information processing apparatus described above, the first event is identified by an image analysis engine based on an output of a camera as a sensor.

[0021] According to the information processing apparatus described above, the first event can be obtained based on an image of the camera.

[0022] A storage medium according to another aspect of the present invention stores a program that enables a computer of an information processing device to function as the following units: a detection unit that detects a purchaser's behavior that requires notification to the transaction processing device; an acquisition unit that acquires the type of behavior that requires notification detected by the detection unit; and a notification unit that makes a notification when multiple types of behavior that requires notification are acquired by the acquisition unit in a transaction.

[0023] According to the above-described storage medium, it is possible to provide a computer with a function of effectively preventing or suppressing effective fraudulent activities while reducing the risk of false detection notification to a purchaser.

[0024] Another aspect of the information processing system of the present invention includes: an output unit, which outputs information required for detecting the purchaser's behavior that needs to be reported to the transaction processing device; a detection unit, which detects the purchaser's behavior that needs to be reported based on the information output by the output unit; an acquisition unit, which acquires the type of behavior that needs to be reported detected by the detection unit; and a notification unit, which makes a notification when the acquisition unit acquires multiple types of behavior that needs to be reported in a transaction.

[0025] According to the above-described information processing system, it is possible to provide a system that can effectively prevent or suppress effective fraud while reducing the risk of false detection notification to buyers. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 This is a diagram schematically illustrating the configuration of a self-checkout system according to an embodiment.

[0027] Figure 2 This is a perspective diagram showing the appearance of a self-service POS terminal.

[0028] Figure 3 This is a block diagram showing the main circuit configuration of a self-service POS terminal.

[0029] Figure 4 This is a block diagram showing an example of the main circuit configuration of a detection terminal.

[0030] Figure 5 This is a diagram showing the main data structure of the notification list.

[0031] Figure 6 This is a series of sequence diagrams used to illustrate the detection and notification of notification behavior in the detection terminal, along with the operations of the camera and self-service POS terminal in the same cash register system.

[0032] Figure 7 This is a flowchart showing the main steps of information processing performed by the processor of the detection terminal.

[0033] Figure 8 This is a diagram showing the notification behavior detection operation for the notification behavior item "scan omission".

[0034] Figure 9 This is a schematic diagram showing the notification behavior detection operation for the notification behavior item "weight error".

[0035] Figure 10 This is a schematic diagram showing the notification behavior detection operation for the notification behavior item "high-priced product error".

[0036] Figure 11 This is a diagram showing the notification behavior detection action for the notification behavior item "Wrong item under the cart".

[0037] Figure 12 This is a schematic diagram showing the notification behavior detection operation for the notification behavior item "Number of Purchases: Large".

[0038] Figure 13 This is an example of a registration screen displayed on the touch panel of a self-service POS terminal.

[0039] Figure 14 This is an example of a registration screen of a self-service POS terminal that receives a notification event of the notification action item "missed scanning".

[0040] Figure 15 This is an example of a monitoring screen displayed on the monitor of a monitoring terminal.

[0041] Figure 16 This is a series of sequence diagrams for explaining the detection and notification-related operations of the notification behavior in the detection terminal of the second embodiment, together with the operations of the camera and self-service POS terminal of the same cash register system.

[0042] Figure 17 1 is a flowchart showing the main steps of information processing executed by the processor of the detection terminal in the second embodiment.

[0043] Figure 18 This is a block diagram showing the main circuit configuration of the detection terminal in the third embodiment.

[0044] Figure 19 is a diagram showing the main data structure of a combination list.

[0045] Figure 20 1 is a flowchart showing the main steps of information processing executed by the processor of the detection terminal in the third embodiment.

[0046] Figure 21 It is an appearance diagram of a self-service POS terminal in another embodiment.

[0047] Figure 22 This is a diagram illustrating the transition of screens displayed on the purchaser display of the self-service POS terminal in another embodiment.

[0048] Figure 23 This is a schematic diagram showing the configuration of a self-checkout system according to another embodiment.

[0049] Description of Reference Numerals

[0050] 1…self-service POS terminal, 2…camera, 3…detection terminal, 4…surveillance terminal, 5…recording device, 6…communication network, 7…detection server, 8…purchaser display, 101…main body, 102…basket, 103…bagging station, 105…touch panel, 108…scanner, 109…reading window, 122…scale unit, 311…detection unit, 312…acquisition unit, 313…notification unit, 314…second notification unit, 315…third notification unit, 331…notification list, 332…camera image storage unit, 333…event record storage unit, 334…combination list. DETAILED DESCRIPTION

[0051] Hereinafter, embodiments of an information processing device that can reduce the risk of false detection notification to a purchaser and effectively prevent or suppress effective fraudulent activities will be described using the accompanying drawings.

[0052] [First embodiment]

[0053] First, an embodiment of a self-checkout system using an information processing device will be described.

[0054] [Instructions for the self-checkout system]

[0055] Figure 1 1 is a schematic diagram showing the structure of a self-service checkout system SYS according to an embodiment. The self-service checkout system SYS includes a plurality of self-service POS terminals 1, a plurality of cameras 2, a plurality of detection terminals 3, a monitoring terminal 4, and a recording device 5. Specifically, the self-service checkout system SYS corresponds one camera 2 and one detection terminal 3 to each self-service POS terminal 1 to form a cash register system RS. Each cash register system RS is set up at the checkout counter of the store. The self-service checkout system SYS connects the self-service POS (Point of Sales) terminal 1, camera 2, detection terminal 3, monitoring terminal 4, and recording device 5 of each cash register system RS through a communication network 6 such as a LAN (Local Area Network). In this embodiment, the detection terminal 3 functions as an information processing device that can reduce the risk of false detection notification to the purchaser and effectively prevent or suppress effective unfair behavior.

[0056] The purchaser who has finished shopping becomes a user of the self-service POS terminal 1. The purchaser who has put the purchased goods purchased at the store where the goods are displayed in a shopping basket or the like and moved to the checkout place operates the self-service POS terminal 1, and the self-service performs settlement of the transaction relating to the registration of the purchased goods to the payment of the money. The self-service POS terminal 1 is an example of a transaction processing device that is a full self-service corresponding device. The transaction processing device can also be a device that is not a full self-service corresponding device. The transaction processing device can also be a settlement device in which the registration of the purchased goods is performed in another device, and the purchaser himself or herself performs an operation relating to the payment of the money based on the data of the purchased goods registered by the device to settle the transaction.

[0057] The self-service POS terminal 1 transmits event information, that is, a POS event, indicating the operation content of the purchaser to the corresponding detection terminal 3 via the communication network 6 based on the correspondence relationship with the detection terminal 3 set in advance. The POS event is an example of the second event indicating the action content of the purchaser reported from the self-service POS terminal 1 to the detection terminal 3.

[0058] The camera 2 captures the action of the purchaser who operates the self-service POS terminal 1, and transmits the captured camera image to the corresponding detection terminal 3 via the communication network 6 according to the correspondence relationship with the detection terminal 3 set in advance. Note that, here, although via the communication network 6, the camera image can also be transmitted directly from the camera 2 to the detection terminal 3 by a USB (Universal Serial Bus) cable, for example. In this case, it is not necessary to set the correspondence relationship with the detection terminal 3 in the camera 2. The camera 2 can also transmit the camera image to the recording device 5 via the communication network 6.

[0059] The detection terminal 3 having a function as an information processing device is provided with an image analysis engine based on AI. The image analysis engine analyzes the camera image from the camera 2, detects the action of the purchaser, and identifies the camera event corresponding to the action. That is, the camera 2 is an example of a sensor that detects the action of the purchaser, and the camera event is an example of the first event identified based on the output of the sensor. The detection terminal 3 detects the behavior of the purchaser that needs to be reported based on the camera event identified by the image analysis engine and the POS event acquired from the self-service POS terminal 1. The detection terminal 3 sometimes also detects the behavior to be reported based on the POS event or the behavior to be reported based on the camera event. The detection terminal 3 reports the detected behavior, that is, the behavior to be reported, to the corresponding self-service POS terminal 1 via the communication network 6. The detection terminal 3 reports the behavior to be reported not only to the corresponding self-service POS terminal 1 but also to the monitoring terminal 4.

[0060] The monitoring terminal 4 is a terminal operated by a clerk who is a monitor of the plurality of self-service POS terminals 1 connected through the communication network 6. The monitoring terminal 4 has a display. The monitoring terminal 4 displays information required when monitoring the plurality of self-service POS terminals 1 on the display. The displayed information also includes information of the reported behavior detected by the detection terminal 3.

[0061] The clerk as a monitor monitors the self-service POS terminal 1 according to the information displayed on the display. The clerk as a monitor recognizes that the behavior considered to be an irregular behavior has been performed by the purchaser according to the information of the reported behavior detected by the detection terminal 3. The clerk as a monitor is, for example, called a server. The monitoring terminal 4 is an example of a terminal for a monitor. The monitoring terminal 4 can be any device as long as it can be connected to the communication network 6 by wireless. For example, it can be a tablet terminal which the clerk as a monitor can carry.

[0062] The recording device 5 is a storage device such as a NAS (Network Attached Storage) connected to the communication network 6. The recording device 5 records the camera images from each camera 2.

[0063] [Explanation of self-service POS terminal]

[0064] Figure 2 is a perspective view showing the external configuration of the self-service POS terminal 1, Figure 3 is a block diagram showing the main part circuit configuration of the self-service POS terminal 1. As shown in Figure 2 , the self-service POS terminal 1 has a main body 101 provided on the floor, and a basket table 102 and a bagging table 103 are provided with the main body 101 therebetween. The basket table 102 is used to place a basket or the like in which the purchaser from the store has put purchased goods, and the bagging table 103 is used to place a plastic bag or a shopping bag brought by the purchaser, that is, a so-called eco-bag. The main body 101 has a display pole 104, a touch panel 105, and a camera pole 106 mounted on the upper portion thereof. The purchaser stands in front of the main body 101 to perform an operation so as to be able to see the screen of the touch panel 105. Figure 2 Therefore, from the perspective of the purchaser, the basket table 102 is on the right side and the bagging table 103 is on the left side with the main body 101 therebetween. In the following explanation, the side on which the purchaser stands is set as the front side of the main body 101, the side on which the bagging table 103 is provided is set as the left side of the main body 101, and the side on which the basket table 102 is provided is set as the right side of the main body 101.

[0065] The display pole 104 has a light emitting portion 107 which selectively emits, for example, blue and red light at the front end portion thereof. The display pole 104 displays the state of the self-service POS terminal 1, such as standby, operation, call, error, and the like, according to the light emission color of the light emitting portion 107.

[0066] Touch panel 105 consists of a display for displaying various screens related to transactions such as registration and checkout to the user operating self-service POS terminal 1, and a touch sensor for detecting user touch input on the screen. In self-service POS terminal 1, the user is typically a purchaser. Touch panel 105 can also display information transmitted from detection terminal 3 via communication network 6.

[0067] The camera rod 106 is provided with a camera 2 at its front end. The field of view of the camera 2 is the shooting area, such as Figure 2 As shown by the dashed line, the camera 2 extends from the basket table 102 on the right side of the main body 101 to the bagging table 103 on the left side. Specifically, the camera 2 is positioned and positioned so that it fits within the user's range of motion when operating the self-service POS terminal 1. More specifically, the camera 2 is configured so that its imaging area can capture, from above, at least the opening of a shopping basket or a shopping cart positioned on the basket table 102, the opening for inserting merchandise into a plastic bag or reusable bag placed on the bagging table 103, and the path of merchandise as it is removed from the shopping basket and inserted into the plastic bag or reusable bag placed on the bagging table 103.

[0068] The main body 101 has a scanner 108 formed on its front surface (see Figure 3 ) reading window 109, card reader 110 (refer to Figure 3 ) card insertion port 111, and the printer 112 (see Figure 3 ) is provided at a dispensing port 113 for printing receipts. In addition, an automatic change machine 114 (see Figure 3 )'s coin input port 115, coin dispensing port 116, banknote input port 117 and banknote dispensing port 118.

[0069] A communication cable 119 extends outward from the right side of the main body 101. A cashless payment terminal 120 is connected to the distal end of the communication cable 119. The payment terminal 120 is placed on a stand 121 provided on the upper right side of the main body 101.

[0070] The bagging table 103 includes a scale unit 122. The scale unit 122 measures the total weight of commodities and the like placed on the bagging table 103.

[0071] like Figure 3As shown, the self-service POS terminal 1 is provided with, in addition to the above-described touch panel 105, light emitting section 107, scanner 108, card reader 110, printer 112, automatic change machine 114, settlement terminal 120, scale unit 122, a processor 11, main memory 12, auxiliary storage device 13, clock 14, communication interface 15, and system transmission path 16. The system transmission path 16 includes an address bus, a data bus, a control signal line, and the like. The system transmission path 16 connects the processor 11 and the other sections directly or via a signal input / output circuit, and transmits data signals exchanged therebetween. The processor 11, main memory 12, auxiliary storage device 13, clock 14, and communication interface 15 are connected by the system transmission path 16, thereby constituting a computer of the self-service POS terminal 1.

[0072] The processor 11 corresponds to a central part of the above-described computer. The processor 11 controls the sections in accordance with an operating system or an application program to realize various functions as the self-service POS terminal 1. The processor 11 can be, for example, a CPU (Central Processing Unit). The processor 11 includes, for example, an MPU (Micro Processing Unit), SoC (System on a Chip), DSP (Digital Signal Processor), GPU (Graphics Processing Unit), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), or FPGA (Field-Programmable Gate Array), or the like. Alternatively, the processor 11 can be a processor composed of a plurality of combinations of these.

[0073] The main memory 12 corresponds to a main storage part of the above-described computer. The main memory 12 includes a non-volatile storage area and a volatile storage area. The main memory 12 stores an operating system or an application program in the non-volatile storage area. The main memory 12 can store data required for the processor 11 to execute processing for controlling the sections in the non-volatile or volatile storage area. The main memory 12 uses the volatile storage area as a work area in which data is appropriately rewritten by the processor 11. The non-volatile storage area is, for example, a ROM (Read Only Memory). The volatile storage area is, for example, a RAM (Random Access Memory).

[0074] The auxiliary storage device 13 corresponds to an auxiliary storage portion of the above-described computer. For example, an EEPROM (registered trademark) (Electric Erasable Programmable Read Only Memory), an HDD (Hard Disc Drive), or an SSD (Solid State Drive) or the like can be the auxiliary storage device 13. The auxiliary storage device 13 stores data used when the processor 11 performs various processing, data generated by the processing of the processor 11, and the like. The auxiliary storage device 13 can also store the above-described application program.

[0075] The clock 14 counts the date and time. The processor 11 processes the date and time counted by the clock 14 as a current date and time.

[0076] The communication interface 15 performs data communication with an external device connected through the communication network 6 in accordance with a communication protocol set in advance. The external device is typically the detection terminal 3. The external device can include other devices, such as the monitoring terminal 4 or a server not illustrated.

[0077] The scanner 108 reads a code symbol of a product from an alignment reading window 109. A code symbol indicating a product code or the like for identifying the product is attached to each product sold at a store. The code symbol is, for example, a bar code. The code symbol can be, for example, a two-dimensional data code. The scanner 108 can be a type that reads a code symbol by scanning with laser light, or a type that reads a code symbol from an image captured by an imaging device.

[0078] The card reader 110 reads card data recorded in a card medium such as a credit card or a point card. The card reader 110 introduces a card medium inserted into a card insertion port 111 into the main body 101, reads card data, and discharges the card medium from the card insertion port 111.

[0079] The printer 112 prints, on a sheet of paper, receipt data indicating a product transaction content or the like. The sheet of paper on which the receipt data is printed is discharged from a dispensing port 113, cut by a cutter not illustrated, and dispensed as a receipt or a voucher.

[0080] The automatic change machine 114 includes a coin unit and a bill unit. The coin unit sorts coins one by one to identify the denomination of the coins, and stores the coins in a cash box by denomination. The coin unit, for example, takes out coins of a corresponding denomination from the cash box in accordance with change data, and dispenses the coins from a coin dispensing port 116. The bill unit sorts bills one by one to identify the denomination of the bills, and stores the bills in a cash box by denomination. The bill unit, for example, takes out bills of a corresponding denomination from the cash box in accordance with change data, and dispenses the bills from a bill dispensing port 118.

[0081] The settlement terminal 120 performs, for example, reading and rewriting of electronic money recorded in an electronic money medium. The electronic money medium is, for example, a noncontact IC card. The electronic money medium can also be an electronic device such as a smartphone or a tablet terminal.

[0082] The self-service POS terminal 1 of this configuration takes a part of the volatile memory area in the main memory 12 as a region of a transaction file 17. The transaction file 17 is a data file for storing data related to one product transaction processed by the self-service POS terminal 1. The transaction file 17 stores, for example, data of a transaction number, purchase product data, a total number of pieces, a total amount, a discount amount, a settlement amount, and the like. The transaction number is a series of numbers issued each time a product transaction is processed in the self-service POS terminal 1. The purchase product data is record data made for each product bought and sold in a product transaction identified by the transaction number. Here, the purchase product data is composed of items of a product code, a product name, a price, a number of pieces, an amount, and the like. The number of pieces is the number of pieces of a product identified by the product code that is bought. The amount is an amount corresponding to the number of pieces that is bought. The transaction file 17 can store a plurality of pieces of purchase product data. The total number of pieces is the number of pieces obtained by totaling the number of pieces of each piece of purchase product data. The total amount is the amount obtained by totaling the amount of each piece of purchase product data. The discount amount is the amount obtained by discounting the total amount. The settlement amount is the amount obtained by subtracting the discount amount from the total amount.

[0083] [Configuration of detection terminal]

[0084] Figure 4 is a block diagram showing an example of a main part circuit configuration of the detection terminal 3. The detection terminal 3 includes a processor 31, a main memory 32, a storage device 33, a clock 34, a communication interface 35, and a system transmission path 36. The system transmission path 36 includes an address bus, a data bus, a control signal line, and the like. The system transmission path 36 connects the processor 31 and the other parts directly or via a signal input / output circuit, and transmits data signals exchanged therebetween. The processor 31, the main memory 32, the storage device 33, the clock 34, and the communication interface 35 are connected through the system transmission path 36, thereby configuring a computer of the detection terminal 3. The computer of the detection terminal 3 can be referred to as a computer of a transaction processing device.

[0085] The processor 31 corresponds to a central part of the above-described computer. The processor 31 controls the parts to realize various functions as the detection terminal 3 in accordance with an operating system or an application program. The processor 31 is, for example, a CPU. The processor 31 can be a multi-core / multi-threaded processor, and can execute a plurality of processes in parallel. The processor 31 can be, for example, an MPU, a SoC, a DSP, a GPU, an ASIC, a PLD, or an FPGA, or the like. Alternatively, the processor 31 can also be a processor configured by combining a plurality of these.

[0086] The main memory 32 corresponds to the main storage portion of the above-described computer. The main memory 32 includes a non-volatile memory area and a volatile memory area. The main memory 32 stores an operating system or an application program in the non-volatile memory area. The main memory 32 can store data necessary for the processor 31 to execute processing for controlling each portion in the non-volatile or volatile memory area. The main memory 32 uses the volatile memory area as a work area in which data is appropriately overwritten by the processor 31. The non-volatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

[0087] The auxiliary storage device 33 corresponds to the auxiliary storage portion of the above-described computer. For example, an EEPROM, an HDD, or an SSD, or the like can be the auxiliary storage device 33. The auxiliary storage device 33 holds data used when the processor 31 performs various processing, data generated by the processing of the processor 31, and the like. The auxiliary storage device 13 can also store the above-described application program.

[0088] The application program stored in the main memory 32 or the auxiliary storage device 33 includes, for example, an information processing program for causing the above-described computer to function as the information processing apparatus of the first embodiment, and an image analysis program that realizes an AI-based image analysis engine. The method of installing these programs in the main memory 32 or the auxiliary storage device 33 is not particularly limited. The programs can be recorded in a removable storage medium, or distributed by communication via a network, and installed in the main memory 32 or the auxiliary storage device 33. If the storage medium is capable of storing the programs like a CD-ROM, a memory card, or the like, and the apparatus is capable of reading, it does not matter what form it is.

[0089] The clock 34 counts the date and time. The processor 31 processes the date and time counted by the clock 34 as the current date and time.

[0090] The communication interface 35 performs data communication with external devices connected through the communication network 6 in accordance with a communication protocol set in advance. The external devices are, for example, the self-service POS terminal 1, the camera 2, the monitoring terminal 4, the recording apparatus 5, and the like.

[0091] The detection terminal 3 of this configuration sets a part of the storage area of the auxiliary storage device 33 as the area of the notification list 331, the camera image storage 332, and the event log storage 333.

[0092] As Figure 5As shown, the notification list 331 is a data list in which a notification behavior item and a detection flag are described in association with a notification behavior ID. The notification behavior ID is unique identification information set for each notification behavior in order to identify the kind of the behavior of the purchaser for which notification is required to the transaction processing device, i.e., the self-service POS terminal 1.

[0093] The notification behavior item is a name indicating the behavior of the purchaser for which notification is required to the self-service POS terminal 1. In the present embodiment, five items of "scanning omission", "weight error", "high-priced goods error", "goods under the cart error", and "purchase quantity: large" are exemplified as the items of the notification behavior. The kind of each notification behavior will be described later in detail.

[0094] The detection flag is one-bit data for identifying whether or not the notification behavior item identified by the corresponding notification behavior ID is detected. In the present embodiment, the detection flag indicating that the notification behavior is not detected is set to "0", and the detection flag indicating that the notification behavior is detected is set to "1".

[0095] The camera image storage section 332 sequentially stores the camera image from the corresponding camera 2. The event log storage section 333 sequentially stores the log of the POS event from the self-service POS terminal 1 and the log of the camera event identified from the camera image. The camera image storage section 332 and the event log storage section 333 can delete the stored contents at an arbitrary timing, for example, outside the business hours of the store, as needed.

[0096] Returning to Figure 4 the description.

[0097] As shown in Figure 4 , the processor 31 of the detection terminal 3 has the functions of the detection section 311, the acquisition section 312, the notification section 313, and the second notification section 314. These functions are realized by information processing according to the above-mentioned information processing program and the image analysis program.

[0098] The detection section 311 is a function of detecting the behavior of the purchaser for which notification is required to the transaction processing device, i.e., the self-service POS terminal 1, i.e., the notification behavior. The detection section 311 detects the notification behavior in categories based on the first event, i.e., the camera event, identified by the image analysis engine from the output of the sensor, i.e., the camera 2, detecting the action of the purchaser, and the second event, i.e., the POS event, indicating the content of the action of the purchaser notified from the self-service POS terminal 1. The detection section 311 detects the notification behavior of, for example, the five items of "scanning omission", "weight error", "high-priced goods error", "goods under the cart error", and "purchase quantity: large".

[0099] The acquisition unit 312 is a function of acquiring the kind of the reporting behavior detected by the detection unit 311. The acquisition unit 312 stores information indicating the kind of the reporting behavior acquired. The information indicating the kind of the reporting behavior is each detection flag of the reporting list 331. That is, the acquisition unit 312 updates the detection flag of the reporting list 331 corresponding to the kind of the reporting behavior detected by the detection unit 311 from "0" to "1", and stores the information indicating the kind of the reporting behavior. For example, when the reporting behavior detected by the detection unit 311 is the reporting behavior of the reporting behavior item "scan omission", the acquisition unit 312 updates the detection flag Fa from "0" to "1", and stores that the detected reporting behavior is the reporting behavior item "scan omission". When the reporting behavior detected by the detection unit 311 is the reporting behavior of the reporting behavior item "weight error", the acquisition unit 312 updates the detection flag Fb from "0" to "1", and stores that the detected reporting behavior is the reporting behavior item "weight error". The acquisition unit 312 updates the detection flag Fc from "0" to "1" when the reporting behavior detected by the detection unit 311 is the reporting behavior of the reporting behavior item "expensive item error", and stores that the detected reporting behavior is the reporting behavior item "expensive item error". The acquisition unit 312 updates the detection flag Fd from "0" to "1" when the reporting behavior detected by the detection unit 311 is the reporting behavior of the reporting behavior item "cart bottom item error", and stores that the detected reporting behavior is the reporting behavior item "cart bottom item error". The acquisition unit 312 updates the detection flag Fe from "0" to "1" when the reporting behavior detected by the detection unit 311 is the reporting behavior of the reporting behavior item "purchase quantity: large", that is, when the purchase quantity reaches the quantity as the reporting behavior should be reported, and stores that the detected reporting behavior is the reporting behavior item "purchase quantity: large".

[0100] The reporting unit 313 is a function of reporting when a plurality of kinds of behaviors requiring reporting are acquired by the acquisition unit 312 in one transaction. That is, the reporting unit 313 reports when two or more detection flags are "1" in one transaction. For example, when the detection flag Fa and the detection flag Fb are "1", the reporting unit 313 reports that the reporting behavior items "scan omission" and "weight error" are detected. The reporting unit 313 reports to the transaction processing device of the purchaser, that is, the self-checkout POS terminal 1, which performed the reporting behavior. The reporting unit 313 reports at the time point when the threshold value of the reporting behavior determination criterion is exceeded.

[0101] The second reporting unit 314 is a function of reporting to the terminal for the monitor, that is, the monitoring terminal 4, at the time point when the reporting behavior is detected by the detection unit 311. The second reporting unit 314 reports to the monitoring terminal 4 at the time point when the reporting behavior is detected regardless of the kind of the reporting behavior.

[0102] [Explanation of actions of detection terminal]

[0103] Figure 6 is a series of timing charts for explaining actions involved in detection and notification of the notification behavior in the detection terminal 3 together with actions of the camera 2 and the self-service POS terminal 1 of the same register system RS.

[0104] As shown in Figure 6 , the camera 2 performs imaging (ACT 11) and outputs the imaged camera image to the corresponding detection terminal 3 (ACT 12). For example, the camera 2 has a person detection function and transmits the camera image in which the purchaser is reflected during the imaging. Alternatively, the camera 2 can have a moving body detection function instead of the person detection function and transmit the camera image in which the moving object is reflected during the imaging. In addition, the camera 2 itself can not have such a function, and a person detection sensor or the like can be provided on the self-service POS terminal 1, and the camera 2 can perform imaging only during a period in which a person is detected by the sensor and transmit the camera image. Thus, the camera 2 can transmit the camera image in units of transactions of the purchaser. Note that the camera 2 transmits the camera image not only to the detection terminal 3 but also to the recording device 5. The recording device 5 records the camera image in a data file in chronological order. The recording device 5, for example, distinguishes the file name for each camera 2 and records the camera image in the data file.

[0105] The detection terminal 3 that has received the camera image analyzes the camera image using an AI-based image analysis engine, detects the action of the purchaser, and identifies the camera event corresponding to the action (ACT 31). For example, when the detection terminal 3 detects the action of the purchaser taking the product out of the basket table 102 from the camera image, the detection terminal 3 identifies the camera event corresponding to the action. Hereinafter, this camera event is referred to as a product taking-out event CIa. The product taking-out event CIa sometimes also includes the product code of the product taken out of the basket table 102 by the purchaser, which is specified by the appearance feature data of the product.

[0106] For example, when the detection terminal 3 detects the action of the purchaser aligning the product on the reading window 109 of the scanner 108 from the camera image, the detection terminal 3 identifies the camera event corresponding to the action. Hereinafter, this camera event is referred to as a scanning action event CIb. The scanning action event CIb sometimes also includes the product code of the product aligned on the reading window 109 of the scanner 108 by the purchaser, which is specified by the appearance feature data of the product.

[0107] For example, when the detection terminal 3 detects, based on camera images, a purchaser placing items into a plastic bag or reusable bag placed on the bagging station 103, it identifies a camera event corresponding to this action. This camera event is hereinafter referred to as a product bagging event CIc. The product bagging event CIc may also include a product code specified by the appearance feature data of the product placed in the plastic bag or reusable bag placed on the bagging station 103 by the purchaser.

[0108] When detection terminal 3 detects from camera images that merchandise has been stored in the lower section of a shopping cart placed near basket 102, it identifies a camera event corresponding to the storage of merchandise beneath the cart. This camera event is hereinafter referred to as a "merchandise storage beneath the cart" event CId. The "merchandise storage beneath the cart" event CId may also include a product code, specified by the appearance feature data of the merchandise stored beneath the cart. In this case, if two or more types of merchandise are placed beneath the cart, the "merchandise storage beneath the cart" event CId includes the product code for each merchandise.

[0109] It should be noted that the types of camera events identified by the detection terminal 3 are not limited to the aforementioned four types: the product removal event CIa, the scanning action event CIb, the product bagging event CIc, and the product storage event CId under the cart. The detection terminal 3 can also identify other types of camera events based on camera images.

[0110] When a purchaser performs an operation (ACT 21), the self-service POS terminal 1 outputs a POS event indicating the details of the operation to the corresponding detection terminal 3 (ACT 22). For example, when the self-service POS terminal 1 reads a code symbol of a product positioned against the reading window 109 of the scanner 108, it outputs a POS event indicating the details of the operation. This POS event is hereinafter referred to as a registration event PIa. The registration event PIa includes the product code specified by the code symbol read by the scanner 108.

[0111] For example, when merchandise is placed on the bagging station 103 and the weight measured by the scale unit 122 changes, the self-service POS terminal 1 outputs a POS event indicating the operation. Hereinafter, this POS event is referred to as a weight event PIb. The weight event PIb includes the changed weight.

[0112] For example, the self-service POS terminal 1 displays the registration screen SCa (see Figure 14 ) is touched, a POS event indicating the details of the operation is output. This POS event is hereinafter referred to as a checkout event PIc. When the purchaser completes registration of the purchased goods, he or she touches the [Checkout] touch button BTb.

[0113] Note that the kinds of the POS events output from the self-POS terminal 1 are not limited to the above-mentioned three kinds of the registration event PIa, the weight event PIb, and the checkout event PIc. The self-POS terminal 1 can output other kinds of POS events according to the operation of the purchaser.

[0114] The detection terminal 3 detects the reporting behavior of the purchaser based on the POS event output from the self-POS terminal 1 and the camera event recognized from the camera image of the camera 2 (ACT32). The detection terminal 3, for example, detects a reporting behavior called "scan omission", "high-priced item error", "cart bottom item error", or "purchased item number: large". Alternatively, the detection terminal 3 detects the reporting behavior of the purchaser based on the POS event output from the self-POS terminal 1 (ACT32). The detection terminal 3, for example, detects a reporting behavior called "weight error".

[0115] Thus, the detection terminal 3 detects the reporting behavior of the purchaser based on the POS event and the camera event. That is, the self-POS terminal 1 outputting the POS event and the camera 2 outputting the camera image for recognition of the camera event have a function as an output section which outputs information required for detecting a behavior of the purchaser which needs to be reported to the transaction processing device. Note that the reporting behavior of the purchaser can be detected based on only the POS event, and thus in this case, the self-POS terminal 1 has a function as the output section. Further, since the reporting behavior of the purchaser can be detected based on only the camera event, in this case, the camera 2 has a function as the output section.

[0116] The detection terminal 3 judges whether or not the reporting behavior of the purchaser has been detected (ACT33). When the reporting behavior is detected (YES in ACT33), the detection terminal 3 reports to the monitor that the reporting behavior has occurred. Specifically, the detection terminal 3 outputs a reporting event for reporting to the monitoring terminal 4 of the operator as the monitor that the reporting behavior has occurred (ACT34).

[0117] In addition, the detection terminal 3 updates the detection flag described in the reporting list 331 in association with the reporting behavior ID of the reporting behavior from "0" to "1" (ACT35). Note that in the case where the detection flag is already "1", the state is maintained.

[0118] The detection terminal 3 retrieves the notification list 331, and counts the number n of detection flags that become "1" (ACT36). Then, the detection terminal 3 determines whether the number n of detection flags that become "1" is equal to or greater than a prescribed threshold value N (ACT37). The threshold value N is a threshold value that serves as a determination reference for whether or not to notify the self-service POS terminal 1 of a notification action. In the present embodiment, the threshold value N is set to "2". When the number n of detection flags that become "1" is equal to or greater than the threshold value N (YES in ACT37), the detection terminal 3 notifies the purchaser that a notification action has occurred. Specifically, the detection terminal 3 outputs a notification event for notifying the purchaser of the notification action to the self-service POS terminal 1 that serves as the operator (ACT38). The self-service POS terminal 1 that has input the notification event notifies the purchaser of the notification action, for example, by displaying information such as text or images that indicate the content of the notification action on the touch panel 105 (ACT23). The self-service POS terminal 1 can notify the purchaser of the content of the notification action by voice.

[0119] Note that, in a case where a notification action is not detected in the action of ACT33 of the detection terminal 3 (NO in ACT33), the detection terminal 3 skips the actions of ACT34 to ACT38. Also, in a case where the number n of detection flags that become "1" is less than the threshold value N in the action of ACT37 of the detection terminal 3 (NO in ACT37), the detection terminal 3 skips the action of ACT38.

[0120] The detection terminal 3 repeatedly performs the actions shown in ACT31 to ACT38 during a period before the self-service POS terminal 1 registers the purchased goods of a transaction and settles the transaction. In this way, the detection terminal 3 detects notification actions that occur in a transaction on a category basis based on the POS events output from the self-service POS terminal 1 and the camera events that are recognized from the images captured by the camera 2. Then, when notification actions of a threshold value N or more categories are detected, the detection terminal 3 outputs a notification event for notifying that a plurality of notification actions have been detected to the self-service POS terminal 1 operated by the purchaser who performed the notification actions. On the other hand, with respect to the monitoring terminal 4 that serves as a monitor terminal, a notification event for notifying that a notification action has been detected is output each time a notification action is detected.

[0121] [Explanation of the Program of the Detection Terminal]

[0122] Figure 7 is a flowchart that shows the order of information processing performed by the processor 31 of the detection terminal 3 that performs the actions described above. The processor 31 performs the information processing of the steps shown in the flowchart of Figure 7 according to the information processing program stored in the main memory 32 or the auxiliary storage device 33.

[0123] That is, as ACT 101, the processor 31 confirms whether or not the camera image is acquired from the camera 2 corresponding to the detection terminal 3. In the case where the camera image is not acquired, the processor 31 proceeds to ACT 102. As ACT 102, the processor 31 confirms whether or not the POS event is acquired from the self-POS terminal 1 corresponding to the detection terminal 3. In the case where the POS event is not acquired, the processor 31 returns to ACT 101. In this way, the processor 31 waits for the acquisition of the camera image or the acquisition of the POS event in ACT 101 and ACT 102.

[0124] In the waiting acceptance state of ACT 101 and ACT 102, when the camera image is acquired, the processor 31 proceeds to ACT 103. As ACT 103, the processor 31 stores the camera image thereof by the camera image storage section 332. Then, as ACT 104, the processor 31 analyzes the camera image stored by the camera image storage section 332 by the AI-based image analysis engine, and confirms whether or not the camera event can be recognized. In the case where the camera event is not recognized, the processor 31 returns to the waiting acceptance state of ACT 101 and ACT 102.

[0125] When the camera event is recognized in ACT 104, the processor 31 proceeds to ACT 105. As ACT 105, the processor 31 stores the camera event by the event log storage section 333.

[0126] On the other hand, in the waiting acceptance state of ACT 101 and ACT 102, in the case where the POS event is acquired, the processor 31 proceeds to ACT 106. As ACT 106, the processor 31 stores the POS event in the event log storage section 333.

[0127] In ACT 105 or ACT 106, when the camera event or the POS event is stored by the event log storage section 333, the processor 31 proceeds to ACT 107. As ACT 107, the processor 31 detects the notification behavior of the notification behavior item set in the notification list 331 based on the camera event and the POS event stored in the event log storage section 333. The detection operation of each notification behavior will be described later in detail.

[0128] As ACT 108, the processor 31 confirms whether or not the notification behavior can be detected. In the case where the notification behavior is not detected, the processor 31 returns to the waiting acceptance state of ACT 101 and ACT 102.

[0129] When the reporting behavior of any one of the reporting behavior items is detected in ACT 108, the processor 31 proceeds to ACT 109. As ACT 109, the processor 31 performs monitor reporting. That is, the processor 31 transmits a reporting event for reporting the detection of the reporting behavior to the monitor terminal 4. The reporting event includes information indicating the reporting behavior item of the detected reporting behavior. In the monitor terminal 4 that receives the reporting event, on the display in the detection terminal 3 of the reporting event transmission source, information for reporting the detection of the reporting behavior of the reporting behavior item included in the reporting event to the monitor is displayed (refer to FIG. 6). Figure 15 ).

[0130] The processor 31 that has finished the monitor reporting proceeds to ACT 110. As ACT 110, the processor 31 acquires the kind of the detected reporting behavior. Then, as ACT 111, the processor 31 updates the detection flag described in the reporting list 331 in association with the reporting behavior ID of the kind from "0" to "1". Note that, in the case where the detection flag is already "1", the processor 31 maintains the state.

[0131] As ACT 112, the processor 31 counts the number n of the detection flags that become "1". Then, as ACT 113, the processor 31 judges whether the number n of the detection flags that become "1" is equal to or more than a prescribed threshold N (N = 2 in this embodiment). In the case where the number n of the detection flags that become "1" is less than the threshold N, the processor 31 returns to the waiting acceptance state of ACT 101 and ACT 102.

[0132] On the other hand, in the case where the number n of the detection flags that become "1" is equal to or more than the threshold N, the processor 31 proceeds to ACT 114. As ACT 114, the processor 31 performs reporting to the purchaser. That is, the processor 31 transmits a reporting event for reporting the detection of the reporting behavior to the corresponding self-service POS terminal 1. In the reporting event, information indicating the reporting behavior items of two or more kinds of reporting behaviors respectively associated with two or more detection flags that become "1" is included. In the self-service POS terminal 1 that receives the reporting event, for example, a part of the screen of the touch panel 105 displays information for reporting the detection of the reporting behavior of two or more reporting behavior items included in the reporting event to the purchaser (refer to FIG. 7). Figure 14 ). The processor 31 that has performed the reporting to the purchaser returns to the waiting acceptance state of ACT 101 and ACT 102.

[0133] Here, the processor 31 realizes the function as the detection section 311 through the processing of the ACT 101 to the ACT 108. The processor 31 realizes the function as the acquisition section 312 through the processing of the ACT 110 to the ACT 111. The processor 31 realizes the function as the notification section 313 through the processing of the ACT 112 to the ACT 114. The processor 31 realizes the function as the second notification section 314 through the processing of the ACT 109.

[0134] [Explanation of the kind of notification behavior and detection action]

[0135] Figure 8 is a schematic diagram of the notification behavior detection action indicating the notification behavior item "scan omission". The notification behavior item "scan omission" refers to the behavior of the purchaser not scanning the bar code of the purchased product taken out from the basket table 102 and packed in the plastic bag or the eco bag at the bagging table 103 through the scanner 108 of the self-checkout POS terminal 1. For example, the behavior of the purchaser aligning the purchased product to the reading window 109 of the scanner 108, but packing the product without reading the bar code due to not aligning the bar code correctly, corresponds to the notification behavior of the notification behavior item "scan omission".

[0136] For such behavior, in the event log storage section 334, the product taking-out event CIa is stored first, then the scan action event CIb is stored, and then the product packing event CIc is stored. On the other hand, for the POS event, only the weight event PIb is stored, and the registration event PIa is not stored.

[0137] The detection terminal 3 detects the presence of the notification behavior of the notification behavior item "scan omission" in the case where the product taking-out event CIa, the scan action event CIb, and the product packing event CIc are stored in this order, and the weight event PIb is stored, but the registration event PIa is not stored. Note that, in the case where the purchaser packs the product without aligning the product to the reading window 109, the behavior also becomes the notification behavior of the notification behavior item "scan omission". That is, the detection terminal 3 also detects the presence of the notification behavior of the notification behavior item "scan omission" in the case where the product taking-out event CIa and the product packing event CIc are stored, and the weight event PIb is stored, but the registration event PIa and the scan action event CIb are not stored.

[0138] When the notification behavior of the notification behavior item "scan omission" is detected, the detection flag Fa is "1". Then, when the number n of the detection flags that become "1" is equal to or more than the threshold value N, the detection terminal 3 notifies the purchaser. At this time, in the notification event transmitted to the self-checkout POS terminal 1, information indicating the notification behavior item "scan omission" and information indicating the notification behavior item associated with the notification behavior ID of the other detection flag that becomes "1" are included.

[0139] Figure 9 is a schematic diagram of a notification behavior detection action indicating the notification behavior item "weight error". The notification behavior item "weight error" refers to a behavior in which a purchaser takes out a purchased product from the basket table 102 and packs it in a plastic bag or an eco bag at the bagging table 103, and the product does not match the product specified by the bar code scanned by the scanner 108 of the self-checkout POS terminal 1. For example, a behavior in which a purchaser takes out two kinds of purchased products from a shopping basket, scans only one of the products, and packs both of the products, corresponds to the notification behavior of the notification behavior item "weight error". For example, on a product that is a package sale of a plurality of the same product, a bar code corresponding to the package sale price is printed, and on the other hand, a bar code corresponding to the single product price is printed on each product. A behavior in which such a package sale product is taken out from the basket table 102, a bar code corresponding to the single product price is scanned instead of a bar code corresponding to the package sale price, and the product is packed, also corresponds to the notification behavior of the notification behavior item "weight error".

[0140] For such a behavior, in the event log storage section 333, the product taking-out event CIa is stored with respect to the camera event, followed by the scanning action event CIb, and then the product packing event CIc. On the other hand, with respect to the POS event, the registration event PIa is stored, followed by the weight event.

[0141] The detection terminal 3 acquires the set weight Wa of the product specified by the product code included in the registration event PIa in a case where the product taking-out event CIa, the scanning action event CIb, and the product packing event CIc are sequentially stored, and the registration event PIa and the weight event PIb are sequentially stored. In addition, the detection terminal 3 acquires the measured weight included in the weight event (ACT202). Then, the detection terminal 3 calculates a change amount Wb of the measured weight included in the previous weight event and the measured weight included in this time's weight event (ACT203).

[0142] The detection terminal 3 calculates a difference W of the set weight Wa and the change amount Wb (ACT204). Then, the detection terminal 3 confirms whether the difference W is equal to or greater than a determination value Wx (ACT205). The determination value Wx is an arbitrary value that exceeds the allowable range ±a of the set weight Wa. In a case where the weights of products with the same bar code are uniform, the determination value Wx is "0" or a value close to "0". However, even for products with the same bar code such as vegetables, fruits, home cooking, and the like, there are products whose weights are not uniform. For such products, an appropriate determination value Wx (Wx > a) that exceeds the allowable range ±a of the set weight Wa is set.

[0143] In the case where the difference W is smaller than the determination value Wx (NO in ACT 205), the detection terminal 3 does not perform detection of the reporting behavior item "weight error". In contrast, in the case where the difference W is the determination value Wx or more (YES in ACT 205), the detection terminal 3 detects the reporting behavior in which the reporting behavior item "weight error" exists.

[0144] When the reporting behavior in which the reporting behavior item "weight error" exists is detected, the detection flag Fb becomes "1". Then, when the number n of detection flags that become "1" becomes the threshold value N or more, the detection terminal 3 performs reporting to the purchaser. At this time, in the reporting event transmitted to the self-service POS terminal 1, information indicating the reporting behavior item "weight error" and information indicating the reporting behavior item of the reporting behavior ID associated with other detection flags that become "1" are included.

[0145] Figure 10 is a schematic diagram of a reporting behavior detection operation indicating the reporting behavior item "expensive goods error". The reporting behavior item "expensive goods error" refers to a behavior in which, in the case where the purchased goods that the purchaser takes out from the basket table 102 and packs in the plastic bag or the eco bag of the bagging table 103 are expensive goods, the goods specified by the bar code scanned by the scanner 108 of the self-service POS terminal 1 are not the expensive goods. For example, goods whose unit price is the prescribed amount or more are set in advance as the expensive goods. The behavior in which the purchaser takes out the expensive goods and other goods from the shopping basket, scans only the other goods to pack, and does not pack the expensive goods but hides the expensive goods corresponds to the reporting behavior of the reporting behavior item "expensive goods error". Alternatively, the behavior in which the purchaser aligns the expensive goods with the reading window 109 of the scanner 108, but does not read the bar code because the bar code is not correctly aligned and packs the expensive goods corresponds to the reporting behavior of the reporting behavior item "expensive goods error". Note that the latter behavior also corresponds to the reporting behavior of the reporting behavior item "scanning omission".

[0146] For such a behavior, in the event log storage section 333, the goods taking-out event CIa is stored with respect to the camera event, and then the scanning action event CIb is stored, and then the goods packing event CIc is stored. On the other hand, with respect to the POS event, the registration event PIa is stored, and then the weight event is stored.

[0147] The detection terminal 3 confirms whether the product is designated, i.e., whether the product code is included in the product removal event CIa, based on the camera image of the behavior of the purchaser removing the product from the basket table 102 (ACT 211). In the case where the product code is included (YES in ACT 211), the detection terminal 3 determines whether the product designated by the product code is a product that is set in advance as a high-priced product (ACT 212). In the case where the product code is not included in the product removal event CIa (NO in ACT 211), or in the case where the product designated by the product code is not a high-priced product (NO in ACT 212), the detection terminal 3 does not perform detection of the notification behavior item "high-priced product error".

[0148] In contrast, in the case where the product designated by the product code is a high-priced product (YES in ACT 212), the detection terminal 3 continues detection of the notification behavior item "high-priced product error". The detection terminal 3 acquires the product code from the registration event PIa (ACT 213). The detection terminal 3 discriminates whether the product code coincides with the product code of the high-priced product (ACT 214). In the case where the product codes coincide (NO in ACT 214), the detection terminal 3 does not perform detection of the notification behavior item "high-priced product error". In contrast, in the case where the product codes do not coincide (YES in ACT 214), the detection terminal 3 detects the notification behavior in which the notification behavior item "high-priced product error" is included.

[0149] When the notification behavior in which the notification behavior item "high-priced product error" is included is detected, the detection flag Fc becomes "1". Then, when the number n of detection flags that become "1" is equal to or greater than the threshold value N, the detection terminal 3 performs notification to the purchaser. At this time, in the notification event transmitted to the self-checkout POS terminal 1, information indicating the notification behavior item "high-priced product error" and information indicating the notification behavior item of the notification behavior ID associated with the other detection flags that become "1" are included.

[0150] Figure 11 is a schematic view of a notification behavior detection operation of the notification behavior item "cart lower product error". The notification behavior item "cart lower product error" refers to a behavior in which the purchaser ends registration of the purchased product without scanning the purchased product accommodated in the lower stage of the shopping cart.

[0151] For such an action, in the event log storage section 333, the cart-under goods storage event CId is stored with respect to the camera event. On the other hand, for the POS event, the checkout event P1c is stored. When the cart-under goods storage event CId is acquired by the detection terminal 3, the goods specified by the cart-under goods storage event CId are recognized (ACT 221). That is, the detection terminal 3 acquires the goods codes included in the cart-under goods storage event CId. At this time, in the case where two or more goods codes are included in the cart-under goods storage event CId, the respective goods codes are acquired.

[0152] After that, when the checkout event P1c is acquired by the detection terminal 3, the purchased goods registered in the transaction file 17 of the corresponding self-checkout POS terminal 1 are searched (ACT 222). Then, the detection terminal 3 confirms whether or not the goods stored under the cart are registered in the transaction file 17 (ACT 223). That is, the detection terminal 3 confirms whether or not the purchase data of the goods codes included in the cart-under goods storage event CId are registered in the transaction file 17. In the case where all the goods stored under the cart are registered in the transaction file 17 (NO in ACT 223), the detection terminal 3 does not perform the detection of the reporting action item "cart-under goods error". In the case where even one kind of the goods stored under the cart is not registered in the transaction file 17 (YES in ACT 223), the detection terminal 3 detects the reporting action of the reporting action item "cart-under goods error".

[0153] Note that, generally, the goods stored in the lower section of the shopping cart are large-sized goods which are not put in the shopping basket. Therefore, in the case where the detection terminal 3 cannot acquire the goods codes from the cart-under goods storage event CId in ACT 221, it searches whether or not the goods classified as large-sized goods are registered in the transaction file 17 in ACT 222. Then, in the case where the goods classified as large-sized goods are not registered in the transaction file 17 (YES in ACT 223), the detection terminal 3 can also detect the reporting action of the reporting action item "cart-under goods error".

[0154] When the reporting action of the reporting action item "cart-under goods error" is detected, the detection flag Fc becomes "1". Then, when the number n of the detection flags which become "1" is equal to or more than the threshold value N, the detection terminal 3 performs the reporting to the purchaser. At this time, in the reporting event transmitted to the self-checkout POS terminal 1, the information indicating the reporting action item "cart-under goods error" and the information indicating the reporting action item associated with the other detection flags which become "1" are included.

[0155] Figure 12is a schematic view of a notification behavior detection action indicating the notification behavior item "number of purchases: large". The notification behavior item "number of purchases: large" refers to the behavior of a purchaser who purchases a large number of items in one transaction. For example, in the case where the purchaser purchases 10 or more items, the detection terminal 3 notifies the monitoring terminal 4 and the self-service POS terminal 1 that the notification behavior item "number of purchases: large" has been detected.

[0156] For such behavior, with respect to the camera events, the item removal event CIa, the scanning action event CIb, and the item bagging event CIc are repeatedly stored in the event log storage section 333. On the other hand, with respect to the POS events, the registration event PIa and the weight event are repeatedly stored.

[0157] The detection terminal 3 stores "0" as the default number of purchases (ACT231). Next, when the item removal event CIa, the scanning action event CIb, and the item bagging event CIc of the camera events, and the registration event PIa and the weight event of the POS events are stored in the event log storage section 333, the detection terminal 3 adds "1" to the number of purchases (ACT232).

[0158] The detection terminal 3 confirms whether the number of purchases is equal to or greater than the notification threshold (ACT233). The notification threshold is the value of the number of purchases that is determined to have detected the notification behavior item "number of purchases: large". For example, assume that the notification threshold is "10" when the notification behavior item "number of purchases: large" is notified of the detection when the purchaser purchases 10 or more items. In the case where the number of purchases is less than the threshold (YES in ACT233), the detection terminal 3 continues the detection action of the notification behavior item "number of purchases: large".

[0159] The detection terminal 3 stores the item removal event CIa, the scanning action event CIb, and the item bagging event CIc of the camera events in the event log storage section 333, and each time the registration event PIa and the weight event of the POS events are stored, adds "1" to the number of purchases (ACT234), and repeatedly performs the process of comparing with the notification threshold (ACT235). As a result, when the number of purchases is equal to or greater than the notification threshold (YES in ACT235), the detection terminal 3 detects the notification behavior of the notification behavior item "number of purchases: large".

[0160] When the reporting behavior of the reporting behavior item "purchase points: large" is detected, the detection flag Fc becomes "1". Then, when the number n of detection flags that become "1" is equal to or greater than the threshold value N, the detection terminal 3 reports to the purchaser. At this time, in the reporting event sent to the self-service POS terminal 1, information indicating the reporting behavior item "purchase points: large" and information of the reporting behavior item indicating the reporting behavior ID associated with the other detection flag that becomes "1" are included.

[0161] [Explanation of the reporting example]

[0162] Figure 13 is an example of a registration screen SCa displayed on the touch panel 105 of the self-service POS terminal 1. The registration screen SCa is a screen for registration of a purchased product. The registration screen SCa is generated by the processor 11 of the self-service POS terminal 1.

[0163] As shown in Figure 13 , the registration screen SCa includes a touch button BTa of [no barcode product] and a touch button BTb of [check out]. The touch button BTa of [no barcode product] is used when registering a product such as a fresh food product that does not have a barcode. According to a touch of this touch button BTa, in the self-service POS terminal 1, a touch button, so-called product button, corresponding to a product to which a code symbol is not attached is displayed, and the purchaser registers a product by touching a product button corresponding to a purchased product. The touch button BTb of [check out] is used when the purchaser who has completed the registration of a purchased product declares a check out of a transaction.

[0164] The registration screen SCa is divided into a registration list area ARa, a text area ARb, and a camera image area Arc. The registration list area ARa is an area for displaying a list of product names, purchase quantities, and purchase amounts of purchased products registered by the purchaser. The text area ARb is an area for displaying texts such as guidance to the purchaser, messages, and the like. The camera image area Arc is an area for displaying a camera image at a current time point taken by the corresponding camera 2.

[0165] In the present embodiment, when a reporting event is received from the detection terminal 3, a text indicating a reporting behavior content is displayed in the text area ARb. Figure 14 is an example of a registration screen SCa of the self-service POS terminal 1 when a reporting event of detection of both the reporting behavior item "scanning omission" and the reporting behavior item "error of product under cart" is received. As shown in Figure 14As shown, in the text area ARb, text indicating the reporting behavior of the reporting behavior item "scan omission" such as "Are there any items not scanned?" and text indicating the reporting behavior of the reporting behavior item "cart-under item error" such as "Were the items under the cart scanned?" are displayed. Thus, a purchaser who has intentionally committed the irregularity of scan omission and the irregularity of not scanning the items under the cart will notice that the store is aware of the irregularity, and thus, the irregularity is prevented.

[0166] Figure 15 is an example of a monitoring screen SCb displayed on the display of the monitoring terminal 4. As shown, the monitoring screen SCb is divided into monitoring areas STa to STn according to the cash register systems RS. In the monitoring areas STa to STn, the states of the self-service POS terminals 1 of the respective cash register systems RS are displayed. In addition, when a reporting event is received from the detection terminal 3 of the corresponding cash register system RS, text indicating the content of the reporting behavior is displayed in the monitoring area STa to STn. Figure 15

[0167] Figure 15 is a monitoring screen SCb when the reporting behavior of the reporting behavior item "scan omission" is detected in the detection terminal 3 of the cash register system RS identified by the cash register number "2", the reporting behavior of the reporting behavior item "scan omission" and the reporting behavior of the reporting behavior item "cart-under item error" are detected in the detection terminal 3 of the cash register system RS identified by the cash register number "7". In the case where one kind of reporting behavior is detected by the detection terminal 3 of the cash register system RS, the self-service POS terminal 1 is not reported. However, when two or more kinds of reporting behavior are detected, the self-service POS terminal 1 is reported. Thus, in the monitoring terminal 4, the monitor can recognize the text of the reporting behavior of the registration system RS for which only one kind of reporting behavior is detected, such as [scan omission], and the text of the reporting behavior of the registration system RS for which two or more kinds of reporting behavior are detected, such as [scan omission] and [cart-under item error], by changing, for example, the color of the text, the font, and the like.

[0168] [Effects of the First Embodiment]

[0169] ​As described above, according to the first embodiment, the detection terminal 3 stores a detection flag for each of the reporting behavior items identified by the reporting behavior ID. Then, in a transaction, when reporting behavior of at least two types of reporting behavior items is detected and the respective detection flags are "1", the detection terminal 3 reports to the corresponding self-service POS terminal 1 that reporting behavior of the two types of reporting behavior items has been detected. Thus, compared to the case where reporting is performed each time reporting behavior of a reporting behavior item is detected, the frequency of reporting is reduced, and thus, the risk of false detection reporting to the purchaser can be reduced. On the other hand, in the case where reporting behavior of two types or more is detected, reporting is performed to the corresponding self-service POS terminal 1, and thus, the effectiveness of the fraudulent behavior can be effectively prevented or suppressed.

[0170] The detection terminal 3, in a transaction, does not report to the corresponding self-service POS terminal 1 that reporting behavior has been detected in the case where reporting behavior of a reporting behavior item less than the threshold value is detected. That is, even if the same reporting behavior item is detected multiple times for a purchaser, when another reporting behavior item is not detected, reporting is not performed because the reporting behavior item does not reach the threshold value or more. A purchaser who performs reporting behavior is less likely to repeat only one type of behavior that requires reporting in a transaction, and is more likely to perform multiple types of behavior that requires reporting. Thus, in the case where only one type of behavior that requires reporting is repeatedly detected, the detection unit can have made a false detection. In a transaction, in the case where one type of behavior that requires reporting is detected, not reporting is performed in order to reduce the risk of false detection reporting to the purchaser. The detection terminal 3 (information processing device) has a reporting unit as follows. In a transaction, in the case where only one type of behavior that requires reporting is detected, even if the same type of behavior that requires reporting is detected multiple times, reporting is not performed, and in the case where multiple types of behavior that require reporting are detected, even if each type of behavior that requires reporting is detected only once, reporting is performed. Since multiple types of behavior that require reporting are detected, it is highly likely that arbitrary behavior that requires reporting has been performed. Thus, a reporting that reduces the risk of false detection reporting can be achieved.

[0171] In addition, the detection terminal 3 reports to the monitoring terminal 4 each time reporting behavior identified by the reporting behavior item is detected. Upon receiving the report, the monitoring terminal 4 displays on the display that reporting behavior identified by the reporting behavior item has been detected. Thus, the monitor can grasp in real time that reporting behavior has occurred, and thus, has greater effectiveness in preventing or suppressing fraudulent behavior. Note that the reporting destination can also be the self-service POS terminal 1, or can also be a monitoring device other than the monitoring terminal, and the like.

[0172] [Second Embodiment]

[0173] Next, usingFigure 16 and Figure 17 The second embodiment of the detection terminal 3 functioning as an information processing apparatus will be described.

[0174] Figure 16 A series of timing charts in which the detection and notification of the notification behavior in the detection terminal 3 of the second embodiment and the actions of the camera 2 and the self-POS terminal 1 of the same register system RS are described together will be described. To the parts common to the timing chart of the first embodiment shown in FIG. 10, the same symbols are given. Figure 6

[0175] As will be described in comparison with Figure 6 and Figure 16 In the second embodiment, in ACT 37, the processing after the number of occurrences is determined to be equal to or more than the notification threshold is different from the first embodiment. That is, in the second embodiment, the detection terminal 3 sets the notification flag (notification F) to "1" (ACT 41) when the number n of the detection flags that become "1" is equal to or more than the threshold N (YES in ACT 37). At this time, the detection terminal 3 does not notify the purchaser.

[0176] The detection terminal 3 determines whether the notification flag is "1" (ACT 43) when the checkout event as the POS event is received from the self-POS terminal 1 (YES in ACT 42). When the notification flag is "1" (YES in ACT 43), the detection terminal 3 notifies the purchaser (ACT 44).

[0177] For example, since the detection flag Fa continuously associated with the notification behavior ID of the notification behavior item "scanning omission" and the detection flag Fd continuously associated with the notification behavior ID of the notification behavior item "cart-under goods error" are both "1", in ACT 41, the notification behavior items "scanning omission" and "cart-under goods error" are notified to the purchaser as the notification behavior when the notification flag is "1".

[0178] Figure 17 is a flowchart showing the main sequence of information processing performed by the processor 31 of the detection terminal 3 of the above-described actions. To the parts common to the flowchart of the first embodiment shown in FIG. 11, the same symbols are given. Figure 7

[0179] As will be described in comparison with Figure 7 and Figure 17 In the second embodiment, the processing after the waiting for the acceptance state of ACT 101 and ACT 102 is different from the first embodiment. That is, the processor 31 confirms whether the POS event is the checkout event as ACT 121. That is, the processor 31 determines whether the POS event is the checkout event by detecting Figure 14 ​​the checkout button BTb of the registration screen Sca in the checkout event is pressed. In a case other than the checkout event, the processor 31 proceeds to ACT 106. Then, the processor 31 performs the processing of ACT 106 to ACT 113 similarly to the processing explained in the first embodiment. When the number n of the detection flags that become "1" in ACT 113 is equal to or more than the threshold value N, the processor 31 proceeds to ACT 122. The processor 31 sets the notification flag to "1" as ACT 122. The notification flag is 1-bit data for identifying whether or not the notification of the notification behavior detected by the detection terminal 3 is performed. The notification flag is a value "0" indicating that the notification is not performed in a default state. When the number n of the detection flags that become "1" in ACT 113 is equal to or more than the threshold value N, it becomes a value "1" indicating that the notification is performed. The processor 31 that sets the notification flag to "1" returns to the waiting acceptance state of ACT 101 and ACT 102.

[0180] When the processor 31 has acquired the checkout event in ACT 121, it proceeds to ACT 123. The processor 31 confirms whether or not the notification flag is "1" as ACT 123. As a result, in a case where the notification flag is "0", the processor 31 ends the information processing of the steps shown in the flowchart of Figure 17

[0181] On the other hand, in a case where the notification flag is "1", the processor 31 proceeds to ACT 124. The processor 31 performs the notification to the purchaser as ACT 124. That is, the processor 31 transmits a notification event for the notification of the detection of the notification behavior of two or more kinds of the notification behavior items for which the detection flag is "1" to the corresponding self-service POS terminal 1. Thus, the processor 31 ends the information processing of the steps shown in the flowchart of Figure 17

[0182] Thus, in the second embodiment, the detection terminal 3 updates the notification flag from the default "0" to "1" when it detects the notification behavior of at least two or more kinds of the notification behavior items and each detection flag is "1" in one transaction. Then, at the timing of the reception of the accounting event from the corresponding self-service POS terminal 1, the notification of the detection of the notification behavior of two or more kinds of the notification behavior items is performed on the condition that the notification flag is "1". Therefore, compared with the first embodiment in which the notification is performed at the timing of the detection of the notification behavior of at least two or more kinds of the notification behavior items, since the frequency of the notification is only once, it is possible to further reduce the risk of the false detection notification to the purchaser. In addition, since the notification is performed after the completion of the product registration, it does not hinder the operation of the product registration of the customer who is not accustomed to the operation of the self-service POS terminal 1. Therefore, it is possible to shorten the time required for the product registration. On the other hand, the detection terminal 3 performs the notification to the monitoring terminal 4 each time it detects the notification behavior identified by the notification behavior item. Therefore, it is effective in preventing or suppressing the fraudulent behavior.​​

[0183] [Third Embodiment]

[0184] Next, the third embodiment in which the information processing apparatus functions to detect the terminal 3 will be described. Figures 18 to 20

[0185] Figure 18 is a block diagram showing the main circuit configuration of the terminal 3 in the third embodiment. The same symbols are attached to the parts common to the block diagram of the terminal 3 in the first embodiment shown in Figure 4

[0186] As shown in Figure 4 Figure 18 As is clear from a comparison with Figure 19 , in the third embodiment, a region of the combination list 334 is added to the storage region of the auxiliary storage device 33. As shown in

[0187] Here, the number of the notification conditions is arbitrary. One kind of condition can be set in the combination list 334, or four or more kinds of conditions can be set in the combination list 334. Further, the combination of the first detection flag and the second detection flag corresponding to one condition is also arbitrary. Further, only the first detection flag can be set without setting the second detection flag.

[0188] Incidentally, in Figure 19 , in association with the notification condition A, the detection flag Fa of the notification behavior item "scan omission" is set as the first detection flag, and the detection flag Fd of the notification behavior item "cart lower goods error" is set as the second detection flag. Further, in association with the notification condition B, the detection flag Fb of the notification behavior item "weight error" is set as the first detection flag, and the detection flag Fd of the notification behavior item "cart lower goods error" is set as the second detection flag. On the other hand, with respect to the notification condition C, only the detection flag Fc of the notification behavior item "high-priced goods error" is set as the first detection flag, and no second detection flag is set.

[0189] As shown in Figure 18 ​​​As shown, the processor 31 of the detection terminal 3 having such a combination list 334 has a function as a third notification section 315 in addition to the detection section 311, the acquisition section 312, and the second notification section 134. The third notification section 315 is a function of notifying the self- checkout POS terminal 1 that the combination of the kinds acquired by the acquisition section 312 satisfies a predetermined condition in a transaction. That is, when the combination of the kinds acquired by the acquisition section 312 satisfies the combination of the first detection flag and the second detection flag set in the combination list 334, the third notification section 315 notifies the self- checkout POS terminal 1.

[0190] Specifically, when the notification behavior of the notification behavior item "scanning omission" and the notification behavior of the notification behavior item "error of goods under cart" are detected in a transaction, condition A is satisfied. Therefore, the third notification section 315 notifies the self- checkout POS terminal 1. Also, when the notification behavior of the notification behavior item "error of weight" and the notification behavior of the notification behavior item "error of goods under cart" are detected in a transaction, condition B is satisfied. Therefore, the third notification section 315 notifies the self- checkout POS terminal 1. On the other hand, when the notification behavior of the notification behavior item "error of high-priced goods" is detected in a transaction, only this satisfies condition C. Therefore, the third notification section 315 notifies the self- checkout POS terminal 1.

[0191] Figure 20 is a flowchart showing the main steps of the information processing performed by the processor 31 of the detection terminal 3 in the third embodiment. The portions common to the flowchart of the first embodiment are given the same symbols. Figure 7 The portions common to the flowchart of the first embodiment are given the same symbols.

[0192] As shown in Figure 7 In contrast to Figure 20 The third embodiment differs from the first embodiment in the processing after the detection flag of the detected notification behavior item is updated to "1" in ACT 111. That is, when the processor 31 updates the detection flag of the detected notification behavior item to "1" in ACT 111, it proceeds to ACT 131. In ACT 131, the processor 31 searches for the notification condition set in the combination list 334 in accordance with the detection flag of the notification list 331. Specifically, the processor 31 searches for the first detection flag and the second detection flag for each notification condition. For the notification condition for which the second detection flag is not set (for example, condition C), only the first detection flag is searched for.

[0193] The processor 31 determines whether the condition is satisfied as ACT132. The processor 31 determines that the condition is satisfied when both the first detection flag and the second detection flag are "1". With respect to the notification condition for which the second detection flag is not set, the processor 31 determines that the condition is satisfied when the first detection flag is "1". When the condition is not satisfied, the processor 31 returns to the waiting for acceptance state of ACT101 and ACT102.

[0194] When the condition is satisfied, the processor 31 proceeds to ACT133. The processor 31 notifies the purchaser as ACT133. That is, the processor 31 transmits a notification event for notifying that the notification behavior is detected to the corresponding self-service POS terminal 1. In the notification event, information of the notification behavior item indicating each notification behavior ID associated with the first detection flag and the second detection flag of the notification condition for which the condition is satisfied is included. In the case where the condition is satisfied only by the first detection flag, information of the notification behavior item indicating the notification behavior ID associated with the first detection flag is included in the notification event. The processor 31 which has performed the notification to the purchaser returns to the waiting for acceptance state of ACT101 and ACT102.

[0195] Here, the processor 31 realizes the function of the third notification section 315 through the processes of ACT131 to ACT133.

[0196] In the third embodiment having such a configuration, in one transaction, when the combination of the notification behavior items of which the notification behavior is detected satisfies the combination condition of the first detection flag and the second detection flag set in the combination list 334, the detection terminal 3 notifies the corresponding self-service POS terminal 1. Therefore, in the third embodiment, since the frequency of the notification is reduced compared to the case where the notification is performed every time the irregular behavior of the notification behavior item is detected, it is possible to reduce the risk of the false detection notification to the purchaser.

[0197] In addition, in the third embodiment, it is possible to set the combination list 334 to use only the first detection flag without setting the second detection flag. Also, in the case where such use is adopted, the detection terminal 3 notifies the corresponding self-service POS terminal 1 at the stage of detecting the notification behavior of the notification behavior item corresponding to the first detection flag. Therefore, for example, in the case where the notification behavior which causes significant damage to the store such as "high-priced goods error" is detected, it is possible to set to perform the notification even if other notification behaviors are not detected. As a result, it is possible to reliably suppress the irregular behavior which causes significant damage to the store.

[0198] Note that, in the third embodiment, it is also possible to notify the self-service POS terminal 1 according to the checkout instruction after the notification condition is satisfied as in the second embodiment.

[0199] [Other Embodiments]

[0200] In the first embodiment, the case where the notification section 313 notifies of two or more kinds of detection marks being "1" in a transaction is exemplified. In this regard, it is also possible to not perform notification at the stage where two kinds of detection marks are "1", and to perform notification in the case where three or more kinds of detection marks are "1". That is, it is also possible to set the threshold value N, which is the criterion for determining whether or not to notify the self-service POS terminal 1 of the notification behavior, to "3" or a value of more than "3".

[0201] In the third embodiment, notification is performed in the case where the combination of detection marks being "1" coincides with the combination of conditions set in the combination list 334. In this regard, for example, it is also possible to perform notification in the case where the notification behavior corresponding to the first detection mark and the second detection mark is detected for a set number of times or more, respectively.

[0202] In the above-described embodiments, the self-service POS terminal 1 sets a part of the registration screen SCa as the text area ARb and the camera image area ARc. In this regard, as shown in FIG. 9, the purchaser display 8 is provided on the self-service POS terminal 1. The purchaser display 8 is arranged, for example, on the left side of the touch panel 105 that displays the registration screen SC and the like. Note that the position of the purchaser display 8 is not limited to the position shown in FIG. 9. It can be arranged anywhere as long as it is a position that the purchaser can confirm. Figure 21 Figure 21 As shown in FIG. 10, the self-service POS terminal 1 divides the screen SCd of the purchaser display 8 into the text area ARb and the camera image area ARc. Also, as shown in the screen SCe of this embodiment, when a notification event is received from the detection terminal 3, the text "Have you missed any items?", which is the text indicating the notification behavior of "scanning omission", the text indicating the notification behavior of the notification behavior item "error in items under the cart", and the like are displayed in the text area ARb. By thus providing the purchaser display 8 on the self-service POS terminal 1, the purchaser can more accurately recognize the notification. In addition, the registration list area ARa can be made larger in the registration screen SCa of the touch panel 105.

[0203] As shown in FIG. 10, the self-service POS terminal 1 divides the screen SCd of the purchaser display 8 into the text area ARb and the camera image area ARc. Also, as shown in the screen SCe of this embodiment, when a notification event is received from the detection terminal 3, the text "Have you missed any items?", which is the text indicating the notification behavior of "scanning omission", the text indicating the notification behavior of the notification behavior item "error in items under the cart", and the like are displayed in the text area ARb. By thus providing the purchaser display 8 on the self-service POS terminal 1, the purchaser can more accurately recognize the notification. In addition, the registration list area ARa can be made larger in the registration screen SCa of the touch panel 105. Figure 22 Figure 22

[0204] ​​​In the above-described embodiments, as one mode of the information processing apparatus capable of reducing the risk of false detection notification to the purchaser and effectively preventing or suppressing the effective fraudulent behavior, the detection terminal 3 is exemplified. The information processing apparatus is not limited to the detection terminal 3. For example, the functions of the detection section 311, the acquisition section 312, the notification section 313, and the second notification section 314 explained in the first embodiment can also be provided by other apparatuses such as the self-checkout POS terminal 1, the camera 2, the monitoring terminal 4, or the recording apparatus 5, so that they function as the information processing apparatus, respectively.

[0205] Alternatively, not all of the detection terminal 3 has each function, but the information processing system can be realized by causing the self-checkout POS terminal 1, the camera 2, the monitoring terminal 4, or the recording apparatus 5, and the like to have a part of the functions. For example, in the first embodiment, the detection terminal 3 has the function as the detection section 311. On the other hand, the functions of the acquisition section 312, the notification section 313, and the second notification section 314 are provided by the self-checkout POS terminal 1. In addition, the self-checkout POS terminal 1 has the notification list 331. According to this configuration, when the detection terminal 3 detects the behavior of the purchaser for which the notification is required, that is, the notification behavior, with respect to the self-checkout POS terminal 1, the information is output to the self-checkout POS terminal 1. The self-checkout POS terminal 1 acquires the kind of the notification behavior from the information and notifies the monitoring terminal 4 at the point in time. In addition, the self-checkout POS terminal 1, when acquiring the information of the notification behavior, specifies the kind thereof and sets the detection flag of the notification list 331 to "1". Also, in one transaction, in the case where the detection flags of the plurality of kinds of the notification behavior are "1", the notification is performed, for example, by pop-up displaying that the notification behavior is detected in the touch panel 105. Even with such a configuration, the effect of reducing the risk of false detection notification to the purchaser and effectively preventing or suppressing the effective fraudulent behavior can be achieved.

[0206] In the above-described embodiments, as shown in Figure 1 , the detection terminal 3 to which the information processing apparatus is applied is provided for each of the cash register systems RS. In this regard, as shown in Figure 23 , the detection terminal 3 is excluded from the cash register system RS, and instead, the detection server 7 is connected to the communication network 6, and a self-checkout system SYS is configured. The detection server 7 is a computer configured to realize the functions of the detection terminal 3 in each of the cash register systems RS. With such a configuration, the same effects as the first or second embodiment can be achieved.

[0207] Of course, the type of the reporting behavior detected by the detection section 311 is not limited to the five items of the reporting behavior items "scan omission", "weight error", "high-priced goods error", "goods under cart error", and "purchase quantity: large". For example, when the behavior of performing bagging without performing a selection operation in the touch panel 105 on a product to which a bar code is not attached is detected, the reporting behavior of the reporting behavior item "error of goods without bar code" can also be detected. For example, when the behavior of touching the touch button of [check out] with a product remaining on the basket table 102 is detected, the reporting behavior of the reporting behavior item "error of registration of omitted goods" can also be detected.

[0208] Furthermore, although several embodiments of the present application have been described, these embodiments are presented by way of example only and are not intended to limit the scope of the application. These novel embodiments can be carried out in various other forms, and various omissions, substitutions and changes can be made without departing from the scope of the application. These embodiments and their modifications are included within the scope of the application, and are included within the scope of the application and its equivalents as recited in the claims.

Claims

1. An information processing apparatus, characterized by, comprises: a detection section that detects a behavior of a purchaser that requires notification to a transaction processing device; an acquisition section that acquires a kind of the behavior that requires the notification detected by the detection section; and a notification section that, in one transaction, makes a notification when a plurality of kinds of the behavior that requires the notification is acquired by the acquisition section.

2. The information processing device according to claim 1, wherein the notification section makes the notification to the transaction processing device of the purchaser that makes the plurality of kinds of the behavior that requires the notification.

3. The information processing device according to claim 2, wherein the notification section makes the notification at a point in time at which the plurality of kinds of the behavior that requires the notification is acquired.

4. The information processing device according to claim 2, wherein the notification section makes the notification at a point in time at which a checkout instruction of the transaction processing device by the purchaser is accepted. further comprises:

5. The information processing apparatus according to any one of claims 1 to 4, wherein a second notification section that makes a notification to a terminal for a monitor at a point in time at which the behavior that requires the notification is detected by the detection section. comprises:

6. An information processing apparatus, characterized by comprising: a detection section that detects a behavior of a purchaser that requires notification to a transaction processing device; an acquisition section that acquires a kind of the behavior that requires the notification detected by the detection section; and a third notification section that, in one transaction, makes a notification when a combination of the kinds acquired by the acquisition section satisfies a predetermined condition.

7. The information processing device according to claim 1 or 6, wherein the detection section detects the behavior that requires the notification in categories based on a first event that is recognized based on an output of a sensor that detects an action of the purchaser and a second event that indicates a content of the action of the purchaser that is notified by the transaction processing device.

8. The information processing device according to claim 7, wherein the first event is recognized by an image analysis engine based on an output of a camera as the sensor.

9. A storage medium storing a program that causes a computer of an information processing device to function as: a detection section that detects a behavior of a purchaser that requires notification to a transaction processing device; an acquisition section that acquires a kind of the behavior that requires the notification detected by the detection section; and a notification section that, in one transaction, makes a notification when a plurality of kinds of the behavior that requires the notification is acquired by the acquisition section. comprises: an output section that outputs information required to detect a behavior of a purchaser that requires notification to a transaction processing device; 10. An information processing system, characterized in that: a detection section that detects the behavior that requires the notification of the purchaser based on the information output by the output section; an acquisition section that acquires a kind of the behavior that requires the notification detected by the detection section; and a notification section that, in one transaction, makes a notification when a plurality of kinds of the behavior that requires the notification is acquired by the acquisition section. ​ ​ ​

Images