Monitoring devices

Abstract

Improve monitoring operations. [Solution] A monitoring device in a system including a plurality of sales data processing devices operated by customers and a monitoring device operated by a store employee, comprising acquisition means for acquiring occurrence information of events that occur in each of the sales data processing devices, and display means for displaying the status of each of the sales data processing devices, wherein if the event obtained from the occurrence information of one of the sales data processing devices corresponds to a predetermined specific event, the display means displays the specific event and related product information as the status of the sales data processing device in a predetermined area, and does not display the status of the sales data processing device in the predetermined area if the event obtained from the occurrence information of one of the sales data processing devices does not correspond to the specific event.

Description

Technical Field

[0001] The present invention relates to a monitoring device.

Background Art

[0002] A technique has been proposed to display the same image as the image displayed on the display of a device operated by a customer on a monitoring computer (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, there is room for improvement in monitoring operations.

[0005] The present invention has been made in view of such circumstances, and an object thereof is to provide a technique for improving monitoring operations.

Means for Solving the Problems

[0006] One embodiment for solving the above-mentioned problems is a monitoring device in a system including a plurality of sales data processing devices operated by customers and a monitoring device operated by a store employee, the monitoring device comprising: acquisition means for acquiring occurrence information of events that occur in each of the sales data processing devices; and display means for displaying the status of each of the sales data processing devices, wherein the display means displays the specific event and related product information as the status of the sales data processing device in a predetermined area when the event obtained from the occurrence information of one of the sales data processing devices corresponds to a predetermined specific event, and does not display the status of the sales data processing device in the predetermined area when the event obtained from the occurrence information of one of the sales data processing devices does not correspond to the specific event. [Brief explanation of the drawing]

[0007] [Figure 1] This is an example of the configuration of the sales system 1 according to the embodiment. [Figure 2] This is an example of the appearance of the registration and settlement device 10. [Figure 3] This is an example of the display of the transaction status management device 60. [Figure 4] This is another example of the first notification information H1 and the second notification information H2. [Figure 5] This is an explanatory diagram illustrating the movement between devices. [Figure 6] This is an explanatory diagram illustrating the movement between devices. [Figure 7] This is an explanatory diagram illustrating the movement between devices. [Figure 8] This is an explanatory diagram illustrating the movement between devices. [Figure 9] This is an explanatory diagram illustrating the movement between devices. [Figure 10] This is a flowchart illustrating an example of the operation of the registration and settlement device 10. [Figure 11] This is a flowchart illustrating an example of the operation of the transaction status management device 60. [Figure 12] This is an explanatory diagram illustrating other operations of the transaction status management device 60. [Figure 13] This is an explanatory diagram illustrating other operations of the transaction status management device 60. [Figure 14] This flowchart shows an example of another operation of the transaction status management device 60. [Modes for carrying out the invention]

[0008] Figure 1 shows an example configuration of a sales system 1 according to an embodiment of the present invention. The sales system 1 can be introduced in, for example, supermarkets, convenience stores, drugstores, home centers, consumer electronics retailers, etc. As shown in Figure 1, the sales system 1 includes a plurality of registration and settlement devices 10 (registration and settlement device 10-1, registration and settlement device 10-2, registration and settlement device 10-N), a transaction status management device 60, a store controller 70, and a headquarters server 80. The registration and settlement devices 10, the transaction status management device 60, and the store controller 70 are installed inside the store. These are connected so that they can communicate via LAN (which may be wired or wireless). The headquarters server 80 is installed outside the store (for example, at the head office or a data center). The devices installed inside the store (registration and settlement devices 10, transaction status management device 60, store controller 70) and the devices installed outside the store (headquarters server 80) can communicate (either directly or via the store controller 70).

[0009] The registration and payment device 10 is a so-called fully self-service register (fully self-service device) that registers products based on customer operations and settles payments based on customer operations. In other words, the registration and payment device 10 performs a registration process to register products and a settlement process to settle payments for the registered products, but both processes are basically performed based on the customer's own operations. In this embodiment, the number of registration and payment devices is assumed to be 8.

[0010] The transaction status management device 60 is a device used by store clerks. The transaction status management device 60 manages other devices (such as the transaction status of other devices). For example, the transaction status management device 60 monitors and controls the registration settlement device 10 (such as the operation status, processing status, and operation status of the registration settlement device 10). In addition, the transaction status management device 60 monitors the customers who operate the registration settlement device 10 (such as the operation content and actions of the customers).

[0011] The transaction status management device 60 includes at least a CPU, a storage unit, a display unit, an operation unit, and a communication unit. The operation unit may be a keyboard, a mouse, etc. The display unit may be a touch display (that is, it may also serve as the operation unit). When the transaction status management device 60 includes a display unit (touch display) that also serves as the operation unit, it may not be necessary to include a keyboard, a mouse, etc.

[0012] The store controller 70 is a server responsible for information communication between devices installed inside the store and devices installed outside the store. The store controller 70 includes at least a CPU, a storage unit, and a communication unit.

[0013] The head office server 80 is installed outside the store (for example, at the head office, data center, etc.). The head office server 80 includes at least a CPU, a storage unit, and a communication unit. Note that the head office server 80 may be a cloud server. The head office server 80 may be composed of multiple servers.

[0014] Each device (for example, the registration settlement device 10, the transaction status management device 60, etc.) can refer to the product master (a file storing product identification information, product name, selling price, etc.) stored in its own device (or in another device). That is, if each device acquires the product identification information, it can refer to the product master and acquire the product name and selling price of the product identified by the product identification information.

[0015] A cloud server may be installed outside the store separately from the head office server 80. Hereinafter, for the sake of distinction, the cloud server when realized as the head office server 80 is referred to as the cloud server 80, and the cloud server separate from the head office server 80 may be referred to as the cloud server 81.

[0016] Figure 2 is an external view example of the registration and settlement device 10. The registration and settlement device 10 includes a main body part 11, an upstream counter 12, and a downstream counter 13. The upstream counter 12 is a counter provided on the upstream side of the customer flow line rather than the main body part 11. On the upstream counter 12, for example, products before registration, shopping baskets containing products before registration, etc. are placed. The downstream counter 13 is a counter provided on the downstream side of the customer flow line rather than the main body part 11. On the downstream counter 13, for example, products after registration, shopping bags (personal bags, paid cashier bags, etc.) containing products after registration, etc. are placed. Note that the upstream counter 12 (similarly for the downstream counter 13) may be a separate body attached to the registration and settlement device 10 (main body part 11).

[0017] A cash settlement part (change machine) 106 is provided in the lower part of the main body part 11. In the upper part of the main body part 11, a printing part 108, a scanner part 104, a display part 103, a non-cash settlement part (settlement terminal) 105, an imaging part (camera) 110, and a support pole part 111 are provided. On the support pole part 111, a light emitting part 112, a monitoring display part 113, and a detection part (sensor part) 120 are provided in order from the top.

[0018] Although some parts have already been described in Figure 2, the registration and settlement device 10 includes a CPU 101 (not shown), a storage part 102 (not shown), a display part 103, a scanner part 104, a non-cash settlement part 105, a cash settlement part 106, a communication part 107 (not shown), a printing part 108, an audio output part 109 (not shown), an imaging part 110, a light emitting part 112, a monitoring display part 113, and a detection part 120. These can communicate with each other via a bus. Note that the registration and settlement device 10 may further include an audio input part (microphone).

[0019] The CPU 101 is a central processing unit that controls the operation of the registration and settlement device 10 by reading and executing programs stored in the memory unit 102. For example, the CPU 101 controls the entire transaction from product registration to settlement (e.g., control the display of the display unit 103, control the communication of the communication unit 107, etc.). In other words, the CPU 101 executes (proceeds) the registration process and the settlement process.

[0020] The memory unit 102 is a general term for one or more different memory components (for example, memory or storage devices such as RAM, ROM, hard disk, SSD (Solid State Drive), etc.). The memory unit 102 stores various types of information.

[0021] The display unit 103 is a touch display that displays various information to the operator (customer) (for example, screens for registration processing, screens for settlement processing), and also accepts the operator's input.

[0022] The scanner unit 104 optically reads various types of information. For example, the scanner unit 104 scans a code attached to a product and reads product identification information (e.g., a JAN code). In other words, the scanner unit 104 obtains product identification information from a code attached to a product. The scanner unit 104 may also capture an image of the code (the area containing the code) attached to the product using a built-in camera (scanner camera) and read the code.

[0023] The registration and settlement device 10 stores the product identification information acquired by the scanner unit 104 in the storage unit 102. In addition to or instead of storing the product identification information acquired by the scanner unit 104 in the storage unit 102, the registration and settlement device 10 may transmit it to another device (for example, the transaction status management device 60).

[0024] The non-cash payment unit 105 is a payment mechanism that uses non-cash payment methods (e.g., credit card payment, electronic money payment, etc.). The non-cash payment unit 105 may be a separate payment terminal from the registration and settlement device 10. The payment terminal 105 may include, for example, a reading unit, a communication unit (a communication unit that communicates with the registration and settlement device 10, a communication unit that communicates with an external server such as a credit server that performs credit card payments), an operation unit, and a display unit. The cash payment unit 106 is a payment mechanism that uses cash. The cash payment unit 106 has a slot for inserting banknotes and coins, and a slot for dispensing banknotes and coins. The cash payment unit 106 detects the currency inserted into the slot, identifies the number of bills of each denomination inserted, calculates the amount inserted, calculates the change amount which is the difference between the amount inserted and the purchase amount, and dispenses the change from the dispensing slot. The insertion of banknotes and coins and the removal of change may be detected by sensors.

[0025] The communication unit 107 transmits and receives information with other devices (for example, the transaction status management device 60, the store controller 70, etc.).

[0026] The printing unit 108 prints and issues various media (receipts, coupons). The removal of media may be detected by a sensor. The audio output unit 109 outputs audio (e.g., confirmation sound, warning sound, voice guidance, etc.).

[0027] The imaging unit 110 images the area below (from the upstream counter 12 to the front of the main unit 11 to the downstream counter 13). In other words, the imaging unit 110 can image actions such as the customer taking items out of the shopping basket, the customer moving items, the customer scanning items, and the operation of inserting cash into the cash settlement unit 106 (or withdrawing cash from the cash settlement unit 106). The images captured by the imaging unit 110 may be still images or moving images.

[0028] The registration and settlement device 10 stores the captured images (still images, moving images) captured by the imaging unit 110 in the storage unit 102. In addition to or instead of storing the captured images captured by the imaging unit 110 in the storage unit 102, the registration and settlement device 10 may transmit them to another device (for example, the transaction status management device 60).

[0029] The light-emitting unit 112 notifies various information by emitting light. For example, the light-emitting unit 112 may notify that a store employee is being called. For example, the light-emitting unit 112 may also notify that the registration is fraudulent (described later).

[0030] The monitoring display unit 113 is, for example, a liquid crystal display that displays various information to the surroundings (the operator, other customers, and store staff). For example, the monitoring display unit 113 may display the device number when in standby mode (waiting for customers) and display the image captured by the imaging unit 110 (moving or still image) during processing. The device number is indicated on both sides and the back of the monitoring display unit 113.

[0031] The detection unit 120 detects the presence of a person using a human presence sensor (for example, a sensor using infrared light). The detection unit 120 may be equipped with multiple human presence sensors with different detection positions. For example, the detection unit 120 may consist of a first sensor that detects a person in a direction looking down from the front of the upstream counter 12 (i.e., detecting the presence of a person in the front of the upstream counter 12), a second sensor that detects a person in a direction looking down from the front of the main unit 11 (i.e., detecting the presence of a person in the front of the main unit 11), and a third sensor that detects a person in a direction looking down from the front of the downstream counter 13 (i.e., detecting the presence of a person in the front of the downstream counter 13).

[0032] (Image processing) The registration and settlement device 10 (CPU 101) is equipped with an image processing function (image recognition function). For example, the registration and settlement device 10 is equipped with an object recognition function (object determination function) that recognizes objects in the image captured by the imaging unit 110. In addition, the registration and settlement device 10 is equipped with the following functions in relation to the object recognition function.

[0033] The registration and payment device 10 includes a product retrieval operation recognition function that recognizes, based on the captured image, the product retrieval operation performed by a customer when they take a product from a shopping basket placed on the upstream counter 12. The product retrieval operation recognition function may also recognize that a product retrieval operation has occurred when a new object (a moving or enlarging object) is recognized from the shopping basket placed on the upstream counter 12.

[0034] The registration and payment device 10 includes a product movement recognition function that recognizes, based on captured images, a product movement action performed by a customer to move products taken out of a shopping basket to the front of the main unit 11. The product movement recognition function may also be a function that recognizes a product movement action when a new object appears on the front (center) of the main unit 11.

[0035] The registration and settlement device 10 is equipped with a product appearance recognition function that recognizes the appearance (shape) of the product to be registered by the customer (the product to be purchased by the customer) based on the captured image. The product appearance recognition function may, for example, be a function that recognizes the appearance of an object that has newly appeared on the front of the main unit 11 (the product whose barcode is to be scanned or the product whose barcode has been scanned).

[0036] Typically, a customer removes an item from their shopping basket, places it in front of the main unit 11, and scans the barcode of the item they have moved. In other words, in this sequence of events, the item removed from the shopping basket (the item newly appearing in front of the main unit 11) and the item whose barcode is scanned are usually the same item.

[0037] (Monitoring for fraudulent registrations) Sales System 1 monitors for fraudulent registrations. Monitoring for fraudulent registrations includes determining whether a registration is fraudulent and issuing a notification (fraud notification) if it is determined to be fraudulent. Fraudulent registrations include scanning and registering the barcode of a product different from the actual product purchased by the customer (the product that should be registered). Scanning and registering the barcode of a product different from the actual product is an example where, when the actual product is a product that packages multiple items together (hereinafter sometimes referred to as a "multi-pack product"), the barcode of the individual products that make up the multi-pack product (hereinafter sometimes referred to as "single products") is scanned and registered instead of scanning the barcode of the multi-pack product (for example, when purchasing a 6-pack of beer, the barcode of the individual products that make up the 6-pack is scanned and registered instead of scanning the barcode of the 6-pack).

[0038] Figure 3 shows an example of the display of the transaction status management device 60. The transaction status management device 60 displays a monitoring screen (management screen) as shown in Figure 3 on its display unit. As shown in Figure 3, the monitoring screen is provided with a first display area 610 and a second display area 650.

[0039] The first display area 610 is an area for monitoring the eight registration and settlement devices 10. The first display area 610 displays the status of each registration and settlement device 10, including specific events that require notification to store staff (for example, calling for store staff, registering age-verified items, registering discounted items, registering identical items, no items sold, customer leaving, etc.). In other words, the transaction status management device 60 monitors all registration and settlement devices 10, and when a specific event requiring notification to store staff occurs, it displays the specific event that occurred in each registration and settlement device 10 in the first display area 610.

[0040] The second display area 650 displays the status of the registration and settlement device 10 where certain events requiring notification to store staff have occurred (for example, calling a store staff member, registering age-verified items, registering discounted items, registering identical items, items not being sold, customers leaving, etc.), specifically those events requiring the attention of store staff. In other words, the transaction status management device 60 targets the registration and settlement device 10 where the above-mentioned events have occurred and displays those events in the second display area 650.

[0041] (First News H1, Second News H2) The status (specific event) of the registered payment device 10 reported in the first display area 610 is referred to as the first notification information H1. The status of the registered payment device 10-N reported in the first display area 610 is referred to as the first notification information H1-N. For example, the status of the registered payment device 10-1 reported in the first display area 610 is referred to as the first notification information H1-1, and the status of the registered payment device 10-2 reported in the first display area 610 is referred to as the first notification information H1-2 (and so on).

[0042] The status of the registered payment device 10 (a subset of specific events) reported in the second display area 650 is referred to as the second notification information H2. The status of the registered payment device 10-N reported in the second display area 650 is referred to as the second notification information H2-N. For example, the status of the registered payment device 10-1 reported in the second display area 650 is referred to as the second notification information H2-1, and the status of the registered payment device 10-2 reported in the second display area 650 is referred to as the second notification information H2-2 (and so on).

[0043] In the example shown in Figure 3, the transaction status management device 60 displays eight first notification information H1 (first notification information H1-1 to first notification information H1-8) corresponding to each of the registered settlement devices 10 (registered settlement devices 10-1 to registered settlement devices 10-8) in the first display area 610, and displays two second notification information H1 (second notification information H2-2 and second notification information H2-4) corresponding to each of the registered settlement devices 10 (registered settlement devices 10-2 and registered settlement devices 10-4) in the second display area 650.

[0044] (First display area 610) The first notification information H1 in the first display area 610 includes the machine number, status, registered points, and total amount. In other words, the transaction status management device 60 displays the machine number, status, registered points, and total amount as the first notification information H1.

[0045] The unit number is information that identifies each registration and settlement device 10. In this embodiment, the unit number of registration and settlement device 10-N is "N". The status is the current state (status) of the registration and settlement device 10, such as registering, settling, standby, or under maintenance. The registered points are the total number of registered items. The total amount is the total amount of registered items.

[0046] In the example shown in Figure 3, for example, the transaction status management device 60 displays the following as the first notification information H1-1 for the registration settlement device 10-1: machine number "1", status "Settlement in progress", registered points "3", and total amount "¥1,051". The transaction status management device 60 also displays the following as the first notification information H1-2 for the registration settlement device 10-2: machine number "2", status "Registering in progress", registered points "4", and total amount "¥750".

[0047] The first notification information H1 further includes various icons 620 corresponding to the information that needs to be notified to the store staff, if there is any other information that needs to be notified. In other words, the transaction status management device 60 may display various icons 620 in addition to the machine number, status, registered points, and total amount as the first notification information H1.

[0048] In the example shown in Figure 3, the transaction status management device 60 displays an age verification icon 620b as the first notification information H1-2 for the registration and settlement device 10-2. The transaction status management device 60 displays a staff call icon 620a as the first notification information H1-4 for the registration and settlement device 10-4. The transaction status management device 60 displays a warning icon 620c as the first notification information H1-5 for the registration and settlement device 10-5. The transaction status management device 60 displays a warning icon 620c as the first notification information H1-6 for the registration and settlement device 10-6.

[0049] The first notification information H1 may include additional text for icon 620 if it includes icon 620 (i.e., if there is information that needs to be notified to the store staff). In other words, if the transaction status management device 60 displays icon 620 as the first notification information H1, it may display additional text for icon 620 as the first notification information H1.

[0050] In the example shown in Figure 3, the transaction status management device 60 displays the additional text "Age Verification" for the age verification icon 620b as the first notification information H1-2 for the registration and settlement device 10-2. The transaction status management device 60 displays the additional text "Call a staff member" for the staff member call icon 620a as the first notification information H1-4 for the registration and settlement device 10-4.

[0051] The first notification information H1 may include product information related to the notification if it includes icon 620 (i.e., if there is information that needs to be notified to the store staff). In other words, if the transaction status management device 60 displays icon 620 as the first notification information H1, it may display product information, etc., as the first notification information H1.

[0052] In the example shown in Figure 3, the transaction status management device 60 displays "Registered Product" and "XX Beer 6-pack" as the first notification information H1-2 for the registration and settlement device 10-2. Note that the "Registered Product" for age verification products is the scanned product. The transaction status management device 60 displays "Registered Product," "XX Dressing," and "50 Yen Discount" as the first notification information H1-5 for the registration and settlement device 10-5. The transaction status management device 60 displays "Registered Product," "XX Bread," and "Same Quantity: 3" as the first notification information H1-6 for the registration and settlement device 10-6.

[0053] "XX Beer 6-pack," "XX Dressing," and "XX Bread" are product information. "50 Yen Discount" is discount information, but it can also be referred to as product information, including discount information. "Same Quantity: 3" is information about the number of identical items, but it can also be referred to as product information, including information about the number of identical items.

[0054] Although icon 620a is displayed in the first notification information H1-4 of the registration and settlement device 10-4, the transaction status management device 60 does not display product information because it is not a notification related to products such as age verification products, discounted products, or registration of identical products. Also, since icon 620 is not displayed in the first notification information H1-1 of the registration and settlement device 10-1 (and similarly in the first notification information H1-3 of the registration and settlement device 10-3, etc.), the transaction status management device 60 does not display product information.

[0055] The first notification information H1 may include a message related to icon 620 if it includes icon 620 (i.e., if there is information that needs to be notified to the store staff). In other words, if the transaction status management device 60 displays icon 620 as the first notification information H1, it may display a message related to icon 620 as the first notification information H1.

[0056] In the example shown in Figure 3, the transaction status management device 60 displays "Change is finished" as the first notification information H1-4 of the registration and settlement device 10-4, in relation to the staff call icon 620a. The transaction status management device 60 displays "Discounted item has been registered" as the first notification information H1-5 of the registration and settlement device 10-5, in relation to the warning icon 620c. The transaction status management device 60 displays "The same item has been registered" as the first notification information H1-6 of the registration and settlement device 10-6, in relation to the warning icon 620c.

[0057] The transaction status management device 60 displays the menu button 630 as an operable general button that can be operated at all times. In the example shown in Figure 3, the transaction status management device 60 displays the menu button 630 as operable below each of the first notification information H1 (first notification information H1-1 to first notification information H1-8). The menu button 630 includes the notification history button 630a (details described later), the transaction details button 630b (details described later), and the other button 630c (details described later).

[0058] The transaction status management device 60 displays the Age OK button 640 as an operable button that can be operated in specific cases. In the example shown in Figure 3, the transaction status management device 60 displays the age verification icon 620b as the first notification information H1-2, and when the age verification icon 620b is displayed, the Age OK button 640 is displayed as operable.

[0059] (Second display area 650) The second notification information H2 in the second display area 650 includes the machine number and status. In other words, the transaction status management device 60 displays the machine number and status as the second notification information H2.

[0060] In the example shown in Figure 3, for instance, the transaction status management device 60 displays the machine number "2" and the status "Registering" as the second notification information H2-2 for the registration and settlement device 10-2. The transaction status management device 60 also displays the machine number "4" and the status "Registering" as the second notification information H2-4 for the registration and settlement device 10-4.

[0061] The second notification information H2 includes some icons 620. In other words, the transaction status management device 60 displays some icons 620 as the second notification information H2, in addition to the machine number and status.

[0062] In the example shown in Figure 3, the transaction status management device 60 displays the age verification icon 620b as the second notification information H2-2 for the registration and settlement device 10-2. The transaction status management device 60 displays the staff call icon 620a as the second notification information H2-4 for the registration and settlement device 10-4.

[0063] The second notification information H2 may include additional text for icon 620 if it includes icon 620. In other words, the transaction status management device 60 may display additional text for icon 620 as the second notification information H2.

[0064] In the example shown in Figure 3, the transaction status management device 60 displays the additional text "Age Verification" for the age verification icon 620b as the second notification information H2-2 for the registration and settlement device 10-2. The transaction status management device 60 displays the additional text "Call a staff member" for the staff member call icon 620a as the first notification information H2-4 for the registration and settlement device 10-4.

[0065] The second notification information H2 may include messages related to icon 620 if it includes icon 620. In other words, if the transaction status management device 60 displays icon 620 as the second notification information H2, it may display messages related to icon 620 as the second notification information H2.

[0066] In the example shown in Figure 3, the transaction status management device 60 displays "Change is finished" as the second notification information H2-4 of the registered settlement device 10-4, in relation to the staff call icon 620a.

[0067] The transaction status management device 60 displays the Age OK button 640 as an operable button that can be operated in specific cases. In the example shown in Figure 3, the transaction status management device 60 displays the Age Verification icon 620b as the second notification information H2-2, and when the Age Verification icon 620b is displayed, the Age OK button 640 is displayed as operable.

[0068] Furthermore, even if the second notification information H2 includes icon 620, it does not include product information. In other words, even if the transaction status management device 60 displays icon 620 as the second notification information H2, it does not display product information as the second notification information H2.

[0069] Furthermore, general buttons such as the menu button 630 are not displayed in the second display area 650.

[0070] The first notification information H1 and the second notification information H2 will be explained for each situation, including the content already explained in Figure 3. Figure 4 shows other examples of the first notification information H1 and the second notification information H2.

[0071] (If a staff member is called) When a customer requests a staff member from one of the registration and settlement devices 10, the transaction status management device 60 notifies the customer that a staff member has been requested from the registration and settlement device 10 in the first display area 610 and the second display area 650.

[0072] For example, if a staff member is called in the registration and settlement device 10-4, the transaction status management device 60 will display a staff member call icon 620a, the additional text "Staff member called," and the message "Change is finished" as the first notification information H1-4 in the first display area 610, as shown in Figure 3, and will display a staff member call icon 620a, the additional text "Staff member called," and the message "Change is finished" as the second notification information H2-4 in the second display area 650.

[0073] (If discounted items are registered) When a discounted item is registered in one of the registration and settlement devices 10, the transaction status management device 60 notifies the first display area 610 that a discounted item has been registered in the said registration and settlement device 10.

[0074] For example, if a discounted product is registered in the registration and settlement device 10-5, the transaction status management device 60 will display the first notification information H1-5 in the first display area 610 as the first notification information H1-5, including a caution icon 620c, product information ("Registered Product", "○○ Dressing", "50 Yen Discount"), and the message "A discounted product has been registered".

[0075] (If the same product has already been registered) If the same product is registered in one of the registration and settlement devices 10 (i.e., if the same product is registered in the same transaction), the transaction status management device 60 will notify the first display area 610 that the same product has been registered in the registration and settlement device 10.

[0076] For example, if the same product is registered in the registration and settlement device 10-6, the transaction status management device 60 will display the first notification information H1-6 in the first display area 610 as the first notification information H1-6, including a caution icon 620c, product information ("Registered product", "○○ bread", "Number of identical items: 3"), and the message "The same product has been registered".

[0077] (If a product is found to be unsold) If a missing item is detected in one of the registration and settlement devices 10, the transaction status management device 60 will notify the first display area 610 that a missing item has been detected in the registration and settlement device 10. The registration and settlement device 10 may, for example, use an image processing function to detect a missing item when an item moves from the upstream counter 12 to the downstream counter 13 without being scanned.

[0078] For example, if a missing item is detected in the registration and settlement device 10-8 (unlike the scene in Figure 3, the registration and settlement device 10-8 is in the process of registering an item), the transaction status management device 60 will display a warning icon 620c and missing item detection information "Missed item detected: 3 times" as the first notification information H1-8 in the first display area 610, as shown in Figure 4(A).

[0079] Furthermore, the transaction status management device 60 may display different displays depending on the number of false alarms. For example, if the number of false alarms detected is 3, the transaction status management device 60 may display the upper part (unit number and status) in the normal manner, as shown in Figure 4(A), and if the number of false alarms detected is 5, the upper part may be displayed in an emphasized manner (shaded in the figure), as shown in Figure 4(B).

[0080] (If a customer leaves the premises during a transaction) When the transaction status management device 60 detects that a customer has left a registration and settlement device 10, it notifies the first display area 610 and the second display area 650 that a customer has left the registration and settlement device 10. The registration and settlement device 10, for example, uses the detection unit 120 to detect when the presence of a person is not detected for a predetermined period of time (for example, 30 seconds) near the front of the upstream counter 12, the front of the main unit 11, or the front of the downstream counter 13 during a transaction (before processing is completed), which is considered a customer leaving during a transaction.

[0081] For example, if a customer leaves the register / settlement device 10-8 (unlike the scene in Figure 3, this is the register / settlement device 10-8 during registration), the transaction status management device 60 will display a departure icon 620d (departure icon 620d, with the additional text "departure") as the first notification information H1-8 in the first display area 610, as shown in Figure 4(C), and will display a departure icon 620d (departure icon 620d, with the additional text "departure") as the second notification information H2-8 in the second display area 650, as shown in Figure 4(D).

[0082] For example, if a customer leaves the register / settlement device 10-8 (unlike the scene in Figure 3, this is the register / settlement device 10-8 during settlement), the transaction status management device 60 will display a customer departure icon 620d and the additional text "Departure" as the first notification information H1-8 in the first display area 610, as shown in Figure 4(E), and will display a customer departure icon 620d and the additional text "Departure" as the second notification information H2-8 in the second display area 650, as shown in Figure 4(F).

[0083] (If beer, etc., is registered / if there is no fraudulent activity with 6-packs) When a beer or the like is registered in one of the registration and settlement devices 10, and there is no fraudulent activity involving 6-packs (fraudulent activity where the barcode of the individual beer or the like that makes up the 6-pack is scanned instead of the barcode of the 6-pack when it should be registered), the transaction status management device 60 notifies the registration and settlement device 10 that an age-verification product has been registered in the first display area 610 and the second display area 650, and also displays the age OK button 640 in an operable manner in the first display area 610 and the second display area 650.

[0084] For example, if beer or the like is registered in the registration and settlement device 10-2, and there is no fraudulent activity with the 6-pack, the transaction status management device 60 will, as shown in Figure 3, display an age verification icon 620b, etc. (age verification icon 620, additional text "Age Verification", product information "XX Beer 6-pack") as the first notification information H1-2 in the first display area 610, and will also display the age OK button 640 as the second notification information H2-2 in the second display area 650, and will also display the age verification icon 620b, etc. (age verification icon 620, additional text "Age Verification"), and will also display the age OK button 640 as the second notification information H2-2.

[0085] In other words, even if the transaction status management device 60 displays product information in the first display area 610, it does not display product information in the second display area 650. In the example in Figure 3, the product information in the first display area 610 is "XX Beer 6-pack," but if there is no fraud in the 6-pack, the product information may change to a single product (for example, "XX Beer").

[0086] (If beer or similar products are registered / if there is fraudulent activity with 6-packs) If a beer or similar product is registered in one of the registration and settlement devices 10, and if there is fraudulent activity involving 6-can packs (if it is determined that there is fraudulent activity involving 6-can packs), the transaction status management device 60 will notify the first display area 610 and the second display area 650 that an age-verification product has been registered in the registration and settlement device 10, along with the fact that fraudulent activity has been determined.

[0087] For example, if beer or the like is registered in the registration and settlement device 10-2, and there is fraud in the 6-pack, the transaction status management device 60 will display the age verification icon 620b etc. (age verification icon 620b, additional text "Age verification (fraudulent)", product information, message "Fraudulent activity has been detected") as the first notification information H1-2 in the first display area 610, as shown in Figure 4(G), and will display the age verification icon 620b etc. (age verification icon 620b, additional text "Age verification (fraudulent)", message "Fraudulent activity has been detected") as the second notification information H2-2 in the second display area 650, as shown in Figure 4(H).

[0088] In other words, even if the transaction status management device 60 displays product information in the first display area 610, it does not display product information in the second display area 650. Also, if there is no fraud in the 6-can pack, the Age OK button 640 is displayed as operable in the first display area 610, but if there is fraud in the 6-can pack, the Age OK button 640 is not displayed in the first display area 610. Note that if there is fraud in the 6-can pack, the product information will not be for a single product (for example, "XX Beer").

[0089] Figures 5 to 9 are explanatory diagrams illustrating the movement between devices. Figure 5 shows the movement between devices when a discounted product is registered. Figure 6 shows the movement between devices when the same product is registered. Figure 7 shows the movement between devices when a product is detected as unavailable. Figure 8 shows the movement between devices when a store clerk is called. Figure 9 shows the movement between devices when a customer leaves during a transaction.

[0090] As shown in Figure 5, the registration and settlement device 10 transmits the product identification information and discount information (information indicating a discount or reduction (e.g., 50 yen off, 10% off)) of the discounted product to the transaction status management device 60 (step S100). The registration and settlement device 10 may also obtain this information from a value reference code (a barcode or the like that codes the discount information) attached to the product as a discounted product. The transaction status management device 60 receives the product identification information, etc. (step S101) and displays in the first display area 610 that the registration and settlement device 10 has registered a discounted product (step S102).

[0091] For example, when a discounted item is registered in the registration and settlement device 10-5, the transaction status management device 60 displays a warning icon 620c, etc. (warning icon 620c, "Registered Item", "○○ Dressing", "50 Yen Discount", "Discounted Item Registered") as the first notification information H1-5 in the first display area 610, as shown in Figure 3.

[0092] As shown in Figure 6, the registration and settlement device 10 transmits product identification information to the transaction status management device 60 (step S110). The transaction status management device 60 receives the product identification information (step S111), and if it is the same product (if it is the same product as a product already registered in the transaction), it displays in the first display area 610 that the same product has been registered by the registration and settlement device 10 (step S112).

[0093] For example, if the same product is registered in the registration and settlement device 10-6, the transaction status management device 60 will display a warning icon 620c, etc. (warning icon 620c, "Registered Product", "○○ Bread", "Number of Identical Products: 3", "The same product has been registered") as the first notification information H1-6 in the first display area 610, as shown in Figure 3.

[0094] Whether or not the items are the same product may be determined by the registration and settlement device 10 or by the transaction status management device 60.

[0095] Furthermore, this embodiment notifies the user that the same product has been registered if a product that has already been registered in the transaction is registered, even if the same product is not registered consecutively. However, it is also possible to notify the user that the same product has been registered consecutively only when the same product is registered consecutively.

[0096] As shown in Figure 7, when the registration and settlement device 10 detects that a product has not been sold, it sends a notification of product failure (information indicating that product failure has been detected) to the transaction status management device 60 (step S120). The transaction status management device 60 receives the notification of product failure (step S121), and if it has done so a predetermined number of times (one or more times as predetermined), it displays in the first display area 610 that product failure has been detected by the registration and settlement device 10 (step S122).

[0097] For example, if the registration and settlement device 10-8 detects a missing item, the transaction status management device 60 displays a warning icon 620c (warning icon 620c, "missed item detected: 3 times") as the first notification information H1-8 in the first display area 610, as shown in Figure 4(A). Depending on the number of times a missing item has been detected, the transaction status management device 60 may change the display pattern, as shown in Figure 4(B).

[0098] As shown in Figure 8, when a staff member is requested by the registered payment device 10 (for example, when a customer presses the staff member request button, when the change or receipts run out (end of transaction), when the change overflows (full), etc.), the registered payment device 10 sends a staff member request notification to the transaction status management device 60 (step S130) and displays a staff member request screen (step S131). More specifically, the registered payment device 10 interrupts processing by, for example, displaying a staff member request screen as a pop-up in front of the screen being displayed as processing progresses. The transaction status management device 60 receives the staff member request notification (step S132) and displays in the first display area 610 and the second display area 650 that a staff member has been requested by the registered payment device 10 (step S133).

[0099] For example, if a staff member is called in the registration and settlement device 10-4, the transaction status management device 60 will display a staff member call icon 620a, etc. (staff member call icon 620a, additional text "Staff member called", "Change is finished") as the first notification information H1-4 in the first display area 610, as shown in Figure 3, and will display a staff member call icon 620a, etc. (staff member call icon 620a, additional text "Staff member called", "Change is finished") as the second notification information H2-4 in the second display area 650.

[0100] A store employee responds to a store employee call and rushes to the registered settlement device 10 that received the call. The registered settlement device 10 resumes processing (reopens the interruption) based on the response of the rushing store employee (response according to the situation of the call; for example, if it was the change end, the change is replenished) (step S134). The registered settlement device 10 sends a store employee response notification (information that the problem at the registered settlement device 10 has been resolved by a store employee) to the transaction status management device 60 (step S135). The transaction status management device 60 receives the store employee response notification (step S136) and clears the store employee call indications in the first display area 610 and the second display area 650 (step S137).

[0101] For example, as shown in Figure 3, when the transaction status management device 60 displays a staff call icon 620a, etc. as the first notification information H1-4 in the first display area 610 and a staff call icon 620a, etc. as the second notification information H2-4 in the second display area 650, and receives a staff call completion notification from the registration settlement device 10-4, it erases the staff call icon 620a, etc. displayed as the first notification information H1-4 in the first display area 610 and erases the staff call icon 620a, etc. displayed as the second notification information H2-4 in the second display area 650.

[0102] As shown in Figure 9, when the registration and settlement device 10 detects that a customer has left during a transaction, it sends a departure notification to the transaction status management device 60 (step S140) and displays a staff call screen (step S141). For example, the registration and settlement device 10 pops up the staff call screen in front of the screen that was being displayed as the processing progresses. The transaction status management device 60 receives the departure notification (step S142) and displays in the first display area 610 and the second display area 650 that a customer has left the registration and settlement device 10 (step S143).

[0103] For example, if a customer leaves the registration settlement device 10-8 during the registration process, the transaction status management device 60 displays a departure icon 620d, etc., as the first notification information H1-8 in the first display area 610, as shown in Figures 4(C) and (D), and displays a departure icon 620d, etc., as the second notification information H2-8 in the second display area 650. Furthermore, if a customer leaves the registration settlement device 10-8 during the settlement process, the transaction status management device 60 displays a departure icon 620d, etc., as the first notification information H1-8 in the first display area 610, as shown in Figures 4(E) and (F), and displays a departure icon 620d, etc., as the second notification information H2-8 in the second display area 650.

[0104] The store clerk rushes to the registration and settlement device 10 where the customer has left in order to deal with the customer leaving. The registration and settlement device 10 displays an operable screen (such as a screen where a new customer can start registration) based on the response of the store clerk who rushed to the scene (response according to the circumstances of the customer leaving) (step S144). The registration and settlement device 10 sends a notification that the store clerk has resolved the issue (information that the problem at the registration and settlement device 10 has been resolved by the store clerk) to the transaction status management device 60 (step S145). The transaction status management device 60 receives the notification that the store clerk has resolved the issue (step S146) and clears the indication that the customer has left from the first display area 610 and the second display area 650 (step S147). This is the same as when a store clerk is called.

[0105] The following describes the case where beer, an age-verification product, is registered. Figure 10 is a flowchart showing an example of the operation of the registration and settlement device 10. Figure 11 is a flowchart showing an example of the operation of the transaction status management device 60. In the explanation of the flowcharts in Figures 10 and 11, it is assumed that the customer scanned the barcode of a single can of beer or a 6-pack of beer, which is a multi-pack product.

[0106] (Flowchart in Figure 10) Step S1: The registration and payment device 10 acquires an image captured by the imaging unit 110 (an image capturing the customer's actions of taking items out of the shopping basket, moving items, scanning items, etc. In other words, an image capturing the item in question). The process then proceeds to step S2.

[0107] Step S2: The registration and payment device 10 acquires product identification information using the scanner unit 104. That is, if a customer scans the barcode of a single can of beer, the registration and payment device 10 acquires the product identification information of the single can of beer. If a customer scans the barcode of a 6-pack of beer, a multi-pack product, the registration and payment device 10 acquires the product identification information of the 6-pack of beer. The process then proceeds to step S3. Note that the order of steps S1 (acquisition of captured image) and S2 (acquisition of product identification information) may be reversed.

[0108] Step S3: The registration and settlement device 10 determines whether the 6-can pack is fraudulent. The determination of whether the 6-can pack is fraudulent will be described later. Next, proceed to step S4. Step S4: If the result of the determination in step S3 is that there is no fraud in the 6-can pack, the registration and settlement device 10 proceeds to step S5. If the result of the determination in step S3 is that there is fraud in the 6-can pack, the registration and settlement device 10 proceeds to step S7. For the sake of explanation, steps S3 and S4 are distinguished, but they may be a single integrated step.

[0109] Step S5: The registration and settlement device 10 transmits the product identification information and the judgment result (judgment result of no fraud) to the transaction status management device 60. In addition to the product identification information and judgment result (judgment result of no fraud), the registration and settlement device 10 may also transmit the captured image (the captured image acquired in step S1 and used in step S3 to determine fraud) to the transaction status management device 60. The process then proceeds to step S6.

[0110] Step S6: The registration and payment device 10 displays the staff call screen (age verification). Then proceed to step S10.

[0111] After the display of the staff call screen in step S6, the process is interrupted, with steps S10(NO) and S11(NO) being repeated until step S10(YES) or step S11(YES) is reached.

[0112] Step S7: The registration and settlement device 10 transmits the product identification information and the judgment result (judgment result of fraud) to the transaction status management device 60. In addition to the product identification information and judgment result (judgment result of fraud), the registration and settlement device 10 may also transmit the captured image (the captured image acquired in step S1 and used in step S3 to determine fraud) to the transaction status management device 60. The process then proceeds to step S8.

[0113] Step S8: The registration and payment device 10 displays a staff call screen (age verification, fraud detection). Then proceed to step S10.

[0114] In step S8, the staff call screen (the staff call screen when fraud is detected) displays information about the fraud in addition to age verification. However, similar to the staff call screen in step S6 (the staff call screen when no fraud is detected), the staff call screen in step S8 may also display only information about age verification (i.e., it is not necessary to display information about fraud).

[0115] After the display of the staff call screen in step S8, the process is interrupted, and steps S10(NO) and S11(NO) are repeated until step S10(YES) or step S11(YES) is reached, similar to after the display of the staff call screen in step S6.

[0116] Step S10: The registration and settlement device 10 determines whether it has received a registration permission notification from the transaction status management device 60. The transaction status management device 60 sends a registration permission notification to the registration and settlement device 10 when the store clerk has pressed the age OK button 640 (step S36 in Figure 11). In other words, the registration and settlement device 10 determines whether the transaction status management device 60 has pressed the age OK button 640. If a registration permission notification is received (if the age OK button 640 has been pressed), the device proceeds to step S12. If a registration permission notification is not received, the device proceeds to step S11.

[0117] Step S11: The registration and payment device 10 determines whether an employee (an employee who responded to a call for an employee) has provided assistance. If an employee has provided assistance, the process proceeds to step S14. If no employee has provided assistance, the process returns to step S10.

[0118] Furthermore, regarding the store clerk's response in step S11, for example, if the clerk determines that there is an age issue, they will cancel the scan (and also collect the beer); if they determine that there is no age issue and that there is no fraud with the 6-can pack, they will perform the age OK (sale OK); and if they determine that there is no age issue but that there is fraud with the 6-can pack, they will cancel the fraudulent scan (scan of the barcode of the individual product) and perform the correct scan (scan of the barcode of the 6-can pack).

[0119] Step S12: The registration and settlement device 10 registers the goods (the goods identified by the barcode scanned in step S1). In other words, when the registration and settlement device 10 receives a registration permission notification from the transaction status management device 60, it releases the interruption and registers the goods. The process then proceeds to step S13. Step S13: The registration settlement device 10 sends a cancellation response notification (response information to the registration permission notification) to the transaction status management device 60. This flowchart then ends.

[0120] In Figure 10, the registration and settlement device 10 is shown to send a cancellation response notification to the transaction status management device 60. However, the registration and settlement device 10 may not send a cancellation response notification to the transaction status management device 60. In other words, in the case where the registration and settlement device 10 sends a cancellation response notification to the transaction status management device 60, the process transitions from step S12 to step S13 to end. However, if the registration and settlement device 10 does not send a cancellation response notification to the transaction status management device 60, the process transitions from step S12 to end.

[0121] Step S14: The registration and settlement device 10 registers or cancels the product in response to the response from the store clerk (the clerk who rushed over in response to the call for a store clerk) in Step S11. The process then proceeds to Step S15.

[0122] Step S15: The registration and settlement device 10 sends a notification that the transaction has been handled by the staff to the transaction status management device 60. This flowchart then ends.

[0123] Let me add some details about step S14. If the store clerk's action in step S11 was to cancel the scan, then in step S14, the product identified by the barcode scanned in step S1 is canceled. If the store clerk's action in step S11 was to confirm the age, then in step S14, the product identified by the barcode scanned in step S1 is registered. If the store clerk's action in step S11 was to scan the actual product, then in step S14, the product identified by the barcode scanned by the store clerk in step S11 (the actual product) is registered.

[0124] (Flowchart in Figure 11) Step S30: The transaction status management device 60 receives product identification information and judgment results. The process then proceeds to step S31.

[0125] Step S31: The transaction status management device 60 checks the judgment result received in step S30 and determines whether the 6-can pack is fraudulent. In other words, the transaction status management device 60 checks whether it received a judgment result in step S30 indicating that there is no fraud in the 6-can pack, or a judgment result in step S30 indicating that there is fraud in the 6-can pack. If there is no fraud in the 6-can pack (if a judgment result indicating that there is no fraud in the 6-can pack was received in step S30), the device proceeds to step S32. If there is fraud in the 6-can pack (if a judgment result indicating that there is fraud in the 6-can pack was received in step S30), the device proceeds to step S42A.

[0126] Step S32: The transaction status management device 60 displays in the first display area 610 and the second display area 650 that an age verification product has been registered in the registration settlement device 10, an age OK button 640, etc.

[0127] For example, if the transaction status management device 60 receives product identification information, etc., from the registration and settlement device 10-2 in step S30, as shown in Figure 3, it displays the age verification icon 620b, the age OK button 640, etc., as the first notification information H1-2 in the first display area 610, and the age verification icon 620b, the age OK button 640, etc., as the second notification information H2-2 in the second display area 650. The process then proceeds to step S33.

[0128] Step S33: The transaction status management device 60 determines whether the Age OK button 640 has been pressed. If the Age OK button 640 has been pressed, the device proceeds to step S36. If the Age OK button 640 has not been pressed, the device proceeds to step S34.

[0129] Step S34: The transaction status management device 60 determines whether it has received a notification that the transaction has been handled by a store clerk from the registered settlement device 10. The registered settlement device 10 sends a notification that the transaction has been handled by a store clerk to the transaction status management device 60 if the transaction has been handled by a store clerk (step S15 in Figure 10). In other words, the transaction status management device 60 determines whether the transaction has been handled by a store clerk at the registered settlement device 10. If a notification that the transaction has been handled by a store clerk is received (if the transaction has been handled by a store clerk at the registered settlement device 10), the device proceeds to step S38. If a notification that the transaction has been handled by a store clerk is not received, the device returns to step S33.

[0130] Step S36: The transaction status management device 60 sends a registration permission notice to the registration settlement device 10. The process then proceeds to step S37.

[0131] Step S37: The transaction status management device 60 determines whether it has received a cancellation response notification from the registration and settlement device 10. Note that if the registration and settlement device 10 that sent the notification in step S36 has registered a product (cancelled the interruption), it sends a cancellation response notification to the transaction status management device 60 (step S13 in Figure 10). If a cancellation response notification is received, the process proceeds to step S38. If a cancellation response notification has not been received, the process returns to step S37 (i.e., waits until a cancellation response notification is received).

[0132] Although Figure 10 explains that the registration and settlement device 10 may not send a cancellation response notification to the transaction status management device 60, if the registration and settlement device 10 does not send a cancellation response notification to the transaction status management device 60, the process proceeds from step S36 to step S38.

[0133] Step S38: The transaction status management device 60 clears the information indicating that an age verification product has been registered, the age OK button 640, etc., in the first display area 610 and the second display area 650. In other words, the transaction status management device 60 clears the age verification icon 620b, the age OK button 640, etc., that were displayed in the first display area 610 and the second display area 650 in step S32. This flowchart then ends.

[0134] Step S42A: The transaction status management device 60 displays in the first display area 610 and the second display area 650 that an age verification product has been registered at the registration and settlement device 10, that fraud has been determined to have occurred, etc.

[0135] For example, if the transaction status management device 60 receives product identification information, etc., from the registration and settlement device 10-2 in step S30, it displays the age verification icon 620b, etc., as the first notification information H1-2 in the first display area 610, and the age verification icon 620b, etc., as the second notification information H2-2 in the second display area 650, as shown in Figure 4(G)(H). The process then proceeds to step S48.

[0136] Step S48: The transaction status management device 60 determines whether it has received a notification that the transaction has been handled by a store clerk from the registered settlement device 10. The registered settlement device 10 sends a notification that the transaction has been handled by a store clerk to the transaction status management device 60 if the transaction has been handled by a store clerk (step S15 in Figure 10). If the notification that the transaction has been handled by a store clerk is received, the device proceeds to step S58A. If the notification that the transaction has been handled by a store clerk is not received, the device returns to step S48 (i.e., waits until the notification that the transaction has been handled by a store clerk is received).

[0137] Step S58A: The transaction status management device 60 deletes the information in the first display area 610 and the second display area 650 indicating that an age verification product has been registered and that fraud has been determined to have occurred. In other words, the transaction status management device 60 deletes the age verification icon 620b and the information indicating that fraud has been determined to have occurred that were displayed in the first display area 610 and the second display area 650 in step S42A. This flowchart then ends.

[0138] (Menu button 630 / Notification history button 630a) In the first display area 610, at most one piece of first notification information H1 (icon 620, additional text, message, etc.) is displayed for each registered payment device 10. The same applies to the second notification information H2 in the second display area 650.

[0139] In the first display area 610, the first notification information H1 displayed for each registered payment device 10 may be erased by the actions of the store staff. The same applies to the second notification information H2 in the second display area 650.

[0140] For example, the first notification information H1 for calling a store employee (store employee call icon 620a, etc.) is removed from the first display area 610 when the store employee takes action (see step S137 in Figure 8).

[0141] Furthermore, even if no action is taken by a store employee, if the next notification occurs, the first notification information H1 for the next notification (H1) may be displayed, and the first notification information H1 for calling a store employee may be removed from the first display area 610. Alternatively, if the priority of notifications is determined and the store employee call has a higher priority than the next notification, the first notification information H1 for calling a store employee may not be removed from the first display area 610 (the first notification information H1 for the next notification with lower priority may not be displayed in the first display area 610). The same applies to the first notification information H1 for leaving the premises and the first notification information H1 for age verification.

[0142] The first notification information H1 of departure (departure icon 620d, etc.) is removed from the first display area 610 by the store employee's action (step S147 in Figure 9).

[0143] The first notification information H1 for age verification (age verification icon 620b, etc.) is deleted from the first display area 610 after the action is taken (steps S38 and S58A in Figure 11).

[0144] Furthermore, the first notification information H1 (warning icon 620c, etc.) for various warnings is simply a notification of an event (that there was a discounted item, that the same item was available, that a false alarm was detected), and does not require any action from the store staff. However, when the next notification occurs, the first notification information H1 for the next notification is displayed, and the first notification information H1 is then cleared from the first display area 610.

[0145] The notification history button 630a is a button used to display the first notification information H1 (icon 620, additional text, message, etc.) for the transaction in question from the registration settlement device 10 as a history.

[0146] When the notification history button 630a of a registration settlement device 10 is operated, the transaction status management device 60 may pop up a notification history screen displaying the first notification information H1 (icon 620, additional text, message, etc.) that has been displayed at least once in that transaction of the registration settlement device 10 as a history.

[0147] For example, if the notification history button 630a of the registered settlement device 10 was operated in the past when the first notification information H1 for calling a store clerk (store clerk call icon 620a, etc.) was displayed in the transaction in question, but currently no first notification information H1 is displayed, the transaction status management device 60 will pop up a notification history screen showing the store clerk call icon 620a, etc.

[0148] For example, if the notification history button 630a of the registration settlement device 10 has been operated in which the transaction has previously displayed a warning notification H1 (warning icon 620c, etc.) or a staff call notification H1 (staff call icon 620a, etc.) and is currently displaying a departure notification H1 (departure icon 620d, etc.), the transaction status management device 60 will pop up a notification history screen displaying the warning icon 620c, staff call icon 620a, and departure icon 620d.

[0149] (Menu button 630 / Transaction details button 630b) In the first display area 610, the total number of registered items and the total amount are displayed as the first notification information H1 for each registration and settlement device 10, but the individual registered items are not displayed. In other words, when the registration and settlement device 10 registers an individual item, it transmits item identification information, etc., to the transaction status management device 60, and the transaction status management device 60 displays the total number of items and the total amount for the registration and settlement device 10. However, because this would make the display cluttered and obscure important information, the names and sales prices of individual items are not displayed as the first notification information H1.

[0150] The transaction details button 630b is a button used to display the details of the transaction in the registered settlement device 10.

[0151] When the transaction details button 630b of a registration and settlement device 10 is operated, the transaction status management device 60 may pop up a transaction details screen displaying the details information (product name, quantity, sales price) of the products registered in that transaction on the registration and settlement device 10.

[0152] Furthermore, if one of the registered settlement devices 10 is in the process of settlement, the transaction status management device 60 may display settlement-related information (for example, information on payment methods such as cash or credit card) on the transaction details screen in place of or in addition to the product details information. The transaction status management device 60 obtains settlement-related information from the registered settlement device 10 and displays it on the transaction details screen.

[0153] In other words, the transaction status management device 60 does not normally display detailed information because it would be cumbersome, but it displays detailed information in response to the actions of the store clerk.

[0154] (Other buttons 630c) The "Other" button 630c is used to display buttons other than the notification history button 630a and the transaction details button 630b.

[0155] The transaction status management device 60 displays, for example, a change confirmation button 630d (not shown), a register stop button 630e (not shown), a register stop release button 630f (not shown), etc., when the other button 630c is operated. The change confirmation button 630d is a button for checking the status of the change in the registered settlement device 10. The register stop button 630e is a button for temporarily suspending the operation of the registered settlement device 10. The register stop release button 630f is a button for releasing the temporary suspension.

[0156] (Judgment on fraudulent practices regarding 6-pack beer, etc.) Several methods can be considered to determine whether a 6-can pack is fraudulent. Two methods (Determination Method A and Determination Method B) are described below.

[0157] (Method A for determining fraud in 6-can packs) Determination method A is the method following steps S1001 to S1002. The customer shall scan either the barcode of a 6-pack of beer or the barcode of a single beer product, as beer is an alcoholic beverage. The lowest selling price of a 6-pack of beer shall be higher than the highest selling price of a single beer product.

[0158] Step S1001: The registration and payment device 10 determines whether the appearance (appearance of the product) recognized from the image captured by the imaging unit 110 (the image in which the product is captured) corresponds to the appearance of a 6-pack of beer (a rectangular parallelepiped of a predetermined size). In other words, the registration and payment device 10 determines whether the product that the customer should register is a 6-pack of beer.

[0159] For example, the registration and settlement device 10 may determine whether the appearance recognized from the captured image corresponds to a predetermined size equivalent to a 6-pack of beer based on the size of the image area recognized from the captured image (the image area of ​​the product removed from the shopping basket). For example, the size of the image area (information indicating the size) when a 6-pack of beer is captured may be stored as a size for comparison (information indicating the size) in a location accessible to the registration and settlement device 10 (for example, the storage unit 102 of the device itself, the storage unit of the transaction status management device 60, the storage unit of the store controller 70, the storage unit of the headquarters server 80, or the storage unit of the cloud server 81), and the registration and settlement device 10 may determine that the appearance corresponds to a predetermined size equivalent to a 6-pack of beer if the difference between the size of the image area recognized from the captured image and the size for comparison is within a predetermined range. The size of the image area (information indicating the size) may also be the volume. The volume may be determined by recognizing the faces and edges of the product from the captured image.

[0160] Alternatively, the registration and settlement device 10 may determine whether the appearance recognized from the captured image is a rectangular prism by recognizing the faces and edges of the product from the imaged area of ​​the captured image.

[0161] If the registration and settlement device 10 determines that the product does not have the prescribed appearance (i.e., if it determines that the product the customer should register is not a 6-pack of beer), it determines that there is no fraud in the 6-pack.

[0162] If the registration and settlement device 10 determines that the item has a predetermined appearance (i.e., it determines that the item the customer should register is a 6-pack of beer), it proceeds to step S1002.

[0163] Step S1002: The registration and settlement device 10 determines whether the product identified by the product identification information acquired by the scanner unit 104 is less than a predetermined amount (the selling price of the cheapest 6-pack of beer). If it is less than the predetermined amount (the selling price of the cheapest 6-pack of beer), the product identified by the product identification information acquired by the scanner unit 104 is a single item of beer.

[0164] If the registration and settlement device 10 determines that the amount is less than a predetermined amount (i.e., if the product identified by the product identification information acquired by the scanner unit 104 is a single product, such as beer), it determines that there is fraud in the 6-can pack.

[0165] If the registration and settlement device 10 determines that the amount is not less than a predetermined amount (i.e., if the product identified by the product identification information acquired by the scanner unit 104 is a 6-pack of beer), it determines that there is no fraud in the 6-pack.

[0166] The order of steps S1001 and S1002 may be reversed. In other words, the registration and settlement device 10 may determine that there is fraud in the 6-pack if the appearance recognized from the image captured by the imaging unit 110 is equivalent to that of a 6-pack of beer, and the product identified by the product identification information acquired by the scanner unit 104 is less than a predetermined amount (i.e., the image shows a 6-pack of beer, but the price is not that of a 6-pack of beer). If at least one of these conditions is not met, the device may determine that there is no fraud in the 6-pack.

[0167] (Method B for determining fraud in 6-can packs) Determination method B is the method described in steps S2001 to S2002 below. The customer shall scan either the barcode of a 6-pack of beer or the barcode of a single beer product, as beer is an alcoholic beverage.

[0168] Furthermore, some brands of beer are available in 6-packs, while others are not. In other words, within a store, there are beers that are sold in 6-packs and beers that are not. Therefore, the product identification information for beer is classified into the following three types (Classification 1 to Classification 3). (Classification 1) Product identification information for beer that is sold as a single item and not in a 6-can pack. (Classification 2) Product identification information for beer sold as a single-pack of 6 cans. (Category 3) Product identification information for 6-pack beer sold in 6-packs.

[0169] Category 2 is the possibility that the barcode of a single beer product was scanned through the gap in a 6-pack.

[0170] Step S2001: The registration and settlement device 10 determines whether the product identification information acquired by the scanner unit 104 is product identification information of classification 2.

[0171] If the registration and settlement device 10 determines that the product identification information is not of category 2 (i.e., if it determines that the product identification information is of category 1 or category 3), it determines that there is no fraud in the 6-can pack.

[0172] If the registration and settlement device 10 determines that the product identification information is of classification 2, it proceeds to step S2002.

[0173] Step S2002: The registration and settlement device 10 determines whether the appearance recognized from the image captured by the imaging unit 110 corresponds to the appearance of a 6-pack of beer. This is the same as step S1001 of determination method A.

[0174] If the registration and settlement device 10 determines that the product does not have the prescribed appearance (i.e., if it determines that the product the customer should register is not a 6-pack of beer), it determines that there is no fraud in the 6-pack.

[0175] If the registration and settlement device 10 determines that the product has a predetermined appearance (i.e., if it determines that the product the customer should register is a 6-pack of beer), it determines that there is a fraudulent 6-pack.

[0176] Note that the order of steps S2001 and S2002 may be reversed. In other words, the registration and settlement device 10 may determine that there is fraud in the 6-pack if it determines that the appearance recognized from the image captured by the imaging unit 110 corresponds to the appearance of a 6-pack of beer, and that the product identification information acquired by the scanner unit 104 is the product identification information of a single beer product that is also sold as a 6-pack of beer. If at least one of these conditions is not met, it may determine that there is no fraud in the 6-pack.

[0177] (Operation of the transaction status management device 60 in the case of no fraudulent activity in the 6-can pack, etc.) The transaction status management device 60 indicates that the 6-can pack is not fraudulent, and enables the operation of the Age OK button 640 (for example, Figure 3). Therefore, as explained in Figures 11 and 12, the store clerk can check the age from a distance and operate the Age OK button 640 to release the interruption of the registration and settlement device 10, without having to rush to the registration and settlement device 10.

[0178] (Operation of the transaction status management device 60 in the event of fraudulent activity in 6-can packs, etc.) If the transaction status management device 60 determines that there is fraud in the 6-can pack, it does not display the age OK button 640 (for example, Figure 4(G)(H)). Therefore, as explained in Figures 11 and 12, the store clerk rushes to the registration and settlement device 10 to deal with the fraud in the 6-can pack (and also checks the age).

[0179] Figures 12 and 13 are explanatory diagrams illustrating other operations of the transaction status management device 60. Next, we will explain the other operations of the transaction status management device 60 when there is no fraud in the 6-can pack, and the other operations of the transaction status management device 60 when there is fraud in the 6-can pack.

[0180] (Other actions of the transaction status management device 60 in the event of fraudulent activity in a 6-can pack) If the transaction status management device 60 determines that there is fraud in the 6-can pack, it may display the captured image (the image used to determine the fraud) based on the store clerk's operation, and allow the suspension of the registration settlement device 10 to be released based on the store clerk's operation after confirming the captured image. In other words, even if it is determined that there is fraud in the 6-can pack, the suspension may be released remotely.

[0181] For example, if the transaction status management device 60 determines that there is no fraud in the 6-pack, it may display the information in the first display area 610 and the second display area 650 as shown in Figures 12(A) and 12(B), instead of displaying it in the first display area 610 and the second display area 650 as shown in Figures 4(G) and 4(F).

[0182] When the image button 641 in Figure 12(A) (or the image button 641 in Figure 12(B)) is pressed, the transaction status management device 60 will pop up an image confirmation screen, for example, as shown in Figure 13(A). The image confirmation screen in Figure 13(A) displays the judgment result of whether fraud was detected ("Judgment Result: Fraud Detected"), product identification information read from the barcode, product name, and captured image (the captured image used to determine fraud), and the release OK button 643 and release NG button 644 are displayed as operable. When the release OK button 643 is pressed, the transaction status management device 60 will release the interruption of the registration and settlement device 10. The store clerk will then check the age from a distance and, if they determine from the captured image that there is no fraud (i.e., if they determine that the judgment of fraud by the registration and settlement device 10 is incorrect), they will press the release OK button 643.

[0183] (Other operations of the transaction status management device 60 in the case of no fraudulent activity in the 6-can pack) The transaction status management device 60 may, if it determines that there is no fraud in the 6-can pack, display the captured image (the image used to determine fraud) based on the store clerk's operation, and release the interruption of the registration settlement device 10 based on the store clerk's operation after they have confirmed the captured image. In other words, even if it is determined that there is no fraud in the 6-can pack, the interruption may be released remotely after the store clerk has confirmed the captured image.

[0184] For example, if the transaction status management device 60 determines that there is no fraud in the 6-pack, it may display the information in the first display area 610 and the second display area 650 as shown in Figure 12(C) and (D), instead of displaying it in the first display area 610 and the second display area 650 as shown in Figure 3.

[0185] When the image button 641 in Figure 12(C) (or the image button 641 in Figure 12(D)) is pressed, the transaction status management device 60 will pop up an image confirmation screen, for example, as shown in Figure 13(B). The image confirmation screen in Figure 13(B) displays the judgment result of whether there is no fraud ("Judgment Result: No Fraud"), product identification information read from the barcode, product name, and captured image (the captured image used to determine fraud), and the release OK button 643 and release NG button 644 are displayed as operable. When the release OK button 643 is pressed, the transaction status management device 60 will release the interruption of the registration and settlement device 10. The store clerk will then check the age from a distance and, if they determine from the captured image that there is no fraud (i.e., if they determine that the judgment of no fraud by the registration and settlement device 10 is correct), they will press the release OK button 643.

[0186] Figure 14 is a flowchart illustrating another example of the operation of the transaction status management device 60. The flowchart in Figure 14 shows another operation of the transaction status management device 60 in the case of no fraudulent activity with the 6-pack. Specifically, the flowchart in Figure 14 shows another operation of the dashed box P in Figure 11.

[0187] While not essential when the transaction status management device 60 performs the operations shown in the flowchart of Figure 11, when the transaction status management device 60 performs the operations shown in the flowchart of Figure 14, the registration and settlement device 10 transmits the captured image in addition to the product identification information and judgment result (judgment result of fraud) to the transaction status management device 60 in step S7 of Figure 10.

[0188] Step S42B: The transaction status management device 60 displays in the first display area 610 and the second display area 650 that an age verification product has been registered at the registration and settlement device 10, that fraud has been determined to have occurred, and displays an image button 641, etc.

[0189] For example, if the transaction status management device 60 receives product identification information, etc., from the registration and settlement device 10-2 in step S30, as shown in Figures 12(A) and (B), it displays the age verification icon 620b, a statement indicating that fraud has been detected, an image button 641, etc., as the first notification information H1-2 in the first display area 610, and the age verification icon 620b, a statement indicating that fraud has been detected, an image button 641, etc., as the second notification information H2-2 in the second display area 650. The process then proceeds to step S43.

[0190] Step S43: The transaction status management device 60 determines whether the image button 641 has been operated. If the image button 641 has been operated, the process proceeds to step S44. If the image button 641 has not been operated, the process proceeds to step S48.

[0191] Step S44: The transaction status management device 60 pops up an image confirmation screen as shown in Figure 13(A). Then proceed to step S45.

[0192] Step S45: The transaction status management device 60 determines whether the release OK button 643 has been pressed. If the release OK button 643 has been pressed, the device proceeds to step S55. If the release OK button 643 has not been pressed, the device proceeds to step S46. Step S46: The transaction status management device 60 determines whether the release NG button 644 has been pressed. If the release NG button 644 has been pressed, the device proceeds to step S47. If the release NG button 644 has not been pressed, the device returns to step S45.

[0193] Step S47: The transaction status management device 60 clears the image confirmation screen displayed in step S44. Then proceed to step S48.

[0194] Step S48: The transaction status management device 60 determines whether it has received a notification that the transaction has been handled by a store clerk from the registered settlement device 10. If it has received a notification that the transaction has been handled by a store clerk, it proceeds to step S58B. If it has not received a notification that the transaction has been handled by a store clerk, it returns to step S43.

[0195] Step S55: The transaction status management device 60 clears the image confirmation screen displayed in step S44. Then proceed to step S56. Step S56: The transaction status management device 60 sends a registration permission notice to the registration settlement device 10. The process then proceeds to step S57.

[0196] Step S57: The transaction status management device 60 determines whether it has received a cancellation response notification from the registration and settlement device 10. Note that if the registration and settlement device 10 that sent the notification in step S56 has registered a product (cancelled the interruption), it sends a cancellation response notification to the transaction status management device 60 (step S13 in Figure 10). If a cancellation response notification is received, the process proceeds to step S58B. If a cancellation response notification has not been received, the process returns to step S57 (i.e., waits until a cancellation response notification is received).

[0197] Although Figure 10 explains that the registration and settlement device 10 may not send a cancellation response notification to the transaction status management device 60, if the registration and settlement device 10 does not send a cancellation response notification to the transaction status management device 60, the process proceeds from step S56 to step S58B.

[0198] Step S58B: The transaction status management device 60 deletes the information indicating that an age verification product has been registered, that fraud has been determined, and the image button 641, etc., in the first display area 610 and the second display area 650. In other words, the transaction status management device 60 deletes the age verification icon 620b, the information indicating that fraud has been determined, and the image button 641, etc., that were displayed in the first display area 610 and the second display area 650 in step S42B. This flowchart then ends.

[0199] The above describes the other operations of the transaction status management device 60 in the case of fraudulent 6-can packs using a flowchart (Figure 14). However, the other operations of the transaction status management device 60 in the case of no fraudulent 6-can packs are the same as those in the case of fraudulent 6-can packs, so the flowchart explanation is omitted.

[0200] (Other devices) Other devices besides those described above may be installed in the store. For example, a registration and payment device 20 that performs registration and payment processing based on the actions of a store employee may be installed. A registration and payment device (face-to-face semi-self-service device) 21 that performs registration processing based on the actions of a store employee and payment processing based on the actions of a customer may be installed. As a semi-self-service system, a registration device 30 that performs registration processing based on the actions of a store employee, and a payment device 31 that acquires registration information from the registration device 30 and performs payment processing based on the actions of a customer may be installed. A registration and payment device 40 that can switch between an operating mode that performs registration processing based on the actions of a store employee and payment processing based on the actions of a customer (face-to-face semi-self-service mode) and an operating mode that performs registration processing and payment processing based on the actions of a customer, similar to the registration and payment device 10 (full self-service mode), may be installed. Furthermore, a portable registration terminal 50 (a terminal that can be attached to a shopping cart, a terminal integrated with a shopping cart, etc., not shown) that performs registration processing based on the actions of a customer in the product sales area may be operated, and a payment device 51 that acquires registration information from the portable registration terminal 50 and performs payment processing based on the actions of a customer may be installed.

[0201] (Sales data processing system, product processing system) For example, devices capable of performing registration processing (e.g., registration and settlement device 10, registration and settlement device 20, registration and settlement device 21, registration device 30, registration and settlement device 40, mobile registration terminal 50) process information related to the sale of goods (generating product registration information, etc.), so devices capable of performing registration processing may be called sales data processing devices. Also, devices capable of performing registration processing process products (processing information related to the sale of goods), so devices capable of performing registration processing may be called product processing devices. The same applies to devices capable of performing settlement processing (e.g., registration and settlement device 10, registration and settlement device 20, registration and settlement device 21, settlement device 31, registration and settlement device 40, settlement device 51). In other words, each device on the store side that constitutes the sales system 1 may be called a sales data processing device or a product processing device.

[0202] Furthermore, as shown in Modification 10 (described later), some of the functions of each device may be implemented in other devices different from the device described as the main component of that function. For example, some of the functions of the registration and settlement device 10 may be implemented in a device different from the registration and settlement device 10. In other words, the functions of the registration and settlement device 10 may be implemented by multiple devices. Accordingly, the sales data processing device may be referred to as a sales data processing system, and the product processing device may be referred to as a product processing system. In other words, a configuration including one or more store-side devices that constitute the sales system 1 may be referred to as a sales data processing system (or product processing system).

[0203] As described above, the embodiment can improve monitoring operations. For example, the transaction status management device 60 does not display detailed product information (product name, quantity, sales price, etc.) on the monitoring screen (Figure 3), but only displays important information that store employees should pay attention to. Therefore, important information is not buried among other information, improving the visibility of important information and reducing the burden on the monitoring store employees. In other words, when detailed product information is displayed, there is a risk of overlooking important information among the detailed product information, so monitoring store employees need to concentrate to avoid missing important information. However, since the monitoring screen of the embodiment displays only important information that store employees should pay attention to, this burden is eliminated.

[0204] Furthermore, the transaction status management device 60 can appropriately handle beer, which is an age-verification product, according to whether or not there is any fraud (the result of the determination of whether or not there is fraud). For example, the transaction status management device 60 allows the release operation (displays the age OK button 640 as operable) if it determines that there is no fraud, while prohibiting the release operation (hides the age OK button 640) if it determines that there is fraud (Figures 3, 4(G)(H), and 11).

[0205] As another example, the transaction status management device 60 is configured to allow the release operation (display the release OK button 643 as operable) even if the result of the determination is that fraud has occurred, once the store clerk has confirmed the captured image (Figures 12(A)(B), 13(A), and 14). As yet another example, the transaction status management device 60 is configured not to allow the release operation (display the release OK button 643 as operable) even if the result of the determination is that no fraud has occurred, until the store clerk has confirmed the captured image (Figures 12(C)(D), and 13(B)).

[0206] (Variations, etc.) Although embodiments have been described above, the configuration of the equipment, the data configuration, the processing flow, the display and output modes, etc., can be changed as appropriate, for example, as shown in the following Modifications 1 to 10. Furthermore, Modifications 1 to 10 can be combined as appropriate.

[0207] (Modification 1) In the above embodiment, an example was described in which the registration settlement device 10 and the transaction status management device 60 communicate directly (Figures 5 to 11, Figure 14), but they may also communicate via another device (for example, a store controller 70).

[0208] (Modification 2) In the above embodiment, an example was described in which the shape of the product is recognized as the appearance of the product. However, in addition to the shape of the product, the color (including patterns and designs) may also be recognized as the appearance of the product. In other words, in the above embodiment, when determining whether the appearance recognized from the captured image (the appearance of the product) corresponds to the appearance of a 6-pack of beer, it was explained that it was determined whether it is a rectangular parallelepiped of a predetermined size. However, it may also be determined whether it is a rectangular parallelepiped of a predetermined size and a predetermined color (the color of a 6-pack of beer).

[0209] The colors of various 6-pack beer containers are stored as predetermined colors (stored in a location accessible to the registration and settlement device 10), and the registration and settlement device 10 may refer to the predetermined colors (colors of various 6-pack beer containers) that have been stored in advance when determining whether a rectangular prism of a predetermined size is of a predetermined color.

[0210] (Modification 3) In the above embodiment, an example was described in which fraudulent activity occurs when a single beer product is registered without registering a 6-can beer pack. However, it is not limited to 6 cans. For example, fraudulent activity may also occur when a single beer product is registered without registering a 4-can beer pack. In other words, the number of single products that make up a multi-pack product does not have to be 6.

[0211] Furthermore, while the above embodiment described an example of monitoring fraudulent activity such as registering a single beer product without registering a 6-pack of beer, the target of fraudulent activity monitoring is not limited to beer. The target of fraudulent activity monitoring may also be other alcoholic beverages (e.g., shochu cocktails, sake). For example, fraudulent activity such as registering a single shochu cocktail without registering a 6-pack of shochu cocktails may be monitored.

[0212] Furthermore, beverages other than alcoholic beverages (e.g., juice, carbonated drinks) may also be included. For example, fraudulent activity such as registering a single juice product instead of a 6-pack of juice may be monitored. The product does not have to be in a can.

[0213] The items subject to monitoring for fraud are not limited to beverages. For example, it could be a four-pack of candy (hanging candy) where four individual bags of candy are connected together and sold. It could also be a pack product where several individual bags of candy are packaged together (or in a box) and sold. It could also be a pack product where several individual packs of sliced ​​ham are bundled together and sold. Furthermore, it could be a pack product where several packs of rice that are heated in a microwave are sold together.

[0214] The scope of fraud monitoring is not limited to food products. For example, it could include everyday necessities sold as individual items or in multi-packs (such as hand warmers and tissues).

[0215] The methods for determining fraud in a 6-pack of beer (Method A, Method B) may also be applied to determining fraud in other multi-pack products (4-pack of beer, 6-pack of shochu, 6-pack of juice, 4-pack of candy, etc.). In other words, the same methods used to determine fraud in a 6-pack of beer may be used to determine fraud in other multi-pack products such as 4-pack of beer, 6-pack of shochu, 6-pack of juice, and 4-pack of candy.

[0216] For example, if the item being monitored for fraud is a four-pack of candy, the system may determine whether the appearance recognized from the captured image corresponds to that of a four-pack of candy (a strip-shaped appearance of a predetermined size). Similarly, if the item being monitored for fraud is a multi-pack of hand warmers, the system may determine whether the appearance recognized from the captured image corresponds to that of a multi-pack of hand warmers (a bag-shaped appearance of a predetermined size).

[0217] (Modification 4) As is related to Modification 3 above, if a multi-pack product is registered, an icon 620 indicating that a multi-pack product has been registered, and the registered product (product name) may be displayed.

[0218] For example, if a 6-pack of XX juice is registered, the following may be displayed in the first display area 610 and the second display area 650: a multi-pack product icon 620e (not shown), an inappropriate activity icon 620f (not shown), etc. Juice 6-can pack (No fraud detected): Multiple pack product icon 620e, registered product "XX Juice 6-can pack". The registered product "XX Juice 6-can pack" will only be displayed in the first display area 610. Juice 6-can pack (judgment result of fraud): Multiple pack product icon 620e, fraudulent product icon 620f, registered product "XX Juice (single item)". Note that the registered product "XX Juice (single item)" will only be displayed in the first display area 610.

[0219] (Modification 5) In the above embodiment, an example was described in which the age verification icon 620b is displayed for age verification products regardless of whether or not fraud has occurred. However, separate icons may be prepared and displayed for fraud. In other words, multiple icons 620 (and their respective additional texts) may be displayed.

[0220] As an example, in the case of fraudulent sales of 6-pack beer and 6-pack juice, an age verification icon 620b and a fraudulent activity icon 620f (not shown) may be displayed in the first display area 610 and the second display area 650, respectively, as shown below. Beer (No fraud detected): Age verification icon 620b Beer (Result of judgment of fraud): Age verification icon 620b, Fraudulent activity icon 620f Juice (Result of judgment: no irregularities): - (Not displayed) Juice (Result of judgment indicating fraud): Fraudulent activity icon 620f

[0221] As another example, in the case of fraudulent beer 6-packs and fraudulent juice 6-packs, an age verification icon 620b and an image verification icon 620g (not shown) may be displayed in the first display area 610 and the second display area 650, respectively, as shown below. Beer (No fraud detected): Age verification icon 620b, Image verification icon 620g Beer (Result of judgment of fraud): Age verification icon 620b, Image verification icon 620g Juice (No irregularities found): Image verification icon 620g Juice (Result of judgment of fraud): Image confirmation icon 620g

[0222] (Modification 6) In the above embodiment, an example was described in which registered products are displayed in the first display area 610 in specific cases (age verification products, discounted products, identical products, and in further modification 4, multi-pack products). However, even if there are no specific cases, the most recent product (or a few products) may be displayed in the first display area 610. In other words, when the transaction details button 630b is operated, the details information of all products is displayed, but the most recent product or so may be displayed in the first display area 610. When displaying the most recent product, the product name of the most recent product may be displayed until the next product is registered (until the product identification information of the next product is received), or it may be deleted after a predetermined time (for example, 5 seconds) has elapsed since the start of display, even if the next product has not been registered.

[0223] Furthermore, priority may be given to displaying discounted items (including multi-pack items and identical items). For example, if the name of a discounted item is displayed, the latest item does not need to be displayed, or the latest item may be displayed for a set period of time (e.g., 2 seconds) and then the discounted item may be displayed again. Also, if the latest item is an age-verification item, there will be no further registration of the next item, but the name of the age-verification item will continue to be displayed until the store clerk has finished verifying it. Similarly, in the case of fraudulent multi-pack items, the name of the fraudulently registered item may continue to be displayed until the store clerk has finished verifying it.

[0224] (Modification 7) In the above embodiment, the registration and settlement device 10 was described in which the appearance of the product is captured by the imaging unit 110. However, instead of or in addition to the imaging unit 110, the appearance of the product may be captured by the built-in camera (scanner camera) of the scanner unit 104.

[0225] If the scanner unit 104 (scanner camera) is configured to capture images of the product's appearance on its own (without the imaging unit 110 capturing images of the product's appearance), the scanner unit 104 acquires the code (i.e., acquires the information necessary for the product's unit price and classification). Therefore, the registration and settlement device 10 can acquire both information about the product's appearance and information necessary for the product's unit price and classification using only the scanner unit 104.

[0226] In a configuration where the imaging unit 110 and the scanner unit 104 (scanner camera) capture images of the product's appearance, the product's appearance based on the image captured by the imaging unit 110 may be compared with the product's appearance based on the image captured by the scanner unit 104. Furthermore, the accuracy of appearance recognition may be improved by using both captured images.

[0227] (Modification 8) In the above embodiment, an example was described in which the registration and settlement device 10 determines fraud (step S3 in Figure 10), but the transaction status management device 60 may also determine fraud. For example, each device (registration and settlement device 10, transaction status management device 60) may operate as follows. The registration and settlement device 10 transmits product identification information and captured images to the transaction status management device 60. Based on the product identification information and captured images received from the registration and settlement device 10, the transaction status management device 60 determines fraud in the same way as the registration and settlement device 10 (determination method A or determination method B). The transaction status management device 60 displays a monitoring screen (Figure 3) according to the determination result (no fraud, fraud present) and transmits the determination result to the registration and settlement device 10. If the judgment result received from the transaction status management device 60 indicates no fraud, the registration and settlement device 10 displays a staff call screen (age) (step S6 in Figure 10). If the judgment result received from the transaction status management device 60 indicates fraud, it displays a staff call screen (age, fraud) (step S8 in Figure 10). As mentioned above, even if the judgment result indicates fraud, the registration and settlement device 10 may choose to display only the age verification information (i.e., it may choose not to display the fraud information).

[0228] A third device (for example, a cloud server 81), other than the registration and settlement device 10 or the transaction status management device 60, may determine fraud. In other words, the registration and settlement device 10 may transmit product identification information and captured images to the third device (cloud server 81), the third device (cloud server 81) may determine fraud, and transmit the determination result to the transaction status management device 60 or the registration and settlement device 10.

[0229] (Modification 9) In the above embodiment, an example of monitoring the registration and settlement device 10, which is a fully self-service device, was described, but other devices may be monitored. In other words, the device to be monitored is not limited to the registration and settlement device 10.

[0230] For example, the transaction status management device 60 may, in place of or in addition to the registration and settlement device 10, display the status (registration status, settlement status, operation status, etc.) of the registration and settlement device 40 (for example, a registration and settlement device 40 in full self-service mode) on the monitoring screen (Figure 3).

[0231] Furthermore, the transaction status management device 60 may display the status of the settlement device 51 (settlement status, operation status, etc.) on the monitoring screen. For example, the transaction status management device 60 may monitor whether a customer leaves the premises during settlement. The settlement device 51 is a device that settles products registered in the mobile registration terminal 50. If a discounted product or an age-verification product is registered in the mobile registration terminal 50, the transaction status management device 60 may display the fact that a discounted product or an age-verification product has been registered as the first notification information H1 and the second notification information H2 of the settlement device 51 on the monitoring screen (Figure 3). In other words, the transaction status management device 60 may display the registration status in the mobile registration terminal 50 as the status of the settlement device 51 on the monitoring screen.

[0232] Furthermore, the transaction status management device 60 may display the status of the settlement device 31 (settlement status, operation status, etc.) on the monitoring screen. For example, the transaction status management device 60 may monitor whether a customer leaves the premises during settlement. Note that since the settlement device 31 is a device that settles the goods registered in the registration device 30 operated by the store clerk, the transaction status management device 60 does not need to display the registration status in the registration terminal 30 as the status of the settlement device 31 on the monitoring screen.

[0233] (Modification 10) Some or all of the functions (input / output, storage, processing (including judgment)) in each device (registration and settlement device 10, transaction status management device 60, etc.) may be implemented in a device other than the device described as the main entity of that function.

[0234] For example, the system may be configured to include an imaging processing device (a device having an imaging unit 110 and a processing unit) as a separate device from the registration and payment device 10, and the imaging processing device may recognize the product removal operation of taking products out of the shopping basket (or implement a part corresponding to the product removal operation recognition function), or recognize the product movement operation of moving the products that have been taken out of the shopping basket to the front of the main unit 11 (or implement a part corresponding to the product movement operation recognition function), or recognize the appearance of the products from the captured image. In other words, the imaging processing device may perform at least a part of the image processing functions described as functions of the registration and payment device 10.

[0235] For example, the transaction status management device 60 may recognize the appearance of the product from the captured image, determine whether the appearance of the product is a predetermined appearance, or determine if the 6-can pack is fraudulent. Also, the cloud server 81 may recognize the appearance of the product from the captured image, determine whether the appearance of the product is a predetermined appearance, or determine if the 6-can pack is fraudulent.

[0236] Furthermore, each device may function as a so-called thin client, specializing in input / output interfaces, etc. For example, the cloud server 81 may execute a program to control the operation of each device, and each device may display a screen using a browsing function, etc.

[0237] <Summary of Embodiments> [Technical field] This invention relates to a monitoring device. [Background technology] A technology has been proposed that displays the same image on the staff's management computer as the image displayed on the customer's device screen (see, for example, Patent Document 1). [Prior art document] [Patent] [Patent Document 1] Japanese Unexamined Patent Publication No. 2009-67457 [Overview of the prefecture] [Problems the invention aims to solve] However, there is room for improvement in monitoring. This invention has been made in view of these circumstances and aims to provide technology to improve monitoring operations. [Means for solving the problem]

[0238] (1) One embodiment for solving the above-mentioned problems is a monitoring device in a system (e.g., sales system 1) that includes a plurality of sales data processing devices operated by customers (e.g., registration and settlement device 10, registration and settlement device 40, settlement device 51, settlement device 31) and a monitoring device operated by a store clerk (e.g., transaction status management device 60), wherein the monitoring device includes an acquisition means for acquiring occurrence information (e.g., store clerk call notification, product identification information, judgment result, loss detection notification, departure notification) of events (e.g., store clerk call, product registration, registration fraud, no-show, departure) that occur in each of the sales data processing devices, and each of the sales data processing devices The monitoring device includes a display means for displaying the status, wherein if an event obtained from the occurrence information of a sales data processing device corresponds to a predetermined specific event (for example, registration of age-verified products, registration of multi-pack products, registration of discounted products, registration of identical products, or fraudulent registration), the display means displays the specific event and related product information as the status of the sales data processing device in a predetermined area, and does not display the status of the sales data processing device in the predetermined area if the event obtained from the occurrence information of a sales data processing device does not correspond to a predetermined specific event. According to the configuration in (1), monitoring operations can be improved. Furthermore, the burden on the store staff performing the monitoring can be reduced.

[0239] For example, if the transaction status management device 60 obtains an event from the information generated by one sales data processing device that is a predetermined specific event (registration of age-verification products), it will display the specific event and related product information in the first display area 610 (displaying an age verification icon 620b, product information, etc.). Also, if the transaction status management device 60 obtains an event from the information generated by one sales data processing device that is a predetermined specific event (registration of multi-pack products), it will display the specific event and related product information in the first display area 610 (displaying a multi-pack product icon 620e, product information, etc.). Furthermore, if the transaction status management device 60 obtains an event from the information generated by one sales data processing device that is a predetermined specific event (registration of discounted products), it will display the specific event and related product information in the first display area 610 (displaying a warning icon 620c, product information, etc.). Furthermore, if the transaction status management device 60 determines that an event obtained from the information generated by a single sales data processing device is a predetermined specific event (registration of the same product), it will display the specific event and related product information (display a warning icon 620c, product information, etc.) in the first display area 610.

[0240] (2) The monitoring device described in (1) is characterized in that the specific event is the registration of individual products (for example, canned beer which is an individual product, and bagged snacks which is a unit product) that make up a multi-pack product (for example, a 6-pack of beer, a 4-pack of snacks). According to the configuration in (2), monitoring operations can be improved while monitoring multi-pack products that are prone to fraud.

[0241] (3) The monitoring device described in (1) is characterized in that the specific event is the registration of a discounted product. The configuration in (3) allows for monitoring of discounted products that are prone to fraud while improving monitoring operations. For example, it can monitor fraud such as replacing discount stickers (stickers printed with a value reference code) with other products. The transaction status management device 60 may also refer to a discount file (a file that stores product identification information and discount information in association) and monitor the registration of discounts on products that are not currently discounted. The discount file is stored in a location accessible to the transaction status management device 60 (for example, the storage unit of the device itself, the storage unit of the store controller 70, the storage unit of the headquarters server 80, or the storage unit of the cloud server 81).

[0242] (4) The monitoring device described in (1) is characterized in that the specific event is the consecutive registration of the same product. According to configuration (4), monitoring operations can be improved while monitoring consecutive registrations of the same product, which may be due to customer registration errors.

[0243] (5) The sales data processing device has a determination means for determining whether an alcoholic beverage has been fraudulently registered (for example, determining the fraudulence of a 6-pack in step S3 of Figure 10) using an image captured when a customer registers a product and product identification information obtained by the customer's operation, and the monitoring device has an operation receiving means for receiving operations from a store employee, and the operation receiving means can accept an operation to permit the sale of alcoholic beverages (for example, the operation of the age OK button 640 in step S33 of Figure 11) when it is determined that the alcoholic beverage has not been fraudulently registered (for example, in step S31 (NO) of Figure 11), and can accept an operation to display the captured image (for example, the operation of the image button 641 in step S43 of Figure 14) when it is determined that the alcoholic beverage has been fraudulently registered (for example, in step S31 (YES) of Figure 11). This is the monitoring device according to (1). According to the configuration of (5), appropriate monitoring operations can be carried out regarding the registration of alcoholic beverages, depending on whether or not the registration is fraudulent.

[0244] Furthermore, the processing of each of the above-described devices (Registration and Settlement Device 10, Registration and Settlement Device 20, Registration and Settlement Device 21, Registration Device 30, Settlement Device 31, Registration and Settlement Device 40, Portable Registration Terminal 50, Settlement Device 51, Transaction Status Management Device 60, etc.) may be performed by recording a program for realizing the functions of each device on a computer-readable recording medium, loading the program recorded on this recording medium into a computer system, and executing it. Here, "loading the program recorded on the recording medium into a computer system and executing it" includes installing the program into the computer system. Here, "computer system" includes hardware such as the OS and peripheral devices. Also, "computer system" may include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. Also, "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into the computer system. Thus, the recording medium on which the program is stored may be a non-transient recording medium such as a CD-ROM. Furthermore, the recording medium includes internal or external recording media accessible from the distribution server for distributing the program. The program code stored on the distribution server's recording medium may be different from the program code in an executable format for the terminal device. In other words, the format in which it is stored on the distribution server is irrelevant as long as it can be downloaded from the distribution server and installed in an executable format for the terminal device. It is also acceptable for the program to be divided into multiple parts, downloaded at different times, and then combined on the terminal device, and for each of the divided programs to be distributed by a different distribution server. Moreover, "computer-readable recording medium" includes volatile memory (RAM) within computer systems that act as servers or clients when a program is transmitted over a network, which retains the program for a certain period of time. Furthermore, the program may be intended to implement only a part of the functions described above.Furthermore, the above-mentioned functions may be realized in combination with programs already recorded in the computer system, such as so-called differential files (differential programs). [Explanation of Symbols]

[0245] 1...Sales system, 10...Registration and settlement device, 20...Registration and settlement device, 21...Registration and settlement device, 30...Registration device, 31...Settlement device, 40...Registration and settlement device, 50...Mobile registration terminal, 51...Settlement device, 60...Transaction status management device, 70...Store controller, 80...Head office server (cloud server), 81...Cloud server

Claims

1. A monitoring device in a system that includes multiple sales data processing devices operated by customers and a monitoring device operated by store employees, An acquisition means for acquiring information on events that have occurred in each of the aforementioned sales data processing devices, Display means for displaying the status of each of the aforementioned sales data processing devices and Equipped with, The aforementioned display means is If an event obtained from the aforementioned occurrence information of a sales data processing device corresponds to a predetermined specific event, the status of the sales data processing device is displayed in a predetermined area, showing the specific event and related product information. If the event obtained from the occurrence information of one sales data processing device does not correspond to the specified event, the status of the sales data processing device will not be displayed in the predetermined area. A monitoring device characterized by the following features.

2. The aforementioned specific event is the registration of a single product that constitutes a multi-pack product. The monitoring device according to feature 1.

3. The aforementioned specific event is the registration of discounted products. The monitoring device according to feature 1.

4. The aforementioned specific event is the consecutive registration of the same product. The monitoring device according to feature 1.

5. The aforementioned sales data processing device has a determination means for determining whether an alcoholic beverage has been fraudulently registered, using the image captured when the customer registers the product and the product identification information obtained through the customer's operation. The aforementioned monitoring device is A means of receiving orders from store staff. Equipped with, The aforementioned operation reception means is If it is determined that the registration of alcoholic beverages is not fraudulent, the procedure to authorize the sale of alcoholic beverages can be accepted. If it is determined that the registration of alcoholic beverages is fraudulent, the system can accept an operation to display the captured image. The monitoring device according to feature 1.

Images