Product information registration device, product information registration system, and program

Abstract

To provide a product information registration device, a product information registration system, and a program that reduce customer resistance to using a product information registration device operated by the customer themselves. [Solution] The product information registration device of the embodiment is a product information registration device that can be operated by the customer, and comprises a product registration means, an image acquisition means, a detection means, and a notification means. The product registration means registers the product to be purchased by the customer. The image acquisition means acquires an image of the customer. The detection means detects a specific action of the customer from the image. The notification means notifies if the detection means has not detected a specific action and the waiting time for the customer's prescribed operation is longer than a first length, and if the detection means has detected a specific action and the waiting time for the customer's prescribed operation is longer than a first length (a second length), then notifies the customer.

Description

Technical Field

[0003] , , , , ,

[0004]

[0001] Embodiments of the present invention relate to a product information registration device, a product information registration system, and a program.

Background Art

[0002] In recent years, due to the reduction of the number of store employees, etc., the introduction of self-POS (Point of Sales) devices operated by customers themselves has been progressing. However, there are also customers who feel resistance to such self-POS devices that they operate themselves. For example, it is common for self-POS devices to have a function of outputting an alert by means such as a pop-up on the screen if a customer does not perform an operation within a certain period of time. Customers who are not used to self-POS devices tend to take a long time for screen operations and handling of products, so such alerts are likely to be output. For this reason, it is conceivable that such customers feel anxious when an alert is issued and avoid using the self-POS device.

Summary of the Invention

Problems to be Solved by the Invention

[0003] The problem to be solved by the present invention is to provide a product information registration device, a product information registration system, and a program that reduce the resistance of customers to a product information registration device operated by the customers themselves. [[ID=​​​​The product information registration device of the embodiment is a product information registration device that can be operated by the customer, and comprises a product registration means, an image acquisition means, a detection means, and a notification means. The product registration means registers the product to be purchased by the customer. The image acquisition means acquires an image of the customer. The detection means detects a specific action of the customer from the image. The notification means notifies if the detection means has not detected a specific action and the waiting time for the customer's prescribed operation is longer than a first length, and if the detection means has detected a specific action and the waiting time for the customer's prescribed operation is longer than a first length (a second length), then notifies the customer. [Brief explanation of the drawing]

[0005] [Figure 1] Figure 1 is a perspective view showing an example of the external appearance of a self-service POS device according to the first embodiment. [Figure 2] Figure 2 shows an example of the hardware configuration of a POS terminal according to the first embodiment. [Figure 3] Figure 3 shows an example of the hardware configuration of a scanner according to the first embodiment. [Figure 4] Figure 4 is a block diagram showing an example of the functional configuration of a self-service POS device according to the first embodiment. [Figure 5] Figure 5 shows an example of a specific customer behavior according to the first embodiment. [Figure 6] Figure 6 is a flowchart showing an example of the product registration process according to the first embodiment. [Figure 7] Figure 7 is a flowchart showing an example of the product registration process according to the second embodiment. [Figure 8] Figure 8 shows an example of the screen transitions of a self-service POS device according to the third embodiment. [Figure 9] Figure 9 shows an example of the overall configuration of the product information management system according to the fourth embodiment. [Figure 10] Figure 10 shows an example of the hardware configuration of an image recognition device according to the fourth embodiment. [Figure 11]Figure 11 is a block diagram showing an example of the functional configuration of a self-service POS device according to the fourth embodiment. [Figure 12] Figure 12 is a block diagram showing an example of the functional configuration of an image recognition device according to the fourth embodiment. [Modes for carrying out the invention]

[0006] The embodiments will be described in detail below with reference to the drawings. However, the invention is not limited to the embodiments described below.

[0007] (First embodiment) Figure 1 is a perspective view showing an example of the external appearance of a self-service POS (Point of Sales) device 1 according to the first embodiment. The self-service POS device 1 can be operated by the customer purchasing the goods. The self-service POS device 1 is installed in stores such as supermarkets and convenience stores. The self-service POS device 1 is an example of a product information registration device in this embodiment. The self-service POS device 1 performs product registration processing and accounting processing in response to the operation of the user, the customer.

[0008] The self-service POS device 1 includes, for example, a POS terminal unit 10 and a scanner 20 built into the POS terminal unit 10.

[0009] Scanner 20 is a reading device that reads the code symbol of a product. Scanner 20 captures an image of the product and acquires an image of the product's appearance (hereinafter referred to as the product image). Scanner 20 transmits the acquired product image to the POS terminal 10 via a LAN (Local Area Network) or USB (Universal Serial Bus) cable, etc. Scanner 20 also detects and decodes the product barcode (1D code and 2D code), which is the code symbol contained in the acquired product image. In other words, Scanner 20 reads the information held by the product barcode. Scanner 20 transmits the decoded product barcode result as an output code to the POS terminal 10.

[0010] The POS terminal unit 10 comprises a main unit 50, a first basket stand 70, and a second basket stand 80. The main unit 50 has a display 51 and a touch panel 52 on its top, and houses a printer 53, a card reader 54, and a change dispenser 55 (see Figure 2 for each) inside.

[0011] Display 51 is a display device such as an LCD (Liquid Crystal Display) that displays various information. For example, display 51 displays product information such as the product name and price of products registered by the customer during the customer registration operation. Display 51 also displays accounting information such as the total transaction amount and change amount in conjunction with the customer's accounting operation. Display 51 is an example of a display unit.

[0012] The touch panel 52 is located on the surface of the display 51 and inputs information corresponding to the touch location to the control unit 100 (see Figure 2) of the POS terminal unit 10. Customers using the POS terminal unit 10 can operate the touch panel 52 by touching various buttons and operation keys displayed on the display 51.

[0013] As shown in FIG. 1, below the display 51, a reading window 230 of the scanner 20, an issuing port 531 of a receipt printed by the printer 53, and a card insertion slot 541 of the card reader 54 are formed in the direction where the customer is located.

[0014] The reading window 230 is a window for the scanner 20 to image the appearance of the product. A customer who is a user operating the self-POS device 1 performs an operation related to product registration by shielding the product to be purchased against the reading window 230. The customer shields the product against the reading window 230 while changing the orientation with respect to the reading window 230 until the self-POS device 1 executes product registration and a registration completion sound is generated.

[0015] The issuing port 531 is an opening for discharging the paper printed by the printer 53. The paper is generally referred to as a receipt, and information (accounting processing information) related to the transaction processed by the POS terminal unit 10 is printed thereon. Note that the POS terminal unit 10 may be set to issue an electronic receipt that can be referred to on the customer's terminal or the like instead of the paper printed by the printer 53.

[0016] The card insertion slot 541 is an opening for inserting a credit card or the like that is a reading target of the card reader 54. When the customer makes a payment by credit card or when the customer allows the store membership card or the like to be read, the card is inserted through the card insertion slot 541.

[0017] In addition, in the main body 50, a coin insertion slot 551, a coin discharge port 552, a coin tray 553, a bill insertion slot 554, and a bill discharge port 555 are formed corresponding to the position of the coin dispenser 55 housed therein.

[0018] The coin insertion slot 551 is an opening through which a customer inserts coins for payment. The coins inserted into the coin insertion slot 551 are stored in the change machine 55. The coin discharge opening 552 is an opening through which the coins paid out from the change machine 55 are discharged. The coin discharge opening 552 discharges the coins that are change or the coins that were inserted from the coin insertion slot 551 and not accepted by the change machine 55. The coin tray 553 is a tray that receives the coins discharged from the coin discharge opening 552. The bill insertion slot 554 is an opening through which a customer inserts bills for payment. The bills inserted into the bill insertion slot 554 are stored in the change machine 55. The bill discharge opening 555 is an opening through which the bills that are change paid out from the change machine 55 are discharged.

[0019] The first basket placing table 70 is a table on which a shopping basket (not shown) containing the goods that the customer intends to purchase is placed. The first basket placing table 70 includes a first weighing unit 71.

[0020] The first weighing unit 71 weighs the weight of the goods before registration. More specifically, the first weighing unit 71 weighs the total weight of the shopping basket placed on the first basket placing table 70 and the goods contained in the shopping basket.

[0021] The second basket placing table 80 is a table on which a shopping basket (not shown) that contains the goods taken out from the shopping basket placed on the first basket placing table 70 and whose product barcode has been read, that is, the goods for which product registration has been completed, is placed. The second basket placing table 80 includes a second weighing unit 81, a pair of support rods 82, and a temporary table 83.

[0022] The second weighing unit 81 weighs the weight of registered products. More specifically, the second weighing unit 81 weighs the total weight of a shopping basket placed on the second basket support stand 80 and the products contained in the shopping basket, or the total weight of a shopping bag (not shown) supported by a pair of support rods 82 and the products contained in the shopping bag. The support rods 82 are rods for hooking and supporting a shopping bag containing registered products. The support rods 82 make it easier to put products into the shopping bag by supporting the shopping bag in an open state. The temporary stand 83 is a stand for temporarily placing products that are easily broken or deformed among the registered products, such as tofu and eggs. Customers can then place the products placed on the temporary stand 83 into a shopping basket or shopping bag.

[0023] The customer registers the items by holding the items they have taken out of the shopping basket placed on the first basket stand 70 over the reading window 230. The customer then places the registered items into a shopping basket placed on the second basket stand 80 or into a shopping bag supported by the support rod 82. Moving the registered items in this manner is one example of a prescribed operation by the customer in this embodiment.

[0024] The first weighing unit 71 measures the weight before and after removing items from a shopping basket placed on the first basket stand 70, allowing the control unit 100 (see Figure 3) to recognize the weight change. The second weighing unit 81 measures the weight before and after placing items in a shopping basket placed on the second basket stand 80 or in a shopping bag supported by a support rod 82, allowing the control unit 100 to recognize the weight change. By determining whether these two weight changes are equal, the control unit 100 can determine whether all the items the customer intends to purchase have been registered.

[0025] The main body 50 may also include a cylindrical pole 57 extending upward. The upper tip of the pole 57 may be provided with a light-emitting part 571 that illuminates when calling a store employee.

[0026] In Figure 1, the self-service POS device 1 is shown to include a POS terminal unit 10 and a scanner 20, but the scanner 20 may be a peripheral device not included in the self-service POS device 1. In this case, the POS terminal unit 10 may be referred to as the self-service POS device 1.

[0027] Next, the hardware configuration of the POS terminal unit 10 will be described.

[0028] Figure 2 shows an example of the hardware configuration of the POS terminal unit 10 according to the first embodiment. As shown in Figure 2, the POS terminal unit 10 includes a control unit 100, a storage unit 110, a display 51, a touch panel 52, a printer 53, a card reader 54, a change dispenser 55, a first weighing unit 71, a second weighing unit 81, a light-emitting unit 571, an audio output unit 120, a connection interface 121, and a LAN interface 122. These control unit 100, storage unit 110, display 51, touch panel 52, printer 53, card reader 54, change dispenser 55, first weighing unit 71, second weighing unit 81, light-emitting unit 571, audio output unit 120, connection interface 121, and LAN interface 122 are connected to each other via a bus 123 or the like.

[0029] The control unit 100 is configured as a computer equipped with a CPU (Central Processing Unit) 101, ROM (Read Only Memory) 102, and RAM (Random Access Memory) 103. The CPU 101, ROM 102, and RAM 103 are connected to each other via a bus 123.

[0030] The CPU 101 controls the entire POS terminal unit 10. The CPU 101 is an example of a processor, and an MPU (Micro Processing Unit) may be used instead. Furthermore, if it is a multi-core / multi-threaded processor, multiple processes can be executed in parallel. The processor may also be implemented in various other forms, including integrated circuits such as ASIC (Application Specific Integrated Circuit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), DSP (Digital Signal Processor), SoC (System on a Chip), and PLD (Programmable Logic Device), or a combination of several of these.

[0031] ROM 102 stores various programs and data, such as programs used to drive the CPU 101. RAM 103 is used as the work area for the CPU 101 and loads the various programs and data stored in ROM 102 and the memory unit 110. The control unit 100 executes various control processes of the POS terminal unit 10, for example, by having the CPU 101 operate according to the control program 111 stored in the memory unit 110 and loaded into RAM 103.

[0032] The RAM 103 has a product information unit 1031. The product information unit 1031 stores product information read from the product master 112 (described later) based on the output code obtained from the scanner 20. Product registration is performed when product information is stored (registered) in the product information unit 1031. The product information stored in the product information unit 1031 includes the product code, product name, and price. The product information unit 1031 stores product information related to one transaction and is cleared when the accounting processing for that transaction is completed.

[0033] The storage unit 110 is composed of a storage medium such as an HDD (Hard Disk Drive) or flash memory, and retains its contents even when the power is cut off. The storage unit 110 stores the control program 111 and the product master 112.

[0034] The control program 111 is a program for implementing various processes performed by the POS terminal unit 10. The control program 111 may be stored in the ROM 102 instead of the storage unit 110.

[0035] Product Master 112 is a master file that stores product information for products handled by a store. For example, Product Master 112 includes a product code, an output code associated with the product code, a product category, a product name, and a price. The product code is information that identifies the product. The product category is information that classifies the products sold in the store. The product name is information that indicates the name of the product. The price is information that indicates the price (unit price) of the product. In addition, Product Master 112 may also include other information associated with the product code.

[0036] The printer 53 is configured, for example, as a thermal printer. The printer 53 prints transaction information on roll-shaped receipt paper and issues it as a receipt from the issuing slot 531.

[0037] The card reader 54 reads the credit information necessary for payment from the credit card inserted through the card slot 541. The card reader 54 also reads member information that identifies the member from a membership card or point card or other medium inserted through the card slot 541. The card reader 54 may read information magnetically from the card, or it may be an IC card reader that reads information from an IC card with a built-in IC (Integrated Circuit) chip.

[0038] The change dispenser 55 accepts the banknotes and coins paid by the customer when the customer pays for the goods in cash, and dispenses change as needed.

[0039] The audio output unit 120 is a speaker that outputs voice or sound as needed to notify customers of information.

[0040] The connection interface 121 is an interface for communicating with the scanner 20 via LAN or USB cable. The control unit 100 sends and receives information (data) to and from the scanner 20 via the connection interface 121, via LAN or USB cable. For example, the control unit 100 receives output codes from the scanner 20 via the connection interface 121, via LAN or USB cable.

[0041] The LAN interface 122 is an interface that can connect to other information processing devices, etc., via a LAN. Other information processing devices include, for example, a store server (not shown) managed by a store, but are not limited to these.

[0042] Next, we will describe the hardware configuration of scanner 20.

[0043] Figure 3 shows an example of the hardware configuration of the scanner 20 according to the first embodiment. As shown in Figure 3, the scanner 20 comprises a control unit 200, a storage unit 210, an imaging unit 220, a connection interface 221, and a LAN interface 222. These control unit 200, storage unit 210, imaging unit 220, connection interface 221, and LAN interface 222 are connected to each other via a bus 223, etc.

[0044] The control unit 200 is configured as a computer equipped with a CPU 201, ROM 202, and RAM 203. The CPU 201, ROM 202, and RAM 203 are connected to each other via a bus 223.

[0045] The CPU 201 controls the entire scanner 20. A processor other than the CPU 201 may also be used. The ROM 202 stores various programs and data, such as the program used to drive the CPU 201. The RAM 203 is used as the work area for the CPU 201 and loads the various programs and data stored in the ROM 202 and the storage unit 210. The control unit 200 executes various control processes for the scanner 20, for example, by having the CPU 201 operate according to the control program stored in the storage unit 210 and loaded into the RAM 203.

[0046] The storage unit 210 is composed of a storage medium such as an HDD or flash memory, and retains its contents even when the power is cut off. The storage unit 210 stores, for example, control programs related to the processing performed by the scanner 20, a setting table that manages various settings for the scanner 20, and the decoding results of decoded product barcodes.

[0047] The imaging unit 220 is composed of, for example, a color CCD (Charge Coupled Device) image sensor or a color CMOS (Complementary Metal Oxide Semiconductor) image sensor. The imaging unit 220, in accordance with the control of the control unit 200, captures images of products through the reading window 230 and outputs the acquired product images. For example, the imaging unit 220 captures moving images at a predetermined frame rate. The imaging unit 220 sequentially stores the captured frame images in the RAM 203. The frame images (product images) held in the RAM 203 are used to identify the code value of the product shown in the frame image.

[0048] Furthermore, the imaging unit 220 in this embodiment captures not only product images but also customer images. More specifically, the imaging range of the imaging unit 220 is sized and oriented to capture at least the customer's hands and the product held by the customer. The customer's hands refer to the area including the customer's hands and the vicinity of those hands. The image of the customer captured by the imaging unit 220 is called a customer image. The imaging unit 220 continuously captures the customer, for example, while the customer is performing product registration and payment operations. The customer image may be a video, or it may be a series of images captured at regular intervals.

[0049] The connection interface 221 is an interface for communicating with the POS terminal unit 10 via LAN or USB cable. The control unit 200 sends and receives information (data) to and from the POS terminal unit 10 via the connection interface 221, either via LAN or USB cable.

[0050] The LAN interface 222 is an interface for communicating with other information processing devices, etc., via the LAN.

[0051] The control unit 200 of the scanner 20 detects the product barcode contained in the frame image (product image) held by the RAM 203 and obtains the product code by decoding the product barcode. The control unit 200 transmits the decoded product code to the POS terminal unit 10 via the connection interface 221. The control unit 200 of the scanner 20 also transmits the customer image captured by the imaging unit 220 to the POS terminal unit 10 via the connection interface 221.

[0052] Next, the functional configuration of the self-service POS device 1 will be described. Figure 4 is a block diagram showing an example of the functional configuration of the self-service POS device 1 according to the first embodiment. In Figure 4, the functions mainly implemented in the POS terminal unit 10 will be described.

[0053] As shown in Figure 4, the self-service POS device 1 is functionally configured to include a reception unit 1001, a product registration unit 1002, an image acquisition unit 1003, a behavior detection unit 1004, a condition change unit 1005, a weight acquisition unit 1006, a display control unit 1007, an audio output control unit 1008, an accounting processing unit 1009, and a transmission / reception control unit 1010.

[0054] Some or all of the functional configuration of the self-service POS device 1 may be a software configuration realized through the cooperation of the processor (e.g., CPU 101) and the memory (e.g., ROM 102, storage unit 110) of the POS terminal unit 10 of the self-service POS device 1. Alternatively, some or all of the functional configuration of the self-service POS device 1 may be a hardware configuration realized by a dedicated circuit or the like installed in the self-service POS device 1.

[0055] The reception unit 1001 accepts user (customer) operations via the touch panel 52.

[0056] The product registration unit 1002 registers the products that the customer intends to purchase. More specifically, the product registration unit 1002 obtains the product code decoded by the scanner 20 via the connection interface 121 and registers it in the storage unit 110, etc. The product registration unit 1002 is an example of a product registration means in this embodiment.

[0057] The image acquisition unit 1003 acquires customer images captured by the imaging unit 220 of the scanner 20 via the connection interface 221. The image acquisition unit 1003 is an example of an image acquisition means in this embodiment.

[0058] The behavior detection unit 1004 detects specific customer behaviors from customer images acquired by the image acquisition unit 1003.

[0059] A specific customer action is one that, other than operating the self-service POS device 1, is likely to take more than a certain amount of time. A concrete example of a specific customer action is putting items into a bag.

[0060] Figure 5 shows an example of a specific action of customer C according to the first embodiment. As described above, customer C registers the product by taking the product 8 from the shopping basket (not shown) placed on the first basket stand 70, which is the object to be weighed by the first weighing unit 71 of the self-service POS device 1, and holding it up to the scanner 20. Then, customer C places the registered product 8 into another shopping basket (not shown) placed on the second basket stand 80 or into a shopping bag (not shown) supported by the support rod 82, and places it on the second weighing unit 81.

[0061] However, during the movement of product 8 from the first weighing unit 71 to the second weighing unit 81, customer C may place product 8 in an individual packaging bag 90 such as a Timee bag, as shown in Figure 5. When product 8 is packaged in this way, the time required from when product 8 is registered until it is placed on the second weighing unit 81 is longer compared to when it is not packaged.

[0062] The method for detecting a specific action of customer C is not particularly limited. For example, the action detection unit 1004 may detect a specific action when it recognizes an object that represents a specific action of customer C. More specifically, the action detection unit 1004 may detect the action of putting product 8 into bag 90 when it recognizes customer C's hand H, product 8, and bag 90 from the customer image. The specific action to be detected and the detection conditions for that action (for example, recognizing customer C's hand H, product 8, and bag 90 from the customer image) may be associated and stored, for example, in a storage unit 110.

[0063] The method for recognizing customer C's hand H, product 8, and bag 90 from a customer image is not particularly limited. For example, image recognition techniques using deep learning such as CNN (Convolutional Neural Network) can be employed.

[0064] It should be noted that the specific actions of customer C are not limited to the examples shown in Figure 5, but any action that is likely to take more than a certain amount of time is acceptable. For example, actions such as rotating product 8 to find the code symbol during product registration processing, organizing the contents of a shopping bag supported by support rod 82, or searching for a wallet during checkout processing may be specific actions of customer C. Furthermore, the time exceeding a certain amount of time is, for example, a first length of time or more until an alert is issued by the display control unit 1007 or the voice output control unit 1008, which will be described later.

[0065] Returning to Figure 4, the condition change unit 1005 changes the waiting time for a predetermined operation by customer C until an alert is issued by the display control unit 1007 or the voice output control unit 1008, described later, when the action detection unit 1004 detects a specific action by customer C. For example, the condition change unit 1005 changes the waiting time for a predetermined operation by customer C from a first length to a second length that is longer than the first length. The condition change unit 1005 is an example of a control means in this embodiment. The entire control unit 100 may also be an example of a control means.

[0066] The weight acquisition unit 1006 acquires the weights measured by the first weighing unit 71 and the second weighing unit 81, respectively. The weight acquisition unit 1006 is an example of a weight acquisition means in this embodiment.

[0067] The display control unit 1007 controls the display 51 to display various screens. For example, the display control unit 1007 notifies customer C if the waiting time for a specified operation is greater than or equal to a first length.

[0068] In this embodiment, the prescribed operation for customer C is, for example, to place the registered product 8 on the second weighing unit 81 within a prescribed time, as shown in the example in Figure 5. In this case, the waiting time for customer C's prescribed operation is the time from when the product 8 is registered until the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81 match.

[0069] However, the prescribed operation is not limited to this; customer C may also input information by operating the touch panel 52 or by holding the next product 8 over the scanner 20.

[0070] Here, the measurement result of the first weighing unit 71 and the measurement result of the second weighing unit 81 are said to match if the difference between the decrease in weight measured by the first weighing unit 71 and the increase in weight measured by the second weighing unit 81 is within the specified range. Since changes in weight due to packaging such as bags 90 may also occur, the decrease in weight measured by the first weighing unit 71 and the increase in weight measured by the second weighing unit 81 do not necessarily have to be exactly the same, but they may still be treated as "matching". Furthermore, the measurement result of the first weighing unit 71 and the measurement result of the second weighing unit 81 are said to not match if the difference between the decrease in weight measured by the first weighing unit 71 and the increase in weight measured by the second weighing unit 81 exceeds the specified range.

[0071] If the weighing result from the first weighing unit 71 and the weighing result from the second weighing unit 81 match for each registered product, then the weight of the products in the shopping basket placed on the first basket stand 70 before the product registration process matches the weight of the products in another shopping basket placed on the second basket stand 80 or in a shopping bag supported by the support rod 82 after the product registration process. This weight matching determination can prevent acts such as fraudulently acquiring products without paying. The specified range for weight difference is, for example, a few grams, but it may be set by store staff or others according to the security level required for the self-POS device 1.

[0072] The display control unit 1007 notifies the customer C if the behavior detection unit 1004 has not detected a specific action by the customer C, and if the waiting time for the customer C's prescribed operation is greater than or equal to a first length. For example, the display control unit 1007 may superimpose a pop-up display on the display 51 on the product registration screen prompting the customer C to place the product 8 into a shopping basket placed on the second basket stand 80 or into a shopping bag supported by the support rod 82. This is because, although it is acceptable for a temporary discrepancy to occur between the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81 for the purpose of registering the product 8, it is desirable that this discrepancy be resolved as quickly as possible after the product 8 is registered.

[0073] Furthermore, the display control unit 1007 notifies the customer C if the behavior detection unit 1004 detects a specific behavior of customer C, and the waiting time for customer C's prescribed operation is greater than or equal to the second length. The second length is longer than the first length. In this embodiment, the first length and the second length are predetermined fixed lengths of time. For example, the first length may be 5 seconds and the second length may be 30 seconds, but it is not limited to these.

[0074] Furthermore, the display control unit 1007 does not notify if the behavior detection unit 1004 has not detected a specific action by customer C, and if a specified operation by customer C is performed before a first length of time has elapsed since the registration of product 8. Also, the display control unit 1007 does not notify if the behavior detection unit 1004 has detected a specific action by customer C, and if a specified operation by customer C is performed before a second length of time has elapsed since the registration of product 8.

[0075] Furthermore, the voice output control unit 1008 controls the voice output unit 120 to output voices, alert sounds, etc. In the event of a discrepancy between the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81, the voice output control unit 1008 may also provide notification, in addition to the notification by the display control unit 1007 described above. For example, the voice output control unit 1008 may cause the voice output unit 120 to output a voice message prompting the user to place the product 8 into a shopping basket placed on the second basket stand 80 or into a shopping bag supported by the support rod 82. The conditions for outputting the notification are the same as those for the display control unit 1007.

[0076] The display control unit 1007 and the audio output control unit 1008 are examples of notification means in this embodiment. The content of the notification by the display control unit 1007 and the audio output control unit 1008 is not limited to the above example, and may be anything that prompts the waiting customer C to perform a specified operation.

[0077] The accounting processing unit 1009 performs accounting processing for the registered product 8 based on the customer C's actions. For example, the accounting processing unit 1009 settles the payment for the registered product 8 using the payment method selected by customer C.

[0078] The transmit / receive control unit 1010 controls the transmission and reception of information with other devices via the LAN interface 122 and the connection interface 121.

[0079] Next, we will explain the processing flow performed by the self-service POS device 1 configured as described above. Here, we will explain the product registration process as an example.

[0080] Figure 6 is a flowchart showing an example of the product registration process according to the first embodiment.

[0081] When the product registration process begins, the weight acquisition unit 1006 acquires the weights measured from the first weighing unit 71 and the second weighing unit 81, respectively (S1). Thereafter, until the product registration process is completed, the weight acquisition unit 1006 continues to acquire weights from the first weighing unit 71 and the second weighing unit 81.

[0082] Next, the scanner 20 reads the code symbol of product 8 held up to the imaging unit 220 by customer C, decodes the code symbol, and transmits the resulting product code to the POS terminal unit 10 (S2). The product registration unit 1002 of the POS terminal unit 10 acquires the read product code and registers the purchased product 8 by saving the product code in the storage unit 110 or the like (S3).

[0083] The image acquisition unit 1003 acquires customer images captured by the imaging unit 220 of the scanner 20 via the connection interface 221 (S4).

[0084] The condition change unit 1005 then changes the notification waiting time depending on whether the action detection unit 1004 has detected a specific action of customer C from the customer image. For example, if the action detection unit 1004 has not detected a specific action of customer C from the customer image, the condition change unit 1005 does not change the notification waiting time from the first time.

[0085] Therefore, if the behavior detection unit 1004 does not detect a specific behavior of customer C from the customer image (S5 "No"), and the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81 do not match (S6 "Yes"), and the elapsed time since product registration is equal to or greater than the first length (S7 "Yes"), the display control unit 1007 and / or the voice output control unit 1008 will issue a notification (S8). For example, the display control unit 1007 may display on the display 51 a message prompting customer C to place the registered product 8 into a shopping basket placed on the second basket stand 80 or into a shopping bag supported by the support rod 82. Alternatively, the voice output control unit 1008 may output a voice message or alert sound to the voice output unit 120 to prompt customer C to place the registered product 8 into a shopping basket placed on the second basket stand 80 or into a shopping bag supported by the support rod 82.

[0086] If the elapsed time since product registration is less than the first length (S7 "No"), the process returns to S4, and if the weight discrepancy is resolved before the elapsed time since product registration is equal to or greater than the first length, the display control unit 1007 and / or the audio output control unit 1008 will not provide notification.

[0087] After notification in S8, the process returns to S4, and notification continues until the discrepancy between the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81 is resolved when customer C places product 8 into a shopping basket placed on the second basket stand 80 or into a shopping bag supported by the support rod 82.

[0088] Furthermore, if the behavior detection unit 1004 detects a specific action of customer C from the customer image, the condition change unit 1005 changes the notification waiting time to the second time. For this reason, if the behavior detection unit 1004 detects a specific action of customer C from the customer image acquired by the image acquisition unit 1003 (S5 "Yes"), and the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81 do not match (S9 "Yes"), and the elapsed time since product registration is equal to or greater than the second length (S10 "Yes"), the display control unit 1007 and / or the voice output control unit 1008 will issue a notification (S11). This is because, even if it takes time for product 8 to move because customer C is performing a specific action such as bagging, it is undesirable from a security standpoint for the weight discrepancy to persist indefinitely.

[0089] Furthermore, if the elapsed time since product registration is less than the second length (S10 "No"), the process returns to S4, and if the weight discrepancy is resolved before the elapsed time since product registration is equal to or greater than the second length, the display control unit 1007 and / or the audio output control unit 1008 will not provide notification.

[0090] After notification in S11, the process returns to S4, and notification continues until the discrepancy between the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81 is resolved when customer C places product 8 into a shopping basket placed on the second basket stand 80 or into a shopping bag supported by the support rod 82.

[0091] Furthermore, regardless of whether or not a specific action by customer C is detected, if the discrepancy between the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81 is resolved (S6 "No" or S9 "No"), and customer C has not completed the product registration operation (S12 "No"), the process returns to S2 and the reading of the code symbol for the next product is performed.

[0092] Furthermore, if customer C completes the product registration process (S12 "Yes"), the product registration process in this flowchart is terminated. Note that after this flowchart, accounting processing for the registered product 8 may be performed.

[0093] As described above, the self-service POS device 1 of this embodiment, if it does not detect a specific action of customer C from the customer image captured of customer C purchasing product 8, notifies the customer if the waiting time for customer C to perform a prescribed operation is longer than a first length. Furthermore, if the self-service POS device 1 of this embodiment detects a specific action of customer C from the customer image, it notifies the customer if the waiting time for customer C to perform a prescribed operation is longer than a first length, i.e., longer than a second length. In other words, the self-service POS device 1 of this embodiment provides customer C with time to perform the operation without rushing by extending the waiting time before notification when a specific action of customer C is detected. This reduces customer C's resistance to using the self-service POS device 1, which they operate themselves.

[0094] For example, with a manned POS system operated by a store employee, the employee can anticipate customer C's situation and wait for them. However, with a typical self-service POS system, the system performs mechanical actions regardless of customer C's situation, which can cause customer C to feel impatient or perceive the system as impersonal. In contrast, by changing the timing of notifications according to customer C's actions, as in the self-service POS system 1 of this embodiment, it is possible to reduce the negative feelings customer C may have towards the self-service POS system 1.

[0095] Furthermore, in this embodiment, the first and second lengths of the waiting time until notification output are predetermined fixed lengths. In this embodiment, when the self-POS device 1 detects a specific action by customer C, it does not issue a notification if customer C performs the operation before the second length of time has elapsed. Therefore, if customer C performs the operation within an appropriate time range when a specific action is detected, for example, within the time range generally required to bag the product 8, customer C can continue using the self-POS device 1 without feeling inconvenienced by the notification.

[0096] Furthermore, the self-service POS device 1 of this embodiment obtains the weight measured by a first weighing unit 71 that weighs the registered product 8 and a second weighing unit 81 that weighs the product 8 that has already been registered. The prescribed operation of customer C is to place the registered product 8 on the second weighing unit 81 within a prescribed time. A specific action of customer C is to put the product 8 into a bag. If the self-service POS device 1 of this embodiment does not detect a specific action of customer C, it notifies the customer if there is a discrepancy between the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81 within a first length of time after the product 8 is registered. If the self-service POS device 1 of this embodiment detects a specific action of customer C, it notifies the customer if there is a discrepancy between the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81 within a second length of time after the product 8 is registered. Therefore, according to the self-POS device 1 of this embodiment, by changing the timing of notifications according to the customer C's situation, it is possible to encourage the customer C to place the product 8 on the second weighing unit 81 within a specified time without rushing them unnecessarily.

[0097] (Second embodiment) In the first embodiment described above, the first and second lengths of the notification waiting time were assumed to be predetermined fixed lengths. However, the method for extending the notification waiting time when a specific action by customer C is detected is not limited to this.

[0098] The self-service POS device 1 of this embodiment has the same configuration as the first embodiment described in Figures 1 to 3. Furthermore, the self-service POS device 1 of this embodiment has the same functional configuration as the first embodiment described in Figure 4, including a reception unit 1001, a product registration unit 1002, an image acquisition unit 1003, a behavior detection unit 1004, a condition change unit 1005, a weight acquisition unit 1006, a display control unit 1007, an audio output control unit 1008, an accounting processing unit 1009, and a transmission / reception control unit 1010.

[0099] In this embodiment, the first length of the notification waiting time is a predetermined fixed length of time, similar to the first embodiment. In contrast, the second length is a variable length of time, and while the action detection unit 1004 is detecting a specific action of customer C from the customer image, the display control unit 1007 and / or the audio output control unit 1008 will not perform notification even if the waiting time exceeds the first length.

[0100] Furthermore, the display control unit 1007 and / or the voice output control unit 1008 of this embodiment provide notification when a predetermined third length of time has elapsed since the behavior detection unit 1004 last detected a specific action of customer C. The predetermined third length is not particularly limited, but for example, it may be the general length of time required from when customer C finishes a specific action such as bagging product 8 until the product 8 is placed in a shopping basket on the second basket stand 80 or in a shopping bag supported by the support rod 82.

[0101] In this embodiment, an example of the second length is the time obtained by adding a predetermined third length to the time from the registration of product 8 to the time when a specific action of customer C is last detected.

[0102] Figure 7 is a flowchart showing an example of the product registration process according to the second embodiment. The process from obtaining the weight in S1 to detecting a specific action of customer C in S5 is the same as in the first embodiment described in Figure 6. Furthermore, the processing after failing to detect a specific action of customer C in S5 is also the same as in the first embodiment described in Figure 6.

[0103] In this embodiment, if the behavior detection unit 1004 detects a specific behavior of customer C from the customer image acquired by the image acquisition unit 1003 (S5 "Yes"), and the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81 do not match (S21 "Yes"), the image acquisition unit 1003 acquires a new customer image (S22).

[0104] Then, if the behavior detection unit 1004 detects a specific behavior of customer C from the new customer image (S23 "Yes"), the display control unit 1007 and / or the audio output control unit 1008 do not provide notification, and the process returns to S21.

[0105] Furthermore, if the behavior detection unit 1004 does not detect a specific behavior of customer C from the new customer image (S23 "No"), and the elapsed time since the last detection of a specific behavior of customer C is greater than or equal to the third length (S24 "Yes"), the display control unit 1007 and / or the voice output control unit 1008 will issue a notification (S25).

[0106] After notification in S25, the process returns to S21, and notification continues until the discrepancy between the weighing result of the first weighing unit 71 and the weighing result of the second weighing unit 81 is resolved when customer C places product 8 into a shopping basket placed on the second basket placement stand 80 or into a shopping bag supported by the support rod 82.

[0107] Furthermore, even if the behavior detection unit 1004 does not detect a specific behavior of customer C from the new customer image in S23, if the elapsed time since the last detection of a specific behavior of customer C is less than the third length (S24 "No"), no notification is given. In this case, the process returns to S21, and if the weight mismatch is resolved (S21 "No"), no notification is given, and the process proceeds to the product registration completion determination process in S12.

[0108] Thus, the self-POS device 1 of this embodiment does not notify even if the waiting time exceeds a first length while detecting a specific action of customer C, and notifies when a predetermined third length of time has elapsed since the last detection of a specific action of customer C. Therefore, in addition to the same effects as the first embodiment, the self-POS device 1 of this embodiment can further flexibly extend the notification waiting time according to the actions of customer C.

[0109] (Third embodiment) In the first and second embodiments described above, a specific action by customer C was defined as an action other than the operation of the self-service POS device 1 that required a certain amount of time. In this third embodiment, in addition to the above, a specific action by customer C is defined as an action that can identify a branch in the processing of the self-service POS device 1.

[0110] Self-service POS device 1 may change the processing it performs in response to customer C's actions. For example, at the beginning of the product registration process, self-service POS device 1 may display a screen asking customer C whether they need a paid shopping bag (plastic bag). In such cases, depending on customer C's response regarding the need for a shopping bag, self-service POS device 1 will change whether or not to include the cost of the shopping bag in the settlement.

[0111] However, such a process of asking customer C for answers may be bothersome to customer C. Therefore, the self-POS device 1 of this embodiment reduces the burden on customer C by automatically changing the processing in response to specific actions of customer C detected from the customer image, rather than requiring conscious operation by customer C.

[0112] The self-service POS device 1 of this embodiment has the same configuration as the first embodiment described in Figures 1 to 3.

[0113] Figure 8 is a block diagram showing an example of the functional configuration of the self-service POS device 1 according to the third embodiment.

[0114] The self-POS device 1 of this embodiment, like the first embodiment described in Figure 4, is functionally configured to include a reception unit 1001, a product registration unit 1002, an image acquisition unit 1003, a behavior detection unit 1004, a condition change unit 1005, a weight acquisition unit 1006, a display control unit 1007, an audio output control unit 1008, an accounting processing unit 1009, and a transmission / reception control unit 1010.

[0115] The reception unit 1001, product registration unit 1002, image acquisition unit 1003, condition change unit 1005, weight acquisition unit 1006, voice output control unit 1008, accounting processing unit 1009, and transmission / reception control unit 1010 have the same functions as in the first embodiment.

[0116] In addition to the same functions as in the first embodiment, the behavior detection unit 1004 of this embodiment detects, for example, the action of customer C placing a bag (reusable bag) brought by customer C onto a pair of support rods 82 as a specific action of customer C. The method for detecting this as a specific action of customer C is the same as in the first embodiment. The pair of support rods 82 is an example of a bag rack.

[0117] In addition to having the same functions as in the first embodiment, the display control unit 1007 of this embodiment displays a selection screen on the display 51 allowing customer C to choose whether or not they need a paid shopping bag to put the product 8 in, if the action detection unit 1004 does not detect customer C placing the bag they brought on the pair of support rods 82. Furthermore, if the display control unit 1007 detects customer C placing the bag they brought on the pair of support rods 82, it does not display the paid shopping bag selection screen on the display 51. The display control unit 1007 is an example of a display control means.

[0118] Figure 8 shows an example of screen transitions in the self-service POS device 1 according to the third embodiment. At the beginning of the product registration process, if the action detection unit 1004 does not detect that customer C has placed the bag they brought on the pair of support rods 82, the display control unit 1007 displays a shopping bag selection screen 501 on the display 51, in which customer C can select whether or not they need a shopping bag and the number of bags.

[0119] The shopping bag selection screen 501 includes a message prompting customer C to select a number of shopping bags, such as "Please select the number of shopping bags," operation buttons or input fields for entering whether or not a shopping bag is needed and the number of bags, a "No Shopping Bag Needed" button 513 to indicate that a shopping bag is not needed, and a confirmation button 512 to confirm the entered shopping bag needs and number of bags.

[0120] For example, when the reception unit 1001 receives an operation from customer C, who is a user, via the touch panel 52 to input the number of shopping bags and to press the confirmation button 512, it registers the price of the number of shopping bags entered as the item to be settled.

[0121] Furthermore, when the reception unit 1001 receives an operation from customer C, who is a user, pressing the "No plastic bag needed" button 513 via the touch panel 52, the display control unit 1007 transitions to the product registration screen 502. In this case, the price of the plastic bag is not registered as an item to be paid for. In other words, the processing of the self-POS device 1 differs depending on the operation of customer C.

[0122] In this embodiment, the display control unit 1007 of the self-service POS device 1 detects that customer C has placed a bag brought by the customer onto a pair of support rods 82, and instead of displaying the shopping bag selection screen 501 on the display 51, it displays the product registration screen 502. Therefore, with the self-service POS device 1 of this embodiment, the inconvenience of customer C having to choose whether or not to purchase a paid shopping bag, even though they have brought their own bag, can be reduced.

[0123] The subsequent product registration process is the same as in the first embodiment described in Figure 6. In this embodiment, the self-POS device 1 is described as having a function to extend the notification waiting time depending on whether or not a specific action of customer C is detected, as in the first embodiment, but this function is not essential in this embodiment.

[0124] (Fourth embodiment) In the first to third embodiments described above, some of the functions described as functions of the self-POS device 1 may be implemented by other devices. For example, reading code symbols from images and detecting specific actions of customer C require a lot of processing resources. Therefore, by having other information processing devices connected to the self-POS device 1 handle some of the processing and the storage of information used for processing, effects such as faster processing can be obtained.

[0125] Figure 9 shows an example of the overall configuration of the product information management system MS according to the fourth embodiment. The product information management system MS includes the product information registration system RS according to the first embodiment and a server 40.

[0126] The product information registration system RS comprises a POS terminal unit 10, a scanner 20, and an image recognition device 30 as an example of a product image recognition device according to the first embodiment. The POS terminal unit 10 and the scanner 20 are connected to communicate via a LAN or USB cable. The scanner 20 and the image recognition device 30 are connected to communicate via a LAN. Furthermore, the LAN is not limited to a wired LAN; it may also be a wireless LAN, or a mixture of wired and wireless connections may be used.

[0127] The POS terminal unit 10 and the image recognition device 30 are connected to a LAN hub LH via LAN so as to be able to communicate. The LAN hub LH is connected to a router RT via LAN so as to be able to communicate. The router RT can communicate with the server 40 via the network NW. The router RT may be connected to the network NW via a wired connection and communicate via wired communication, or it may be connected to the network NW via wireless communication and communicate via wireless communication.

[0128] Note that although Figure 9 shows only one product information registration system RS per LAN hub LH, there may be multiple product information registration systems RS. Similarly, although only one LAN hub LH per router RT is shown, there may be multiple LAN hub LHs. Furthermore, there may be multiple router RTs. For example, one or more LAN hub LHs under one router RT and one or more product information registration systems RS under each LAN hub LH can be deployed in one store. Server 40 can be, for example, a management server located in the headquarters that manages and oversees the operations of multiple stores in a company that operates multiple stores.

[0129] The hardware configuration of the scanner 20 and the POS terminal unit 10 is the same as in the first embodiment. The image recognition device 30 may be built into the main body 50 of the self-service POS device 1, for example, or it may be installed near the self-service POS device 1.

[0130] Figure 10 shows an example of the hardware configuration of the image recognition device 30 according to the fourth embodiment. The image recognition device 30 is, for example, an edge device that is responsible for image recognition processing.

[0131] As shown in Figure 10, the image recognition device 30 comprises a control unit 300, a storage unit 310, and a LAN interface 321. These control unit 300, storage unit 310, and LAN interface 321 are connected to each other via a bus 322, etc.

[0132] The control unit 300 is configured as a computer equipped with a CPU 301, ROM 302, and RAM 303. The CPU 301, ROM 302, and RAM 303 are connected to each other via a bus 322.

[0133] The CPU 301 controls the entire image recognition device 30. A processor other than the CPU 301 may also be used. The ROM 302 stores various programs and data, such as the program used to drive the CPU 301. The RAM 303 is used as the work area for the CPU 301 and loads the various programs and data stored in the ROM 302 and the storage unit 310. The control unit 300 executes various control processes for the image recognition device 30, for example, by having the CPU 301 operate according to the control program stored in the storage unit 310 and loaded into the RAM 303.

[0134] The storage unit 310 is composed of a storage medium such as an HDD or flash memory, and retains its contents even when the power is cut off. The storage unit 310 stores, for example, a control program that defines the processing of the image recognition device 30, a trained model for performing image recognition, and various setting tables.

[0135] The LAN interface 321 is an interface for communicating with the scanner 20 and the LAN hub LH. The control unit 300 sends and receives information (data) to and from the scanner 20 and the LAN hub LH via the LAN interface 321. For example, the control unit 300 may receive the code value of the decoded code symbol of product 8 from the scanner 20. The control unit 300 transmits the image recognition result to the scanner 20 via the LAN interface 321. The information transmitted by the image recognition device 30 to the scanner 20 is transmitted from the scanner 20 to the POS terminal unit 10. Alternatively, various data may be transmitted directly from the image recognition device 30 to the POS terminal unit 10 without going through the scanner 20.

[0136] Furthermore, the control unit 300 of the image recognition device 30 may, if necessary, transmit the product image that has undergone image recognition and the code value of the decoded result received from the scanner 20 to the server 40 via the LAN interface 321. The control unit 300 of the image recognition device 30 may also transmit the customer image received from the scanner 20 to the server 40.

[0137] In this embodiment, since the image recognition device 30 has image recognition functions, the self-POS device 1 does not need to have image recognition functions compared to the first embodiment.

[0138] Figure 11 is a block diagram showing an example of the functional configuration of the self-service POS device 1 according to the fourth embodiment. In Figure 11, the functions mainly implemented in the POS terminal unit 10 will be explained.

[0139] As shown in Figure 11, the self-POS device 1 of this embodiment includes, as its functional configuration, a reception unit 1001, a product registration unit 1002, a condition change unit 1005, a weight acquisition unit 1006, a display control unit 1007, a voice output control unit 1008, an accounting processing unit 1009, and a transmission / reception control unit 1010.

[0140] The reception unit 1001, product registration unit 1002, condition change unit 1005, weight acquisition unit 1006, display control unit 1007, voice output control unit 1008, and accounting processing unit 1009 of the self-service POS device 1 have the same functions as those of the first embodiment described in Figure 4.

[0141] The transmission / reception control unit 1010 has the same functions as in the first embodiment and receives from the image recognition device 30 or scanner 20 whether or not the image recognition device 30 has detected a specific action of customer C. The transmission / reception control unit 1010 is an example of a receiving means in this embodiment.

[0142] Figure 12 is a block diagram showing an example of the functional configuration of the image recognition device 30 according to the fourth embodiment. As shown in Figure 12, the image recognition device 30 includes an image acquisition unit 3001, a behavior detection unit 3002, and a transmission / reception control unit 3004. In addition to the functions shown in Figure 12, the image recognition device 30 may also include an image processing function for product identification by image recognition.

[0143] The image acquisition unit 3001 acquires customer images captured by the imaging unit 220 of the scanner 20, similar to the image acquisition unit 1003 of the self-service POS device 1 in the first embodiment.

[0144] The behavior detection unit 3002 detects specific actions of customer C from customer images acquired by the image acquisition unit 3001, similar to the behavior detection unit 1004 of the self-POS device 1 in the first embodiment.

[0145] According to the product information registration system RS of this embodiment, the image recognition device 30 handles the computationally intensive image recognition processing, thereby achieving the same effects as in the first embodiment, as well as faster processing.

[0146] (Variation 1) In the above embodiment, a fully self-service self-POS system 1 in which customer C performs all product registration and accounting processing was used as an example of a product information registration device. However, the product information registration device is not limited to a fully self-service system. The product information registration device only needs to allow customer C to operate at least a part of the product registration and accounting processing themselves. For example, it could be a semi-self-service POS system in which a store employee performs product registration and customer C performs accounting processing.

[0147] (Modification 2) In the embodiments described above, the imaging unit 220 of the scanner 20 was equipped with the function of capturing customer images, but the imaging unit that captures customer images is not limited to this. For example, the POS terminal unit 10 may be equipped with an imaging unit, and the customer image may be captured by this imaging unit.

[0148] Alternatively, the imaging unit may be a surveillance camera mounted near the self-service POS device 1 or on the ceiling of the store.

[0149] (Variation 3) In the first embodiment, the POS terminal unit 10 and the scanner 20 were described as separate devices, but the POS terminal unit 10 may also have the functionality of the scanner 20. In this case, the POS terminal unit 10 may decode the product barcode. Furthermore, the method for obtaining the product code is not limited to decoding the code symbol. For example, the POS terminal unit 10, the scanner 20, or the image recognition device 30 may identify the product code of the product by image recognition from an image of the product's appearance.

[0150] (Modification 4) In the embodiments described above, the image acquisition unit 1003, action detection unit 1004, display control unit 1007, audio output control unit 1008, and weight acquisition unit 1006, which are software-based functional configurations, were used as examples of image acquisition means, notification means, and weight acquisition means. However, these means may also represent hardware configurations.

[0151] For example, the scanner 20, imaging unit 220, or connection interface 121 may be examples of image acquisition means. Also, the display 51 and / or audio output unit 120 may be examples of notification means. Furthermore, the first weighing unit 71 and the second weighing unit 81 may be examples of weight acquisition means.

[0152] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, modifications, and combinations are possible without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of symbols]

[0153] 1 Self-service POS device 8 products 10 POS terminal section 20 Scanners 30 Image recognition device 40 servers 50 Main body 51 displays 52 Touch Panel 53 Printers 54 Card Reader 55 Change machine 57 Paul 70 First basket mounting platform 71 1st weighing section 80 Second basket mounting platform 81 2nd weighing section 82 Support rod 83 Temporary Stand 90 bags 100, 200, 300 Control Unit 101 CPU 102 ROM 103 RAM 110,210,310 Storage section 111 Control Program 112 Product Master 120 Audio output section 121,221 Connection Interfaces 122,222,321 LAN interfaces 123,223,322 buses 201,301 CPU 202,302 ROM 203,303 RAM 220 Imaging Department 230 Reading window 501 Shopping bag selection screen 502 Product Registration Screen 512 Confirm button 513 "No plastic bag needed" button 531 issuing accounts 541 Card slot 551 Coin slot 552 Coin ejection port 553 Coin tray 554 Bill slot 555 Bill ejection port 571 Light-emitting part 1001 Reception Department 1002 Product Registration Department 1003,3001 Image acquisition unit 1004,3002 Action detection unit 1005 Condition Change Section 1006 Weight acquisition part 1007 Display Control Unit 1008 Audio Output Control Unit 1009 Accounting Processing Department 1010,3004 Transmit / Receive Control Unit 1031 Product Information Department C customer H hand [Prior art documents] [Patent Documents]

[0154] [Patent Document 1] Japanese Patent Publication No. 2023-84585

Claims

1. A product information registration device that can be operated by the customer, A product registration means for registering the products to be purchased by the aforementioned customer, Image acquisition means for acquiring an image of the aforementioned customer, A detection means for detecting specific customer behavior from the aforementioned image, If the detection means does not detect the specific action, a notification means provides notification if the waiting time for the customer's prescribed operation is longer than a first length; if the detection means does detect the specific action, a notification means provides notification if the waiting time for the customer's prescribed operation is longer than a first length (a second length); A product information registration device equipped with the following features.

2. The first length and the second length are predetermined fixed lengths of time, The notification means shall not provide notification if, when the detection means detects the specific action, the customer performs the prescribed operation before the second length of time has elapsed. The product information registration device according to claim 1.

3. The first length is a fixed length of time, The second length is a variable length of time, The notification means does not provide notification if the waiting time exceeds the first length while the detection means is detecting the customer's specific action, and provides notification when a predetermined third length of time has elapsed since the detection means last detected the customer's specific action. The product information registration device according to claim 1.

4. The system further comprises a first weighing unit for weighing the product before registration and a second weighing unit for weighing the product after registration, and a weight acquisition means for acquiring the weights measured from these units. The aforementioned customer's prescribed operation is to place the registered product on the second weighing unit within the prescribed time, The aforementioned specific action of the customer is the action of putting the product into a bag. The notification means shall, if the detection means has not detected the specific action, notify if the weighing result of the first weighing unit and the weighing result of the second weighing unit do not match within the first length of time after the product is registered; and if the detection means has detected the specific action, notify if the weighing result of the first weighing unit and the weighing result of the second weighing unit do not match within the second length of time after the product is registered. The product information registration device according to claim 1.

5. The aforementioned specific action of the customer is the action of placing the bag that the customer brought with them on the bag rack. The detection means detects the action of the customer placing the bag they brought onto the bag rack, The system further includes a display control means that, if the detection means does not detect the customer placing the bag they brought onto the bag rack, displays a selection screen on the display unit allowing the customer to choose whether or not they need a paid shopping bag to put the items in; and if the detection means detects the customer placing the bag they brought onto the bag rack, it does not display the selection screen on the display unit. A product information registration device according to any one of claims 1 to 4.

6. It includes a product information registration device that can be operated by the customer, and an image recognition device, The aforementioned image recognition device is Image acquisition means for acquiring an image of the aforementioned customer, The system includes a detection means for detecting specific customer behaviors from the aforementioned image, The aforementioned product information registration device is A product registration means for registering the products to be purchased by the aforementioned customer, Receiving means for receiving whether or not the image recognition device has detected the customer's specific behavior, The product information registration device provides notification if the waiting time for the customer's prescribed operation is longer than a first length when the product information registration device has not detected the specific action, and provides notification if the waiting time for the customer's prescribed operation is longer than a first length when the product information registration device has detected the specific action, and provides notification if the waiting time for the customer's prescribed operation is longer than a first length (a second length). Product information registration system.

7. The product registration step involves registering the products that the customer intends to purchase, Image acquisition step of acquiring an image of the aforementioned customer, A detection step for detecting a specific customer action from the aforementioned image, If the specific action is not detected, a notification is issued if the waiting time for the customer's prescribed operation is longer than or equal to a first length; if the specific action is detected, a notification is issued if the waiting time for the customer's prescribed operation is longer than or equal to a second length, which is longer than the first length. A program that causes a computer to execute something.

Images