Programs, information terminals, systems

Abstract

To implement the registration of articles using mobile terminals in a suitable manner.SOLUTION: A program for allowing a computer to function as an information terminal used for registering articles to be purchased includes: image acquisition means for acquiring images; registration means for registering articles based on article identification information in the images acquired by the image acquisition means; vibration detecting means for detecting vibration of the information terminal; and output means for outputting information on the purchase of the articles to an operator of the information terminal. The output means outputs information on the purchase of the articles when a predetermined vibration is detected by the vibration detection means and the articles have not been registered by the registration means before the detection of the vibration.SELECTED DRAWING: Figure 1

Description

【Technical Field】 【0001】 The present invention relates to a program, an information terminal, and a system. 【Background Art】 【0002】 A system for customers to register products themselves using a mobile terminal is known (see, for example, Patent Document 1). 【Prior Art Documents】 【Patent Documents】 【0003】 【Patent Document 1】 Japanese Unexamined Patent Application Publication No. 2018-147252 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0004】 However, in the above-described system, there is room for improvement, for example, in measures against malicious customers or inexperienced customers. 【0005】 The present invention has been made in view of such circumstances, and an object thereof is to provide a technique for suitably performing registration of products using a mobile terminal. 【Means for Solving the Problems】 【0006】 A program, which is one aspect for solving the above-described problems, causes a computer to function as an information terminal used for registering a product to be purchased, and causes the computer to function as an image acquisition unit that acquires an image, a registration unit that registers a product based on product identification information in the image acquired by the image acquisition unit, a vibration detection unit that detects vibration of the self-information terminal, and an output unit that can output information regarding purchase of the product to an operator of the self-information terminal. The output unit outputs information regarding purchase of the product when a predetermined vibration is detected by the vibration detection unit and the product has not been registered by the registration unit before the detection of the vibration. [Brief explanation of the drawing] 【0007】 [Figure 1] This is a conceptual diagram of a network used to explain the sales system. [Figure 2] This is an explanatory diagram describing a cart that can be fitted with a mobile device. [Figure 3] This is a sequence diagram illustrating the general operation of the mobile terminal, cloud server, and payment device. [Figure 4] This is an example of how it looks on a mobile device. [Figure 5] This is an example of how it looks on a mobile device. [Figure 6] This is a flowchart illustrating an example of how a mobile device works. [Figure 7] This is a flowchart illustrating an example of how a mobile device works. [Figure 8] This is a flowchart illustrating an example of how a mobile device works. [Figure 9] This flowchart illustrates other examples of how mobile devices work. [Figure 10] This flowchart illustrates other examples of how mobile devices work. [Figure 11] This flowchart illustrates other examples of how mobile devices work. [Modes for carrying out the invention] 【0008】 (First Embodiment) Figure 1 is a conceptual diagram of a network illustrating the sales system 1 of the first embodiment (the same applies to the second embodiment). The sales system 1 shown in Figure 1 includes a headquarters server 10, a cloud server 20, a store controller 30, a transaction status management device 40 (e.g., a personal computer), a settlement device 50, and a mobile terminal 60. 【0009】 Sales system 1 can be implemented in various types of businesses (supermarkets, convenience stores, drugstores, home centers, consumer electronics stores, etc.). In Figure 1, the dashed line T represents the inside of the store (product display area, checkout area, back room, etc.). As shown in Figure 1, the store controller 30, transaction status management device 40, and settlement device 50 are installed inside the store. These are connected via LAN 19 (which can be wired or wireless) for communication. A mobile terminal 60 is present inside the store. The mobile terminal 60 is basically used attached to (set up) a cart (shopping cart) 70. The headquarters server 10 and cloud server 20 are installed outside the store (for example, at the head office or data center). The devices installed inside the store (store controller 30, transaction status management device 40, settlement device 50) and the devices installed outside the store (head office server 10, cloud server 20) can communicate (either directly or via the store controller 30). 【0010】 Note that the number of each device (terminal) in Figure 1 is illustrative. For example, although "..." is shown to the right of the payment device 50 in Figure 1, the number of payment devices 50 installed in the store only needs to be one or more. Also, although two mobile terminals 60 are shown in Figure 1, the number of mobile terminals 60 used in the store will vary depending on the number of customers. In addition, other devices may be installed in the store. For example, a group of semi-self-service devices (registration device, payment device) that register products based on the operation of a store clerk and settle the payment based on the operation of the customer may be installed in the store, or a fully self-service device (registration and payment device) that registers products based on the operation of the customer and settles the payment based on the operation of the customer may be installed. 【0011】 (Mobile device 60) The mobile device 60 is used by the customer. Specifically, the mobile device 60 is used by the customer when registering products themselves within the store. The mobile device 60 is, for example, a smartphone, but it may also be a tablet device. The mobile device 60 may be owned by the customer, or it may be lent to the store. 【0012】 Although not shown in the diagram, the mobile terminal 60 includes, for example, a CPU, memory unit, display unit, operation unit, audio output unit (speaker), audio input unit (microphone), imaging unit (camera), and communication unit, as well as a vibration detection unit that detects vibrations (displacement, velocity, or acceleration) of the mobile terminal 60 (casing). The vibration detection unit can be any sensor (device) capable of detecting vibrations of the mobile terminal 60 (itself mobile terminal 60), such as an acceleration sensor or a gyroscope. When the vibration detection unit detects vibration, it outputs the detection result to the CPU. For example, the vibration detection unit outputs the magnitude of the detected vibration to the CPU as the detection result. The magnitude of vibration may be referred to as the vibration value (or vibration quantity). The magnitude of vibration (vibration value) detected by the vibration detection unit may be the magnitude of displacement, velocity, or acceleration. The vibration detection unit detects vibrations caused not only by placing products into the cart 70 (described later), but also vibrations caused by, for example, the movement (driving) of the cart 70. The mobile terminal 60 may also be equipped with a light-emitting unit (light). 【0013】 The CPU is a central processing unit that controls the entire mobile terminal 60 by reading and executing programs stored in the memory unit. The memory unit stores various types of information (for example, information referenced or generated by the CPU, information obtained from external sources, etc.). The memory unit is a general term for one or more different storage components (for example, memory or storage devices; for example, RAM, ROM, hard disk, SSD (Solid State Drive), etc.). The display unit is, for example, a liquid crystal display that displays various types of information (including image information). The display unit is configured as a touch panel that can accept operations on the display screen. The operation unit accepts operations from the operator (customer). The operation unit is a general term for one or more various operating elements (various operating elements (hard buttons) provided on the housing). Note that the display unit is configured as a touch panel and may be considered as part of the operation unit. The audio output unit outputs audio. The audio input unit inputs audio. The imaging unit acquires captured images (still images, moving images). The communication unit sends and receives various information. The communication unit is a general term for one or more various communication elements (for example, communication elements such as 5G mobile wireless communication, wireless LAN, short-range wireless communication, contactless communication, etc.). 【0014】 The mobile terminal 60 is equipped with a code recognition function (scanner function) that reads various codes (for example, barcodes such as JAN codes) from images acquired by the imaging unit. Registration by the mobile terminal 60 is achieved by this code recognition function. The mobile terminal 60 also performs control according to the status (state) of vibration detection and processing by the vibration detection unit. In other words, the mobile terminal 60 performs control according to the circumstances when vibration is detected, and control according to whether or not vibration has been detected in a given situation. Details will be described later. 【0015】 Figure 2 is an explanatory diagram illustrating a cart 70 to which a mobile terminal 60 can be attached. As shown in Figure 2, the cart 70 has a shopping basket holder section 71 on which a shopping basket 80 (not shown) can be placed, and a holder section 72 to which a mobile terminal 60 can be attached. Although it has been explained that the mobile terminal 60 is basically used attached to the cart 70, it is specifically used attached to the holder section 72. 【0016】 In the example shown in FIG. 2, the shopping basket 80 is not placed on the shopping basket placement section 71, and the mobile terminal 60 is not attached to the holder section 72. However, as a preparation, a customer places the shopping basket 80 on the shopping basket placement section 71 and attaches the mobile terminal 60 to the holder section 72. Further, a dedicated bag 90 for temporarily storing products that require confirmation by a store clerk at the time of settlement (products on hold with respect to carry-out by the customer or return to the store) is attached to the cart 70. 【0017】 When the mobile terminal 60 is attached to the holder section 72, an imaging image (through image (live view)) in the direction of looking down at the shopping basket 80 from the position of the holder section 72 is acquired by the imaging unit. When a customer finds a desired product (product to be purchased) in the product display area (display shelf), the customer picks up the product and moves it below the holder section 72 (the space between the holder section 72 and the shopping basket 80) so that the barcode attached to the product can be read by the scanner function. 【0018】 (Scanning operation) The operation of holding the product below the holder section 72 so that the barcode attached to the product can be read by the scanner function is referred to as a product scanning operation (or simply a scanning operation). Note that FIG. 4(B) shows a scene where the scanning operation is being performed. The mobile terminal 60 acquires a product code (product identification information) by the scanning operation. 【0019】 The mobile terminal 60 may recognize the product scanning operation. That is, the mobile terminal 60 may determine whether or not the product scanning operation is being performed (i.e., the presence or absence of the scanning operation). For example, the mobile terminal 60 may determine the presence or absence of the scanning operation based on whether or not an object such as a product, a hand, or a barcode is recognized in the captured image by an image recognition function using an image recognition technology (e.g., a pattern recognition technology or the like). 【0020】 (Settlement device 50) The payment device 50 is used by the customer. Specifically, the payment device 50 settles the payment for products registered by the mobile terminal 60 based on the customer's operation. In other words, the sales system 1 provides a service in which the customer registers products themselves using the mobile terminal 60 and settles the payment themselves using the payment device 50. 【0021】 Although not shown in the diagram, the payment device 50 includes a CPU, a memory unit, a display unit, a scanner unit, a card payment unit (non-cash payment unit), a change dispenser (cash payment unit), a printing unit, an audio output unit, an imaging unit, a communication unit, and a signpost. The payment device 50 may further include a key operation unit consisting of one or more various operating members, and sensors (such as motion sensors) that detect (detect and recognize) the presence of people. 【0022】 The CPU is a central processing unit that controls the entire payment device 50 by reading and executing programs stored in the memory unit. The memory unit stores various information. The memory unit is a general term for one or more different storage components. The display unit is, for example, a liquid crystal display that displays various information. The display unit is configured as a touch panel that can accept operations on the display screen. The scanner unit scans various codes (for example, payment codes (described later), product codes, employee codes attached to vouchers, point cards, employee name tags, etc.) and reads each code. 【0023】 The card payment unit is a payment mechanism that accepts various cards (credit cards, prepaid cards such as transportation cards, cash cards for debit payments, point cards for point payments, etc.). The change dispenser is a payment mechanism that accepts cash. The printing unit prints and issues various media (receipts, etc.). The audio output unit outputs audio (e.g., confirmation sounds, warning sounds, voice guidance, etc.). The imaging unit (camera) acquires captured images (still images, moving images). The communication unit is a general term for one or more various communication components. The sign pole has a light-emitting unit at its tip, and various information (call for staff, operating status, etc.) is communicated by the pattern of light emission from the light-emitting unit. 【0024】 (Headquarters Server 10) The headquarters server 10 is a server that manages the entire sales system 1. The headquarters server 10 stores various information (e.g., product master file (product master), etc.) and various performance information (e.g., sales performance information, product sales performance information, etc.). The headquarters server 10 also supplies various information (e.g., product master, etc.) to the cloud server 20 and the store controller 30. The product master is a file that stores product names, prices, etc., associated with product codes. Although not shown in the diagram, the headquarters server 10 includes at least a CPU, a storage unit, and a communication unit. The headquarters server 10 may be composed of multiple servers. 【0025】 (Cloud Server 20) The cloud server 20 is a server that primarily supports product registration by the mobile terminal 60. The cloud server 20 stores various types of information (e.g., product master data, transaction information (cart information), etc.). The cloud server 20 also supplies various types of information (e.g., screen information, etc.) to the mobile terminal 60 and the payment device 50. Although not shown in the diagram, the cloud server 20 comprises at least a CPU, a memory unit, and a communication unit. The cloud server 20 may be composed of multiple servers. 【0026】 (Store controller 30) The store controller 30 is a server primarily responsible for communicating information between devices installed inside the store (transaction status management device 40, settlement device 50) and devices installed outside the store (head office server 10, cloud server 20). Although not shown in the diagram, the store controller 30 comprises at least a CPU, a memory unit, and a communication unit. 【0027】 (Transaction status management device 40) The transaction status management device 40 is a device (for example, a personal computer) that manages (monitors and controls processing status, operating status, etc.) devices installed in the store (store controller 30, settlement device 50). Although not shown in the diagram, the transaction status management device 40 comprises at least a CPU, a memory unit, a display unit (which may be configured as a touch panel), an operation unit (keyboard, mouse, etc.), and a communication unit. The transaction status management device 40 can communicate with a printing device (not shown) and may output various information from the printing device. 【0028】 In addition to managing devices installed within stores, the transaction status management device 40 may also access the headquarters server 10, etc., to maintain the product master stored in the headquarters server 10, etc. (such as setting up products), or it may access the cloud server 20 to display or modify transaction information, etc., stored in the cloud server 20. 【0029】 (Overview of the operation of the mobile terminal 60, cloud server 20, and payment device 50) Figure 3 is a sequence diagram illustrating the general operation of the mobile terminal 60, the cloud server 20, and the payment device 50. The sequence diagram in Figure 3 shows the operation of each device (mobile terminal 60, cloud server 20, and payment device 50) from the time the mobile terminal 60 displays the initial registration screen (the registration screen before registering the first product item; the registration screen in Figure 4(A)) until the payment device 50 displays the product list screen (not shown). Note that since the sequence diagram in Figure 3 mainly explains the coordination of each device, the explanation of the part related to vibration control by the mobile terminal 60 described above is omitted in the sequence diagram in Figure 3. 【0030】 The mobile terminal 60 will, for example, display a service start screen (menu screen; not shown) based on customer operation, and display an initial registration screen based on operation of the "Start Shopping" button on the service start screen. Furthermore, when displaying the initial registration screen (based on operation of the "Start Shopping" button), the mobile terminal 60 will acquire (receive) transaction identification information from the cloud server 20 to identify the transaction (or transaction identification information of said transaction) made by the mobile terminal 60. 【0031】 Step S1: The mobile terminal 60 obtains the product code through the customer's scanning action. Step S2: The mobile terminal 60 sends the transaction identification information for the transaction and the product code obtained in Step S1 to the cloud server 20. 【0032】 Step S3: The cloud server 20 receives transaction identification information and product code from the mobile terminal 60. Step S4: The cloud server 20 updates the transaction information for the transaction (the transaction corresponding to the transaction identification information received in Step S) based on the product code. In other words, the cloud server 20 retrieves (extracts) the product name and price corresponding to the product code received in Step S3 from the product master and stores them in the transaction information for that transaction. Step S5: The cloud server 20 sends the updated transaction information to the mobile terminal 60. For example, the cloud server 20 generates a registration screen (for example, the registration screen in Figure 4(C)) that reflects the content of the updated transaction information, and sends the screen information of the registration screen to the mobile terminal 60. 【0033】 Step S6: The mobile terminal 60 receives screen information (transaction information) from the cloud server 20. Step S7: The mobile terminal 60 displays a registration screen based on the screen information received in Step S6. Specifically, in the case of a single product item, the mobile terminal 60 displays a registration screen reflecting that single product item instead of the initial registration screen, and in the case of a second or subsequent product item, the mobile terminal 60 displays a registration screen reflecting that second or subsequent product item. 【0034】 After step S7, there are two possibilities: either the product code is obtained through the customer's scanning action (returning to step S1), or a settlement code is generated and displayed based on the customer's operation of the checkout instruction button BT630 (see Figure 4(C)) (proceeding to step S8). In other words, steps S1 to S7 are executed repeatedly each time a product code is obtained. 【0035】 Step S8: The mobile terminal 60 generates and displays a settlement code based on the customer's operation of the payment instruction button BT630. The settlement code is a coded (e.g., two-dimensional code) representation of the settlement information. The settlement information is the information necessary to obtain the transaction information for the transaction from the cloud server 20 (e.g., transaction identification information to identify the transaction). 【0036】 The customer has the payment device 50 read the payment code displayed on the mobile terminal 60. The payment device 50, in standby mode, displays a guidance screen that directs the customer to read the payment code (reading operation). 【0037】 Step S9: The settlement device 50 reads the settlement code displayed on the mobile terminal 60 based on the customer's reading action. In other words, the settlement device 50 obtains transaction identification information that identifies the transaction. Step S10: The settlement device 50 requests transaction information for the transaction from the cloud server 20. For example, the settlement device 50 sends request information (transaction information acquisition request information) including transaction identification information that identifies the transaction to the cloud server 20. 【0038】 Step S11: The cloud server 20 receives a request (transaction information acquisition request information). Step S12: The cloud server 20 transmits the transaction information for the transaction (the transaction corresponding to the transaction identification information included in the transaction information acquisition request information received in Step S11) to the settlement device 50. For example, the cloud server 20 generates a product list screen (not shown) that reflects the contents of the transaction information for the transaction, and transmits the screen information of the product list screen to the settlement device 50. 【0039】 Step S13: The settlement device 50 and the mobile terminal 60 receive screen information (transaction information) from the cloud server 20. Step S14: The payment device 50 displays the product list screen based on the screen information received in step S13. 【0040】 (Example display on mobile device 60) Figures 4 and 5 show examples of the display of the mobile terminal 60. The mobile terminal 60 is assumed to be already attached to the cart 70 (holder part 72). When the image is taken from the position of the holder part 72 looking down at the shopping basket 80, the shopping basket 80 and items already placed in the shopping basket 80 are captured when no scanning operation is being performed, and when a scanning operation is being performed, the target product of the scanning operation and the shopping basket 80 and items already placed in the shopping basket 80 are captured behind the target product. However, in Figures 4 and 5, for simplification, items other than the target product of the scanning operation (such as the shopping basket 80 and items already placed in the shopping basket 80) are omitted from the illustration. 【0041】 Figure 4(A) shows the registration screen (initial registration screen) when no scanning operation has been performed. The mobile terminal 60 displays a service start screen (menu screen; not shown) based on customer operation, for example, and displays the registration screen (initial registration screen) based on the operation of the shopping start instruction button on the service start screen. 【0042】 The registration screen in Figure 4(A) (and similarly in Figures 4(B) and 4(C)) includes an image capture display area HR610 and a registration information display area HR620. The image capture display area HR610 is primarily for displaying the captured image. The registration information display area HR620 is primarily for displaying the product registration information. 【0043】 Figure 4(B) is a scene that follows the scene in Figure 4(A). Specifically, Figure 4(B) shows a customer scanning a product (a loaf of bread). 【0044】 Figure 4(C) is a scene that follows the scene in Figure 4(B). Specifically, Figure 4(C) shows the scene where the product (loaf of bread) has been registered by the scanning operation shown in Figure 4(B). In other words, the mobile terminal 60, which has obtained the product code by the scanning operation, sends the product code and other information to the cloud server 20 (step S2 in Figure 3), and displays a registration screen as shown in Figure 4(C) (step S6 in Figure 3). 【0045】 After registering a product (one item), the mobile terminal 60 displays an operational payment instruction button BT630 (in this example, a button labeled "Proceed to Checkout"), as shown in Figure 4(C), which accepts payment instruction operations. When a customer wants to proceed to checkout (i.e., finish registering a product), they operate the payment instruction button BT630. 【0046】 Figure 5(A) shows the scene in Figure 4(A) or another scene following Figure 4(B). When the mobile terminal 60 is not performing the scanning operation shown in Figure 4(B), or when the scanning operation shown in Figure 4(B) has been performed but no product has been registered, if the vibration detection unit detects a vibration greater than the second threshold (which is greater than the first threshold), it displays the small screen SG10 in front of the registration screen (Figure 4(A)) as shown in Figure 5(A). 【0047】 (First threshold, second threshold, accuracy) The first and second thresholds will now be explained. The first and second thresholds are values ​​that are compared with the magnitude of vibration (vibration value) detected by the mobile terminal 60 (vibration detection unit). The mobile terminal 60 uses the first and second thresholds to determine the possibility that a product has been placed in the cart 70 (shopping basket 80) (product placement possibility). Specifically, the mobile terminal 60 uses the first and second thresholds to determine the product placement possibility in three stages (no product placement, product placement (low probability), product placement (high probability)). "No product placement" is the judgment result that no product has been placed. "Product placement (low probability)" is the judgment result that a product has been placed, and the probability of this judgment result (judgment that a product has been placed) is judged to be relatively low. "Product placement (high probability)" is the judgment result that a product has been placed, and the probability of this judgment result (judgment that a product has been placed) is judged to be relatively high. 【0048】 The mobile terminal 60 determines that no product has been placed if the detected vibration value is below the first threshold. The mobile terminal 60 determines that a product has been placed (low probability) if the detected vibration value is between the first threshold and the second threshold. The mobile terminal 60 determines that a product has been placed (high probability) if the detected vibration value is above the second threshold. In other words, the first threshold is the threshold for determining whether or not a product has been placed, and the second threshold is the threshold for determining the probability of the determination that a product has been placed. 【0049】 The first threshold (and the second threshold) may be determined by experiment, for example. For instance, the vibration values ​​detected by the vibration detection unit when products are actually placed in the cart 70 (shopping basket 80) (vibration values ​​when products are placed in the cart) and the vibration values ​​detected by the vibration detection unit when the cart 70 is moved (vibration values ​​when no products are placed in the cart) may be collected in large quantities. Based on the distribution of vibration values ​​when products are placed in the cart and the distribution of vibration values ​​when no products are placed in the cart, the first and second thresholds may be determined. 【0050】 For example, if, based on the distribution of vibration values ​​when products are placed in the cart and when no products are placed in the cart, vibrations below a certain vibration value (vibration value A) are very unlikely to be caused by placing products in the cart 70, and very likely to be caused by moving the cart 70, then vibration value A may be used as the first threshold. Also, if, based on the distribution of vibration values ​​when products are placed in the cart and when no products are placed in the cart, vibrations above a certain vibration value (vibration value B) are very likely to be caused by placing products in the cart 70, and very unlikely to be caused by moving the cart 70, then vibration value B may be used as the second threshold. 【0051】 Return to Figure 5(A). The small screen SG10 displays a message MS11 instructing the customer to place the items in the special bag 90, an image GA12 instructing the customer to place the items in the special bag 90, a message MS13 informing the customer that the item could not be registered, and a message MS14 informing the customer that a store employee will assist them at the checkout machine (checkout device 50). The OK button BT15 is also displayed as operable on the small screen SG10. 【0052】 The customer places the product into the special bag 90 and operates the OK button BT15 (the customer may also place the product into the special bag 90 after operating the OK button BT15). The small screen SG10 is cleared by operating the OK button BT15 (resulting in a display similar to Figure 4(A)). 【0053】 Figure 5(B) shows the scene in Figure 4(A) or another scene following Figure 4(B). When the mobile terminal 60 is not performing the scanning operation shown in Figure 4(B), or when the scanning operation shown in Figure 4(B) has been performed but no product has been registered, if the vibration detection unit detects a vibration that is above the first threshold but below the second threshold, it displays the small screen SG20 in front of the registration screen (Figure 4(A)) as shown in Figure 5(B). 【0054】 The small screen SG20 displays three messages: MS21, which indicates that confirmation is required; MS23, which indicates that product registration failed; and MS24, which asks whether or not to register the product. The small screen SG20 also displays two operable buttons: BT25, which indicates that the product will not be registered; and BT26, which indicates that the product will be registered. 【0055】 The customer operates the "Do not register" button BT25 if they do not wish to register the product, and the "Register" button BT26 if they wish to register the product. The small screen SG20 is cleared by operating either the "Do not register" button BT25 or the "Register" button BT26 (resulting in a display similar to Figure 4(A)). 【0056】 Figure 5(C) is a scene that follows the scene in Figure 4(C). In the state after product registration as shown in Figure 4(C), if the vibration detection unit does not detect vibrations above the first threshold, the mobile terminal 60 displays a small screen SG30 in front of the registration screen (Figure 4(C)). 【0057】 The small screen SG30 displays a message MS31 indicating that it is a confirmation and a message MS32 confirming whether or not the product has been inserted. The OK button BT35 is also displayed as operable on the small screen SG30. 【0058】 The customer confirms that the product has been loaded (loads it if it hasn't been loaded yet) and operates the OK button BT35 (the customer may also confirm that the product has been loaded after operating the OK button BT35). The small screen SG30 is cleared by operating the OK button BT35 (resulting in a display similar to Figure 4(C)). 【0059】 (Example of a mobile terminal 60 (Example 1)) The mobile terminal 60 has, for example, at least one of the following functions a to e, and operates to implement at least one of these functions. Further details will be explained using the flowcharts in Figures 6 to 8. 【0060】 (Function a) The mobile terminal 60 determines that an item has been placed in the cart 70 without the item being registered (i.e., without obtaining an item code) (by detecting vibrations above the first threshold), and if the accuracy of this determination is relatively high (if the vibration is above the second threshold), it outputs an error sound (a loud sound), instructs the item to be placed in the dedicated bag 90, and notifies the checkout device 50 that a store employee will handle the situation (steps 450 and 460 in Figure 8). For example, the mobile terminal 60 outputs an error sound and displays the small screen SG10 shown in Figure 5(A). (Function b) If the mobile terminal 60 determines that an item has been added to the cart 70 even though the item has not been registered (i.e., it has detected vibrations above the first threshold), but the accuracy of this determination is relatively low (i.e., the vibrations were below the second threshold), it outputs a notification sound (a soft tone) and asks whether or not to register the item (steps 470 and 480 in Figure 8). For example, the mobile terminal 60 outputs a notification sound and displays the small screen SG20 shown in Figure 5(B). (Function c) If the mobile terminal 60 determines that a registered product has been added to the cart 70 (i.e., it detects vibrations above the first threshold), but the accuracy of this determination is relatively low (i.e., the vibrations were below the second threshold), it confirms that the product has been added (step 420 in Figure 7(A)). For example, the mobile terminal 60 displays the small screen SG30 in Figure 5(C). (Function d) If the mobile terminal 60 determines that the registered product has not been added to the cart 70 (i.e., it does not detect vibrations above the first threshold), it confirms that the product has been added (step 520 in Figure 7(B)). For example, the mobile terminal 60 displays the small screen SG30 in Figure 5(C). (Function e) When the mobile terminal 60 obtains the product code of a certain product, if it determines that no products registered before that product have been added to the cart 70 (i.e., if it does not detect vibrations above the first threshold), it confirms that the product has been added (step 220 in Figure 6(B)). For example, the mobile terminal 60 displays the small screen SG30 in Figure 5(C). 【0061】 Figures 6 to 8 are flowcharts illustrating an example of the operation of the mobile terminal 60. The flowchart in Figure 6(A) starts based on the operation of the "Start Shopping" button on the service start screen. The flowcharts in Figures 6(B), 7(A), and 7(B) each transition from the flowchart in Figure 6(A). The flowchart in Figure 8 transitions from the flowchart in Figure 7(A). Note that the flowcharts in Figures 6 to 8 (and similarly in Figures 9 to 11) are related to steps S1, S2, and S8 of the sequence diagram in Figure 3 (mainly related to step S1). 【0062】 (Explanation of flags and timers) First, we will explain the "product code acquisition status flag" (hereinafter abbreviated as "product code acquisition flag"), the "product code acquisition flag clear timer," and the "store clerk confirmation flag" that appear in the flowcharts in Figures 6 to 8 (and similarly in Figures 9 to 11). Product Code Acquisition Flag: This flag indicates whether or not a product code has been acquired within the preceding specified time period (e.g., 10 seconds). If the product code acquisition flag is set (e.g., value "1"), it indicates that a product code has been acquired within the preceding specified time period. If the product code acquisition flag is not set (e.g., value "0"), it indicates that a product code has not been acquired within the preceding specified time period. The product code acquisition flag is set based on whether or not a product code has been acquired. Product Code Acquisition Flag Clear Timer: This timer manages the timing for clearing the product code acquisition flag (for example, changing its value from "1" to "0"). Specifically, the product code acquisition flag clear timer is a timer that counts down (or counts up) for a predetermined period of time (for example, 10 seconds). The product code acquisition flag clear timer is set based on the acquisition of a product code. Staff Confirmation Flag: This flag indicates whether or not staff assistance is required during the processing by the payment device 50. When the Staff Confirmation Flag is set, it indicates that staff assistance is required, and when the Staff Confirmation Flag is cleared, it indicates that staff assistance is not required. The Staff Confirmation Flag is set based on the judgment that there is a relatively high probability of product input when a product code has not been acquired within the preceding predetermined time (i.e., no product has been registered). 【0063】 (Flowchart in Figure 6(A)) At the start of the flowchart in Figure 6(A), the product code acquisition flag, the store clerk confirmation flag, and the product code acquisition flag clear timer are initialized (cleared). 【0064】 Step S200: The mobile terminal 60 determines whether or not it has obtained a product code. If it has obtained a product code (Step S200: YES), proceed to step S201 in Figure 6(B). If it has not obtained a product code (Step S200: NO), proceed to step S400. Step S400: The mobile terminal 60 determines whether or not it has detected vibrations exceeding the first threshold. In other words, the mobile terminal 60 determines whether or not there was vibrations of a magnitude exceeding the first threshold. If vibrations exceeding the first threshold are detected (Step S400: YES), the process proceeds to step S401 in Figure 7(A). If vibrations exceeding the first threshold are not detected (Step S400: NO), the process proceeds to step S502. 【0065】 Step S502: The mobile terminal 60 determines whether it has acquired a product code within the preceding predetermined time (product code acquired state). Specifically, the mobile terminal 60 determines that it is in the product code acquired state if the product code acquisition flag is set, and determines that it is not in the product code acquired state if the product code acquisition flag is not set. The same applies to step S201 in Figure 6(B) and step S401 in Figure 7(A). If it is in the product code acquired state (step S502: YES), proceed to step S503. If it is not in the product code acquired state (step S502: NO), proceed to step S600. Note that the product code acquired state is also the state in which product input is scheduled (product input waiting state). 【0066】 Step S503: The mobile terminal 60 determines whether or not it is the end of the post-product code acquisition state (waiting for product input state). Specifically, the mobile terminal 60 determines that it is the end of the post-product code acquisition state if the product code acquisition flag clear timer times out, and determines that it is not the end of the post-product code acquisition state if the product code acquisition flag clear timer has not timed out. If it is the end of the state (Step S503: YES), proceed to step S509 in Figure 7(B). If it is not the end of the state (Step S503: NO), proceed to step S600. 【0067】 Step S600: The mobile terminal 60 determines whether or not the payment instruction button BT630 has been operated. If the payment instruction button BT630 has been operated (Step S600: YES), proceed to Step S700. If the payment instruction button BT630 has not been operated (Step S600: NO), return to Step S200. Step S700: The mobile terminal 60 generates and displays a payment code. This flowchart then ends. The customer then has the payment device 50 read the payment code displayed on the mobile terminal 60. 【0068】 (Flowchart in Figure 6(B)) Step S201: The mobile terminal 60 determines whether it is in the state after obtaining the product code (waiting for product input). If it is in the state after obtaining the product code (Step S201: YES), proceed to step S208. If it is not in the state after obtaining the product code (Step S201: NO), proceed to step S235. Step S208: The mobile terminal 60 clears the product code acquisition flag clear timer (stops the count). Then proceed to step S209. Step S209: The mobile terminal 60 clears the product code acquisition flag. Then proceed to step S220. Step S220: The mobile terminal 60 confirms with the customer that the product has been loaded. For example, the mobile terminal 60 displays the small screen SG30 shown in Figure 5(C). The same applies to step S420 in Figure 7(A) and step S520 in Figure 7(B). The process then proceeds to step S221. Step S221: The mobile terminal 60 determines whether or not a confirmation operation was performed. For example, the mobile terminal 60 determines whether or not the OK button BT35 on the small screen SG30 in Figure 5(C) was pressed. The same applies to step S421 in Figure 7(A) and step S521 in Figure 7(B). If a confirmation operation was performed (step S221: YES), proceed to step S225. If no confirmation operation was performed (step S221: NO), return to step S221. 【0069】 Step S235: The mobile terminal 60 sends the product code and other information obtained in step S200 of Figure 6(A) to the cloud server 20. The process then proceeds to step S238. Step S238: The mobile terminal 60 sets the product code acquisition flag. Then proceed to step S239. Step S239: The mobile terminal 60 sets the product code acquisition flag clear timer. Then, the process returns to step S200 in Figure 6(A). 【0070】 (Flowchart in Figure 7(A)) Step S401: The mobile terminal 60 determines whether it is in the state after obtaining the product code (waiting for product input). If it is in the state after obtaining the product code (Step S401: YES), proceed to step S408. If it is not in the state after obtaining the product code (Step S401: NO), proceed to step S440 in Figure 8. Step S408: The mobile terminal 60 clears the product code acquisition flag clear timer. Then proceed to step S409. Step S409: The mobile terminal 60 clears the product code acquisition flag. Then proceed to step S410. 【0071】 Step S410: The mobile terminal 60 determines whether or not it has detected vibrations exceeding the second threshold. In other words, in step S400 of Figure 6(A), it was detected that the vibration was greater than or equal to the first threshold, but it determines whether or not the magnitude of the vibration is greater than or equal to the second threshold. If vibrations exceeding the second threshold are detected (step S410: YES), the process returns to step S200 of Figure 6(A). If vibrations exceeding the second threshold are not detected (step S410: NO), the process proceeds to step S420. Step S420: The mobile terminal 60 confirms with the customer that the product has been placed in the machine. The process then proceeds to step S421. Step S421: The mobile terminal 60 determines whether or not a confirmation operation has been performed. If no confirmation operation has been performed (Step S421: NO), the process returns to Step S421. 【0072】 (Flowchart in Figure 7(B)) Step S509: The mobile terminal 60 clears the product code acquisition flag. Then proceed to step S520. Step S520: The mobile terminal 60 confirms with the customer that the product has been placed in the machine. The process then proceeds to step S451. Step S521: The mobile terminal 60 determines whether or not a confirmation operation has been performed. If a confirmation operation has been performed (Step S521: YES), the process returns to Step S200 in Figure 6(A). If no confirmation operation has been performed (Step S521: NO), the process returns to Step S521. 【0073】 (Flowchart in Figure 8) Step S440: The mobile terminal 60 determines whether or not it has detected vibrations exceeding the second threshold. That is, in step S400 of Figure 6(A), it was detected that the vibration was greater than or equal to the first threshold, but it determines whether the magnitude of the vibration is greater than or equal to the second threshold. If vibrations exceeding the second threshold are detected (step S440: YES), the process proceeds to step S450. If vibrations exceeding the second threshold are not detected (step S440: NO), the process proceeds to step S470. 【0074】 Step S450: The mobile terminal 60 outputs an error sound (warning sound) (for example, for 1 second). The error sound is louder than the notification sound output in step S470 (for example, a sound that can be described as a "beep"). The process then proceeds to step S460. 【0075】 Step S460: The mobile terminal 60 instructs the customer to place the items into the special bag 90 and notifies the customer via the payment device 50 that a store employee will assist them. For example, the mobile terminal 60 displays the small screen SG10 shown in Figure 5(A). The process then proceeds to step S461. Step S461: The mobile terminal 60 determines whether or not a confirmation operation was performed. For example, the mobile terminal 60 determines whether or not the OK button BT15 on the small screen SG10 in Figure 5(A) was pressed. If a confirmation operation was performed (Step S461: YES), proceed to step S469. If no confirmation operation was performed (Step S461: NO), return to step S461. 【0076】 Step S469: The mobile terminal 60 sets the "Confirmation by store staff required" flag. If the "Confirmation by store staff required" flag has already been set, the process in step S469 may be omitted. The process then returns to step S200 in Figure 6(A). 【0077】 Step S470: The mobile terminal 60 outputs a notification sound (confirmation sound) (for example, for 1 second). The notification sound is softer in tone than the error sound output in step S450 (for example, a sound that can be described as "plinking"). The process then proceeds to step S480. 【0078】 Step S480: The mobile terminal 60 confirms with the customer whether or not to register the product. For example, the mobile terminal 60 displays the small screen SG20 shown in Figure 5(B). The process then proceeds to step S481. Step S481: The mobile terminal 60 determines whether or not an operation to not register was performed. For example, the mobile terminal 60 determines whether or not the "do not register" button BT25 on the small screen SG20 in Figure 5(B) was operated. If an operation to not register was performed (Step S481: YES), the process returns to Step S200 in Figure 6(A). If no operation to not register was performed (Step S481: NO), the process proceeds to Step S482. 【0079】 Step S482: The mobile terminal 60 determines whether or not an operation to register was performed. For example, the mobile terminal 60 determines whether or not the registration button BT26 on the small screen SG20 in Figure 5(B) was operated. If an operation to register was performed (Step S482: YES), the process proceeds to Step S483. If an operation to register was not performed (Step S482: NO), the process returns to Step S481. 【0080】 Step S483: The mobile terminal 60 determines whether or not it has obtained a product code. If it has obtained a product code (Step S483: YES), proceed to Step S485. If it has not obtained a product code (Step S483: NO), return to Step S483. Step S285: The mobile terminal 60 sends the product code and other information obtained in step S483 to the cloud server 20. Then, the process returns to step S200 in Figure 6(A). 【0081】 (Another embodiment of the mobile terminal 60 (Embodiment 2)) In Example 1, the operation (function) did not change subsequent operations depending on whether or not a scan operation was performed. However, in Example 2, subsequent operations are changed depending on whether or not a scan operation was performed. Specifically, the mobile terminal 60 operates to implement function a' of Example 2 instead of function a of Example 1, and operates to implement function b' of Example 2 instead of function b of Example 1. Further details will be explained using the flowcharts in Figures 9 to 11. 【0082】 (Function a') The mobile terminal 60 determines that an item has been placed in the cart 70, even though only a scanning operation was performed and no item was actually registered (step S402 (NO) in Figure 11), and if the accuracy of this determination is relatively high, it outputs an error sound, instructs the item to be placed in the dedicated bag 90, and notifies the cashier 50 that a store employee will handle the matter (steps 450 and 460 in Figure 8). 【0083】 In other words, in Example 1, if vibration above the second threshold is detected when no product is registered, the small screen SG10 as shown in Figure 5(A) is displayed regardless of whether or not a scan operation as shown in Figure 4(B) was performed. However, in Example 2, even if vibration above the second threshold is detected when no product is registered, the small screen SG10 is not displayed if a scan operation is not performed (the small screen SG10 is displayed if a scan operation is performed). 【0084】 (Function b') The mobile terminal 60 determines that an item has been added to the cart 70, even though only a scanning operation was performed and no item was actually registered (step S402 (NO) in Figure 11). However, if the accuracy of this determination is relatively low, it outputs a notification sound to confirm whether or not to register the item (steps 470 and 480 in Figure 8). 【0085】 In other words, in Example 1, if vibration between the first threshold and the second threshold is detected while no product is registered, the small screen SG20, as shown in Figure 5(B), is displayed regardless of whether a scan operation was performed or not. However, in Example 2, even if vibration between the first threshold and the second threshold is detected while no product is registered, the small screen SG20 is not displayed unless a scan operation is performed (the small screen SG20 is displayed if a scan operation is performed). 【0086】 Figures 9 to 11 are flowcharts illustrating other examples of the operation of the mobile terminal 60. The flowchart in Figure 9(A) starts based on the operation of the "Start Shopping" button on the service start screen. The flowcharts in Figures 9(B), 10(A), 10(B), and 11 each transition from the flowchart in Figure 9(A). 【0087】 (Explanation of flags and timers) First, we will explain the "pre-scan operation flag" and the "scan operation flag clear timer" that appear in the flowcharts in Figures 9 to 11. Scan Operation Flag: This flag indicates whether or not a scan operation was performed within the preceding specified time period (e.g., 10 seconds). If the scan operation flag is set (e.g., value "1"), it indicates that a scan operation was performed within the preceding specified time period. If the scan operation flag is not set (e.g., value "0"), it indicates that no scan operation was performed within the preceding specified time period. The scan operation flag is set based on the detection of a scan operation. Scan Operation Flag Clear Timer: This timer manages the timing for clearing the scan operation flag (for example, changing its value from "1" to "0"). Specifically, the scan operation clear timer is a timer that counts down (or counts up) for a predetermined period of time (for example, 10 seconds). The scan operation clear timer is set based on the detection of a scan operation. 【0088】 (Flowchart in Figure 9(A)) At the start of the flowchart in Figure 9(A), each flag (product code acquisition flag, store clerk confirmation flag, scan operation flag) and each timer (product code acquisition flag clear timer, scan operation flag clear timer) are initialized. 【0089】 The flowchart in Figure 9(A) has steps S100, S302, and S303 added compared to the flowchart in Figure 6(A). Note that steps S600 and beyond (steps S600 and S700) are omitted from the flowchart in Figure 9(A). Steps S200, S400, S502, S503, S600 (omitted), and S700 (omitted) in the flowchart of Figure 9(A) are the same as in the flowchart of Figure 6(A), so some or all of the explanation is omitted. 【0090】 Step S100: The mobile terminal 60 determines whether or not a scan operation occurred. If a scan operation occurred (Step S100: YES), proceed to step S106 in Figure 9(B). If no scan operation occurred (Step S100: NO), proceed to step S200. 【0091】 Step S200: The mobile terminal 60 determines whether or not it has obtained a product code. If it has obtained a product code (Step S200: YES), it executes the process in Step S201 in Figure 10(A). If it has not obtained a product code (Step S200: NO), it executes the process in Step S302. 【0092】 Step S302: The mobile terminal 60 determines whether or not a scan operation has been performed within the preceding predetermined time (post-scan state). Specifically, the mobile terminal 60 determines that it is in the post-scan state if the scan operation flag is set, and determines that it is not in the post-scan state if the scan operation flag is not set. The same applies to step S402 in Figure 11. If it is in the post-scan state (step S302: YES), proceed to step S303. If it is not in the post-scan state (step S302: NO), proceed to step S400. 【0093】 Step S303: The mobile terminal 60 determines whether or not it is the end of the post-scan state. Specifically, the mobile terminal 60 determines that it is the end of the post-scan state if the scan operation flag clear timer has timed out, and determines that it is not the end of the post-scan state if the scan operation flag clear timer has not timed out. If it is the end of the state (Step S303: YES), proceed to step S306 in Figure 10(B). If it is not the end of the state (Step S303: NO), proceed to step S400. 【0094】 Step S400: The mobile terminal 60 determines whether or not it has detected vibrations above a first threshold. If it has detected vibrations above a first threshold (Step S400: YES), it executes the process in Step S401 of Figure 11. If it has not detected vibrations above a first threshold (Step S400: NO), it executes the process in Step S502. 【0095】 Step S502: The mobile terminal 60 determines whether it has acquired a product code within the previously determined time period (post-product code acquisition state). If it is in the post-product code acquisition state (Step S502: YES), it executes the process in Step S503. If it is not in the post-product code acquisition state (Step S502: NO), it executes the process in Step S600. Step S503: The mobile terminal 60 determines whether it is the end of the state after obtaining the product code (waiting for product input). If it is the end of the state (Step S503: YES), it executes the process in Step S509 of Figure 7(B). If it is not the end of the state (Step S503: NO), it executes the process in Step S600. As mentioned above, although the flowchart in Figure 9(A) omits the illustration of steps S600 and beyond, it is the same as the flowchart in Figure 6(A) from Step S600 onwards. 【0096】 (Flowchart in Figure 9(B)) Step S106: The mobile terminal 60 sets the scan operation flag. Then proceed to step S107. Step S107: The mobile terminal 60 sets the scan operation flag clear timer. Then return to step S100 in Figure 9(A). 【0097】 (Flowchart in Figure 10(A)) The flowchart in Figure 10(A) has steps S236 and S236 added compared to the flowchart in Figure 6(B). In the flowchart in Figure 10(A), the steps within the dashed frame P in the flowchart in Figure 6(B) (steps S201 to S221) are collectively abbreviated as "P". Steps S201 to S221 (abbreviated as "P"), S235, S238, and S239 in the flowchart in Figure 10(A) are the same as in the flowchart in Figure 6(B), so some or all of the explanation is omitted. 【0098】 Step S235: The mobile terminal 60 sends the product code and other information obtained in step S200 of Figure 9(A) to the cloud server 20. Then proceed to step S236. Step S236: The mobile terminal 60 clears the scan operation flag clear timer. Then proceed to step S237. Step S237: The mobile terminal 60 clears the scan operation flag. Then proceed to step S238. 【0099】 The mobile terminal 60 sets the product code acquisition flag (step S238), sets the product code acquisition flag clear timer (step S239), and returns to step S100 in Figure 9(A). 【0100】 (Flowchart in Figure 10(B)) Step S306: The mobile terminal 60 clears the scan operation flag. Then return to step S100 in Figure 9(A). 【0101】 (Flowchart in Figure 11) The flowchart in Figure 11 has steps S402, S436, and S437 added compared to the flowchart in Figure 7(A). Note that the flowchart in Figure 11 omits the illustration of steps S408 onwards (steps S408 to S410, S420, and S421) from the flowchart in Figure 7(A). Steps S401 and S408 onwards (omitted from illustration) in the flowchart in Figure 11 are the same as the flowchart in Figure 7(A), so some or all of the explanation is omitted. 【0102】 Step S401: The mobile terminal 60 determines whether it is in the state after obtaining the product code (waiting for product input). If it is in the state after obtaining the product code (Step S401: YES), it executes the processes from Step S408 onwards. If it is not in the state after obtaining the product code (Step S401: NO), it executes the process in Step S402. 【0103】 Step S402: Determine whether the mobile terminal 60 is in the post-scan state. If it is in the post-scan state (Step S402: YES), proceed to step S436. If it is not in the post-scan state (Step S402: NO), return to step S100 in Figure 9(A). 【0104】 Step S436: The mobile terminal 60 clears the scan operation flag clear timer. Then proceed to step S437. Step S437: The mobile terminal 60 clears the scan operation flag. Then, the process proceeds to step S440 in Figure 8. In other words, the process following step S437 in Figure 11 is the same as the process following step S401(NO) in Figure 7(A). 【0105】 As described above, the first embodiment allows for the effective registration of products using the mobile terminal 60. For example, in the mobile terminal 60 of Example 1, when no products are registered, if the vibration detected by the vibration detection unit (vibration value acquired by the CPU) is between a first threshold and a second threshold, it is determined (low accuracy) that an unregistered product has been added (so-called cart removal), and if it is above the second threshold, it is determined (high accuracy) that a cart removal has occurred (functions a and b). With the mobile terminal 60 of Example 1, when it is determined that an unregistered product has been added to the cart 70 (shopping basket 80), an appropriate response can be taken according to the accuracy of the determination. Furthermore, the mobile terminal 60 of Example 2, provided that a scan operation has been performed and no product has been registered, determines with low accuracy if the vibration detected by the vibration detection unit (vibration value acquired by the CPU) is between the first threshold and the second threshold, and determines with high accuracy if the vibration is above the second threshold (cart removal). The mobile terminal 60 of Example 2 can effectively deal with malicious customers who attempt to falsify product registration by performing a scan operation while ignoring the effects of vibrations caused by the movement of the cart 70 or collisions of people or objects with the cart 70. In addition, the mobile terminal 60 of Example 1 (and the mobile terminal 60 of Example 2) can prevent customers from forgetting to put registered products into the cart 70 (functions c to e). 【0106】 Other configurations relating to the first embodiment will be described below. Of the other configurations relating to the first embodiment described below, those that are also applicable to the second embodiment (when the mobile terminal 60 acquires vibration values ​​from the cart-side vibration detection unit (described later)) may be applied to the second embodiment. 【0107】 In addition, although it is common to both Example 1 and Example 2, the mobile terminal 60 is described as confirming with the customer in step S220 of Figure 6(B) whether the registered product has been inserted. However, it may also confirm whether the registered product has been inserted or returned to the shelf without being inserted. For example, in step S220, the mobile terminal 60 may display a small screen SG40 (not shown) instead of the small screen SG30 in Figure 5(C), which displays buttons to indicate that the product has been inserted and buttons to indicate that the product has been returned to the shelf without being inserted. The same applies to step S420 in Figure 7(A) and step S520 in Figure 7(B). 【0108】 If the button indicating that the item has been returned to the shelf is pressed on the small screen SG40 (not shown), the mobile terminal 60 may notify the customer that a store employee will assist them at the checkout machine (checkout device 50), and may also notify the customer that the registered but returned item will be placed in the special bag 90. For example, if the button indicating that the item has been returned to the shelf is pressed on the small screen SG40 (not shown), the mobile terminal 60 may display the small screen SG10 shown in Figure 5(A). 【0109】 Furthermore, in both Example 1 and Example 2, if the mobile terminal 60 performs an operation to not register in step S481 in Figure 8 (for example, if the "Do not register" button BT25 on the small screen SG20 in Figure 5(B) is pressed), it sets the "Store staff confirmation required" flag, and in the case of Example 1, it may return to step S200 in Figure 6(A) (in the case of Example 2, it may return to step S100 in Figure 9(A)). 【0110】 Furthermore, as is common to both Example 1 and Example 2, if the mobile terminal 60 does not obtain a product code within a predetermined time in step S483 of Figure 8, it may ask again whether or not to register the product (it may also return to step S480). If the mobile terminal 60 does not obtain a product code within a predetermined time, instead of or in addition to asking again whether or not to register the product, it may set a flag indicating that store staff confirmation is required. 【0111】 In addition, as is common to both Example 1 and Example 2, if the payment instruction button BT630 is operated (step S600: YES), the mobile terminal 60 may execute the steps within the dashed frame P in Figure 6(B) (steps S201 to S221), and then generate and display a settlement code (step S700). 【0112】 In other words, the mobile terminal 60 may operate to implement the following function f in place of or in addition to the functions described above (function a, function b, function a', function b', function c, function d, function e). 【0113】 (Function f) When the checkout instruction button BT630 is operated, the mobile terminal 60 determines that no items registered before the item in question have been added to the cart 70 (i.e., it does not detect vibrations exceeding the first threshold), and confirms that the item has been added. 【0114】 Furthermore, common to both Example 1 and Example 2, the flowcharts above (flowcharts in Figures 6 to 11) describe an example where a timer corresponding to each flag is generated (started) and each flag is controlled (cleared). However, the flags may also be controlled based on the elapsed time from the time recorded as a log, etc., without generating a timer. In other words, the flags may be controlled by a timestamp. For example, in step S238 of Figure 6(B), the mobile terminal 60 sets the product code acquisition flag, and in the following step S239, it sets the product code acquisition flag clear timer as a timer to control the product code acquisition flag. For example, in step S503 of Figure 6(A), the terminal determines the termination timing by referring to the value of the product code acquisition flag clear timer. However, in step S239, the terminal may not set the product code acquisition flag clear timer (i.e., not perform the processing in step S239), and in step S503 of Figure 6(A), it may determine the termination timing by referring to the elapsed time from the time the product code acquisition flag was set (processing time of step S238) or the time the product code was transmitted (processing time of step S235). 【0115】 Furthermore, while the flowchart above illustrates an example of different control based on the value of each flag (whether it is set or not), the control may also be different based on the state of the timer (i.e., whether it is counting or not). For example, in step S238 of Figure 6(B), the mobile terminal 60 sets the product code acquisition flag, and in the following step S239, sets the product code acquisition flag clear timer as a timer that controls the product code acquisition flag. For example, in step S502 of Figure 6(A), the value of the product code acquisition flag is referenced to determine whether the device is in the post-product code acquisition state. However, in step S238, the product code acquisition flag may not be set (i.e., the process in step S238 may not be performed), and in step S502 of Figure 6(A), the device may determine whether the device is in the post-product code acquisition state based on whether the product code acquisition flag clear timer is operating (counting). 【0116】 Alternatively, the operation may be controlled by using (changing, referencing, etc.) a status (operation status information) instead of or in addition to one or both of the flags and / or timers. Examples of changing statuses include the pre-scan operation (absent) state, the post-scan operation (present) state, and the post-product code acquisition state (waiting for product input). 【0117】 Furthermore, as is common to both Example 1 and Example 2, when the mobile terminal 60 determines (with high probability) that a shopping cart has been left behind (step S440 in Figure 8), it sets the staff confirmation flag after the confirmation operation (step S461 (YES)) (step S469). However, when it determines (with high probability) that a shopping cart has been left behind, the staff confirmation flag may be set unconditionally (for example, before outputting an error sound). 【0118】 Furthermore, as is common to both Example 1 and Example 2, the mobile terminal 60 sets a confirmation flag for store staff when it determines (with high probability) that a shopping cart has been left behind (step S469 in Figure 8). However, instead of or in addition to setting the confirmation flag for store staff, information indicating that a shopping cart has been left behind (with high probability) may be transmitted to other devices (for example, the cloud server 20, the transaction status management device 40) along with transaction identification information. 【0119】 The transaction status management device 40 may display information regarding the occurrence of a shopping cart being left behind in a transaction (information indicating whether or not it has been determined that a shopping cart has been left behind) (by sending information to the cloud server 20 indicating that it has been determined (with high probability) that a shopping cart has been left behind, or by accessing the cloud server 20 and displaying the information if it is not sent to the transaction status management device 40). In addition, if the mobile terminal 60 determines (with high probability) that a shopping cart has been left behind, it may send information to the store clerk's mobile terminal indicating that it has been determined (with high probability) that a shopping cart has been left behind. 【0120】 The judgment result of the mobile terminal 60 in each transaction may be counted. For example, in each transaction, either the number of times it was determined that a cart was left behind (low probability) (the number of times it was determined to be step S440 (NO) in Figure 8) or the number of times it was determined that a cart was left behind (high probability) (the number of times it was determined to be step S440 (YES) in Figure 8) or both may be counted. 【0121】 The counting of low-probability and high-probability occurrences may be performed by the mobile terminal 60, or by a device other than the mobile terminal 60 (for example, the cloud server 20 or the transaction status management device 40). In other words, if the mobile terminal 60 determines that a cart has been left unattended in each transaction (low probability), it may increment the low-probability count itself, or it may send information indicating that a cart has been left unattended (low probability) along with transaction identification information to the cloud server 20, and the cloud server 20 may increment the low-probability count, or it may send information indicating that a cart has been left unattended (low probability) along with transaction identification information to the transaction status management device 40, and the transaction status management device 40 may increment the low-probability count. The same applies when it determines that a cart has been left unattended (high probability). 【0122】 In an embodiment in which the mobile terminal 60 counts up low-probability counts or high-probability counts, when the mobile terminal 60 counts up low-probability counts or high-probability counts, it may transmit the count after the count (or information indicating which count was counted up (i.e., whether it was a low-probability count or a high-probability count)) along with the transaction identification information to the cloud server 20 or the transaction status management device 40. In addition to or instead of when the mobile terminal 60 counts up low-probability counts or high-probability counts, it may also transmit the final count along with the transaction identification information to the cloud server 20 or the transaction status management device 40 when requesting transaction information (step S10 in Figure 3). Furthermore, the mobile terminal 60 may transmit the low-probability count or high-probability count along with the transaction identification information to the store clerk's mobile terminal. 【0123】 Furthermore, in an embodiment in which the cloud server 20 (and the transaction status management device 40) counts up the number of low-probability or high-probability occurrences based on information (low-probability / high-probability) received from the mobile terminal 60 indicating that a cart has been left behind, the cloud server 20 (and the transaction status management device 40) may, when it has counted up the number of low-probability or high-probability occurrences, transmit the number after the count-up (or information indicating whether the count-up occurred) to the mobile terminal 60. 【0124】 The transaction status management device 40 may display information on the occurrence of cart abandonment in each transaction (low probability count, high probability count) (if the cloud server 20 counts up the low probability count and high probability count and the transaction status management device 40 does not count them up, it may access the cloud server 20 and display the information). 【0125】 Furthermore, in the payment device 50, even if the number of high-probability attempts is 0, if the number of low-probability attempts is 1 or more, a store employee may intervene. In this case, the payment device 50 may display a message such as "A store employee will randomly check the transaction" or "The number of incorrect operations has exceeded 1, so a store employee will need to check the transaction." 【0126】 Furthermore, the mobile terminal 60 may determine the accuracy of the cart escape detection based on the comparison result of images acquired (captured) by the imaging unit (image comparison result), instead of or in addition to the comparison result of the vibration (vibration value) detected by the vibration detection unit with a threshold (vibration comparison result). For example, the mobile terminal 60 may determine the accuracy of the cart escape detection based on the image comparison result obtained by comparing a pre-vibration image (for example, an image captured before vibration above the first threshold is detected) and a post-vibration image (an image captured after vibration above the first threshold is detected). Alternatively, the mobile terminal 60 may determine the occurrence of a cart escape based on the image comparison result, instead of or in addition to the vibration comparison result. In other words, the mobile terminal 60 may determine the occurrence of a cart escape based on at least one of the vibration comparison result and the image comparison result, and may determine the accuracy of the cart escape detection based on at least one of the vibration comparison result and the image comparison result (there are 3 x 3 = 9 possible combinations). 【0127】 For example, in a configuration where the occurrence of shopping cart abandonment is determined based on the image comparison results, and the accuracy of the shopping cart abandonment determination is also determined based on the image comparison results, the mobile terminal 60 calculates the degree of difference between two images of interest (previous image and next image) when no products are registered. (For example, it calculates a value that shows the difference between the total feature quantities of the previous image and the total feature quantities of the next image.) The above degree of difference will be larger when an object that is not present in the previous image is present in the next image than when an object that is not present in the previous image is also not present in the next image. Therefore, when no products are registered, the mobile terminal 60 may determine that shopping cart abandonment has occurred (low accuracy) if the calculated degree of difference is between the first threshold and the second threshold, and may determine that shopping cart abandonment has occurred (high accuracy) if the calculated degree of difference is above the second threshold. 【0128】 As described above, the mobile terminal 60 is used while attached to the holder unit 72, but the vibration detection unit may determine whether or not it is attached to the holder unit 72. For example, if the mobile terminal 60 does not change its posture for a predetermined time (i.e., no acceleration, etc. is detected), it may be determined that it is attached to the holder unit 72. The cart 70 may also be equipped with a charging function to charge the mobile terminal 60 attached to the holder unit 72. In this case, the mobile terminal 60 may be determined to be attached to the holder unit 72 if it is being charged by the charging function (for example, if it is recognized as being charged, or if it is recognized as being connected to the connector (terminal or cable) on the cart 70 side related to the charging function). Furthermore, the cart 70 may be equipped with a sensor and a communication unit capable of recognizing whether or not the mobile terminal 60 is attached to the holder unit 72, and the cart 70 may transmit information to the mobile terminal 60 attached to the holder unit 72 indicating that it is attached to the holder unit 72 (transmitted at predetermined time intervals). In this case, if the mobile terminal 60 has not received the above information for a predetermined period of time, it may be determined that it is not attached to the holder 72. 【0129】 The mobile terminal 60 may have a cart-escape detection function enabled when it is attached to the holder 72, which determines whether or not a cart has been left behind, and may have this function disabled when it is not attached to the holder 72. In other words, the mobile terminal 60 may switch the cart-escape detection function from enabled to disabled when it is removed from the holder 72, and switch the cart-escape detection function from disabled to enabled when it is reattached to the holder 72. If the mobile terminal 60 is not owned by the customer but is part of the cart 70, the function to switch the cart-escape detection function on and off may not be necessary (i.e., the cart-escape detection function may always be enabled). 【0130】 Furthermore, the registration of products by the mobile terminal 60 may be restricted depending on whether or not the mobile terminal 60 is attached to the holder unit 72. For example, product registration may be permitted when the mobile terminal 60 is attached to the holder unit 72, and prohibited when the mobile terminal 60 is not attached to the holder unit 72. The method of prohibition may be, for example, prohibiting imaging with the imaging unit, prohibiting the acquisition of product codes (step S1 in Figure 3), prohibiting the transmission of product codes etc. to the cloud server 20 (step S2 in Figure 3), or prohibiting the updating of transaction information on the cloud server 20 (step S4 in Figure 1). 【0131】 Furthermore, if the mobile terminal 60 is not attached to the holder unit 72, registration using the mobile terminal 60 may be restricted depending on the type of product. Specifically, for certain products (large products, products that require reading barcodes on price tags on display shelves, etc.) that cannot be registered or are difficult to register when the mobile terminal 60 is attached to the holder unit 72, registration may be permitted even when the mobile terminal 60 is attached to the holder unit 72. For products other than these specific products (i.e., products that can be easily registered even when attached to the holder unit 72), registration may be prohibited if the mobile terminal 60 is not attached to the holder unit 72. Whether or not a product is a specific product may be set in advance in the product master, for example. 【0132】 (Second Embodiment) In the first embodiment, the mobile terminal 60 detects vibration, but in the second embodiment, the cart 70 detects vibration. The cart 70 includes at least a vibration detection unit and a communication unit. For convenience of explanation, the vibration detection unit of the mobile terminal 60 may be referred to as the terminal-side vibration detection unit, and the vibration detection unit of the cart 70 may be referred to as the cart-side vibration detection unit. The vibration detection unit of the cart 70 (cart-side vibration detection unit) is, for example, an acceleration sensor or a gyroscope sensor that detects vibrations of the cart 70 (self-cart 70) and vibrations of the shopping basket 80 placed on the cart 70. 【0133】 The cart 70 outputs the vibration value (vibration detection result) detected by the cart-side vibration detection unit to the mobile terminal 60 via its communication unit. Communication between the communication unit of the cart 70 and the communication unit of the mobile terminal 60 may be, for example, wired communication via a device controller and USB, or wireless communication via Bluetooth®. 【0134】 When the mobile terminal 60 obtains vibration values ​​from the cart 70, it determines whether a cart has been removed based on the obtained vibration values, as in the first embodiment, and determines the accuracy of the determination of whether a cart has been removed. The threshold values ​​(first threshold and second threshold) to be compared with the vibration values ​​obtained from the cart 70 may be determined based on the distribution of vibration values ​​when products are placed in the cart (buying basket 80), collected from a large number of vibration values ​​detected by the cart-side vibration detection unit when products are actually placed in the cart (vibration values ​​when products are placed), and vibration values ​​detected by the cart-side vibration detection unit when the cart 70 is moved, etc. 【0135】 (Vibration detection by other sensors) The cart-side vibration detection unit was described as, for example, an acceleration sensor or a gyro sensor. However, the cart-side vibration detection unit only needs to be a sensor capable of detecting vibrations of the cart 70 or the shopping basket 80 placed on the cart 70. It may be a sensor capable of detecting weight (for example, the weight of the items in the shopping basket 80) (for example, a load cell), a sensor capable of detecting pressure (for example, the pressure applied to the cart 70 or shopping basket 80 from above), or a sensor capable of detecting sound pressure (for example, the sound pressure around the cart 70 or shopping basket 80). In other words, the cart-side vibration detection unit may be an acceleration sensor or a gyro sensor, similar to the terminal-side vibration detection unit. However, since vibrations when items are placed in the cart or when the cart 70 moves can also be detected as changes in weight, pressure, or sound pressure, the cart-side vibration detection unit may be a sensor capable of detecting weight, a sensor capable of detecting pressure, or a sensor capable of detecting sound pressure. In other words, the cart 70 may be equipped with a weight detection unit, a pressure detection unit, or a sound pressure detection unit as a sensor (cart-side vibration detection unit) for detecting vibrations. 【0136】 The number of thresholds used to determine the accuracy of the basket removal judgment, based on vibration values ​​determined from weight changes, may be two or more. In other words, the number of thresholds compared with the vibration values ​​determined from weight changes should be such that the basket removal judgment and the accuracy of that judgment can be determined, and may be two or more. That is, the thresholds compared with the vibration values ​​determined from weight changes may be determined, for example, by collecting a large number of weight changes detected when products are actually placed in the cart 70 (shopping basket 80) (weight change when products are placed) and weight changes detected when the cart 70 is moved, etc. (weight change when products are not placed), and based on the patterns of weight changes when products are placed and when products are not placed. The same applies to thresholds compared with vibration values ​​determined from pressure changes and thresholds compared with vibration values ​​determined from sound pressure changes. 【0137】 (Judgment based on factors other than vibration) Furthermore, the cart 70 may, in lieu of or in addition to vibration, detect (weigh) weight (for example, the weight of the items in the shopping basket 80) and output the weight value (weight detection result) to the mobile terminal 60. Also, the cart 70 may, in lieu of or in addition to vibration or weight, detect pressure (for example, the pressure applied to the cart 70 or shopping basket 80 from above) and output the pressure value (pressure detection result) to the mobile terminal 60. Also, the cart 70 may, in lieu of or in addition to vibration, weight, or pressure, detect sound pressure (for example, the sound pressure around the cart 70 or shopping basket 80) and output the sound pressure value (sound pressure detection result) to the mobile terminal 60. In other words, the cart 70 may be equipped with a weight detection unit, a pressure detection unit, and a sound pressure detection unit as sensors for detecting vibrations (cart-side vibration detection unit), but it may also be equipped with a weight detection unit to detect (weigh) weight (for example, the weight of the items in the shopping basket 80), a pressure detection unit to detect pressure (for example, the pressure applied from above to the cart 70 or shopping basket 80), and a sound pressure detection unit to detect sound pressure (for example, the sound pressure around the cart 70 or shopping basket 80). 【0138】 The mobile terminal 60 may determine whether an item has been left out of the cart and the accuracy of that determination based on various information obtained from the cart 70. In other words, the mobile terminal 60 may determine whether an item has been placed in the cart and the accuracy of that determination based on at least one of the following obtained from the cart 70: vibration value (vibration detection result), weight value (weight detection result), pressure value (pressure detection result), and sound pressure value (sound pressure detection result), along with their respective thresholds (first threshold, second threshold). 【0139】 Regarding the thresholds (first threshold and second threshold) used to compare the weight values ​​obtained from cart 70, for example, the first threshold could be a weight at which it can be determined that the increase in weight is not due to product input (specifically, a weight smaller than the weight of the lightest product), and the second threshold could be a weight at which it can be determined that the increase in weight is due to product input (i.e., a weight that cannot be considered to have increased due to error). 【0140】 The threshold values ​​(first threshold and second threshold) to be compared with the pressure values ​​obtained from the cart 70 may be determined based on the distribution of pressure values ​​obtained when products are actually placed in the cart 70 (shopping basket 80), collected from multiple sources, and from pressure values ​​obtained when the cart 70 is moved or otherwise moved, etc., and from the distribution of pressure values ​​obtained when products are placed in the cart 70 and when products are not placed. The same applies to the threshold values ​​to be compared with the sound pressure values ​​obtained from the cart 70. 【0141】 Alternatively, instead of the mobile terminal 60, the cart 70 may determine whether a cart has been left behind and assess the accuracy of that determination. For example, the cart 70 may be equipped with a CPU and memory and determine whether a cart has been left behind and assess the accuracy of that determination based on the detection results it has detected (at least one of vibration detection results, weight detection results, pressure detection results, and sound pressure detection results) and thresholds for each detection result stored in the memory (first threshold, second threshold). The cart 70 transmits the determination results to the mobile terminal 60. 【0142】 Although it was explained that the cart 70 is equipped with a vibration detection unit (cart-side vibration detection unit), a vibration detector equipped with a vibration detection unit may be attached to the cart 70. Furthermore, the shopping basket 80 may be equipped with a vibration detection unit, or a vibration detector may be attached to the shopping basket 80. The same applies to the weight detection unit, pressure detection unit, and sound pressure detection unit. 【0143】 Furthermore, two or more vibration detection units (cart-side vibration detection units) may be provided on the cart 70 side (vibration detection units may be provided at two or more locations on the cart 70 side). The same applies to the weight detection unit, pressure detection unit, and sound pressure detection unit. 【0144】 As described above, the second embodiment allows for the registration of products using a mobile terminal, similar to the first embodiment. Furthermore, the accuracy of the judgment can be improved by using multiple types of sensing information (vibration, weight, pressure, sound pressure) or by sensing at multiple locations. 【0145】 As described above, each embodiment allows for the effective implementation of product registration using a mobile terminal. 【0146】 (Variations, etc.) Although each embodiment has been described above, the configuration of the equipment, the data configuration, the processing flow, the display and output modes, etc., can be changed as appropriate, for example, as shown in (1) to (8) below. Furthermore, (1) to (8) below can be combined as appropriate. 【0147】 (1) In the first embodiment, an example was described in which the presence or absence of a product is determined and the accuracy of the determination is determined based on the detection results (vibration, etc.) of the terminal-side vibration detection unit, etc., of the mobile terminal 60. In the second embodiment, an example was described in which the presence or absence of a product is determined and the accuracy of the determination is determined based on the detection results (vibration, etc.) of the cart-side vibration detection unit, etc. However, the first and second embodiments may be combined. In other words, the mobile terminal 60 may determine whether or not a product is placed in the cart and the accuracy of the determination is determined based on at least one of the following: vibration detected by the terminal-side vibration detection unit of the mobile terminal 60 itself, captured images acquired by the imaging unit of the mobile terminal 60 itself, vibration acquired from the cart-side vibration detection unit, weight acquired from the weight detection unit, pressure acquired from the pressure detection unit, and sound pressure acquired from the sound pressure detection unit. The information may be collected by the cart 70 (the detection results are transmitted from the mobile terminal 60 to the cart 70), and the cart 70 may make the determination. 【0148】 Furthermore, in an embodiment in which the detection results of the vibration detection unit of the mobile terminal 60 are used for the determination, rather than using the detection results of the vibration detection unit of the cart 70, the detection results may be transmitted from the mobile terminal 60 to the cart 70, and the cart 70 may determine whether or not an item has been placed in the cart and determine the accuracy of that determination instead of the mobile terminal 60. The same applies to the contents described as the operation of the mobile terminal 60 in (2) and subsequent sections below. 【0149】 (2) In the first embodiment (and the second embodiment as well), an example was described in which there are two thresholds (first threshold, second threshold) related to vibration (vibration detection result), but there may be three or more. In other words, in the first embodiment (and the second embodiment as well), an example was described in which if the vibration is less than the first threshold, it is determined that no product has been placed; if it is between the first threshold and the second threshold, it is determined that a product has been placed (low probability); and if it is above the second threshold, it is determined that a product has been placed (high probability). Different information is output depending on whether a product has been placed (low probability) or a product has been placed (high probability). However, the judgment may be made in a more detailed manner, and information corresponding to each case may be output. The same applies to the thresholds related to images (image comparison results). The same also applies to the thresholds related to weight (weight detection result), pressure (pressure detection result), and sound pressure detection result in the second embodiment. 【0150】 (3) In the first embodiment (and the second embodiment as well), the loading of goods into the moving cart 70 (shopping basket 80) may be considered. Since the vibration caused by loading goods into a vibrating cart 70 is considered to be greater than the vibration caused by loading goods into a stationary cart 70, even when considering the loading of goods into a moving cart 70, if the vibration is less than the first threshold, it may be determined that no goods have been loaded; if the vibration is between the first threshold and the second threshold, it may be determined that goods have been loaded (low probability); and if the vibration is above the second threshold, it may be determined that goods have been loaded (high probability). 【0151】 Alternatively, the vibration detection unit may collect a large number of vibrations detected when a product is actually placed in a stationary cart 70 (vibration value when a product is placed in a stationary cart), vibrations detected by the vibration detection unit when a product is actually placed in a moving cart 70 (vibration value when a product is placed in a moving cart), and vibrations detected by the vibration detection unit when the cart 70 is simply moved (vibration value when a product is not placed in a moving cart). Based on the distribution of each vibration (vibration value when a product is placed in a stationary cart, vibration value when a product is placed in a moving cart, and vibration value when a product is not placed in a moving cart), two or more thresholds may be determined. By comparing the vibration detected by the vibration detection unit with these two or more thresholds, it may be determined whether no product has been placed, a product has been placed (low probability), or a product has been placed (high probability). 【0152】 The system may also detect whether the cart 70 is stationary or moving using a different component than the terminal-side vibration detection unit (or cart-side vibration detection unit) (for example, a position sensor such as GPS on the mobile terminal 60 or cart 70, a sensor on the cart 70 that detects the movement of wheels, a sound pressure detection unit, or an image recognition function (such as recognition of changes in the background of an captured image)). If the system determines that the cart 70 is moving using the different component, it may determine whether no product has been loaded, whether a product has been loaded (low probability), or whether a product has been loaded (high probability) by comparing the vibration detected by the vibration detection unit (vibration value of the moving cart 70) with thresholds for when the cart is moving (first threshold for when the cart is moving, second threshold for when the cart is moving). The thresholds for when the cart is moving may be determined based on the distribution of vibrations during movement (vibration values ​​when a product is loaded during movement, and when a product is not loaded during movement). 【0153】 (4) In the first embodiment (and the second embodiment as well), the collapse (movement) of items in the cart 70 (shopping basket 80) may be taken into consideration. For example, it may be assumed (set) that the collapse is likely to occur when there are more than a predetermined number of items (e.g., 5 items) in the cart 70, and based on the vibration detected by the vibration detection unit, the number of items already placed in the cart 70 (or the number of items already registered) at the time before the vibration detection, and a threshold, it may be determined that no items have been placed, items have been placed (low probability), or items have been placed (high probability). As an example, if the vibration detected by the vibration detection unit is above the second threshold and the number of items already placed in the cart 70 (or the number of items already registered) at the time before the vibration detection is less than the predetermined number, it may be determined that items have been placed (high probability). Even if the vibration detected by the vibration detection unit is above the second threshold, if the number of items already placed in the cart 70 (or the number of items already registered) at the time before the vibration detection is greater than the predetermined number, it may be determined that items have been placed (low probability). In addition to the number of items already placed in cart 70 (or the number of items already registered), the total weight of the items already placed in cart 70 (or the number of items already registered), as well as the size and shape of the items already placed in cart 70 (or the number of items already registered), may also be considered when determining whether or not the load is likely to collapse. In other words, the determination of whether or not items have been placed, whether or not items have been placed (low accuracy), or whether or not items have been placed (high accuracy) may be made based on the vibration detected by the vibration detection unit and the circumstances at the time of vibration detection (one or more of the number of items, total weight, and size and shape of the items). Furthermore, the determination of whether or not the load has collapsed may also be made based on the image. For example, if an object that was not present in the image before vibration is present in the image after vibration, or if a new object is recognized in a predetermined area (periphery) of the image before vibration (if an item or hand is recognized entering the imaging area), it may be determined that the load has not collapsed. 【0154】 (5) In the first embodiment (and the second embodiment as well), an example was described in which the presence or absence of a product is determined based on a single value (instantaneous value) for certain sensing information (for example, vibration acquired from one vibration detection unit). However, the presence or absence of a product may also be determined based on multiple values ​​(for example, a pattern of change in values ​​over time, or a feature obtained from multiple values). 【0155】 As an example, let's explain the case of vibration. For decision-making purposes, when an item is actually placed in the cart 70 (shopping basket 80), a large number of vibration change patterns (vibration change patterns when an item is placed) obtained continuously from the terminal-side vibration detection unit (or cart-side vibration detection unit) are collected, and the feature quantities of the vibration change patterns when an item is placed are calculated. In the decision-making process, the mobile terminal 60 calculates the feature quantities of the vibration change patterns obtained continuously from the terminal-side vibration detection unit (or cart-side vibration detection unit), compares the calculated feature quantities with the feature quantities of the vibration change patterns when an item is placed, and if the similarity (degree of agreement) between the two is less than the first threshold, it is determined that no item has been placed; if it is between the first threshold and the second threshold, it is determined that an item has been placed (low probability); and if it is above the second threshold, it is determined that an item has been placed (high probability). Alternatively, for decision-making purposes, when the cart 70 is moved, a large number of vibration change patterns (vibration change patterns when no item is placed) obtained continuously from the terminal-side vibration detection unit (or cart-side vibration detection unit) are collected, and the feature quantities of the vibration change patterns when no item is placed are calculated. In the decision-making process, the mobile terminal 60 may calculate the characteristic quantities of the vibration change pattern obtained continuously from the terminal-side vibration detection unit (or cart-side vibration detection unit), compare the calculated characteristic quantities with the characteristic quantities of the vibration change pattern when no product is placed, and determine that no product has been placed if the difference between the two is less than the first threshold, determine that a product has been placed (low probability) if it is between the first threshold and the second threshold, and determine that a product has been placed (high probability) if it is above the second threshold. The mobile terminal 60 may also use both the characteristic quantities of the vibration change pattern when a product is placed and the characteristic quantities of the vibration change pattern when no product is placed to determine whether no product has been placed, a product has been placed (low probability), or a product has been placed (high probability). 【0156】 (6) As also related to (5) above, a trained model generated by machine learning may be used to determine whether or not a product is being stocked. The trained model for determining whether or not a product is being stocked (hereinafter referred to as trained model 1000) may be a model represented using a neural network, for example. Specifically, trained model 1000 may take sensing information (one or more of the following: vibration value, weight value, sound pressure value, position, movement of wheels, etc., captured images, etc.) as input and output the probability (likelihood) that a product is being stocked and the probability (likelihood) that a product is not being stocked. 【0157】 The trained model 1000 is generated by a trained model generation device (e.g., a personal computer). The trained model generation device generates a model based on, for example, the following: each feature quantity (input featureless quantity) based on sensing information, etc., in numerous scenarios where no products are placed in the cart 70; training data indicating that no products are placed in each of these scenarios (i.e., training data corresponding to the input featureless quantity); each feature quantity (input feature quantity) based on sensing information, etc., in numerous scenarios where products are placed in the cart 70; and training data indicating that products are placed in each of these scenarios (i.e., training data corresponding to the input feature quantity). 【0158】 The mobile terminal 60 calculates features from sensing information, etc. The mobile terminal 60 inputs the calculated features into the input layer of the trained model 1000 and obtains output values ​​(probability that the product was introduced, probability that the product was not introduced) from the output layer. For example, the mobile terminal 60 may determine that the product was not introduced if the probability that the product was introduced obtained from the output layer is less than a predetermined first probability (e.g., 10%), determine that the product was introduced (low probability) if it is greater than or equal to the predetermined first probability but less than a predetermined second probability (e.g., 50%), and determine that the product was introduced (high probability) if it is the predetermined second probability. 【0159】 (7) As also related to (6) above, a pre-trained model generated by machine learning may be used to determine whether or not a scan operation has been performed. The pre-trained model for determining whether or not a scan operation has been performed (hereinafter referred to as pre-trained model 1100) may be a model represented using a neural network, for example. Specifically, the pre-trained model 1100 may, when given features based on an captured image as input, output the probability (likelihood) that a scan operation has been performed and the probability (likelihood) that a scan operation has not been performed. 【0160】 The trained model 1100 is generated by a trained model generator. The trained model generator generates a model based on, for example, the respective feature quantities (scan operation non-feature quantities) based on the captured images in a large number of scenes where scanning is not performed, training data indicating that scanning is not performed in each of those scenes (i.e., training data corresponding to the scan operation non-feature quantities), the respective feature quantities (scan operation-enabled feature quantities) based on the captured images in a large number of scenes where scanning is performed, and training data indicating that scanning is performed in each of those scenes (i.e., training data corresponding to the scan operation-enabled feature quantities). The trained model 1100 generated by the trained model generator is stored in a location accessible to the mobile terminal 60. 【0161】 The mobile terminal 60 calculates features from the captured image. The mobile terminal 60 inputs the calculated features into the input layer of the trained model 1100 and obtains output values ​​(the probability that a scan operation was performed, the probability that a scan operation was not performed) from the output layer. For example, the mobile terminal 60 determines that a scan operation was not performed if the probability obtained from the output layer is less than a predetermined probability (for example, 50%), and determines that a scan operation was performed if it is greater than or equal to the predetermined probability. 【0162】 (8) Some or all of the functions (input / output, storage, processing (including judgment)) in each device (mobile terminal 60, payment device 50, cart 70, etc.) may be implemented in a device other than the device described as the entity that executes the function. For example, each device may function as a so-called thin client specialized in input / output interfaces, etc. As an example, a cloud server (which may be the same as cloud server 20 or a different cloud server) may execute a program to control the operation of each device, and each device may display a screen using a browsing function, etc. As a specific example, cloud server 20 may acquire (receive) information necessary for judgment from mobile terminal 60 and determine whether no product has been entered, whether a product has been entered (low probability), or whether a product has been entered (high probability). 【0163】 <Summary of Embodiments> [Technical field] This invention relates to a program, an information terminal, and a system. [Background technology] A system is known in which customers register products themselves using a mobile device (see, for example, Patent Document 1). [Prior art document] [Patent] [Patent Document 1] Japanese Unexamined Patent Publication No. 2018-147252 [Overview of the prefecture] [Problems the invention aims to solve] However, the systems described above have room for improvement, for example, in dealing with malicious or unfamiliar customers. The present invention has been made in view of these circumstances and aims to provide a technology for suitably implementing product registration using a mobile terminal. [Means for solving the problem] 【0164】 (1) One embodiment for solving the above-mentioned problems is a program that causes a computer to function as an information terminal (e.g., a mobile terminal 60) used for registering products to be purchased, wherein the computer functions as an image acquisition means for acquiring an image, a registration means for registering a product based on product identification information in the image acquired by the image acquisition means, a vibration detection means for detecting vibrations of the information terminal (e.g., a terminal-side vibration detection unit), and an output means (e.g., a display unit, an audio output unit, a communication unit) capable of outputting information regarding the purchase of a product to the operator of the information terminal, wherein the output means outputs information regarding the purchase of a product (e.g., see steps S450, S460, S470, and S480) when a predetermined vibration is detected by the vibration detection means and the product has not been registered by the registration means before the detection of the vibration (e.g., when step S401 in Figure 7 is NO). According to the program in (1), product registration using a mobile terminal can be suitably implemented. For example, if there is a risk of items being left out of the shopping cart, necessary information can be notified to the operator. 【0165】 (2) The program according to (1), characterized in that the output means varies the output content according to the vibration detected by the vibration detection means (see, for example, steps S440, S450, S470, and S480 in Figure 7). According to the program in (2), product registration using a mobile terminal can be suitably implemented. For example, the operator can be notified of suitable information according to the likelihood (certainty) of items being left behind in the shopping cart. For example, as shown in Figure 8, if the likelihood of items being left behind in the shopping cart is relatively high, the operator is notified of information requesting them to take action against the item being left behind (step S460), and if the likelihood of items being left behind in the shopping cart is relatively low, the operator is notified of information simply requesting confirmation (step S480). This allows for maintaining (without loosening) measures against items being left behind in the shopping cart, while avoiding unnecessarily causing discomfort to the operator. Furthermore, the frequency of store staff having to respond to items being left behind in the shopping cart can also be effectively reduced. 【0166】 (3) The program according to (1) or (2), wherein the computer is further configured to function as a behavior recognition means (e.g., an image recognition function) that recognizes the behavior of the operator of the information terminal from the image acquired by the image acquisition means, and the output means outputs information related to the purchase of a product when the behavior recognized by the behavior recognition means is a predetermined behavior (e.g., a scanning operation) (see, for example, step S402 in Figure 11). According to the program in (3), product registration using a mobile terminal can be suitably implemented. For example, malicious customers who attempt to falsify product registration by performing a scanning operation while ignoring the effects of vibrations caused by the movement of the cart 70 or collisions of people or objects with the cart 70 can be effectively dealt with. 【0167】 (4) The output means is a program according to any one of (1) to (3), characterized in that it outputs information relating to the purchase of a product, such as information indicating that the intervention of a store employee is required when purchasing a product (for example, the small screen SG10 in Figure 5(A)), or information confirming whether or not to purchase a product (for example, the small screen SG20 in Figure 5(B)). According to the program in (4), product registration using a mobile terminal can be suitably performed. Information can be output according to the situation. 【0168】 (5) The program according to any one of (1) to (4), characterized in that the computer is further configured to function as a means for determining whether or not a store employee is required to purchase a product, based on vibrations detected by the vibration detection means (see, for example, steps S440, S460, and S469 in Figure 8). According to the program in (5), product registration using a mobile device can be suitably implemented. For example, the frequency of store staff having to deal with items left out of shopping carts can also be effectively reduced. 【0169】 (6) One embodiment for solving the above-mentioned problems is a program that causes a computer to function as an information terminal (for example, a mobile terminal 60) used for registering products to be purchased, wherein the computer functions as an image acquisition means for acquiring an image, a registration means for registering a product based on product identification information in the image acquired by the image acquisition means, a vibration acquisition means for acquiring vibrations from a source other than the information terminal (for example, a communication unit for acquiring vibration values ​​from a cart-side vibration detection unit), and an output means (for example, a display unit, an audio output unit, a communication unit) capable of outputting information regarding the purchase of a product to the operator of the information terminal, wherein the output means outputs information regarding the purchase of a product (for example, see steps S450, S460, S470, and S480) when a predetermined vibration is acquired by the vibration acquisition means and the product has not been registered by the registration means before the acquisition of the vibration (for example, when step S401 in Figure 7 is NO). According to program (6), the same effect as program (1) can be obtained. 【0170】 (7) One embodiment for solving the above-mentioned problems is an information terminal (for example, a mobile terminal 60) used for registering products to be purchased, comprising: an image acquisition means for acquiring an image; a registration means for registering a product based on product identification information in the image acquired by the image acquisition means; a vibration detection means for detecting vibrations of the information terminal itself; and an output means (for example, a display unit, an audio output unit, a communication unit) capable of outputting information related to the purchase of a product to the operator, wherein the output means outputs information related to the purchase of a product (for example, see steps S450, S460, S470, and S480) when the vibration detection means detects vibrations of a predetermined value or higher and the product has not been registered by the registration means before the detection of the vibrations (for example, when step S401 in Figure 7 is NO). According to the information terminal in (7), the same effect as the program in (1) can be obtained. 【0171】 (8) One embodiment for solving the above-mentioned problems is a system including an information terminal (e.g., a mobile terminal 60) used for registering products to be purchased, comprising: an image acquisition means for acquiring an image; a registration means for registering a product based on product identification information in the image acquired by the image acquisition means; a vibration detection means for detecting vibrations of the information terminal; and an output means (e.g., a display unit, an audio output unit, a communication unit) capable of outputting information regarding the purchase of a product to the operator of the information terminal, wherein the output means outputs information regarding the purchase of a product (e.g., see steps S450, S460, S470, and S480) when a predetermined vibration is detected by the vibration detection means and the product has not been registered by the registration means before the detection of the vibration (e.g., when step S401 in Figure 7 is NO). According to the system in (8), the same effect as the program in (1) can be obtained. 【0172】 (9) The system according to (8), further comprising: posture detection means for detecting the posture of the information terminal (for example, a vibration detection unit of the mobile terminal 60, a connector on the cart 70 side, a sensor); and restriction means for restricting the registration of products in the registration means according to the posture detected by the posture detection means (for example, means for prohibiting imaging by the imaging unit, means for prohibiting the acquisition of product codes, means for prohibiting the transmission of product codes, etc., means for prohibiting the updating of transaction information) According to the system in (9), for example, in the case where the mobile terminal 60 detects vibration, it is possible to reliably notify the operator of the necessary information when there is a risk of a car being left behind. 【0173】 Furthermore, the functions of each of the devices described above (headquarters server 10, store controller 30, transaction status management device 40, settlement device 50, mobile terminal 60, cart 70, etc.) may be realized by recording the program to realize the functions of each device on a computer-readable recording medium, loading the program recorded on this recording medium into a computer system, and executing it. Here, "loading the program recorded on the recording medium into a computer system and executing it" includes installing the program into the computer system. Here, "computer system" includes hardware such as the OS and peripheral devices. Also, "computer system" may include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. Also, "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into the computer system. Thus, the recording medium storing the program may also be a non-transient recording medium such as a CD-ROM. Also, the recording medium includes internal or external recording media that can be accessed from a distribution server for distributing the program. The program code stored on the distribution server's recording medium may be different from the program code in an executable format on the terminal device. In other words, as long as it can be downloaded from the distribution server and installed in an executable format on the terminal device, the format in which it is stored on the distribution server is irrelevant. Furthermore, the program may be divided into multiple parts, downloaded at different times and then combined on the terminal device, and each of the divided programs may be distributed by a different distribution server. In addition, "computer-readable recording medium" includes volatile memory (RAM) within computer systems that act as servers or clients when a program is transmitted over a network, which retains the program for a certain period of time. Moreover, the above program may be intended to implement only a part of the functions described above.Furthermore, the above-mentioned functions may be realized in combination with programs already recorded in the computer system, such as so-called differential files (differential programs). [Explanation of Symbols] 【0174】 1…Sales system 10…Headquarters server 20…Cloud server 30…Store controller 40…Transaction status management device 50…Settlement device 60…Mobile terminal 70…Shopping cart 90…Dedicated bag

Claims

[Claim 1] A program that makes a computer function as an information terminal used for registering products to be purchased, The aforementioned computer, Image acquisition means for capturing images, A registration means for registering a product based on product identification information in an image acquired by the aforementioned image acquisition means, Vibration detection means for detecting vibrations of a self-information terminal, Output means capable of outputting information regarding product purchases to the operator of the user information terminal. To make it function as, The output means is If the vibration detection means detects a vibration that is between a first threshold and a second threshold, and the product has not been registered in the registration means before the detection of the vibration, then information confirming whether or not the product needs to be purchased is output as information regarding the purchase of the product. If the vibration detection means detects a vibration of a second threshold or higher, and the product was not registered in the registration means before the detection of the vibration, the system outputs information regarding the purchase of the product indicating that the assistance of a store employee is required for the purchase. A program characterized by the following features. [Claim 2] The information terminal is attachable to the holder portion, The aforementioned computer, A means for determining whether or not the user information terminal is attached to the holder. To make it function even better, The output means is If the aforementioned determination means determines that the self-information terminal is attached to the holder, it outputs information about the product. If the aforementioned determination means determines that the information terminal is not attached to the holder, the product information will not be output. The program according to feature 1. [Claim 3] The information terminal is attachable to the holder portion, The aforementioned computer, A means for determining whether or not the user information terminal is attached to the holder. Prohibition means for prohibiting the registration of goods by the aforementioned registration means, To make it function even better, The aforementioned prohibition means is, If the aforementioned determination means determines that the information terminal is not attached to the holder, the registration of the product by the registration means is prohibited. The program according to feature 1. [Claim 4] The information terminal is attachable to the holder portion, In terms of product types, there are products that cannot be registered or are difficult to register when attached to the holder, and products that can be easily registered even when attached to the holder. The aforementioned computer, A means for determining whether or not the user information terminal is attached to the holder. Prohibition means for prohibiting the registration of goods by the aforementioned registration means, To make it function even better, The aforementioned prohibition means is, If the aforementioned determination means determines that the user information terminal is not attached to the holder, registration will be prohibited for products that can be easily registered even when attached to the holder. The program according to feature 1. [Claim 5] A program that makes a computer function as an information terminal used for registering products to be purchased, The aforementioned computer, Image acquisition means for capturing images, A registration means for registering a product based on product identification information in an image acquired by the aforementioned image acquisition means, Vibration acquisition means for acquiring vibrations from a source other than the user's own information terminal. Output means capable of outputting information regarding product purchases to the operator of the user information terminal. To make it function as, The output means is If the vibration acquisition means acquires vibrations that are between a first threshold and a second threshold, and the product has not been registered by the registration means before the acquisition of such vibrations, then information confirming whether or not the product needs to be purchased is output as information regarding the purchase of the product. If the vibration acquisition means acquires vibrations at or above the second threshold, and the product has not been registered by the registration means before the acquisition of such vibrations, then information indicating that the involvement of a store employee is required for the purchase of the product will be output as information related to the purchase of the product. A program characterized by the following features. [Claim 6] An information terminal used to register products to be purchased, Image acquisition means for acquiring images, A registration means for registering a product based on product identification information in an image acquired by the aforementioned image acquisition means, A vibration detection means for detecting vibrations of the information terminal, An output means capable of outputting information regarding the purchase of a product to the operator. Equipped with, The output means is If the vibration detection means detects a vibration that is between a first threshold and a second threshold, and the product has not been registered in the registration means before the detection of the vibration, then information confirming whether or not the product needs to be purchased is output as information regarding the purchase of the product. If the vibration detection means detects a vibration of a second threshold or higher, and the product was not registered in the registration means before the detection of the vibration, the system outputs information regarding the purchase of the product indicating that the assistance of a store employee is required for the purchase. An information terminal characterized by the following features. [Claim 7] A system including an information terminal used to register products to be purchased, Image acquisition means for capturing images, A registration means for registering a product based on product identification information in an image acquired by the aforementioned image acquisition means, Vibration detection means for detecting vibrations of a self-information terminal, Output means capable of outputting information regarding product purchases to the operator of the user information terminal. Equipped with, The output means is If the vibration detection means detects a vibration that is between a first threshold and a second threshold, and the product has not been registered in the registration means before the detection of the vibration, then information confirming whether or not the product needs to be purchased is output as information regarding the purchase of the product. If the vibration detection means detects a vibration of a second threshold or higher, and the product was not registered in the registration means before the detection of the vibration, the system outputs information regarding the purchase of the product indicating that the assistance of a store employee is required for the purchase. A system characterized by the following features.

Images