Program, system, mobile communication terminal, and information processing device

Abstract

To improve the efficiency of system operation.SOLUTION: A program causes a computer to function as a system, and causes the computer to function as acquisition means, detection means, and notification means. The acquisition means acquires product information on a product to be registered. The detection means detects that an item has been added to a cart. The notification means issues a predetermined announcement based on an acquisition state of the acquisition means and a detection result of the detection means. The notification means does not issue the announcement if a predetermined condition is satisfied.SELECTED DRAWING: Figure 14

Description

Technical Field

[0001] The present invention relates to a program, a system, a mobile communication terminal, and an information processing apparatus.

Background Art

[0002] Conventionally, various techniques for wirelessly connecting a plurality of communication devices have been known. For example, there is known an information communication terminal that reads a MAC address of a device from an NFC tag attached to the device and transmits data with an IP address corresponding to the read MAC address as a destination (see, for example, Patent Document 1). In recent years, a system has also been known in which a customer registers products by himself / herself in a product display area using a shopping cart.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, there are cases where announcements regarding the loading and unloading of products into / from a shopping cart cannot be appropriately notified. As a result, not only is there a risk that customers cannot shop comfortably, but there is also a risk that the business efficiency of store clerks may decrease due to the calling of store clerks. For this reason, there has been a problem that the prior art may not be able to efficiently operate the system.

[0005] The present invention has been made in view of such circumstances, and an object thereof is to provide a technology capable of efficiently operating a system.

Means for Solving the Problems

[0006] In order to solve the above-described problems, a program according to one aspect of the present invention is a program that causes a computer to function as a system, and causes the computer to function as an acquisition unit that acquires product information of a product to be registered, a detection unit that detects that an article has been added to a cart, and a notification unit that notifies a predetermined announcement based on an acquisition state of the acquisition unit and a detection result of the detection unit, and the notification unit does not notify the announcement when a predetermined condition is satisfied. A program characterized by that.

[0007] In order to solve the above-described problems, a system according to another aspect of the present invention includes an acquisition unit that acquires product information of a product to be registered, a detection unit that detects that an article has been added to a cart, and a notification unit that notifies a predetermined announcement based on an acquisition state of the acquisition unit and a detection result of the detection unit, and the notification unit does not notify the announcement when a predetermined condition is satisfied. A system characterized by that.

[0008] In order to solve the above-described problems, a program according to another aspect of the present invention is a program that causes a computer as a mobile communication terminal to function as an acquisition unit that acquires product information of a product to be registered, a detection unit that detects that an article has been added to a cart, and a notification unit that notifies a predetermined announcement based on an acquisition state of the acquisition unit and a detection result of the detection unit, and the notification unit does not notify the announcement when a predetermined condition is satisfied. A program characterized by that.

[0009] In order to solve the above-described problems, a mobile communication terminal according to another aspect of the present invention includes an acquisition unit that acquires product information of a product to be registered, a detection unit that detects that an article has been added to a cart, and a notification unit that notifies a predetermined announcement based on an acquisition state of the acquisition unit and a detection result of the detection unit, and the notification unit does not notify the announcement when a predetermined condition is satisfied. A mobile communication terminal characterized by that.

[0010] In order to solve the above-described problems, an information processing apparatus according to another aspect of the present invention is an information processing apparatus that connects to a mobile communication terminal that can be used for registering products, and includes an acquisition unit that acquires product information of a product to be registered, a detection unit that detects that an item has been added to a cart, and a notification unit that notifies a predetermined announcement based on an acquisition state of the acquisition unit and a detection result of the detection unit, wherein the notification unit does not notify the announcement when a predetermined condition is satisfied. An information processing apparatus characterized by this.

[0011] In order to solve the above-described problems, a program according to another aspect of the present invention is a program that causes a computer to function as an information processing apparatus that connects to a mobile communication terminal that can be used for registering products, and causes the computer to function as an acquisition unit that acquires product information of a product to be registered, a detection unit that detects that an item has been added to a cart, and a notification unit that notifies a predetermined announcement based on an acquisition state of the acquisition unit and a detection result of the detection unit, wherein the notification unit does not notify the announcement when a predetermined condition is satisfied. A program characterized by this.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12A

Figure 12B

Figure 13

Figure 14

Figure 15

Figure 16

[0013] (Embodiment) (Network configuration of sales system 1) FIG. 1 is an explanatory diagram showing a network configuration of a sales system 1 according to an embodiment. The sales system 1 is an example of a system. The sales system 1 can be introduced in various stores. The various stores are, for example, supermarkets, drug stores, home improvement stores, convenience stores, and electronics retailers.

[0014] In the sales system 1, transactions are conducted in a self-service mode. Specifically, in the self-service transactions in the sales system 1, the registration of products received from customers in the product display area is performed by the mobile terminal 60, and the settlement of the products is performed by the settlement device 50. Hereinafter, mainly such self-service transactions will be described. However, in addition to such a mode, the sales system 1 includes a registration and settlement device (cash register) installed in the store, and a mode in which product registration and settlement are performed in the registration and settlement device. Note that the registration of products in the registration and settlement device may be performed by a store clerk or by a customer. Also, the settlement in the registration and settlement device may be performed by a store clerk or by a customer.

[0015] As shown in FIG. 1, the sales system 1 includes a head office server 10, a cloud server 20, a store controller 30, a transaction status management device 40, a settlement device 50, a mobile terminal 60, and a cart device 70. The various devices provided in the store St may be owned by the store St, may be lent by the manufacturer of each device, or may be lent under a lease contract from a leasing company.

[0016] The head office server 10 and the cloud server 20 are installed, for example, outside the store (e.g., at the head office, data center, etc.). The store controller 30, the transaction status management device 40, and the settlement device 50 are each installed inside the store. The devices installed inside the store and the devices installed outside the store can communicate (directly communicate or communicate via the store controller 30). The devices installed inside the store are each communicably connected via a LAN (Local Area Network) 19. Each device shown in FIG. 1 is a computer device provided with a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a communication unit, and the like. Each device is communicably connected via a network.

[0017] (Head office server 10) The head office server 10 is installed, for example, at the head office of a store. The head office server 10 acquires various information from the store controllers 30 arranged in each store and manages the various information for each store. The various information includes information such as sales, inventory status, and sales history.

[0018] (Cloud server 20) In a transaction, the cloud server 20 generates and manages transaction information (cart information) indicating the products in a virtual cart. The transaction information includes registration information indicating the products registered by each customer. The transaction information is generated for each customer (for each transaction). The transaction information is updated based on the product code (product identification information) read by the mobile terminal 60. Transaction identification information (cart identification information) for identifying the transaction (cart or customer) is assigned to the transaction information. Further, the transaction information also includes a store clerk call flag, information indicating the connection status with the cart device 70, and status information. The status information is information indicating each status such as before entering the store, starting product registration, ending product registration, starting settlement, ending settlement, and leaving the store.

[0019] In addition to the transaction information, the information managed by the cloud server 20 also includes customer information regarding customers, store information regarding stores, and product information (product master) regarding products for each store. The product master is a file that stores product information such as the product identification information (for example, JAN (Japanese Article Number) code), product name, and selling price of each product. Further, the product master includes various information such as the product identification information, product name, and unit price of products that require weighing.

[0020] (Store controller 30) The store controller 30 manages the settlement device 50 and a weighing device (not shown) for weighing weighed products. Further, the store controller 30 stores various information necessary for transactions such as the product master. In addition to the product master, the store controller 30 stores various information such as sales, inventory status, sales history, and deposit and withdrawal records.

[0021] (Transaction Status Management Device 40) The transaction status management device 40 is a monitoring terminal device that monitors the settlement device 50. Specifically, the transaction status management device 40 can display the status (processing status) of the settlement device 50 and control the settlement device 50. A store clerk for monitoring is arranged at the transaction status management device 40. Note that the sales system 1 may include a clerk terminal device held by a clerk instead of or in addition to the transaction status management device 40. The clerk terminal device, for example, displays the same content as that displayed on the transaction status management device 40 or notifies that a clerk is to be called.

[0022] (Settlement Device 50) The settlement device 50 is a self - settlement device that performs settlement by a customer's operation. The settlement device 50 acquires transaction information (registration information) used for settlement from the cloud server 20 and performs settlement based on the transaction information. The number of settlement devices 50 arranged in the store may be one or a plurality.

[0023] (Mobile Terminal 60) The mobile terminal 60 is an example of a mobile communication terminal. The mobile communication terminal includes a mobile terminal 60 (customer terminal) owned by a customer and a lending terminal owned by the store St. Hereinafter, mainly the mobile terminal 60 will be described as the mobile communication terminal. The mobile terminal 60 is a portable computer device such as a smartphone, a tablet device, or a mobile phone, for example. The mobile terminal 60 includes a communication unit, a camera (imaging unit), a touch panel display unit, etc., and is operated by a customer. The mobile terminal 60 is detachably attached to the shopping cart.

[0024] Note that when not in use, the lending terminal may be connected to a charger installed at the entrance of the store St or the like and be charged. The charging method of the lending terminal may be a contact charging method (cord - type charging) or a non - contact charging method (wireless charging). Also, the lending terminal may be installed in the shopping cart, that is, it may be non - detachably attached to the shopping cart.

[0025] The mobile terminal 60 is installed with application software (hereinafter referred to as "shopping app") for receiving the use of the services related to the sales system 1. By activating the shopping app, the mobile terminal 60 accepts the registration of products or the start of settlement. Specifically, the mobile terminal 60 accepts the registration of a product by scanning (reading) the product code (barcode) attached to the product. When the mobile terminal 60 reads the product code, it transmits the read code information to the cloud server 20 together with the transaction identification information. Thereby, the product information corresponding to the product code is registered in the cloud server 20.

[0026] In addition, when the mobile terminal 60 accepts the operation to start settlement, it displays a settlement code obtained by encoding the transaction identification information. The settlement code is represented by, for example, a two-dimensional code (or barcode). The customer causes the settlement device 50 to read the settlement code. When the settlement device 50 reads the settlement code, it makes a transmission request for transaction information (registration information) including the transaction identification information to the cloud server 20. The settlement device 50 can receive the transaction information from the cloud server 20 in response to the transmission request and perform settlement.

[0027] (Hardware Configuration of Mobile Terminal 60) FIG. 2 is a block diagram showing an example of the hardware configuration of the mobile terminal 60. As shown in FIG. 2, the mobile terminal 60 includes a CPU 201, a memory 202, a communication I / F (interface) 203, a storage medium I / F 204, an input device 205, a display 206, and a camera 207. Each unit is connected by a bus 220.

[0028] The CPU 201 controls the overall operation of the mobile terminal 60. The memory 202 includes, for example, a ROM, a RAM, a hard disk, an SSD (Solid State Drive), etc. The memory 202 stores various programs. The various programs include a shopping app. The shopping app includes the announcement notification program according to this embodiment. The RAM is used as a work area for the CPU 201. The programs stored in the memory 202 are loaded into the CPU 201 to cause the CPU 201 to execute the coded processes.

[0029] The communication I / F 203 is connected to a network such as the Internet through a communication line and is connected to other devices (e.g., the cloud server 20, the cart device 70, etc.) via the network. Also, the communication I / F 203 serves as an interface between the network and the internal part of the device itself and controls the input and output of data from other devices. The communication I / F 203 is a general term for one or more various communication members. The various communication members are, for example, 5G (the 5th generation mobile communication system), Wi-Fi, NFC (Near Field Communication), Bluetooth (registered trademark), etc.

[0030] The storage medium I / F 204 controls the reading and writing of data to / from a storage medium (not shown) such as a magnetic disk or an optical disk according to the control of the CPU 201. The input device 205 includes a touch panel and operation buttons. Note that the input device 205 may also include a keyboard, a mouse, a microphone, etc. The display 206 is a touch panel display unit that displays images.

[0031] The camera 207 captures video or still images. A CCD (charge coupled device) camera or a CMOS (Complementary Metal Oxide Semiconductor) camera is used for the camera 207. The camera 207 reads the product code attached to the product. When reading the product code, the captured image is displayed on the display 206.

[0032] Note that the mobile terminal 60 may be provided with a scanner instead of or in addition to the camera 207. The scanner is provided, for example, at the upper end of the housing of the mobile terminal 60. For the reading method of the scanner, for example, a laser method, a CCD method, or the like can be adopted. The scanner reads, for example, a product code (barcode) attached to a product.

[0033] Note that in addition to the display 206 and the camera 207, the mobile terminal 60 is also provided with, as output devices, a speaker, a position detection unit, various sensors, and the like. The speaker outputs sound. The position detection unit receives position information from GPS (Global Positioning System) satellites, beacons, or the like, and detects the current location of the mobile terminal 60 on map data. The various sensors include, for example, a gyro sensor, an acceleration sensor, a distance sensor, and the like. Based on the detection results of the various sensors, the mobile terminal 60 can detect, for example, the inclination of the mobile terminal 60.

[0034] (Cart device 70) In the store, there is a shopping cart prepared by the store (hereinafter referred to as the "cart device 70"). The cart device 70 has a function of communicating with the mobile terminal 60 and a function of weighing the products in the cart. The cart device 70 places and transports the products registered by the mobile terminal 60. Specifically, the mobile terminal 60 can be attached (set) to the cart device 70. The mobile terminal 60 and the cart device 70 can communicate with each other by wireless communication (for example, NFC (Near Field Communication) such as RFID (Radio frequency identification), Bluetooth (registered trademark)). In FIG. 1, the mobile terminal 60 shown inside the cart device 70 shows the mobile terminal 60 in a state attached to the cart device 70.

[0035] The cart device 70 may be capable of directly communicating with the cloud server 20, the store controller 30, the transaction status management device 40, etc. In this case, the cart device 70 can acquire various information such as the identification number of the cart device 70, the status information of the cart device 70 (battery status, usage times, scale status), the identification number of the connected mobile terminal 60, and the transaction identification information stored in the mobile terminal 60, and transmit it to the cloud server 20.

[0036] In addition, in a mode where the cart device 70 and the cloud server 20 can be connected, if the cart device 70 and the cloud server 20 cannot be connected, the mobile terminal 60 may acquire the above various information from the cart device 70 and transmit the acquired various information to the cloud server 20. The various information includes the identification number of the cart device 70, the status information of the cart device 70 (for example, battery status, usage times, scale status), etc. The mobile terminal 60 may transmit the transaction information including these various information to the cloud server 20. The cloud server 20 manages the transaction information including the various information. Thereby, the cloud server 20 can manage (monitor) the cart device 70 on the system.

[0037] In addition, the mobile terminal 60 registers a product based on the customer's operation (action) in a state where it can communicate with one cart device 70. As long as the mobile terminal 60 can communicate with one cart device 70, it can register a product based on the customer's operation whether it is attached to the cart device 70 or removed from the cart device 70 (for example, a state where the customer is holding and operating it).

[0038] FIG. 3 is an explanatory diagram showing an example of the cart device 70. As shown in FIG. 3, the cart device 70 includes a placement part (placement table) 71, a weighing device (substrate BOX) 72, a cart charging part 73, a holder part 74, a mobile terminal charging part 75, a battery (not shown), a connection cord 78, and an NFC tag 79 (IC tag).

[0039] The placement part 71 is a member on which a shopping basket or the like can be placed. The metering device 72 is realized by one or more substrates. The metering device 72 includes a metering unit and a cart communication unit, and transmits the metering result to the mobile terminal 60. Details of the metering unit and the cart communication unit will be described later with reference to FIG. 4.

[0040] The cart charging unit 73 includes contact terminals that are detachable from a power supply cable (not shown). A battery charging terminal is connected to the tip of the contact terminal. The battery stores the power supplied to the metering device 72.

[0041] The holder unit 74 is a member for setting the mobile terminal 60. The holder unit 74 has an opening. The opening is formed at a position corresponding to the camera 207 (lens) of the set mobile terminal 60. The mobile terminal charging unit 75 stores the power supplied to the mobile terminal 60 set in the holder unit 74.

[0042] The connection cord 78 is attached to the mobile terminal charging unit 75. The connection cord 78 encodes connection information (device identification information) for connecting the own device (the cart device 70) and the mobile terminal 60 in a two-dimensional code.

[0043] The NFC tag 79 is attached to the holder unit 74. The NFC tag 79 includes a storage unit and an IC tag communication unit. The storage unit stores connection information (device identification information) for connecting the own device (the cart device 70) and the mobile terminal 60. The IC tag communication unit transmits the connection information stored in the storage unit to the outside (for example, the mobile terminal 60).

[0044] FIG. 3 shows an example in which a shopping basket is not placed on the placement unit 71 and the mobile terminal 60 is not attached to the holder unit 74. When a customer comes to the store, the customer places a shopping basket on the placement unit 71 and attaches the mobile terminal 60 to the holder unit 74. The customer connects the mobile terminal 60 to a cable (not shown) of the mobile terminal charging unit 75 as needed. Thereby, even when the remaining battery level of the mobile terminal 60 is low, the customer can shop while charging the mobile terminal 60.

[0045] (Hardware Configuration of Cart Device 70) FIG. 4 is a block diagram showing an example of the functional configuration of a cart device 70 (weighing device 72). As shown in FIG. 4, the cart device 70 includes a CPU 301, a memory 302, a weighing unit 303, and a cart communication unit 304. Each unit is connected by a bus 320 respectively.

[0046] The CPU 301 controls the overall operation of the cart device 70 (weighing device 72). The memory 202 is, for example, a ROM, a RAM, a hard disk, an SSD (Solid State Drive), etc. The memory 202 stores various programs. The RAM is used as a work area for the CPU 301. The programs stored in the memory 302 are loaded into the CPU 301 to cause the CPU 301 to execute the coded processes.

[0047] The weighing unit 303 weighs the articles placed on the placement unit 71. The articles include a shopping basket, the goods in the shopping basket, the customer's luggage in the shopping basket, etc. The cart communication unit 304 is connected to other devices (for example, a mobile terminal 60, a cloud server 20, etc.) through a communication line. The cart communication unit 304 transmits, for example, a beacon. Also, the cart communication unit 304 periodically transmits the weighing result measured by the weighing unit 303 to the mobile terminal 60 at a predetermined control cycle.

[0048] (Regarding the Notification of Various Announcements) The mobile terminal 60 can notify various announcements during a customer's shopping process. The various announcements include, for example, an unauthorized input announcement and a product removal announcement. The unauthorized input announcement is an announcement that is notified when the measurement result increases while the product is not registered. The product removal announcement is an announcement that is notified when the measurement result decreases without a cancellation operation of the product. The unauthorized input announcement is provided with the intention of making the customer remember the correct registration order of registering the product and then putting it into the shopping basket. The unauthorized input announcement aims to prevent the store's sales loss. Also, the product removal announcement is provided with the intention of making the customer remember the correct cancellation order of canceling the product and then taking the product out of the shopping basket. The product removal announcement aims to prevent the customer from overpaying and, thus, prevent the store's loss of trust.

[0049] Here, if a customer accidentally puts an unregistered product into the shopping basket, the unauthorized input announcement will be notified when the measurement result increases. Then, assuming the customer notices the un-scanned product and takes the product out of the shopping basket to register it. In such a case, since the customer is aware that the product is unregistered, if the product removal announcement is notified, it may result in excessive notification and may interfere with a comfortable shopping experience. Therefore, in this embodiment, it is designed to suppress any interference with a comfortable shopping experience caused by the announcement notification. Hereinafter, the functional configuration of the mobile terminal 60 according to this embodiment will be described with reference to FIG. 6.

[0050] (Functional Configuration of Mobile Terminal 60) FIG. 5 is a block diagram showing an example of the functional configuration of the mobile terminal 60 according to the present embodiment. As shown in FIG. 5, the mobile terminal 60 includes a reading result acquisition unit 501, a registration unit 502, a detection result acquisition unit 503, a motion detection unit 504, a notification unit 505, a mode setting unit 506, and a cancellation unit 507. Each unit is realized by the CPU 201. That is, the CPU 201 realizes the functions of each unit by executing a shopping application (including an announcement notification program) stored in the memory.

[0051] (Reading result acquisition unit 501) The camera 207 reads the product code (product identification information) attached to the product placed in the shopping basket according to the customer's operation. The camera 207 outputs the reading result to the reading result acquisition unit 501. The reading result acquisition unit 501 acquires the reading result of the product code from the camera 207.

[0052] (Registration unit 502) The registration unit 502 registers the product based on the reading result acquired by the reading result acquisition unit 501. Specifically, the registration unit 502 transmits the product code acquired by the reading result acquisition unit 501 to the cloud server 20. The cloud server 20 registers the product (product name, unit price, etc.) corresponding to the product code received from the mobile terminal 60 in the virtual cart, and transmits registration information indicating that the product has been registered to the mobile terminal 60. The registration unit 502 acquires the registration information (product name, unit price, etc.) received from the cloud server 20 and causes the acquired registration information to be displayed on the display 206.

[0053] (Detection result acquisition unit 503) The detection result acquisition unit 503 acquires a detection result based on the measurement result of the measurement unit 303. The detection result includes an input detection result indicating the input of a product into the shopping basket and a removal detection result indicating the removal of a product from the shopping basket. The input detection result is a detection result indicating that the measurement result has increased. The removal detection result is a detection result indicating that the measurement result has decreased. The determination as to whether the measurement result has increased or decreased, in other words, the determination as to whether it is an input detection result or a removal detection result, is made by a determination unit (not shown) provided in the mobile terminal 60. Therefore, the detection result acquisition unit 503 acquires the detection result from the determination unit.

[0054] Note that the determination as to whether it is an input detection result or a removal detection result is not limited to being made based on the measurement result of the measurement unit 303. These determinations may be made based on the imaging result of the camera 207. For example, the determination unit may determine that it is an input detection result when the products in the shopping basket increase based on the analysis result of the image captured by the camera 207, and may determine that it is a removal detection result when the products in the shopping basket decrease.

[0055] Further, the determination unit may be provided in the cart device 70. That is, the cart device 70 (measurement device 72) may determine whether it is an input detection result or a removal detection result based on the measurement result of the measurement unit 303.

[0056] (Operation detection unit 504) The operation detection unit 504 detects an unregistered input operation. The operation detection unit 504 detects, as an unregistered input operation, a case where there is no product registration by the registration unit 502 when an input detection result is acquired by the detection result acquisition unit 503. In other words, the unregistered input operation is an operation in which a product is input into the shopping basket without the product being registered. Specifically, the unregistered input operation is an operation in which a product is input into the shopping basket without the product code being scanned. That is, the unregistered input operation is an operation indicating that the product code has not been read by the reading result acquisition unit 501 and the input detection result has been acquired by the detection result acquisition unit 503. Hereinafter, the unregistered input operation is referred to as an "unscanned input operation".

[0057] An example of the un-scanned input operation is listed below. · An operation of putting a product into the cart device 70 (shopping basket placed on the placement unit 71) without performing a scan operation. · An operation of performing an inappropriate scan operation intentionally so as not to read the barcode of the product and putting the product into the cart device 70. · An operation of unconsciously or intentionally reading the barcode of a single item (one canned beer) instead of the barcode of a set product (for example, a 6-pack of canned beer) and putting the set product into the cart device 70. · An operation (scan error) of putting a product into the cart device 70 without noticing that the scan operation has failed although it is not intentional.

[0058] (Announcement of illegal input) When the operation detection unit 504 detects an un-scanned input operation, the notification unit 505 notifies an illegal input announcement indicating that fact. Specifically, the illegal input announcement is, for example, a notification such as "The product has not been scanned." or "Please scan the product." The illegal input announcement is notified for a preset period (for example, 10 seconds) after the un-scanned input operation is detected. The said period may be a period whose setting can be changed. In the case of an illegal input announcement, since there is a risk of shoplifting etc., the store may suffer losses.

[0059] (Calling of store staff by illegal input announcement) When the mobile terminal 60 receives a notification of an unauthorized input announcement, it turns on the store clerk call flag. When the store clerk call flag is turned on, the mobile terminal 60 transmits flag information indicating that the store clerk call flag is on to the cloud server 20. When the cloud server 20 receives the flag information from the mobile terminal 60, it stores the flag information in the transaction information. When performing settlement, the settlement device 50 acquires the transaction information from the cloud server 20. If the flag information is included in the transaction information, the settlement device 50 makes a store clerk call. Specifically, the settlement device 50 makes a store clerk call by setting the display or sign pole provided in its own device to the display mode of the store clerk call. Note that the flag information may be included in the settlement code. In this case, the settlement device 50 may make a store clerk call when the read settlement code includes the flag information.

[0060] Note that in order to facilitate verification by the store clerk, the mobile terminal 60 stores captured images for each product (captured images from each direction), and may detect whether the image of the scanned product matches the object newly placed in the cart device 70 by image recognition. Also, the mobile terminal 60 may transmit the captured image and the detection result to the cloud server 20. Further, the settlement device 50 may acquire the captured image from the cloud server 20 at the time of settlement and display it on the display of its own device.

[0061] (Product removal announcement) When the detection result acquisition unit 503 acquires a removal detection result, the notification unit 505 notifies a product removal announcement indicating that fact. Specifically, the notification unit 505 notifies a product removal announcement when the product is removed without being canceled by the cancellation unit 507. In other words, the notification unit 505 does not notify a product removal announcement when the removal detection result is acquired by the detection result acquisition unit 503 within a predetermined period (for example, within 10 seconds) after the product is canceled by the cancellation unit 507.

[0062] The merchandise removal announcement is a notification such as, for example, "The merchandise has been removed.", "Please return the merchandise to the shopping basket.", "Please cancel the merchandise.", etc. The notification by the notification unit 505 is made by the display on the display 206 or the voice from the speaker. The merchandise removal announcement is notified for a preset period (for example, 10 seconds) after the removal detection result is acquired. The said period may be a period whose setting can be changed. In the case of the merchandise removal announcement, since it is not expected to be disadvantageous to the store, a store clerk is not called at the time of settlement. That is, when the mobile terminal 60 notifies the merchandise removal announcement, it does not turn on the store clerk call flag.

[0063] In this way, in the case of the illegal input announcement that is highly likely to cause disadvantages to the store, the store clerk is called, and in the case of the merchandise removal announcement that is less likely to cause disadvantages to the store, the store clerk is not called. Thereby, even when the number of store clerks in the store is small, the efficiency of store operation can be realized. Also, when the number of store clerks in the store is equal to or more than a certain number, the store clerk call flag may be turned on so that a store clerk is called at the time of settlement even for a transaction for which the merchandise removal announcement has been made.

[0064] (Regarding the case where the merchandise removal announcement is not notified) In particular, in the present embodiment, the notification unit 505 may not notify the merchandise removal announcement even when the removal detection result is acquired by the detection result acquisition unit 503. Specifically, even if the customer inadvertently puts an unscanned item into the shopping basket and then notices the unscanned item and takes out the item from the shopping basket to register the item, the merchandise removal announcement is not notified. In other words, if it is within a predetermined period (for example, within 5 seconds) after the unscanned input operation is detected by the operation detection unit 504, the notification unit 505 does not notify the merchandise removal announcement even when the removal detection result is acquired by the detection result acquisition unit 503.

[0065] For example, when the operation detection unit 504 detects an un-scanned input operation, the notification unit 505 notifies an illegal input announcement. By the illegal input announcement, the customer notices that it is un-scanned and takes out the item from the shopping basket. If the item is taken out from the shopping basket within a predetermined period (for example, within 5 seconds) after the notification unit 505 notifies the illegal input announcement, the notification unit 505 does not notify a product removal announcement. Also, in this case, the notification unit 505 also forcibly ends the illegal input announcement. Also, in this case, the mobile terminal 60 turns off the clerk call flag that was turned on based on the detection of illegal input. That is, at the time of settlement, the clerk is not called.

[0066] (Regarding the case where the illegal input announcement is not notified) Even when the operation detection unit 504 detects an un-scanned input operation, the notification unit 505 may not notify an illegal input announcement. For example, during shopping, the customer may organize the items in the shopping basket. In this organization, the customer may take out an item from the shopping basket and then put it back into the shopping basket again. In this case, the notification unit 505 does not notify an illegal input announcement. In other words, if the operation detection unit 504 detects an un-scanned input operation within a predetermined period (for example, within 5 seconds) after the detection result acquisition unit 503 acquires the removal detection result, the notification unit 505 does not notify an illegal input announcement.

[0067] For example, when the detection result acquisition unit 503 acquires the removal detection result, the notification unit 505 notifies a product removal announcement. If it is an organization of the items in the shopping basket, the customer immediately puts the taken-out item back into the shopping basket. If the item is put back into the shopping basket within a predetermined period (for example, within 5 seconds) after the notification unit 505 notifies the product removal announcement, the notification unit 505 does not notify an illegal input announcement. Also, in this case, the notification unit 505 also forcibly ends the product removal announcement. Since the illegal input announcement is not notified, the mobile terminal 60 does not turn on the clerk call flag. That is, at the time of settlement, the clerk is not called.

[0068] In the control that does not notify the product removal announcement and the control that does not notify the unauthorized insertion announcement, the weight of the removed product may be memorized, the memorized weight may be compared with the weight of the product re-inserted, and when the comparison result is within a predetermined range, each announcement may not be notified. In other words, for example, when the comparison result of the weight between the removed product and the inserted product is not within the predetermined range, the notification unit 505 notifies the unauthorized insertion announcement, sets the clerk call flag to ON, and may call the clerk at the time of settlement.

[0069] (Cancellation of Product) When the cancellation unit 507 receives an operation of a predetermined button (cancellation start button) displayed on the display 206, it displays a cancellation screen. The cancellation unit 507 cancels the registered product by receiving a selection of the cancellation target from among the products listed on the cancellation screen. Note that the cancellation of the registered product is not limited to the selection from the cancellation screen. For example, when the cancellation unit 507 receives an operation of the cancellation start button displayed on the display 206, it may cancel the registered product by reading the product code of the cancellation target with the camera 207.

[0070] The mobile terminal 60 determines whether the product to be cancelled has been removed from the cart device 70. For example, if the mobile terminal 60 cancels a product but the weight of the cart device 70 does not decrease within a predetermined period after the cancellation of the product, it may be determined that the product to be cancelled has not been removed from the cart device 70. Note that after receiving the cancellation operation, if there is no removal of the product even after a certain period of time, the mobile terminal 60 may notify a guidance such as "Please return the product to the shelf".

[0071] (Switching from Registration Mode to Cancellation Mode) The mode setting unit 506 sets one mode among a plurality of modes including a registration mode and a cancellation mode. The registration mode is a mode in which a product is registered by the registration unit 502. The cancellation mode is a mode in which the cancellation unit 507 cancels the product registered by the registration unit 502. The switching between the registration mode and the cancellation mode is performed, for example, by accepting the pressing of a predetermined button (registration button, cancellation start button).

[0072] The screen of the mobile terminal 60 is, for example, such that the upper half is a display area for an imaging image by the camera (for example, the imaging image display area 641 in FIG. 6(E)) and the lower half is a display area for registration details (for example, the registration information display area 642 in FIG. 6(E)) in either the registration mode or the cancellation mode. Therefore, there may be a case where it is difficult for the customer to immediately grasp the current mode at a glance. For this reason, an icon indicating the current mode (for example, an icon indicating a character) may be displayed on the screen of the mobile terminal 60, or the background color indicating the current mode may be used. In this way, the customer can easily grasp the current mode.

[0073] Also, the mobile terminal 60 operates in the registration mode almost all the time while the shopping app is running. In other words, the cancellation mode indicates an irregular state that is used occasionally. For this reason, in the registration mode, no display indicating the mode may be provided, and only in the case of the cancellation mode, which is an irregular state, a display mode indicating the mode (icon display or special background color) may be used. Even in this way, the customer can easily grasp that the current mode is a special mode (cancellation mode) other than the registration mode.

[0074] When a customer takes out a product from the shopping basket during shopping, in addition to organizing the inside of the shopping basket, it is expected that the product will be returned to the display shelf (cancellation of registration). Therefore, when the detection result acquisition unit 503 acquires the take-out detection result, the mode setting unit 506 switches from the registration mode to the cancellation mode. That is, the mode setting unit 506 displays the cancellation screen as the cancellation mode and prompts the cancellation of the product without receiving an operation of the cancellation start button. Note that the mode setting unit 506 may prompt to read the product code of the cancellation target by the camera 207 as the cancellation mode without receiving an operation of the cancellation start button.

[0075] Specifically, when the take-out detection result is acquired, the mode setting unit 506 determines whether the product has been cancelled before that. For example, although the mode setting unit 506 determines that the product has been taken out from the cart device 70 based on the weighing result received from the cart device 70, if the product has not been cancelled by the cancellation unit 507 before that (for example, within a predetermined period retroactively from the time of the determination), it is determined that the taken-out product has not been cancelled, and the mode is switched to the cancellation mode. In other words, when the take-out detection result is acquired by the detection result acquisition unit 503 within a predetermined period after the product has been cancelled by the cancellation unit 507, the mode setting unit 506 does not switch from the registration mode to the cancellation mode and continues the registration mode.

[0076] When switching to the cancellation mode, the notification unit 505 may notify that the taken-out product has not been cancelled. The notification is, for example, a message such as "Please read the barcode of the taken-out product. Cancellation will be performed." Further, when the mobile terminal 60 determines that the taken-out product has not been cancelled, the mobile terminal 60 may set a store clerk call flag (which may be a dedicated store clerk call flag indicating that the taken-out product has not been cancelled) in the transaction information of the transaction. The settlement device 50 may acquire flag information indicating that the store clerk call flag is ON at the time of settlement and call the store clerk (perform store clerk confirmation).

[0077] (Automatic switching from cancellation mode to registration mode) When the removal of an item can be regarded as the sorting within the shopping basket, the mode setting unit 506 switches from the cancellation mode to the registration mode. Specifically, after the mode setting unit 506 switches from the registration mode to the cancellation mode, if an un-scanned input operation is detected by the motion detection unit 504 within a predetermined period (for example, within 5 seconds), the mode setting unit 506 switches from the cancellation mode to the registration mode. The mode setting unit 506 displays a registration screen without accepting an operation of the registration button. Note that the mobile terminal 60 may store the weight of the removed item, compare the stored weight with the weight of the item re-input, and switch from the cancellation mode to the registration mode when the comparison result is within a predetermined range.

[0078] Note that the automatic switching from the cancellation mode to the registration mode is not limited to the above case. For example, even when a predetermined number (for example, one item) of product codes are scanned in the cancellation mode, the mode setting unit 506 may automatically end the cancellation mode and return to the registration mode. The scan is a scan indicating the registration of an item. However, the scan may also be a scan indicating the cancellation of an item. Also, the predetermined number of scan targets may be changeable by setting.

[0079] (Other announcements) In addition to the above-described illegal input announcement and the item removal announcement, various announcements include other announcements such as a forgotten removal announcement, a forgotten input announcement, and a forgotten cancellation announcement. Other announcements will be described below.

[0080] (Forgotten removal announcement: Notification when there is no removal after cancellation of an item) If the mobile terminal 60 determines that the item has been forgotten to be taken out when there has been a cancellation of the item but the item has not been taken out of the shopping basket (when the measured value does not decrease), it is considered an oversight. If the item has not been taken out within a predetermined period (for example, within 10 seconds) after the cancellation of the item, the notification unit 505 determines that it is an oversight and then notifies an oversight announcement. The oversight announcement is, for example, to perform a predetermined display for the item in the registration information display area 642 (Fig. 6(E)). The predetermined display is, for example, a display such as "Weight NG", "Needs confirmation", "Needs confirmation (not taken out)". In addition, instead of or in addition to displaying "Weight NG" or the like for the item to be cancelled, the notification unit 505 may display a message such as "Please return the cancelled item to the shelf." Note that the notification unit 505 may notify the oversight announcement without waiting for the elapse of the predetermined period after the cancellation of the item.

[0081] Also, when the mobile terminal 60 determines that it is an oversight, instead of or in addition to the oversight announcement, it may set a clerk call flag (which may be a dedicated clerk call flag indicating that the cancelled item has not been taken out) in the transaction information of the transaction. The settlement device 50 may obtain flag information indicating that the clerk call flag is ON at the time of settlement and call the clerk (perform clerk confirmation). Note that since forgetting to take out is not fraud (fraud that causes the store to suffer losses), it is not necessary to set the clerk call flag.

[0082] (Forgotten input announcement: Notification when the measured value does not change after registering the item) If, despite the product registration, no product has been placed in the shopping basket (i.e., the measured value does not increase), the mobile terminal 60 determines that it has been forgotten to be placed. For example, if no product has been placed in the shopping basket within a predetermined period (e.g., within 10 seconds) after the product registration, the notification unit 505 determines that it has been forgotten to be placed, and then notifies a forgotten placement announcement. In other words, the forgotten placement announcement is not made if a product has been placed in the shopping basket within the predetermined period after the product registration. By notifying the forgotten placement announcement, it is possible to prevent the customer from suffering disadvantages. Note that the notification unit 505 may notify the forgotten placement announcement without waiting for the elapse of the predetermined period after the product registration.

[0083] The forgotten placement announcement may, for example, display "Weight NG", "Needs confirmation", or "Needs confirmation (not placed)" for the scanned product, or may be a message display such as "Please place the registered product in the shopping basket." Also, when it is determined that the product has been forgotten to be placed, instead of or in addition to notifying the forgotten placement announcement, a clerk call flag (which may be a dedicated clerk call flag indicating that the scanned product has not been placed) may be set in the transaction information of the transaction. At the time of settlement, the settlement device 50 may acquire flag information indicating that the clerk call flag is ON and call a clerk (perform clerk confirmation). Note that since forgetting to place is not fraud (fraud that causes the store to suffer disadvantages), it is not necessary to set the clerk call flag.

[0084] (Forgotten cancellation announcement: Notification when there is no cancellation after taking out the product) If there is no cancellation operation even though a product has been taken out, the mobile terminal 60 determines that it is an oversight in cancellation. For example, if the product is not cancelled by the cancellation unit 507 within a predetermined period (e.g., within 10 seconds) after the product is taken out, the notification unit 505 determines that it is an oversight in cancellation, and then notifies an oversight-in-cancellation announcement. In other words, the oversight-in-cancellation announcement is not made if the product is cancelled within the predetermined period after the product is taken out. By notifying the oversight-in-cancellation announcement, it is possible to prevent the customer from suffering disadvantages. Note that the notification unit 505 may notify the oversight-in-cancellation announcement without waiting for the elapse of the predetermined period after the product is taken out.

[0085] The oversight-in-cancellation announcement may be, for example, a message display such as "Please cancel the taken-out product." Also, when it is determined that there is an oversight in cancellation, instead of or in addition to notifying the oversight-in-cancellation announcement, a clerk call flag (which may be a dedicated clerk call flag indicating that the scanned product has not been input) may be set in the transaction information of the transaction. The settlement device 50 may obtain flag information indicating that the clerk call flag is ON at the time of settlement and call a clerk (perform clerk confirmation). Note that since an oversight in cancellation is not fraud (fraud that causes the store to suffer disadvantages), it is not necessary to set the clerk call flag.

[0086] Note that the oversight-in-cancellation announcement can also be controlled differently from the above control. For example, in a state where only one product is registered in the registration details, if the taking out of the product is detected and there is no cancellation operation, it is presumed that the taken-out product is the only product registered in the registration details. Therefore, in this case, the mobile terminal 60 can identify the taken-out product. Thus, the mobile terminal 60 may identify and present the name of the product. For example, the mobile terminal 60 may make a presentation such as "Is the taken-out product XX?" Also, instead of or in addition to the presentation, the mobile terminal 60 may automatically delete the identified product. When automatically deleting the product, the mobile terminal 60 may notify to that effect.

[0087] (Connection between the mobile terminal 60 and the cart device 70) The mobile terminal 60 is connected to a single cart device 70 via Bluetooth (Bluetooth connection). When the mobile terminal 60 is connected to a single cart device 70, the device identification information (e.g., Bluetooth address) of the cart device 70 is required as pairing information. The mobile terminal 60 can acquire the device identification information of each cart device 70 from the beacons transmitted by each cart device 70.

[0088] The mobile terminal 60 can acquire the connection information of each cart device 70 from the beacons transmitted by each cart device 70, but can also acquire the connection information of each cart device 70 from the connection code 78 attached to each cart device 70.

[0089] Based on the customer's operation, the mobile terminal 60 reads the connection code 78 attached to each cart device 70. Thereby, the mobile terminal 60 acquires the connection information of a single cart device 70 (the cart device 70 that the customer intends to use). That is, the mobile terminal 60 recognizes the connection code 78 in the captured image by the object recognition function, reads the recognized connection code 78, and acquires the connection information. The mobile terminal 60 uses the acquired connection information to connect to the cart device 70, enabling communication (Bluetooth communication) with the cart device 70.

[0090] (Example of a screen displayed on the display 206 of the mobile terminal 60) FIG. 6 is a diagram showing an example of a screen displayed on the display 206 of the mobile terminal 60. FIG. 6 shows an example in which the mobile terminal 60 is connected to the cart device 70 using the connection code 78. It is assumed that a shopping application is already installed on the mobile terminal 60.

[0091] (Initial screen 610) FIG. 6(A) shows the initial screen 610 of the mobile terminal 60. The initial screen 610 is a standby screen. Specifically, the initial screen 610 shows a screen in a state where various applications are not executed. On the initial screen 610, an icon 611 of a shopping application is displayed. When the icon 611 is pressed, the screen transitions to the menu screen 620 shown in FIG. 6(B).

[0092] (Menu screen 620) FIG. 6(B) shows the menu screen 620 (start screen) displayed immediately after the shopping application is launched. The menu screen 620 includes a shopping start button 621 (621a, 621b) and a related information display area 622. The first shopping start button 621a is a button that accepts the start of shopping in a mode using the cart device 70. The second shopping start button 621b is a button that accepts the start of shopping in a mode not using the cart device 70. When the second shopping start button 621b is pressed, shopping is started in a mode where product registration and settlement are performed in the registration settlement device. On the other hand, when the first shopping start button 621a is pressed, the screen transitions to the connection instruction screen 630 in FIG. 6(C). Note that the related information display area 622 includes buttons that accept various functions for supporting shopping.

[0093] (Connection instruction screen 630) FIG. 6(C) shows the connection instruction screen 630. The connection instruction screen 630 includes a message 631 and an explanatory image 632. The message 631 indicates to prompt the reading of the connection code 78. The explanatory image 632 shows an image explaining the method of reading the connection code 78. On the connection instruction screen 630, when a predetermined time elapses or a predetermined operation (for example, pressing the screen) is accepted, the screen switches to an imaging screen (not shown), and the mobile terminal 60 reads the connection code by the customer's operation. When the connection code 78 (device identification information) is read, the connection between the mobile terminal 60 and the cart device 70 is completed, and the screen transitions to the initial registration screen 640 in FIG. 6(D).

[0094] (Initial registration screen 640) FIG. 6(D) shows the initial registration screen 640. The initial registration screen 640 includes an imaging image display area 641 and a registration information display area 642. The imaging image display area 641 will display the imaging image. The central part of the imaging image display area 641 is a barcode reading area suitable for barcode reading. The barcode reading area is a rectangular area where a message "Please hold the barcode" is displayed. The registration information display area 642 is an area mainly for displaying product registration information and total information. An explanatory image 643 is displayed in the registration information display area 642. The explanatory image 643 is an image explaining the product registration method. Note that the explanatory image 643 may not be displayed from the next time onwards according to the settings.

[0095] Also, the initial registration screen 640 includes a cart image 644. The cart image 644 indicates that it is connected to (communicable with) the cart device 70. The cart image 644 is always displayed if it is connected to the cart device 70.

[0096] Note that the imaging image in the direction looking down from the position of the holder part 74 towards the shopping basket side also includes the shopping basket and the products put into the shopping basket. However, for the sake of simplicity of illustration, these are omitted in FIG. 6.

[0097] (Registration screen 650) FIG. 6(E) shows the registration screen 650 after registering the product. On the registration screen 650, in the registration information display area 642, it is shown that ○○ bread has been registered as one item of product and ○○ oolong tea has been registered as the second item of product.

[0098] Specifically, in the imaging image display area 641 of the registration screen 650, ○○ oolong tea is displayed (imaged). That is, the registration screen 650 shows the scene immediately after registering ○○ oolong tea (right after scanning) and before ○○ oolong tea is put into the cart device 70 (shopping basket).

[0099] In the registration information display area 642, information about the registered products (product name, quantity, price) is displayed. Specifically, in the registration information display area 642, "〇〇 Food Bread, 1 piece, ￥220" is displayed as one item of the product. Also, in the registration information display area 642, "〇〇 Oolong Tea, 1 piece, ￥150" is displayed as the second item of the product.

[0100] Note that the mobile terminal 60 obtains product information by querying the product information based on the product code obtained by scanning the barcode of the product. The query destination of the product information is a device that stores the product master. The device that stores the product master may be another device (for example, the cloud server 20), or it may be the self-terminal if the product master is stored in the storage unit of the self-terminal.

[0101] In the registration information display area 642, "Weight OK" is displayed in the column of 〇〇 Food Bread. This indicates that after scanning the product code of 〇〇 Bread and putting 〇〇 Bread into the shopping cart, the weight has increased. On the other hand, since 〇〇 Oolong Tea has not been put into the cart device 70, "Weight OK" is not displayed in the column of 〇〇 Oolong Tea. Note that when 〇〇 Oolong Tea is put into the cart device 70, "Weight OK" will be displayed in the column of 〇〇 Oolong Tea. That is, after the mobile terminal 60 scans the product, if it receives a weighing result indicating an increase in weight from the cart device 70 within a predetermined period (for example, within 10 seconds), "Weight OK" will be displayed. On the other hand, if it does not receive a weighing result indicating an increase in weight within the predetermined period, "Weight NG" will be displayed.

[0102] After registering one item of the product, the mobile terminal 60 can end the product registration and proceed to settlement. For this reason, an end-of-settlement start button 651 and a message 652 are displayed on the registration screen 650. The end-of-settlement start button 651 is a button that accepts the start of settlement (the end of product registration). The message 652 is a notification indicating that settlement can proceed when the end-of-settlement start button 651 is pressed.

[0103] (Illegitimate Input Announcement Screen 660) Figure 6(F) shows the illegitimate input announcement screen 660. The illegitimate input announcement screen 660 includes a message 661 and a notification end button 662. The message 661 indicates that it is an illegitimate input announcement. Specifically, the message 661 indicates a notification prompting the scanning of a product code. The notification end button 662 accepts the termination of the illegitimate input announcement screen 660 and returns to the registration screen. When the notification end button 662 is pressed, the product code of the target product is scanned, and the product is put into the shopping cart, the registration of the product is completed.

[0104] (Product Retrieval Announcement Screen 670) Figure 6(G) shows the product retrieval announcement screen 670. The product retrieval announcement screen 670 includes a message 671 and a notification end button 672. The message 671 indicates that it is a product retrieval announcement. Specifically, the message 671 indicates a notification prompting the return of the product to the shopping cart or the cancellation of the product. The notification end button 672 accepts the termination of the product retrieval announcement screen 670 and returns to the registration screen. When the notification end button 672 is pressed, and the product is returned to the shopping cart, or when the cancellation of the product is accepted, it returns to the registration screen.

[0105] (Settlement Code Display Screen 680) Figure 6(H) is the settlement code display screen 680 displayed after the pressing of the settlement start button 651 (Figure 6(E)). The settlement code display screen 680 includes a settlement code 681, a message 682, an explanatory image 683, and a return button 684. The settlement code 681 is a code that causes the settlement device 50 to start settlement when read by the scanner unit of the settlement device 50. The message 682 is a notification indicating that the settlement device 50 should read the settlement code 681. The explanatory image 683 shows a guiding image when the settlement device 50 reads the settlement code 681. The return button 684 accepts the return to the registration screen before the settlement start button 651 is pressed.

[0106] The settlement code 681 is a two-dimensional coding of transaction identification information that identifies the transaction information of the relevant transaction from among a plurality of transaction information (including weight OK / weight NG information) stored in the cloud server 20. That is, the settlement code 681 displayed on a certain mobile terminal 60 indicates information that can identify the transaction information of the mobile terminal 60 among the plurality of transaction information stored in the cloud server 20. When the settlement device 50 reads the settlement code 681, it makes a transmission request for the transaction information including the transaction identification information to the cloud server 20, and acquires (receives) the transaction information of the mobile terminal 60 from the cloud server 20. Note that the settlement code 681 may be a two-dimensional coding of the location information (storage location within the sales system 1, such as a URI (Uniform Resource Identifier), etc.) of the transaction information of the mobile terminal 60.

[0107] (An example of the operation of the mobile terminal 60) FIG. 7 is a flowchart showing an example of the processing performed by the mobile terminal 60. The flowchart of FIG. 7 shows the flow from when a customer visits the store with the mobile terminal 60 until the settlement code display screen 680 (FIG. 6(H)) is displayed after the mobile terminal 60 connects to the cart device 70 using the connection code 78. Note that at the start of this flowchart (when visiting the store), it is assumed that the mobile terminal 60 is displaying the initial screen 610 (FIG. 6(A)).

[0108] Step S1: The mobile terminal 60 receives an operation to start the shopping app. For example, the mobile terminal 60 receives an operation on the shopping app icon 611 on the initial screen 610 (FIG. 6(A)). Step S2: The mobile terminal 60 displays the menu screen 620 (FIG. 6(B)). Step S3: The mobile terminal 60 receives a shopping start operation for shopping using the cart device 70. For example, the mobile terminal 60 receives an operation on the first shopping start button 621a on the menu screen 620. Step S4: The mobile terminal 60 displays the connection instruction screen 630 (FIG. 6(C)).

[0109] Step S5: The mobile terminal 60 determines whether it has acquired connection information (device identification information of the cart device 70) for connecting to the cart device 70. For example, when the mobile terminal 60 reads the connection code 78 attached to the cart device 70 based on a customer's operation, the mobile terminal 60 acquires the connection information of the cart device 70 from the connection code 78. If the connection information is acquired (Step S5: YES), the mobile terminal 60 proceeds to Step S6. If the connection information has not been acquired (Step S5: NO), the mobile terminal 60 repeats Step S5.

[0110] Step S6: The mobile terminal 60 pairs with and connects to the cart device 70. Step S7: The mobile terminal 60 transmits the tare instruction information to the cart device 70.

[0111] (Tare) The tare is an item placed on the placement unit 71 in the initial state before the start of shopping (more specifically, the state before an item of merchandise is placed). The weight of the tare is the measured value in the initial state before the start of shopping. The tare may include, in addition to the shopping basket, the customer's carry-on items (such as a wallet, bag, etc.). For example, when an empty shopping basket is placed on the placement unit 71 as the initial state before the start of shopping, the tare is the shopping basket, and the tare weight is the weight of the shopping basket. Also, for example, when a shopping basket containing a wallet is placed on the placement unit 71 as the initial state before the start of shopping, the tare is the shopping basket and the wallet, and the tare weight is the sum of the weight of the shopping basket and the weight of the carry-on item.

[0112] The air bag removal instruction information indicates an instruction to cause the cart device 70 to start weighing excluding the current air bag weight. When the cart device 70 receives the air bag removal instruction information, it starts weighing assuming the weight at the time of reception is 0 g. For example, when the weighing value in the unloaded state is 0 g and the weight of the shopping basket is 500 g (known), if the weighing value at the time of receiving the air bag removal instruction information is 500 g, the air bag weight is 500 g (the air bag consists only of the shopping basket). Also, for example, in the above case, if the weighing value at the time of receiving the air bag removal instruction information is 3000 g, the air bag weight is 3000 g (shopping basket weight: 500 g, luggage weight: 2500 g) (the air bag is the sum of the shopping basket and the customer's luggage).

[0113] When the cart device 70 receives the air bag removal instruction information from the mobile terminal 60, it determines the weighing value at the time of reception as the weighing value (initial value) in the initial state before the start of shopping. That is, the cart device 70 stores the weighing value in the unloaded state, and after the shopping basket or the customer's luggage is placed from the unloaded state and the air bag removal instruction information is received, it sets the weighing value in the state where the shopping basket or the customer's luggage is placed as the initial value. When the cart device 70 receives an air bag removal instruction from the mobile terminal 60 in a state where 3000 g is measured by the weighing unit 303, it notifies the mobile terminal 60 with "3000 g" as "0 g". In this case, the mobile terminal 60 may proceed with the process assuming the reference weight at the start of shopping is 0 g.

[0114] Note that when the cart device 70 receives an air bag removal instruction from the mobile terminal 60 in a state where 3000 g is measured by the weighing unit 303, it may also notify the "3000 g" to the mobile terminal 60. In this case, the mobile terminal 60 may proceed with the process assuming the reference weight at the start of shopping is 3000 g.

[0115] Since the weight of the shopping basket is known, it is possible to calculate the weight of the customer's luggage as a result. For example, if the measured value in the unloaded state is 0 g, the weight of the shopping basket is 500 g (known), and the measured value when receiving the tare indication information is 3000 g, the weight of the luggage is 2500 g. In this case, it may be possible to store the weight of 2500 g for the luggage. As a result, when the measured value decreases by 2500 g during shopping, it can be determined that the luggage has been taken out. That is, when the luggage is taken out of the shopping basket, it is possible to prevent it from being determined that an item has been taken out, or to prevent it from being determined that there has been an oversight in canceling the item to be taken out.

[0116] The mobile terminal 60 may transmit the tare indication information to the cart device 70 at least before the input of at least one item of merchandise. For example, the mobile terminal 60 transmits the tare indication information to the cart device 70 immediately after the connection with the cart device 70 is completed. For example, the mobile terminal 60 may transmit the information to the cart device 70 while the initial registration screen 640 (FIG. 6(D)) is being displayed.

[0117] Note that the mobile terminal 60 may transmit the tare indication information to the cart device 70 after registering (scanning) one item of merchandise and before putting the merchandise into the shopping basket. This is because the closer the execution timing of the tare is to immediately before the merchandise is put in (the closer it is to the merchandise input timing), the more the accuracy of detecting fraud can be improved.

[0118] Suppose that the transmission timing of the tare indication information is set to be earlier than, for example, the timing of placing the shopping basket (assuming the order of transmitting the tare indication information → placing the shopping basket on the placement unit 71). In this case, the placement of the shopping basket on the placement unit 71 may be erroneously detected as being improper (input without scanning). If an improper input that is not actually an improper input is erroneously detected as an improper input without scanning, it will also give a bad impression to the customer, and it will also require unnecessary confirmation work etc. for the store clerk (store).

[0119] Therefore, the transmission timing of the tare weight instruction information is preferably as late as possible, i.e., immediately after the registration of one item of merchandise, just before the item is put in. If the timing of placing the shopping cart is earlier than the transmission timing of the tare weight instruction information (if the order is placing the shopping cart on the placement unit 71 → transmitting the tare weight instruction information), it is possible not to detect the placement of the shopping cart on the placement unit 71 as an un-scanned input.

[0120] Also, when the connection with the mobile terminal 60 is completed, the cart device 70 periodically (constantly according to the control cycle) transmits to the mobile terminal 60 the weighing results measured constantly according to the control cycle. However, the weighing results are not limited to being transmitted constantly, and may be transmitted only when there is an increase or decrease in the weighing results. Further, the information transmitted from the cart device 70 to the mobile terminal 60 is not limited to the weighing results, and may also be a judgment result indicating that an item has been put in or taken out. In other words, the cart device 70 may judge whether an item has been put in or taken out. Specifically, when the cart device 70 detects an increase in weight, it may judge that an item has been put in, and when it detects a decrease in weight, it may judge that an item has been taken out. In this case, when the cart device 70 judges that an item has been put in or taken out, it may transmit the judgment result to the mobile terminal 60.

[0121] Note that the cart device 70 may transmit to the mobile terminal 60 the weight of all articles including the tare weight as the latest weighing value, or may transmit to the mobile terminal 60 the weight value of all merchandise excluding the tare weight (the tare weight is stored).

[0122] Step S8: The mobile terminal 60 transmits various information including information regarding the cart device 70 to the cloud server 20. The various information is received from the cart device 70. The various information includes, for example, the serial number of the cart device 70 (which cart it is), the status of the battery, etc., and various announcement information. The cloud server 20 transmits the various information of the cart device 70 to the transaction status management device 40. Thereby, the transaction status management device 40 can receive and display the various information of the cart device 70 from the cloud server 20. Also, the monitoring staff who monitors in the transaction status management device 40 can appropriately perform maintenance on the cart device 70. Step S9: The mobile terminal 60 displays the initial registration screen 640 (Fig. 6(D)).

[0123] Note that in step S8, the information regarding the cart device 70 transmitted from the cart device 70 is transmitted from the mobile terminal 60 to the cloud server 20. For this reason, the cart device 70 does not need to have a function of communicating with the cloud server 20. Therefore, in the sales system 1, an inexpensive cart device 70 that does not have the communication function can be used.

[0124] Note that the mobile terminal 60 acquires connection information from the connection code 78 (step S5: YES) and stores it. Even if the connection to the cart device 70 fails for some reason, the mobile terminal 60 can uniquely identify the cart device 70 from the connection information. For this reason, the mobile terminal 60 may transmit connection failure information indicating that the connection has failed to the cloud server 20 as information regarding the cart device 70. Thereby, the cloud server 20 can also manage the connection failure information. Also, the monitoring staff can perform maintenance on the cart device 70 based on the connection failure information. Also, instead of or in addition to transmitting the connection failure information to the cloud server 20, the mobile terminal 60 may output (display on the screen, voice output) a message such as "There may be a problem with the cart. Please use another cart."

[0125] Note that the mobile terminal 60 may perform the processes of steps S7 to S9 in any order. That is, after the mobile terminal 60 is connected to the cart device 70 (step S6), for the transmission of the invoice instruction information to the cart device 70 (step S7), the transmission of the information regarding the cart device 70 to the cloud server 20 (step S8), and the display of the initial registration screen 640 (Fig. 6(D)) (step S9), they may be performed in any order.

[0126] Step S11: The mobile terminal 60 performs the in-process product registration process (Fig. 8).

[0127] Step S12: The mobile terminal 60 determines whether to end the product registration. For example, when the settlement start button 651 (Fig. 6(E)) is pressed, the mobile terminal 60 determines to end the product registration. If the product registration is to be ended (step S12: YES), it proceeds to step S13. If the product registration is not to be ended (step S12: NO), the mobile terminal 60 returns to step S10.

[0128] Step S13: The mobile terminal 60 disconnects the connection with the cart device 70 and cancels the pairing. Step S14: The mobile terminal 60 displays the settlement code display screen 680 (Fig. 6(H)). Note that when the clerk call flag is ON, the settlement code 681 includes an instruction to make a clerk call.

[0129] (An example of the in-process product registration process performed by the mobile terminal 60) Fig. 8 is a flowchart showing an example of the in-process product registration process performed by the mobile terminal 60. Step S800: The mobile terminal 60 determines whether a product code (barcode) has been scanned by the customer's scanning operation. When the mobile terminal 60 has scanned the product code (step S800: YES), it proceeds to step S801. On the other hand, when the product code has not been scanned (step S800: NO), it proceeds to step S802.

[0130] Step S801: The mobile terminal 60 registers the product (the product whose barcode was read in step S10). The mobile terminal 60 displays (adds) the information of the product (product name, quantity, price) in the registration information display area 642 of the registration screen and updates the total information.

[0131] Step S802: The mobile terminal 60 determines whether the weighing result (weight value) received from the cart device 70 has increased. Note that when the product (the product registered in step S801) is put into the shopping cart, the cart device 70 transmits to the mobile terminal 60 a weighing result indicating an increase in the quantity of the product. In step S802, if the mobile terminal 60 determines that the weighing result has not increased (step S802: NO), it proceeds to step S807. On the other hand, if the mobile terminal 60 determines that the weighing result has increased (step S802: YES), that is, when it has obtained an input detection result, the mobile terminal 60 proceeds to step S803.

[0132] Step S803: The mobile terminal 60 determines whether it is within the valid period (for example, within 10 seconds) after the scanning of the product code in step S10. If it is within the valid period (step S803: YES), the mobile terminal 60 proceeds to step S804. On the other hand, if it is not within the valid period (step S803: NO), that is, when an unsampled input operation is detected, the mobile terminal 60 proceeds to step S805.

[0133] Step S804: The mobile terminal 60 displays the weighing result (for example, "Weight OK") in the registration information display area 642 (the column for the product) of the registration screen. Step S805: The mobile terminal 60 displays the unauthorized input announcement screen 660 (Fig. 6(F)) and notifies of the unauthorized input announcement. Step S806: The mobile terminal 60 sets the store clerk call flag to ON.

[0134] Step S807: The mobile terminal 60 determines whether it has received a cancellation operation for the product. If it has not received a cancellation operation for the product (Step S807: NO), the mobile terminal 60 proceeds to Step S809. On the other hand, if it has received a cancellation operation for the product (Step S807: YES), it cancels the target product (Step S808).

[0135] Step S809: The mobile terminal 60 determines whether the weighing result (weight value) received from the cart device 70 has decreased. Note that when a product is taken out of the shopping cart, the cart device 70 transmits to the mobile terminal 60 a weighing result in which the weight corresponding to the taken-out product has decreased. In Step S809, if the mobile terminal 60 determines that the weighing result has not decreased (Step S809: NO), it proceeds to Step S12 (Fig. 7). On the other hand, if the mobile terminal 60 determines that the weighing result has decreased (Step S809: YES), that is, when it has obtained a take-out detection result, it proceeds to Step S810.

[0136] Step S810: The mobile terminal 60 determines whether it is within the valid period (for example, within 10 seconds) after the cancellation of the product in Step S808. If it is within the valid period (Step S810: YES), the mobile terminal 60 proceeds to Step S12 (Fig. 7). On the other hand, if it is not within the valid period (Step S810: NO), that is, for example, when a product is taken out of the shopping cart without cancellation of the product, the mobile terminal 60 proceeds to Step S811.

[0137] Step S811: The mobile terminal 60 displays the product take-out announcement screen 670 (Fig. 6(G)) and notifies of the product take-out announcement. Step S812: The mobile terminal 60 switches from the registration mode to the cancellation mode and prompts for cancellation of the product.

[0138] Although not shown in the drawings, if the mobile terminal 60 does not receive the weighing result from the cart device 70 within the valid period after product registration (scanning), the mobile terminal 60 will display "Weight NG" in the column of the product in the registration information display area 642 (Fig. 6(E)). Also, in this case, the mobile terminal 60 will notify of the forgotten input announcement. Further, if no product is taken out within the valid period after the cancellation operation, the mobile terminal 60 will notify of the forgotten removal announcement. Also, if the cancellation of the product is not accepted within the valid period after removal, the mobile terminal 60 will notify of the forgotten cancellation announcement.

[0139] (An example of the processing during the illegal input announcement by the mobile terminal 60) Fig. 9 is a flowchart showing an example of the processing during the illegal input announcement by the mobile terminal 60. Note that the processing shown in Fig. 9 is the processing performed during the notification of the illegal input announcement. Step S901: The mobile terminal 60 determines whether it has received a press of the notification end button 662 (Fig. 6(F)). If it has received a press of the notification end button 662 (Step S901: YES), it proceeds to Step S905. If it has not received a press of the notification end button 662 (Step S901: NO), it proceeds to Step S902.

[0140] Step S902: The mobile terminal 60 determines whether the weighing result (weight value) received from the cart device 70 has decreased. If the weighing result has not decreased (Step S902: NO), it proceeds to Step S903. On the other hand, if the weighing result has decreased (Step S902: YES), that is, if the removal detection result is obtained during the notification of the illegal input announcement, in other words, if the customer notices the un-scanned item and takes the product out of the shopping cart, the mobile terminal 60 proceeds to Step S904.

[0141] Step S903: The mobile terminal 60 continues the illegal input announcement as it is and returns to Step S901. Step S904: The mobile terminal 60 turns off the store clerk call flag. Step S905: The mobile terminal 60 ends the illegal insertion announcement and terminates the series of processes. Note that if the mobile terminal 60 determines in step S902 that the measurement result has decreased (step S902: YES), but ends the illegal insertion announcement without receiving the pressing of the notification end button 662, the product removal announcement is not performed.

[0142] (An example of the processing during the product removal announcement performed by the mobile terminal 60) FIG. 10 is a flowchart showing an example of the processing during the product removal announcement performed by the mobile terminal 60. Note that the processing shown in FIG. 10 is the processing performed during the notification of the product removal announcement. Step S1001: The mobile terminal 60 determines whether it has received the pressing of the notification end button 672 (FIG. 6(G)). If it has received the pressing of the notification end button 672 (step S1001: YES), it proceeds to step S1007. If it has not received the pressing of the notification end button 672 (step S1001: NO), it proceeds to step S1002.

[0143] Step S1002: The mobile terminal 60 determines whether it has detected an un-scanned insertion operation. If it has not detected an un-scanned insertion operation (step S1002: NO), the mobile terminal 60 proceeds to step S1003. If it has detected an un-scanned insertion operation (step S1002: YES), the mobile terminal 60 proceeds to step S1004.

[0144] Step S1003: The mobile terminal 60 continues the product removal announcement and returns to step S1001. Step S1004: The mobile terminal 60 determines whether it is within a predetermined period (for example, within 5 seconds) after transitioning to the cancellation mode (after the start of the product removal announcement). If it is within the predetermined period after transitioning to the cancellation mode (Step S1004: YES), in other words, if the customer sorts the products in the shopping basket (takes the products out of the shopping basket and then puts them back into the shopping basket), the process proceeds to Step S1007. If it is not within the predetermined period after transitioning to the cancellation mode (Step S1004: NO), in other words, if the customer cannot be considered to have sorted the products in the shopping basket, the process proceeds to Step S1005.

[0145] Step S1005: The mobile terminal 60 displays the illegal input announcement screen 660 (Fig. 6(F)) and notifies the illegal input announcement. Step S1006: The mobile terminal 60 turns on the store clerk call flag and proceeds to the process during the illegal input announcement performed by the mobile terminal 60 in Fig. 9. Note that, in the case of Step S1004: NO, the process of Step S1003 (continuing the product removal announcement) may be proceeded to without performing the process of Step S1005 (notifying the illegal input announcement).

[0146] Step S1007: The mobile terminal 60 ends the product removal announcement. Note that, although the mobile terminal 60 has determined in Step S1002 that an un-scanned input operation has been detected (Step S1002: YES), if the product removal announcement screen 670 (Fig. 6(G)) is ended without accepting the pressing of the notification end button 672, the illegal input announcement is not performed. Step S1008: The mobile terminal 60 switches from the cancellation mode to the registration mode and ends the series of processes.

[0147] (Regarding an example of the screen of the cash register device 50, etc.) Fig. 11 is a diagram showing an example of the screen of the cash register device 50, etc. Fig. 11(A) shows the settlement screen 1110 when there are no products with NG weight. Specifically, the settlement screen 1110 shows the screen progressed from a scene such as Fig. 6(E) (for example, when both the ○○ food bread and the ○○ oolong tea have OK weight).

[0148] FIG. 11(B) shows the settlement screen 1120 when there is a product with a weight NG. Specifically, the settlement screen 1120 shows a screen that progresses from a scenario where the ○○ bread has a weight OK and the ○○ oolong tea has a weight NG. The settlement screens 1110 and 1120 are displayed when the customer operates the settlement start button 651 (FIG. 6(E)) and causes the settlement device 50 (the scanner unit of the settlement device 50) to read the settlement code 681 (FIG. 6(H)) displayed on the mobile terminal 60 by this operation.

[0149] The flow from the reading of the settlement code 681 to the display of the product list screen is, for example, as follows. (1) The settlement device 50 that has read the settlement code 681 displayed on the mobile terminal 60 transmits request information including transaction identification information (information for identifying the transaction information of the mobile terminal 60) obtained from the settlement code 681 to the cloud server 20. (2) The cloud server 20 that has received the request information from the settlement device 50 generates the settlement screens 1110 and 1120 that reflect the content of the transaction information identified by the transaction identification information included in the request information, and transmits the screen information of the settlement screens 1110 and 1120 to the settlement device 50. The settlement screens 1110 and 1120 are screens that list and display the transaction information (including "weight OK" and "weight NG") registered by the mobile terminal 60. (3) The settlement device 50 that has received the screen information from the cloud server 20 displays the product list screen on the display unit based on the screen information.

[0150] Incidentally, the cloud server 20 only needs to store transaction information regarding all the products registered by the mobile terminal 60 at the timing of receiving request information from the settlement device 50. In other words, each time a product is registered by the mobile terminal 60, the cloud server 20 may receive information regarding the product (information regarding the measurement result) from the mobile terminal 60, or may receive information regarding all the products registered up to that point from the mobile terminal 60 collectively based on the operation of the settlement start button 651 (when displaying the settlement code 681).

[0151] In addition, the settlement device 50 determines whether flag information indicating that the clerk call flag is ON is included in the transaction information. If the flag information is included, the settlement device 50 sends a clerk call notification to the transaction status management device 40. The clerk call notification includes the device identification information of its own device and information indicating a clerk call. The monitoring staff arranged in the transaction status management device 40 goes to the corresponding settlement device 50, checks the details of fraud or the like within the transaction, and takes necessary measures. The necessary measures are, for example, registering un-scanned products. The registration is performed on a maintenance screen for clerks or a screen that transitions from the maintenance screen.

[0152] Incidentally, the determination of the presence or absence of the flag information may be made by the cloud server 20 instead of the settlement device 50. In this case, if the cloud server 20 determines that the flag information is included in the transaction information, the cloud server 20 may send a clerk call notification to the transaction status management device 40.

[0153] If the flag information is included in the transaction information, the settlement device 50 may be configured not to complete the settlement process until the cause of fraud or the like is identified and the fraud situation is resolved. For example, the settlement device 50 may be configured not to accept the operation of the accounting button 1111 (the button for receiving the issuance of a receipt).

[0154] Also, when identifying the cause of irregularities or the like and eliminating the situation of irregularities or the like, the store clerk checks the information such as "Weight NG" displayed on the settlement device 50. Further, as information to assist the store clerk, when the transaction information includes flag information, the settlement device 50 may display the captured image on a maintenance screen or the like for a certain period of time. The captured image is, for example, three still images (or a moving image including the product input timing) before, during, and after the un-scanned product is put into the cart. Also, the captured image may be two still images (or a moving image including the product cancellation timing) before and after the cancellation of the product (5 seconds after the product cancellation).

[0155] Thereby, the store clerk can easily find the corresponding product (for example, the un-scanned product to be registered, the cancelled product to be removed) from the shopping cart. Also, the store clerk compares the number of products with the number of the said product registered in the transaction details, and if there is a discrepancy, performs an operation of registering (increasing the quantity) or cancelling (decreasing the quantity) the said product to match the content of the transaction details with the content of the shopping cart, and may eliminate the situation of irregularities or the like. Note that the still images and moving images described above are captured images captured by the mobile terminal 60, transmitted from the mobile terminal 60 to the cloud server 20, and further transmitted from the cloud server 20 to the settlement device 50.

[0156] (When the connection with the cart device 70 is disconnected during the registration of the product) During the registration of the product (after the operation of the first shopping start button 621a and before the operation of the settlement start button 651), the connection between the mobile terminal 60 and the cart device 70 may be disconnected. The disconnection may occur, for example, when the mobile terminal 60 is removed from the cart device 70 and separated from the cart device 70 to a certain extent. Also, the disconnection may include, among other things, the case where Bluetooth is deactivated in the settings of the mobile terminal 60, or the case where the mobile terminal 60 or the cart device 70 malfunctions or the power is turned off. Even if it is disconnected, the mobile terminal 60 attempts to reconnect in the background, and will reconnect if the distance to the cart device 70 becomes close.

[0157] Specifically, even if the connection with the cart device 70 is disconnected during the registration of a product, the mobile terminal 60 can continue the product registration. For example, even if the connection with the cart device 70 is disconnected after registering one item of ○○ food bread, as shown in FIGS. 11(C) and 11(D), it is possible to register two items of ○○ oolong tea. Note that FIG. 11(C) shows the scene immediately after registering ○○ oolong tea (immediately after scanning the barcode of ○○ oolong tea) (the scene before ○○ oolong tea is put into the cart device 70). FIG. 11(D) shows the scene after ○○ oolong tea has been put into the cart device 70.

[0158] On the registration screens 1130 and 1140 shown in FIGS. 11(C) and 11(D), a cart image 644 (FIG. 6(D)) indicating that it is connected to the cart device 70 is not displayed. Also, in the column for ○○ oolong tea, it is displayed that it is not connected to the cart device 70 (the text "not connected"). Note that the mobile terminal 60 may display, instead of or in addition to the fact that it is not connected to the cart device 70, that there is no check by weighing (for example, the text "no weight confirmation" or the text "no check").

[0159] Note that the information during disconnection (not connected, no weight confirmation, no check) is also transmitted as transaction information to the cloud server 20 and the settlement device 50. FIG. 11(E) shows the settlement screen 1150 that has progressed from the scene in FIG. 11(D). On the settlement screen 1150, "not connected" is displayed in the column for ○○ oolong tea.

[0160] As described above, in the sales system 1 according to the present embodiment, when the portable terminal 60 detects the removal of a product after detecting an un-scanned input operation (for example, during an announcement of illegal input), it does not make a product removal announcement. As a result, even if a customer inadvertently puts an un-scanned product into the shopping basket and then takes it out of the shopping basket to register the product, it is possible to prevent a product removal announcement corresponding to the removal from being made. Therefore, it is possible to suppress the frequent occurrence of product removal announcements, that is, to suppress excessive notifications of product removal announcements, and to notify appropriate product removal announcements according to the situation. For this reason, it is possible to suppress the situation where the announcement of product removal hinders comfortable shopping. Therefore, according to the sales system 1 according to the present embodiment, it is possible to support appropriate shopping.

[0161] Also, in the present embodiment, when the portable terminal 60 detects an un-scanned input operation within a predetermined period after detecting the removal of a product (for example, during a product removal announcement), it does not notify an illegal input announcement. As a result, even if a customer reorganizes the products in the shopping basket (takes out a product from the shopping basket and then puts it back into the shopping basket), it is possible to prevent an illegal input announcement corresponding to the input of the product from being made. Therefore, it is possible to suppress the frequent occurrence of illegal input announcements, that is, to suppress excessive notifications of illegal input announcements, and to notify appropriate illegal input announcements according to the situation. For this reason, it is possible to suppress the situation where the announcement of illegal input hinders comfortable shopping.

[0162] Also, in the present embodiment, when the portable terminal 60 detects the removal of a product in the registration mode, it switches from the registration mode to the cancellation mode. Thereby, when the portable terminal 60 detects the removal of a product, it can allow the customer to cancel the product quickly and easily.

[0163] Also, in this embodiment, after the mobile terminal 60 switches from the registration mode to the cancellation mode, if an un-scanned input operation is detected within a predetermined period, it switches back from the cancellation mode to the registration mode. As a result, when a customer arranges the products in the shopping cart (takes out the products from the shopping cart and then puts them back into the shopping cart), even if the customer transitions to the cancellation mode due to taking out the products, the customer can return to the registration mode by putting the products back into the shopping cart. Therefore, when the products in the shopping cart are arranged, the products can be registered as they are after the arrangement. Thus, appropriate shopping can be supported.

[0164] (Modification of the Embodiment) Next, a modification of the embodiment will be described. In the following description, the content described in the above-described embodiment will be omitted as appropriate. Also, it is possible to combine the following modifications and the above-described embodiment respectively.

[0165] In the above-described embodiment, an example in which the mobile terminal 60 acquires connection information from the connection code 78 when connecting to the cart device 70 has been described. In a modification of the embodiment, instead of or in addition to such a configuration, an example in which the mobile terminal 60 acquires connection information from the NFC tag 79 when making the connection will be described.

[0166] In the modification, the mobile terminal 60 acquires (receives) connection information from the NFC tag 79 attached to each cart device 70. For example, when the mobile terminal 60 is set in the holder portion 74 of the cart device 70 by the customer, the mobile terminal 60 receives the connection information of the cart device 70 from the NFC tag 79 attached to the holder portion 74.

[0167] (An Example of the Operation of the Mobile Terminal 60 According to the Modification of the Embodiment) FIG. 12A is a flowchart for explaining an example of the operation of the mobile terminal 60 according to a modified form of the embodiment. The flowchart of FIG. 12A shows the flow from when a customer comes to the store with the mobile terminal 60 and the mobile terminal 60 connects to the cart device 70 using the NFC tag 79 until the settlement code display screen 680 (FIG. 6(H)) is displayed. Note that at the start of this flowchart (when coming to the store), it is assumed that the mobile terminal 60 is displaying the initial screen 610 (FIG. 6(A)).

[0168] Step S31: The mobile terminal 60 determines whether it has received connection information (device identification information of the cart device 70) for connecting to the cart device 70. For example, when the customer sets the mobile terminal 60 on the cart device 70 (holder unit 74), the connection information of the cart device 70 (the set cart device 70) is received from the NFC tag 79 (IC tag communication unit) attached to the holder unit 74. If the connection information is received (step S31: YES), the process proceeds to step S32. If the connection information has not been received (step S31: NO), step S31 is repeated.

[0169] Step S32: The mobile terminal 60 pairs with and connects to the cart device 70. Step S33: The mobile terminal 60 transmits information regarding the cart device 70 to the cloud server 20. Thereby, the administrator can monitor the information of the cart device 70 in, for example, the transaction status management device 40 and appropriately perform maintenance on the cart device 70.

[0170] Note that even if the mobile terminal 60 has received the connection information from the cart device 70 (step S31: YES) but fails to connect to the cart device 70, the cart device 70 can be uniquely identified from the connection information. Therefore, the mobile terminal 60 may transmit connection failure information indicating that the connection has failed to the cloud server 20.

[0171] Step S34: When the connection is completed, the mobile terminal 60 displays a connection completion screen (not shown) indicating that fact. Step S35: The mobile terminal 60 receives a shopping app startup operation on the connection completion screen.

[0172] Step S36: The mobile terminal 60 displays the menu screen 620 (Fig. 6(B)). Step S37: The mobile terminal 60 receives an operation on the first shopping start button 621a on the menu screen 620. Note that in the modified form, since it is obvious that shopping is performed in a mode using the cart device 70, the second shopping start button 621b may not be displayed on the menu screen 620 according to the modified form.

[0173] Step S38: The mobile terminal 60 transmits the tax invoice instruction information to the cart device 70. Step S39: The mobile terminal 60 displays the initial registration screen 640 (Fig. 6(D)).

[0174] Hereinafter, steps S11 to S14 in Fig. 12A are the same as steps S11 to S14 in Fig. 7, so the description is omitted.

[0175] According to the modified form of the embodiment, the customer can connect the mobile terminal 60 and the cart device 70 only by setting the mobile terminal 60 on the cart device 70 (holder unit 74) without performing a reading operation of the connection code 78. Therefore, the customer can more easily connect the mobile terminal 60 and the cart device 70.

[0176] (Second Embodiment) Next, the second embodiment will be described. Note that it is also possible to combine the second embodiment and the above-described embodiment.

[0177] In the second embodiment, in addition to the above-described embodiment, an example will be described in which when a shopping cart is placed on the cart device 70 immediately after the start of shopping, an illegal insertion announcement is not notified.

[0178] (Background of the Second Embodiment) When the mobile terminal 60 is connected to the cart device 70 and shopping is started, there may be a case where the shopping basket is not placed on the cart device 70. In this case, the customer will place the shopping basket on the cart device 70 after the start of shopping. At this time, due to the increase in the weight corresponding to the shopping basket, it will be detected as an un-scanned input. If a predetermined announcement (for example, an illegal input announcement) is notified in this case, it will not only hinder comfortable shopping for the customer, but also result in a store clerk being called during settlement, leading to a decrease in the work efficiency of the store clerk.

[0179] That is, if an illegal input announcement is notified for the placement of the shopping basket after the start of shopping, the operation efficiency of the sales system 1 will decrease. Therefore, in the second embodiment, even if the shopping basket is placed on the cart device 70 after the start of shopping, an illegal input announcement is not notified. Hereinafter, with reference to FIG. 13, the functional configuration of the mobile terminal 60 according to the second embodiment will be described.

[0180] (Functional Configuration of Mobile Terminal 60 According to the Second Embodiment) FIG. 13 is a block diagram showing an example of the functional configuration of the mobile terminal 60 according to the second embodiment. As shown in FIG. 13, the mobile terminal 60 according to the second embodiment includes an acquisition unit 1301, a detection unit 1302, a reception unit 1303, a state detection unit 1304, and a notification unit 505. Each unit is realized by the CPU 201. That is, when the CPU 201 executes a shopping application (including an announcement notification program) stored in the memory, the functions of each unit are realized.

[0181] The acquisition unit 1301 acquires product information of the product to be registered. The acquisition unit 1301 acquires product information based on, for example, the reading result of the product code read by the camera 207. Also, when product registration is enabled from a button (product selection button) displayed on the display 206, the acquisition unit 1301 acquires product information based on the operation result of the button.

[0182] The detection unit 1302 detects that an article has been added to the cart device 70. Specifically, when the measurement result constantly obtained from the weighing unit 303 increases, the detection unit 1302 detects that an article has been added to the cart device 70. Further, the detection is also performed based on the imaging result of the camera 207. Specifically, the detection unit 1302 detects that an article has been added to the cart device 70 from the analysis result of the image captured by the camera 207.

[0183] Based on the detection result of the detection unit 1302, the notification unit 505 notifies an announcement (illegal input announcement) indicating that a product has been illegally put into (unscanned input) the cart device 70. The notification unit 505 notifies the illegal input announcement when at least one of the detection of the addition of an article based on the measurement result of the weighing unit 303 and the detection of the addition of an article based on the imaging result of the camera 207 is detected.

[0184] In particular, the notification unit 505 notifies a predetermined announcement (for example, an illegal input announcement) based on the acquisition state of the acquisition unit 1301 and the detection result of the detection unit 1302. The acquisition state includes, for example, a state in which product information is not acquired by the acquisition unit 1301 and a state in which it is acquired. Specifically, the notification unit 505 notifies an illegal input announcement when the product information is not acquired by the acquisition unit 1301 and the addition of an article to the cart device 70 is detected by the detection unit 1302. However, the notification unit 505 does not notify the illegal input announcement when a predetermined condition is satisfied. Not notifying the illegal input announcement means, in other words, restricting the notification of the illegal input announcement. Hereinafter, an example of a predetermined condition under which the illegal input announcement is restricted is illustrated in (1) to (5).

[0185] (1) Regarding the restriction immediately after accepting the start of shopping The reception unit 1303 receives the start of shopping (shopping start). The shopping start may be received, for example, by pressing the first shopping start button 621a (Fig. 6(B)), or after the connection between the mobile terminal 60 and the cart device 70 is completed (after the connection instruction screen 630 in Fig. 6(C)), a predetermined button is displayed and the shopping start may be received by pressing the predetermined button. Note that the reception unit 1303 may enable the reception of the shopping start (enable the predetermined button) on the condition that the placement of the shopping basket on the cart device 70 is detected from the imaging result of the camera 207.

[0186] After the reception unit 1303 receives the start of shopping (after the start of the transaction), the notification unit 505 does not notify an unauthorized insertion announcement even if an unauthorized insertion is detected within a predetermined period. Thereby, even if the shopping basket is placed on the cart device 70 immediately after the start of shopping, it is possible not to notify an unauthorized insertion announcement. The predetermined period is, for example, a period such as 10 seconds or 20 seconds. The predetermined period may be a changeable period. When the predetermined period elapses, thereafter, the notification unit 505 can notify an unauthorized insertion announcement.

[0187] (2) Regulations regarding when the first item is added Also, when the detection unit 1302 first detects the addition of an item after the reception unit 1303 receives the start of shopping, the notification unit 505 does not notify an unauthorized insertion announcement. Thereby, even if the shopping basket is placed on the cart device 70 immediately after the start of shopping, it is possible not to notify an unauthorized insertion announcement. Note that when the detection unit 1302 first detects the addition of an item, thereafter, when the addition of an item is detected, the notification unit 505 can notify an unauthorized insertion announcement.

[0188] (3) Regulations regarding when a predetermined weight is detected The detection unit 1302 detects the weight inside the cart device 70 and its increase or decrease based on the weighing result of the weighing unit 303. The detection unit 1302 detects an increase in a preset weight (for example, 500 g). This weight is the weight of a predetermined article (for example, a shopping basket). When the weight detected by the detection unit 1302 indicates an increase in the weight of the shopping basket (500 g), the notification unit 505 does not notify an illegal insertion announcement. Thereby, even if the shopping basket is placed on the cart device 70 immediately after the start of shopping, it is possible not to notify an illegal insertion announcement. On the other hand, when the weight detected by the detection unit 1302 indicates an increase in a weight different from the weight of the shopping basket, the notification unit 505 can notify an illegal insertion announcement.

[0189] Note that the weight of the shopping basket (preset weight) may vary from store to store. For this reason, the mobile terminal 60 may acquire the weight of the shopping basket corresponding to each store each time the shopping application is started. Also, the weight of the shopping basket is managed by a predetermined device. The predetermined device may be any one of, for example, the head office server 10, the cloud server 20, the store controller 30, and the transaction status management device 40. Furthermore, in the store, the shopping basket may be replaced due to aging deterioration or the like. In this case, the predetermined device may accept the weight of the shopping basket after replacement. Also, the accepted weight may be transmitted to the mobile terminal 60 when the shopping application in the mobile terminal 60 is started. Thereby, even when the shopping basket is replaced, transactions can be performed reflecting the weight of the shopping basket after replacement.

[0190] (4) Regulations Regarding the Case of Reading the Barcode of the Shopping Basket It is also possible to attach a code (e.g., bar code) indicating that it is a shopping basket to the shopping basket. In such a form, when the customer wants to set the shopping basket after receiving the start of shopping, the customer reads the bar code (or specific information) attached to the shopping basket and sets the shopping basket on the placement unit 71. Thereby, the mobile terminal 60 recognizes the operation related to the setting as a correct operation. Therefore, the customer can set the shopping basket on the placement unit 71 without any problem. That is, the shopping basket can be set on the same principle as in the case of product registration.

[0191] (5) Regulations when staying in the shopping cart storage area The mobile terminal 60 acquires the position information of its own terminal from the GPS unit or the beacon, and determines whether its own terminal is staying in the shopping cart storage area. When the own terminal is staying in the shopping cart storage area, the notification unit 505 does not notify an unauthorized insertion announcement even if an unauthorized insertion is detected. Thereby, the notification unit 505 can be made not to notify an unauthorized insertion announcement even when the shopping basket is placed on the cart device 70 when staying in the shopping cart storage area. On the other hand, when the own terminal is staying in the product sales area, the notification unit 505 notifies an unauthorized insertion announcement when an unauthorized insertion is detected.

[0192] In the second embodiment, the notification unit 505 notifies an unauthorized insertion announcement when all of the above (1) to (5) conditions are satisfied. However, the notification unit 505 may notify an unauthorized insertion announcement when at least one of the above (1) to (5) conditions is satisfied, and the combination can be freely set.

[0193] (Regarding that the notification conditions for unauthorized insertion announcements vary depending on the total weight of the cart device 70) Next, it will be explained that the conditions for determining an illegal input announcement differ depending on the total weight of the cart device 70. Generally, the measured value of the weighing device 72 has fine amplitude whether it is in an unloaded state (a state where no article is placed on the weighing unit 303) or a loaded state (a state where an article is placed on the weighing unit 303). The finer the resolution of the measured value to be displayed, the finer the amplitude can be detected. Conversely, when this resolution is lowered, the amplitude becomes coarser, and by setting a display resolution larger than the amplitude, the displayed value becomes stable.

[0194] For example, when there is an amplitude of ±4 g centered on 0 g in the unloaded state, if the display resolution is set to 1 g, the displayed measured value will continue to display random values in the range from -4 g to +4 g. On the other hand, if the display resolution is set to 10 g, the displayed measured value will continue to stably display only 0 g. In this way, the minimum unit that can stably display the measured value is called the visual weight. Also, as the load on the weighing unit 303 increases, the amplitude of the weight value also increases. Therefore, when measuring results are displayed with the visual weight at low load (when the total weight is small) at high load (when the total weight is large), as described above, the amplitude becomes larger than the display resolution, and the displayed value becomes unstable.

[0195] If the visual weight is set to a coarse value based on the high load, the instability at high load can be reduced, but accurate measurement results cannot be displayed in the case of low load. Under such a premise, the concept of multi-range (dual range) is adopted. In the case of low load (low weighing range), a fine visual weight is adopted, and in the case of high load (high weighing range), a coarse visual weight is adopted. Generally, it is common to provide highly accurate measurement results according to the total weight in any measurement. The fact that the visual weight is fine means that the weight value of the condition for determining an illegal input (illegal determination threshold) can also be made small. On the other hand, the fact that the visual weight is coarse means that the weight value of the condition for determining an illegal input (illegal determination threshold) also needs to be made large.

[0196] That is, when the fraud determination value for low load is adopted under high load, the amplitude of the weight value becomes larger than the fraud determination value, and although no product is being inserted, the amplitude value is misrecognized as if there had been product insertion (product removal), resulting in the occurrence of events such as fraud insertion announcements and product removal announcements being reported.

[0197] From the above, the detection unit 1302 makes the target weight finer and sets the fraud insertion determination threshold to a small value in the case of low load, and makes the target weight coarser and sets the fraud insertion determination threshold to a large value in the case of high load. That is, the detection unit 1302 makes the fraud determination threshold variable according to the total weight of the cart device 70. An example of the relationship between the total weight and the fraud determination threshold is shown below. · When the total weight is 0 to 1 kg, the fraud determination threshold is 100 g. · When the total weight is 1 to 2 kg, the fraud determination threshold is 200 g. · When the total weight is 2 to 3 kg, the fraud determination threshold is 300 g. · When the total weight is n - 1 to n kg, the fraud determination threshold is n × 100 g. In this way, as the total weight increases, the fraud determination threshold also increases, and as the total weight decreases, the fraud determination threshold also decreases. Note that the total weight thresholds (1 kg, 2 kg, 3 kg) at which the fraud determination threshold switches may be referred to as "total weight thresholds" below. Also, among the total weight thresholds, 1 kg is "total weight threshold G1", 2 kg is "total weight threshold G2", and n kg is "total weight threshold G n " in some cases.

[0198] As described above, the notification unit 505 notifies an illegal insertion announcement based on the detection result of the article by the detection unit 1302. The detection result of the article (illegal determination threshold) by the detection unit 1302 varies according to the total weight. For example, when the total weight is 0 to 2 kg, the notification unit 505 notifies an illegal insertion announcement when an increase of the illegal determination threshold (100 g) or more is detected. Also, for example, when the total weight is 4 to 6 kg, the notification unit 505 notifies an illegal insertion announcement when an increase of the illegal determination threshold (200 g) or more is detected. That is, even when the total weight increases, by adopting an illegal determination value corresponding to the total weight, it is possible to prevent an unnecessary illegal insertion announcement from being notified.

[0199] (Regarding that the notification condition of the illegal insertion announcement varies according to the moving state of the cart device 70) Next, it will be described that the notification condition of the illegal insertion announcement varies according to the moving state of the cart device 70. When the cart device 70 is moved, vibrations are generated from the wheels of the shopping cart that slides on the store floor, and the vibrations are transmitted to the weighing unit 303 itself, the placement unit 71, the shopping basket, and the products in the shopping basket. For this reason, an amplitude is generated in the measured value due to the vibrations of each device, and there is a risk of false detection of an illegal insertion. Therefore, in the second embodiment, in consideration of such vibrations and acceleration / deceleration during the movement of the cart device 70, an illegal insertion is detected.

[0200] The state detection unit 1304 detects the moving state of the cart device 70. The state detection unit 1304 detects the moving state of the cart device 70 based on the detection results from the acceleration sensor and gyro sensor provided in the mobile terminal 60. When the cart device 70 is equipped with an acceleration sensor and a gyro sensor, the state detection unit 1304 may detect the moving state of the cart device 70 based on the detection results from the acceleration sensor and gyro sensor provided in the cart device 70.

[0201] The moving states include, for example, a starting operation (acceleration), a stopping operation (deceleration), moving (constant speed), and stopped (stationary). As described above, the detection unit 1302 detects an unauthorized input when the weight of the cart device 70 increases by an amount equal to or greater than the unauthorized determination threshold. Further, the detection unit 1302 detects an unauthorized input according to a predetermined moving state detected by the state detection unit 1304. For example, the detection unit 1302 variably sets the unauthorized determination threshold according to the moving state of the cart device 70. Specifically, the relationship between a predetermined moving state and the unauthorized determination threshold is exemplified below. · In the case of a starting operation or a stopping operation, the unauthorized determination threshold is a value obtained by adding 200 g to the unauthorized determination threshold during stoppage. · In the case of moving, the unauthorized determination threshold is a value obtained by adding 100 g to the unauthorized determination threshold during stoppage. Note that the unauthorized determination threshold during stoppage is a value updated according to the total weight, for example. In this way, in a state where vibration and acceleration / deceleration occur, the unauthorized determination threshold also increases, making it difficult to detect an unauthorized input. On the other hand, in a state where vibration is dominant and acceleration / deceleration is unlikely to occur, the unauthorized determination threshold also decreases, making it easier to detect an unauthorized input.

[0202] As described above, the notification unit 505 notifies an unauthorized input announcement based on the detection result of the product by the detection unit 1302. The detection result of the weight value (unauthorized determination threshold) by the detection unit 1302 differs according to the moving state of the cart device 70. For example, when the cart device 70 is stopped, the notification unit 505 can notify an unauthorized input announcement when an increase equal to or greater than the unauthorized determination threshold (100 g) is detected. Further, for example, when the cart device 70 is in a starting operation, the notification unit 505 can notify an unauthorized input announcement when a change in the weight value equal to or greater than the unauthorized determination threshold (200 g) is detected. That is, in a situation where vibration during movement and acceleration / deceleration based on movement are likely to occur (starting operation or stopping operation), it becomes difficult to make an unauthorized input announcement. Thus, the notification conditions for the unauthorized input announcement by the notification unit 505 differ according to the moving state of the cart device 70.

[0203] (An example of the process during product registration performed by the portable terminal 60 according to the second embodiment) FIG. 14 is a flowchart for explaining an example of the in-processing of product registration performed by the mobile terminal 60 according to the second embodiment. The flowchart of FIG. 14 shows the flow from when the connection between the mobile terminal 60 and the cart device 70 is completed to when the settlement code display screen 680 (FIG. 6(H)) is displayed after the start of the transaction. In other words, in FIG. 14, the explanation of the connection (pairing) between the mobile terminal 60 and the cart device 70 and the cancellation of the pairing is omitted.

[0204] Step S1401: The mobile terminal 60 determines whether the transaction has started by the reception unit 1303 receiving (start of shopping). The mobile terminal 60 waits until the transaction starts (Step S1401: NO). When the transaction starts (Step S1401: YES), the mobile terminal 60 proceeds to Step S1402.

[0205] Step S1402: The mobile terminal 60 determines whether the addition of an article (more than a predetermined weight) onto the cart device 70 has been detected by the detection unit 1302. Note that the predetermined weight is updated according to the total weight in the cart device 70. When the addition of an article onto the cart device 70 is not detected (Step S1402: NO), the mobile terminal 60 proceeds to Step S1410. When the addition of an article onto the cart device 70 is detected (Step S1402: YES), the mobile terminal 60 proceeds to Step S1403.

[0206] Step S1403: The mobile terminal 60 determines whether it is within a predetermined period after the start of the transaction. When it is not within the predetermined period after the start of the transaction (Step S1403: NO), the mobile terminal 60 proceeds to Step S1406. On the other hand, when it is within the predetermined period after the start of the transaction (Step S1403: YES), the mobile terminal 60 proceeds to Step S1404.

[0207] Step S1404: The mobile terminal 60 determines whether it is the addition of the first item after the start of the transaction. If it is the addition of the first item after the start of the transaction (Step S1404: YES), the mobile terminal 60 proceeds to Step S1405. On the other hand, if it is not the addition of the first item after the start of the transaction (Step S1404: NO), that is, if it is the input of the second item or later after the start of the transaction, the mobile terminal 60 proceeds to Step S1406.

[0208] Step S1405: The mobile terminal 60 determines whether the increased weight is the weight of the shopping basket (500 g). If the increased weight is not the weight of the shopping basket (Step S1405: NO), the mobile terminal 60 proceeds to Step S1406. On the other hand, if the increased weight is the weight of the shopping basket (Step S1405: YES), the mobile terminal 60 proceeds to Step S1410. That is, if an item equivalent to the shopping basket is added as the first item on the cart device 70 within a predetermined period after the start of the transaction, the mobile terminal 60 proceeds to Step S1410 without notifying an illegal input announcement.

[0209] Step S1406: The mobile terminal 60 determines whether the addition of the item is within the valid period (for example, within 10 seconds) after the scanning of the product code. If it is within the valid period (Step S1406: YES), the mobile terminal 60 proceeds to Step S1407. On the other hand, if it is not within the valid period (Step S1406: NO), that is, if it is an un-scanned input operation, the mobile terminal 60 proceeds to Step S1408.

[0210] Step S1407: The mobile terminal 60 displays the measurement result (for example, "Weight OK") in the registration information display area 642 (the column for the product) of the registration screen. In this case, the product is registered as usual.

[0211] Step S1408: The mobile terminal 60 displays the illegal input announcement screen 660 (Fig. 6(F)) and notifies an illegal input announcement. Step S1409: The mobile terminal 60 turns on the store clerk call flag and proceeds to Step S1410.

[0212] Step S1410: The mobile terminal 60 determines whether to end the registration of the product. For example, when the payment start button 651 (Fig. 6(E)) is pressed, the mobile terminal 60 determines to end the registration of the product. If the registration of the product is not ended (Step S1410: NO), the mobile terminal 60 returns to Step S1402. If the registration of the product is ended (Step S1410: YES), the mobile terminal 60 proceeds to Step S1411.

[0213] Step S1411: The mobile terminal 60 displays the payment code display screen 680 (Fig. 6(H)) and ends a series of processes. When the clerk call flag is ON, the payment code 681 includes an instruction to make a clerk call. Thus, when the clerk call flag is ON, a clerk call is made in the payment device 50.

[0214] (An example of the change process of a predetermined weight according to the total weight performed by the mobile terminal 60 according to the second embodiment) FIG. 15 is a flowchart for explaining an example of the change process of a predetermined weight according to the total weight performed by the mobile terminal 60 according to the second embodiment.

[0215] Step S1501: The mobile terminal 60 determines whether the transaction has started by the reception unit 1303 receiving (shopping start). The mobile terminal 60 waits until the transaction starts (Step S1501: NO). When the transaction starts (Step S1501: YES), the mobile terminal 60 proceeds to Step S1502.

[0216] Step S1502: The mobile terminal 60 sets the total weight threshold Gr to the total weight threshold G1 (for example, 1 kg) as the initial value. Step S1503: The mobile terminal 60 sets the predetermined weight α to be detected as an article to the predetermined weight α1 (for example, 100 g) as the initial value. r

[0217] Step S1504: The mobile terminal 60 determines whether the total weight is the total weight threshold G rDetermine whether the above conditions are met. If the total weight is less than the total weight threshold G r (Step S1504: NO), the mobile terminal 60 proceeds to step S1507. If the total weight is greater than or equal to the total weight threshold G r (Step S1504: YES), the mobile terminal 60 proceeds to step S1505.

[0218] Step S1505: The mobile terminal 60 changes the total weight threshold G r to the next heavier total weight threshold G r+1 . Step S1506: The mobile terminal 60 changes the predetermined weight α r detected as an item to the predetermined weight α r+1 corresponding to the total weight threshold G r+1 .

[0219] Step S1507: The mobile terminal 60 determines whether to end the registration of the product. For example, when the settlement start button 651 (Fig. 6(E)) is pressed, the mobile terminal 60 determines to end the registration of the product. If the registration of the product is not ended (Step S1507: NO), the mobile terminal 60 returns to step S1504. If the registration of the product is ended (Step S1507: YES), the mobile terminal 60 ends a series of processes.

[0220] (An example of the process of changing the predetermined weight according to the moving state performed by the mobile terminal 60 according to the second embodiment) Fig. 16 is a flowchart for explaining an example of the process of changing the predetermined weight according to the moving state performed by the mobile terminal 60 according to the second embodiment.

[0221] Step S1601: The mobile terminal 60 determines whether the transaction has started by the reception unit 1303 receiving (shopping start). The mobile terminal 60 waits until the transaction starts (Step S1601: NO). When the transaction starts (Step S1601: YES), the mobile terminal 60 proceeds to step S1602.

[0222] Step S1602: The mobile terminal 60 determines whether a predetermined movement state (starting operation, stopping operation, moving) is detected by the state detection unit 1304. If a predetermined movement state is detected (Step S1602: YES), the mobile terminal 60 proceeds to Step S1603. If a predetermined movement state is not detected (Step S1602: NO), the mobile terminal 60 proceeds to Step S1604.

[0223] Step S1603: The mobile terminal 60 changes to a predetermined weight according to the movement state.

[0224] Step S1604: The mobile terminal 60 determines whether the release condition is satisfied. The release condition is, for example, that a predetermined time has elapsed since a predetermined movement state (starting operation, stopping operation, moving) is no longer detected by the state detection unit 1304. If the release condition is satisfied (Step S1604: YES), the mobile terminal 60 proceeds to Step S1605. If the release condition is not satisfied (Step S1604: NO), the mobile terminal 60 proceeds to Step S1606.

[0225] Step S1605: The mobile terminal 60 returns the predetermined weight to the predetermined weight at the time of stop.

[0226] Step S1606: The mobile terminal 60 determines whether to end the registration of the product. For example, the mobile terminal 60 determines to end the registration of the product when the settlement start button 651 (Fig. 6(E)) is pressed. If the registration of the product is not ended (Step S1606: NO), the mobile terminal 60 returns to Step S1602. If the registration of the product is ended (Step S1606: YES), the mobile terminal 60 ends a series of processes.

[0227] As described above, in the sales system 1 according to the second embodiment, on the premise that the mobile terminal 60 notifies an illegal insertion announcement based on the acquisition status of product information of the product to be registered and the detection result of the addition of an article on the cart device 70, when a predetermined condition is satisfied, the illegal insertion announcement is not notified. Thereby, even if the shopping cart is placed on the cart device 70 after the mobile terminal 60 and the cart device 70 are connected and shopping is started, it is possible not to notify the illegal insertion announcement. Therefore, it is possible to suppress the hindrance of comfortable shopping for customers. In addition, since it is possible not to call a store clerk at the time of settlement, it is possible to suppress the decrease in the work efficiency of the store clerk. For this reason, the sales system 1 can be efficiently operated.

[0228] Also, in the present embodiment, the mobile terminal 60 does not notify an illegal insertion announcement within a predetermined period after receiving the start of shopping. Thereby, even if a shopping cart is placed on the cart device 70 within a predetermined period after receiving the start of shopping, it is possible not to notify the illegal insertion announcement.

[0229] Also, in the present embodiment, when the mobile terminal 60 first detects the addition of an article after receiving the start of shopping, the mobile terminal 60 does not notify an illegal insertion announcement. Thereby, even if the first article is detected on the cart device 70 after receiving the start of shopping, it is possible not to notify the illegal insertion announcement.

[0230] Also, in the present embodiment, when the weight in the cart device 70 indicates an increase in a preset weight, the mobile terminal 60 does not notify an illegal insertion announcement. Thereby, even if a weight equivalent to a shopping cart is detected on the cart device 70 within a predetermined period after receiving the start of shopping, it is possible not to notify the illegal insertion announcement.

[0231] In addition, in this embodiment, the mobile terminal 60 has a multi-range function, that is, it detects the addition of an article based on a variable fraud determination threshold according to the total weight in the cart device 70. Thereby, the article can be detected with appropriate accuracy according to the total weight. Therefore, it is possible to optimally detect fraudulent insertion.

[0232] Also, in this embodiment, the mobile terminal 60 detects the addition of an article based on a variable fraud determination threshold according to the moving state of the cart device 70. Thereby, the article can be detected with appropriate accuracy according to the moving state. Therefore, when the cart device 70 accelerates or decelerates, it is possible to suppress misdetection of fraudulent insertion.

[0233] Note that in the second embodiment, an example in which the acquisition unit 1301, the detection unit 1302, the reception unit 1303, the state detection unit 1304, and the notification unit 505 are provided in the mobile terminal 60 has been described. However, these functional units may be provided in the cart device 70 (weighing device 72). That is, the weighing device 72 may be provided with a display and a speaker, and may notify or regulate a fraud announcement based on the acquisition state of the product information of the product to be registered and the detection result of the addition of an article on the cart device 70.

[0234] (Modifications, etc.) As described above, each embodiment has been described. However, the configuration of the device, the configuration of the data, the processing flow, the display and output modes, etc. can be appropriately changed as shown in, for example, the following (1) to (30). Also, the following (1) to (30) can be appropriately combined with each other.

[0235] (1) Product registration from the product preset button. In the above embodiment, an example where the registration of a product is mainly performed by reading a barcode with the camera 207 has been described, but the present invention is not limited to this. For example, the registration of a product may be performed by displaying buttons (product preset buttons) corresponding to individual products on the display 206 and accepting the pressing of the buttons, instead of or in addition to reading the barcode. Note that it can be said that the addition of the quantity is also the product registration of the same product. The addition of the quantity is performed by accepting the pressing of a quantity change button (for example, the "×1" part shown in FIG. 6(E) etc.) of the already registered product.

[0236] (2) Other examples of the display position of the cart image 644. In the above embodiment, an example where the cart image 644 (FIG. 6(D)) indicating that it is connected to the cart device 70 (communicable) is displayed in the upper right of the captured image display area 641 has been described, but the present invention is not limited to this. The cart image 644 may be displayed, for example, at a position where it does not get in the way more in the display of the captured image (visual recognition of the captured image). For example, the cart image 644 may be displayed in the related information display area 622 (FIG. 6(B)) at the lower part of the screen.

[0237] (3) Other examples of notifying that it is connected to the cart device 70. In the above embodiment, an example where the fact that it is connected to the cart device 70 is actively notified to the customer by the cart image 644 has been described, but it does not have to be actively notified. For example, the fact that it is connected to the cart device 70 may be notified by changing the display color (background color etc.) of part or all of the related information display area 622. That is, it may be made so that the customer is not made aware of whether or not the mobile terminal 60 and the cart device 70 are connected.

[0238] (4) Other examples related to the attachment of the connection code 78. In the above embodiment, the connection cord 78 has been described as an example of being attached to the mobile terminal charging unit 75, but it is not limited to this. The connection cord 78 may be attached at a location different from the mobile terminal charging unit 75. For example, one or more connection cords 78 may be attached at a location other than the mobile terminal charging unit 75 of the cart device 70, or may be attached on top of (overlaying) the NFC tag 79.

[0239] (5) Another example related to the attachment of the NFC tag 79. In the above embodiment, an example in which one NFC tag 79 is attached to the holder portion 74 has been described, but it is not limited to this. Two or more NFC tags 79 may be attached to the holder portion 74. Also, one or more NFC tags 79 may be attached at a location other than the holder portion 74 of the cart device 70.

[0240] Also, related to the above (4) and (5), it is sufficient if at least one of the connection cord 78 and the NFC tag 79 is attached. For example, when the mobile terminal 60 is connected to the cart device 70 using the connection cord 78, in other words, when the mobile terminal 60 does not use the NFC tag 79, the NFC tag 79 does not have to be attached to the cart device 70. Also, when the mobile terminal 60 is connected to the cart device 70 using the NFC tag 79, in other words, when the mobile terminal 60 does not use the connection cord 78, the connection cord 78 does not have to be attached to the cart device 70.

[0241] (6) Display of the menu screen 620 considering location information and the like. In the above embodiment, an example in which the menu screen 620 (FIG. 6(B)) is displayed by operating the shopping app icon 611 (FIG. 6(A)) has been described, but in addition to this, it may be displayed taking into account the location information. Specifically, when the mobile terminal 60 compares the location information (GPS information) of its own terminal with the location information of the target store (the store visited) at the time of starting the shopping app and determines that it is within the store entry range, the menu screen 620 may be displayed. The determination of whether it is within the store entry range may also be made by receiving the beacon (such as wireless LAN) of the target store (the store visited).

[0242] (7) Omission of the connection completion screen (S34 in FIG. 12A). In the modified form of the above embodiment, when connecting to the cart device 70 using the NFC tag 79, an example of displaying the connection completion screen (S34 in FIG. 12A) has been described, but this screen may be omitted. Specifically, in the above modified form, an example of the transition from the initial screen 610 (FIG. 6(A)) → the connection completion screen (S34 in FIG. 12A) → the menu screen 620 (S36 in FIG. 12A) has been described, but it is not limited to this. That is, the mobile terminal 60 may display the menu screen 620 as it is when connected to the cart device 70.

[0243] (8) Other output examples of information regarding the weighing result and information regarding the connection. In the above embodiment, examples of information regarding the weighing result ("Weight OK", "Weight NG", "No weight confirmation", "No check", etc.) and information regarding the connection to the cart device 70 at the time of registration ("Not connected") being displayed on the display 206 of the mobile terminal 60 and the display of the settlement device 50 have been described, but it is not limited to this. Information regarding the weighing result and information regarding the connection may be displayed on the receipt. The receipt includes a paper receipt and an electronic receipt. Also, information regarding the weighing result and information regarding the connection may be recorded in the transaction history (log) or the electronic journal.

[0244] Also, the judgment result based on the captured image may also be stored in the transaction history or the electronic journal. The judgment result based on the captured image includes, for example, a judgment result indicating the input of an unscanned item into the cart device 70, a judgment result indicating the non-cancellation of an item taken out from the cart device 70, a judgment result indicating the non-removal of a cancellation target item from the cart device 70, and a judgment result indicating the non-input of a scanned item into the cart device 70. In this way, by storing various judgment results as transaction histories, etc., fraud detection based on weighing and fraud detection based on images can be aggregated in various ways such as by customer layer, day, month, year, store, etc., and thus can also be used as an indicator for store operation.

[0245] (9) Other examples of information to be displayed. In the above embodiment, examples of displaying information regarding measurement results and connection information for each product have been described, but the present invention is not limited thereto. For example, when a specific condition is satisfied, it may be displayed to that effect at a specific location (e.g., the upper part) of a predetermined screen. The specific condition is, for example, a condition that the registered number of a specific product is equal to or more than a predetermined number. The specific product is, for example, a product to be confirmed such as an un-scanned input product, an un-cancelled taken-out product (a product with a clerk call flag set), or a product of "not connected (no weight confirmation, no check)". Note that the specific product may be limited to a product in a case where the store suffers a disadvantage. In other words, for example, a product forgotten to be input after product registration or a product forgotten to be taken out after product cancellation may be excluded from the specific products. The predetermined screen is, for example, the registration screen 650 (FIG. 6(E)) of the mobile terminal 60, the settlement code display screen 680 (FIG. 6(H)) of the mobile terminal 60, or the settlement screen 1110 (FIG. 11(A)) of the settlement device 50.

[0246] Note that the specific condition may be a condition that the total amount of a specific product is equal to or more than a predetermined amount. Also, the specific condition may be a condition that the ratio (ratio of the number or ratio of the amount) of a specific product to all products is equal to or more than a predetermined ratio. The fact that the specific condition is satisfied is not limited to being displayed on a predetermined screen, and may be recorded in a transaction history or an electronic journal.

[0247] Also, when the specific condition is satisfied, the settlement device 50 may cause the sign pole to emit light in a manner of notifying that effect, or may transmit a notification indicating that effect to the transaction status management device 40 or the clerk's mobile terminal. Further, the settlement device 50 may display the fact that the specific condition is satisfied on the receipt. The receipt includes a paper receipt and an electronic receipt.

[0248] Also, in the sales system 1 equipped with an exit gate device arranged inside the store, when a specific condition is met, the exit gate device may notify this fact by sound or light, or may restrict the passage of customers. The exit gate device can also be configured to permit exit by reading an exit code (barcode or two-dimensional code) displayed on a medium indicating the completion of settlement (for example, a receipt or the mobile terminal 60). In such a configuration, the exit gate device may notify that a specific condition has been met by reading the exit code.

[0249] Whether to notify that a specific condition has been met may be managed or controlled for each time zone or for each customer. Such notifications include the screen display of the mobile terminal 60 or the settlement device 50, the emission of light from the signpost, the screen display of the transaction status management device 40 or the store clerk's mobile terminal, and the notification in the exit gate device.

[0250] (10) Example of weight check. The weight check may be implemented, for example, as follows.

[0251] (Weight check method 1: Weight excluding tare weight) When the weight of all items excluding the tare weight is transmitted from the cart device 70 to the mobile terminal 60 as the measurement result, the mobile terminal 60 stores the weight received from the cart device 70 last time (for example, the weight of ○○ food bread). The mobile terminal 60 calculates the difference between the weight received last time and the weight received this time (for example, the weight of ○○ food bread + ○○ oolong tea), compares the difference weight with the product weight of ○○ oolong tea, and displays the comparison result. For example, the mobile terminal 60 may determine whether the difference between the difference weight and the product weight is within a predetermined range, and if it is within the predetermined range, display normal, and if it is not within the predetermined range, display abnormal. The same applies to the following weight check methods 2 and 3.

[0252] Note that the mobile terminal 60 may obtain the product weight by querying the device that stores the product weight master. The product weight master is a file that associates the product code with the product weight and may be a part of the product master. The device that stores the product weight master may be the cloud server 20 or the device itself. The same applies to the following weight check methods 2 and 3.

[0253] Also, the calculation of the differential weight and the comparison of the product weight may be performed by the cart device 70. For example, the mobile terminal 60 may send the product weight (weight on the master) registered this time to the cart device 70, and the cart device 70 may compare the differential weight calculated by itself with the product weight received from the mobile terminal 60. The same applies to the calculation of the differential weight in weight check method 2, the comparison with the product weight, and the comparison of the product weight in weight check method 3.

[0254] (Weight check method 2: Weight including tare weight) When the weight of all products including the tare weight is transmitted from the cart device 70 to the mobile terminal 60 as the measurement result, the mobile terminal 60 stores the weight received from the cart device 70 last time (for example, the weight of the tare + ○○ bread). The mobile terminal 60 calculates the difference between the weight received last time and the weight received this time (for example, the weight of the tare + ○○ bread + ○○ oolong tea), compares the differential weight with the product weight of ○○ oolong tea, and displays the comparison result.

[0255] (Weight check method 3: Increase or decrease value of weight) When the increase or decrease value of the weight of all products is transmitted from the cart device 70 to the mobile terminal 60 as the measurement result, the mobile terminal 60 compares the weight received this time with the product weight of ○○ oolong tea and displays the comparison result.

[0256] (11) Conditions for disconnecting the connection between the mobile terminal 60 and the cart device 70. In the above-described embodiment, an example has been described in which the disconnection between the mobile terminal 60 and the cart device 70 is performed by accepting an operation of the settlement start button 651, but the present invention is not limited thereto. The disconnection may be conditional on any of the following a to e, for example. a: The settlement device 50 reads the settlement code 681. Note that the fact that the settlement device 50 has read the settlement code 681 may be transmitted from the settlement device 50 → the cloud server 20 → the mobile terminal 60. Specifically, when the settlement device 50 reads the settlement code 681, it transmits predetermined request information to the cloud server 20. When the cloud server 20 receives the request information, it transmits a disconnection notice indicating that the settlement device 50 has read the settlement code 681 to the mobile terminal 60. When the mobile terminal 60 receives the disconnection notice, it disconnects the connection to the cart device 70. b: Settlement is completed in the settlement device 50. Note that the fact that settlement has been completed in the settlement device 50 may be transmitted from the settlement device 50 → the cloud server 20 → the mobile terminal 60. Specifically, when the settlement device 50 reads the settlement code 681, it transmits predetermined request information to the cloud server 20. When the cloud server 20 receives the request information, it transmits a disconnection notice indicating that settlement has been completed to the mobile terminal 60. c: When a store exit gate device is installed in the store, the customer passes through the store exit gate device. Note that the fact that the customer has passed through the store exit gate device may be transmitted from the store exit gate device → the cloud server 20 → the mobile terminal 60. The store exit gate device may recognize that each customer has passed through, for example, by reading the exit code displayed on the medium (e.g., receipt or mobile terminal 60) of the above (9). d: The cart device 70 has been returned to the cart collection area. The return may be determined by the mobile terminal 60 based on location information (e.g., GPS or beacon), or may be determined by the cart device 70. For example, when charging is started at the cart collection area, the cart device 70 may determine that it has been returned and transmit a disconnection notice indicating that fact to the mobile terminal 60. e: Having left the store. The mobile terminal 60 can determine that the user has left the store based on location information (e.g., GPS or beacon).

[0257] When disconnection control for disconnecting the connection between the mobile terminal 60 and the cart device 70 is performed by operating the actuarial start button 651 or by any of a to e above, the retry control for the connection is stopped. In other words, until the disconnection control is executed, the status requires a BT connection. Therefore, for example, if the connection is interrupted, such as by removing the cart device 70 and reading the barcode of the shelf label, the mobile terminal 60 executes retry control (reconnection) with the cart device 70 based on the connection information.

[0258] Since retry control generally consumes a large amount of power, it is necessary to limit its execution as much as possible. In that regard, performing disconnection control clarifies the timing when the BT connection becomes unnecessary. As a result, unnecessary retry control can be suppressed, and the battery consumption can be reduced.

[0259] (12) Example of using the cart device 70 that has failed to connect. In the above embodiment, an example has been described in which a message such as "There may be a malfunction with the cart. Please use another cart" is output when the connection to the cart device 70 fails, but it is not limited to this. For example, although related to the above (11) and the following (13), the cart device 70 that has failed to connect may be used.

[0260] Although the weighing function of the cart device 70 aims to improve security such as detecting fraud, it does not mean that shopping cannot be done. That is, even if it is determined that the connection is impossible as a result of repeatedly requesting a connection regarding the connection between the cart device 70 and the mobile terminal 60, the customer may still be able to use the cart device 70. For example, even if the connection cannot be made, the initial registration screen 640 (Fig. 6(D)) may be transitioned to.

[0261] However, the mobile terminal 60 (shopping app) may continuously and periodically retry connection requests in the background. Since it operates in the background, there is no difference in the external behavior compared to the case of successful connection establishment. That is, even if the connection to the cart device 70 fails, i.e., even if the weighing function of the cart device 70 cannot be used, customers are not forced to perform any special operations.

[0262] (13) Example of accepting product registration even when not connected to the cart device 70. In the above embodiment, the mobile terminal 60 starts product registration after connecting to the cart device 70. In other words, an example where product registration is prohibited before connecting to the cart device 70 has been described, but it is not limited to this.

[0263] The mobile terminal 60 may be enabled to start product registration even when not connected to the cart device 70. For example, the mobile terminal 60 may start product registration even when not connected in response to a customer's operation. Specifically, when the connection to the cart device 70 fails, a small screen with a "Do not connect" button placed in front of the initial registration screen 640 (Fig. 6(D)) may be displayed, and when there is an operation of the "Do not connect" button, product registration may be enabled.

[0264] Also, the mobile terminal 60 may be enabled to start product registration without displaying the above small screen. The above small screen may be displayed according to the date and time (time zone). Specifically, the mobile terminal 60 may control whether to start product registration based on the operation of the "Do not connect" button by displaying the small screen or not start product registration without displaying the small screen according to the date and time (time zone).

[0265] Further, the small screen may be displayed according to the settings of the store. Specifically, when the connection to the cart device 70 fails, the mobile terminal 60 may control, according to the store settings, whether to (a) prohibit the registration of products, (b) display the small screen and enable the start of product registration based on the operation of the "Do not connect" button, or (c) enable the start of product registration without displaying the small screen. The above (a) to (c) may be set for each date and time (time zone), or may be set for each customer.

[0266] When the connection between the mobile terminal 60 and the cart device 70 is disconnected during product registration, the mobile terminal 60 may prohibit product registration or may prohibit the input of products into the cart device 70. When the connection between the mobile terminal 60 and the cart device 70 is disconnected during product registration, according to the store settings, it may be controlled whether to (a) enable continuous product registration, (b) prohibit product registration, or (c) prohibit the input of products into the cart device 70. The above (a) to (c) may be set for each date and time (time zone), or may be set for each customer.

[0267] In the above (9), an example of notifying that a specific condition is satisfied (the number of products is equal to or more than a predetermined number, the total amount of specific products is equal to or more than a predetermined amount, or the ratio of specific products to all products is equal to or more than a predetermined ratio) has been described. Instead of or in addition to this, a notification regarding non-connection may be made. The notification regarding non-connection includes, for example, that the non-connection time is equal to or more than a predetermined time, the ratio of the non-connection time to the total shopping time is equal to or more than a predetermined ratio, or that registration has started while remaining non-connected. Whether to make a notification regarding non-connection may be managed (set) and controlled for each time zone and each customer.

[0268] (14) Shortening the time until the initial registration screen 640 is displayed. In the above-described embodiment, the initial registration screen 640 (Fig. 6(D)) has been described as an example that is displayed on the condition that the connection to the cart device 70 has been completed (or when not connected), but it is not limited to this. The initial registration screen 640 may be displayed on the condition that the connection code 78 has been read (at the time when the connection code has been read). Thereby, the time until the initial registration screen 640 is displayed can be shortened.

[0269] Note that when the mobile terminal 60 (shopping app) connects to the cart device 70, a connection request is made to the cart device 70. If the connection to the cart device 70 cannot be established with a single connection request, a retry of the connection request is performed. In one retry within the retry period in which multiple retries are performed, the connection may be completed, or the connection may not be possible after the retry period has ended. If the specification is such that the registration screen is transitioned after the retry period has elapsed, there is a risk that product registration cannot be started quickly. That is, the operability is poor and inconvenient. Therefore, the mobile terminal 60 is configured to transition to the registration screen on the condition that the connection code has been read, rather than waiting for the actual connection to be established after reading the connection code. Thereby, since the screen immediately transitions to the registration screen, product registration can be started quickly.

[0270] Also, when the connection to the cart device 70 cannot be established due to an abnormality of the cart device 70 (for example, a failure of the cart communication unit, power OFF, etc.), similarly, if the determination of connection failure after the connection establishment or the end of the retry period is made a condition for product registration, the customer needs to wait for product registration until it is determined that the connection is impossible after the retry period has elapsed. On the other hand, if reading the connection code is made a condition for product registration, the wasted waiting time until it is determined that the connection is impossible after the retry period is eliminated.

[0271] (15) Combined use of scale without cart. The cart device 70 is expensive. Specifically, since the cart device 70 includes a weighing unit (measurement unit 303), a communication unit with the mobile terminal 60 (cart communication unit 304), a power supply unit, a control unit, etc., it is more expensive than a general shopping cart. Many stores such as supermarkets need to prepare a large number of shopping carts in the sales floor so as not to be insufficient even when there are many customers. However, it is a heavy burden for the store to install the measurement unit 303 in all shopping carts. For this reason, it is conceivable that there are cases where shopping carts equipped with the measurement unit 303 (hereinafter referred to as "weighing carts") and shopping carts not equipped with the weighing unit (hereinafter referred to as "non - weighing carts") coexist. In a sales floor where weighing carts and non - weighing carts coexist, the operation start method of the mobile terminal 60 will be different.

[0272] The shopping app cannot proceed with the status (for example, cannot transition the screen) unless it reads the connection code 78. Therefore, in the case of a non - weighing cart, shopping using the app cannot be performed. Here, a method can be considered in which the appearance of the non - weighing cart and the weighing cart is made different so that customers can distinguish the carts and the shopping app accepts the selection operation of the non - weighing cart or the weighing cart. However, this method is inconvenient and unacceptable in terms of operation. As a method to solve this, it may be possible to use, as a start condition of use, pasting a two - dimensional code on the non - weighing cart in the same way as on the weighing cart and having the two - dimensional code read. Thereby, even when using a non - weighing cart, the same operation as that of a weighing cart becomes possible.

[0273] Note that the two - dimensional code pasted on the non - weighing cart is a disconnection code, not the connection code 78. When the mobile terminal 60 (shopping app) reads the disconnection code in a state where it is not connected to the weighing cart, it transitions to the initial registration screen 640 (Fig. 6(D)), and the shopping becomes possible.

[0274] Also, assume that in a state where it is connected to a cart with a scale, the shopping app reads the cut code attached to the cart without a scale. In this case, the connection with the cart with a scale may be terminated (disconnected), and the shopping-enabled state may be maintained as it is. In this way, by enabling the shopping app to read the cut code in a state where it is connected to a cart with a scale, it is possible to appropriately handle customers who exchange shopping carts during shopping. Examples of reasons for exchanging the shopping cart include various reasons such as the caster or handle of the shopping cart being in poor condition and unable to be transported (moved). Even in such a case, the customer can change the shopping cart by transferring the shopping basket from the cart with a scale to the cart without a scale during shopping. Note that if the connection state with the cart with a scale before the change is maintained, various problems may occur. Therefore, the mobile terminal 60 and the cart with a scale are disconnected by reading the cut code.

[0275] Note that assume that in a state where the cart without a scale is used, the shopping app reads the connection code attached to the cart with a scale. In this case, it may connect to the cart with a scale and maintain the shopping-enabled state as it is.

[0276] (16) Inquiry about the presence or absence of a cart with a scale. In relation to the above (15), the operation of the shopping app may be varied based on whether a cart with a scale (cart device 70) exists in the target store (the store visited). For example, when the shopping app receives an activation operation of the icon 611 (Fig. 6(A)), it inquires of the cloud server 20 whether a cart with a scale exists in the store visited (the target store). When a cart with a scale exists in the target store, the shopping app displays a menu screen (e.g., the menu screen 620 in Fig. 6(B)) where the connection with the cart with a scale can be selected. On the other hand, when a cart with a scale does not exist in the target store, the shopping app may display a menu screen (not shown) where the connection with the cart with a scale cannot be selected.

[0277] Alternatively, after the startup operation, the shopping app determines whether the user is within the entry range of the target store (as described in (6) above). When the user is within the entry range of the target store and a scale-equipped cart exists in the target store, a menu screen that allows selection of connection to the scale-equipped cart is displayed. When the user is within the entry range of the target store but no scale-equipped cart exists in the target store, a menu screen that does not allow selection of connection to the scale-equipped cart may be displayed. When the shopping app displays a menu screen that does not allow selection of connection to the scale-equipped cart, subsequent control related to connection to the scale-equipped cart (such as Bluetooth control) is not performed.

[0278] (17) Detection of movement of the cart device 70 by utilization of an acceleration sensor or the like. Regarding the second embodiment, since the mobile terminal 60 is equipped with an acceleration sensor and a gyro sensor, it is possible to determine whether the mobile terminal 60 itself or the cart device 70 with the own terminal set thereon is in motion or at rest. Note that, instead of or in addition to the mobile terminal 60, the cart device 70 itself may be equipped with an acceleration sensor and a gyro sensor to determine whether it is in motion or at rest. That is, the mobile terminal 60 may acquire the sensing results of the acceleration sensor and the gyro sensor and determine whether the cart device 70 is in motion or at rest.

[0279] By determining whether the cart device 70 is in motion (moving state) or at rest (stationary state), it is possible to suppress misjudgments that, for example, wrongly judge something as being incorrect when it is actually not, and improve the accuracy (validity, reliability) of the judgment. For example, when in fact no product has been put in, if there is a sudden acceleration or deceleration (including the start and stop of movement), or if the vibration becomes large due to reasons such as a bad caster state, the measured value of the weighing unit 303 may change, and there is a possibility of being wrongly judged that a product has been put into the cart device 70. That is, there is a possibility of being wrongly judged that it is an input of an un-scanned product into the cart device 70. In contrast, by using the above sensing result, the cart device 70 can be judged to be in motion, that is, it can be judged that the change in the measured value is due to the vibration during movement, and the change in the measured value can be ignored (hereinafter referred to as "ignoring control").

[0280] By ignoring control, in order not to become a breeding ground for fraud, the measured value before the start of movement may be memorized, compared with the measured value after the end of movement (at rest), and the presence or absence of illegal input during movement (from the start of movement to the end of movement) may be monitored. Such monitoring may be performed by the mobile terminal 60 or by the cart device 70. When the measured value increases during movement, the mobile terminal 60 may display a message such as, for example, "Was the product registered correctly? If registration was not successful, please read the barcode again." Also, when the measured value increases during movement and there is no product registration during movement, the mobile terminal 60 may display a message such as, for example, "Registration was not successful, so please read the barcode again.", or a store clerk call flag (which may be a dedicated store clerk call flag indicating that an un-scanned product has not been input) may be set in the transaction information of the transaction. Further, the mobile terminal 60 may prompt product registration after coming to a stop during movement. For example, the mobile terminal 60 may display a message such as, for example, "Moving. Please register the product after stopping the cart." during movement.

[0281] (18) Ignoring control by accepting a declaration of basket sorting. Although related to the above (17), the measured value may also change when the contents of the shopping basket are sorted (such as changing the position of each item in the shopping basket) or when the contents of the shopping basket are checked (such as checking whether an item has been purchased). In order not to be judged as an input to the cart device 70 for scanned goods just by sorting the contents of the shopping basket, buttons (a basket sorting start button and a basket sorting end button) for receiving a declaration of basket sorting are arranged on the screen of the mobile terminal 60 (for example, the registration screen), and during the declaration of basket sorting (between the operation of the basket sorting start button and the operation of the basket sorting end button), the customer may be allowed to sort the basket etc. The mobile terminal 60 executes ignore control during the declaration of basket sorting. Also, similar to the case of movement, the measured value before the start of basket sorting (when the basket sorting start button is operated) is stored, compared with the measured value after the end of basket sorting (when the basket sorting end button is operated), and the presence or absence of illegal input during the declaration of basket sorting may be monitored.

[0282] (19) In-air settlement. When registering goods using the cart device 70, settlement without using the settlement device 50 (for example, so-called in-air settlement using a credit card etc.) may be permitted. Also, when registering goods without using the cart device 70, only settlement using the settlement device 50 may be recognized. Depending on the number or ratio of the specific goods in the above (9), the unconnected time, and whether registration was started while unconnected, it may be determined (decided) whether to permit settlement without using the settlement device 50.

[0283] Note that even when the mobile terminal 60 and the cart device 70 are not used, operations of the shopping app icon 611 are received from the initial screen 610 (Fig. 6(A)). Then, when the mobile terminal 60 receives an operation of the icon 611, it displays the menu screen 620 (Fig. 6(B)). Since it is not connected to the cart device 70, the cart image 644 is not displayed on the menu screen 620 (and the same applies to the registration screen 650 etc. that transitions from the menu screen 620) displayed by the operation of the icon 611.

[0284] (20) Use of the cart device 70 for full self-checkout. The cart device 70 may be used as a scale for a so-called full-self checkout (e.g., a registration and settlement device, a registration and settlement device in full-self mode). The cart device 70 is connected to the full-self checkout and weighs the products registered at the full-self checkout. Note that in the mode where the cart device 70 is used as a so-called full-self checkout, the mobile terminal 60 is not used, that is, the cart device 70 and the mobile terminal 60 are not connected.

[0285] (21) Example where the cart device 70 includes a display unit. The cart device 70 does not necessarily need to include the weighing unit 303. That is, the cart device 70 may be a cart without a scale as described in (15) above. Further, the cart device 70 may include a display unit instead of or in addition to the weighing unit 303. Information regarding products and the like registered by the connected mobile terminal 60 (e.g., additional information of the registered products, recommended product information related to the registered products, etc.) or information corresponding to the position of the connected mobile terminal 60 (recommended product information in the product display area) may be displayed on the display unit of the cart device 70. That is, the details of the scanned and registered products may be displayed (notified) on the mobile terminal 60 (shopping app), and supplementary information and advertisement information may be displayed on the display mounted on the cart device 70. Further, information indicating that the cart device 70 is connected to the mobile terminal 60 (e.g., an image, etc.) may be displayed on the display unit of the cart device 70. Further, the display unit of the cart device 70 may notify various announcements.

[0286] (22) Example where the cart device 70 is connected to the LAN 19. The cart device 70 may be connectable to a network (e.g., LAN 19) by, for example, a wireless LAN.

[0287] (23) Rental terminal. In the above embodiment, the mobile terminal 60 was described as the customer's possession, but it is not limited to this. The mobile terminal 60 may be a terminal prepared by the store (rental terminal). The rental terminal is prepared as a dedicated terminal in a state where only the shopping app can be executed. In a configuration where it is connected to the cart device 70 using the connection cord 78, the rental terminal displays the menu screen 620 from the beginning without accepting the operation of the shopping app icon 611 (FIG. 6(A)).

[0288] Further, the rental terminal may not be a separate body from the cart device 70 but may be a part of the cart device 70. In other words, the cart device 70 may include the mobile terminal 60 (rental terminal). Regardless of whether the mobile terminal 60 is a separate body or a part of the cart device 70, the operation after connection (for example, monitoring for fraud, etc.) is the same. That is, although the part related to BT control (BT connection, BT communication) is different, other parts are common regardless of whether the mobile terminal 60 is a separate body or a part of the cart device 70.

[0289] (24) Communication without encryption. Although the state of establishing communication between the mobile terminal 60 using Bluetooth and the cart device 70 was expressed as pairing, it is not limited to encrypted communication and may be communication without encryption. Also, it may be so-called bonding in which a key exchange protocol for encryption is executed and the key is saved for communication. That is, pairing as used in the present application refers to a state where Bluetooth communication is established, and its detailed mode is not questioned.

[0290] (25) Example where the functional parts of each device are provided in other devices. Some or all of the functions (input / output, storage, processing (including judgment)) in each device (for example, the transaction status management device 40, the settlement device 50, the mobile terminal 60, etc.) may be realized in another device different from the device described as the execution entity of the function. For example, each device may function as a so-called thin client specialized in an input / output interface or the like. As an example, a program for controlling the operation of each device may be executed by a cloud server (which may be the same as the cloud server 20 or another cloud server), and each device may display a screen or the like by a browsing function. As an example, the cloud server 20 may control the display of the screen (Figure 6, etc.) and the operation (Figure 7, etc.) of the mobile terminal 60. That is, a program (shopping app) for controlling the operation related to the service of the mobile terminal 60 may operate on the CPU of the mobile terminal 60 or on the CPU of the cloud server 20. In other words, the shopping app may be a web application used using a browser.

[0291] Here, as an example of an information processing device, the cloud server 20 will be described. The cloud server 20 includes a reading result acquisition unit 501, a registration unit 502, a detection result acquisition unit 503, an operation detection unit 504, a notification unit 505, a mode setting unit 506, and a cancellation unit 507. Each unit is realized by a CPU included in the cloud server 20. That is, the functions of each unit are realized by the CPU executing a predetermined program (announcement notification program) stored in the memory.

[0292] The reading result acquisition unit 501 acquires (receives) the reading result of the product code from the mobile terminal 60 (camera 207). The registration unit 502 registers the product based on the reading result acquired by the reading result acquisition unit 501. The detection result acquisition unit 503 acquires the detection results (input detection result and takeout detection result) based on the weighing result of the weighing unit 303 (cart device 70). The determination as to whether it is an input detection result or a takeout detection result is made, for example, by a determination unit (not shown) provided in the cloud server 20. For this reason, the detection result acquisition unit 503 acquires the detection result from the determination unit. The operation detection unit 504 detects, as an unregistered input operation, the case where there is no product registration by the registration unit 502 when the input detection result is acquired by the detection result acquisition unit 503. The notification unit 505 notifies the mobile terminal 60 of an illegal input announcement or a product takeout announcement. The mobile terminal 60 outputs a display or voice based on the notification from the notification unit 505.

[0293] In addition, the cloud server 20 includes an acquisition unit 1301, a detection unit 1302, a movement detection unit 1304, and a notification unit 505. Further, instead of the reception unit 1303, the cloud server 20 includes a reception result acquisition unit. Each unit is realized by a CPU provided in the cloud server 20. That is, the functions of each unit are realized by the CPU executing a predetermined program (announcement notification program) stored in the memory.

[0294] The acquisition unit 1301 acquires product information of the product to be registered from the mobile terminal 60. The detection unit 1302 detects that an article has been added to the cart device 70 when the weighing result constantly acquired from the weighing unit 303 increases. Further, the detection is also performed based on the imaging result acquired from the mobile terminal 60. Specifically, the detection unit 1302 detects that an article has been added to the cart device 70 from the analysis result of the image captured by the mobile terminal 60 (camera 207).

[0295] The notification unit 505 notifies the cart device 70 of an improper input announcement indicating that a product has been improperly inserted (inserted without being scanned) based on the detection result of the detection unit 1302. The mobile terminal 60 outputs a display and sound based on the notification from the notification unit 505. The state detection unit 1304 acquires the detection results of the acceleration sensor and gyro sensor provided in the mobile terminal 60, and detects the movement state of the cart device 70 based on the detection results. The reception result acquisition unit acquires the reception result of the start of shopping received by the mobile terminal 60 (reception unit 1303). Even if an improper input is detected within a predetermined period after the reception result acquisition unit has acquired the reception result of the start of shopping (after the start of the transaction), the notification unit 505 does not notify an improper input announcement.

[0296] (26) An example in which the cart device 70 makes determinations such as various announcements. In the above embodiment, an example in which determinations of various announcements are made by the mobile terminal 60 has been described, but the present invention is not limited to this. Determinations and detections of operations of various announcements may be made by the cart device 70.

[0297] (Detection of an operation of inserting without scanning by the cart device 70) The cart device 70 may detect an operation of inserting without scanning. In this case, each time the mobile terminal 60 registers a product, the mobile terminal 60 transmits a registration notification indicating that the product has been registered to the cart device 70. When the cart device 70 detects an increase in weight and determines that a product or the like has been inserted, if it has not received a registration notification from the mobile terminal 60 before the detection of the increase in weight (for example, within a predetermined time retroactively from the detection time point), the cart device 70 detects an operation of inserting without scanning.

[0298] When the cart device 70 detects an operation of inserting without scanning, the cart device 70 transmits the detection result to the mobile terminal 60 (notification unit 505). When the notification unit 505 receives from the cart device 70 that an operation of inserting without scanning has been detected, the notification unit 505 notifies an improper input announcement.

[0299] (Determination of a product removal announcement by the cart device 70) The cart device 70 may determine whether an item such as a product has been taken out. In this case, when the mobile terminal 60 receives a cancellation of a product, it transmits a cancellation notice indicating that the product has been cancelled to the cart device 70. When the cart device 70 detects a weight reduction and determines that an item has been taken out, if it has not received a cancellation notice from the mobile terminal 60 before the detection of the weight reduction (for example, within a predetermined time retroactively from the detection time), it determines that it is a product removal announcement.

[0300] When the cart device 70 determines that it is a product removal announcement, it transmits an announcement notice to the mobile terminal 60 (notification unit 505). When the notification unit 505 receives the announcement notice from the cart device 70, it notifies the product removal announcement.

[0301] (Determination of forgetting to take out by the cart device 70) The cart device 70 may determine that a cancelled item has not been taken out (forgetting to take out announcement). In this case, each time the mobile terminal 60 cancels a product, it transmits a cancellation notice indicating that the product has been cancelled to the cart device 70. When the cart device 70 receives the cancellation notice from the mobile terminal 60, if it does not determine that the item such as the product has not been taken out (if it does not detect a weight reduction) after the reception (for example, within a predetermined time from the reception time), it determines that it is a forgetting to take out announcement.

[0302] When the cart device 70 determines that it is a forgetting to take out announcement, it transmits a notice indicating that to the mobile terminal 60 (notification unit 505). When the notification unit 505 receives the notice from the cart device 70, it notifies the forgetting to take out announcement.

[0303] (Determination of forgetting to cancel by the cart device 70) The cart device 70 may determine that the canceled item has not been taken out (cancellation omission announcement). In this case, when the mobile terminal 60 receives the cancellation of the item, it transmits a cancellation notice indicating that the item has been canceled to the cart device 70. When the cart device 70 detects a weight reduction and determines that an item has been taken out, if it does not receive a cancellation notice from the mobile terminal 60 within a predetermined period (for example, within 10 seconds) after the detection of the weight reduction, it determines that it is a cancellation omission announcement.

[0304] When the cart device 70 determines that it is a cancellation omission announcement, it transmits a notice indicating that fact to the mobile terminal 60 (notification unit 505). When the notification unit 505 receives the notice from the cart device 70, it notifies the cancellation omission announcement.

[0305] Also, the notification unit 505 may be provided in the cart device 70. That is, the cart device 70 may notify various announcements. Also, each functional unit shown in FIG. 5 and each functional unit shown in FIG. 13 are not limited to being provided in the mobile terminal 60, and may be provided in the cart device 70. In this case, the cart device 70 may perform various controls, such as control related to the notification of announcements.

[0306] (27) Example of detecting the input and output of an item from a captured image. In the above embodiment, the input detection result and the output detection result have been mainly described as being detected based on the measurement result of the weighing unit 303. However, instead of or in addition to such a configuration, it is also possible to be detected based on the imaging result of the camera 207. The mobile terminal 60 (determination unit) can determine that it is an input detection result when the items in the shopping basket increase from the analysis result of the image captured by the camera 207, and determine that it is an output detection result when the items in the shopping basket decrease. For example, when an input detection result is obtained from the imaging result without registering the item, the motion detection unit 504 detects an un-scanned input operation.

[0307] In addition, the operation detection unit 504 can also detect an un-scanned input operation based on both the measurement result of the weighing unit 303 and the imaging result of the camera 207. In this case, the notification unit 505 notifies an illegal input announcement based on the measurement result of the weighing unit 303 (hereinafter referred to as the "first illegal input announcement"). For example, the first illegal input announcement is a notification such as "scale basket removed" or "measurement failure". Further, the notification unit 505 notifies an illegal input announcement based on the imaging result of the camera 207 (hereinafter referred to as the "second illegal input announcement"). The second illegal input announcement is, for example, a notification such as "image basket removed" or "imaging failure".

[0308] There may be a case where an un-scanned input operation is detected simultaneously. Specifically, there may be a case where an un-scanned input operation based on the measurement result of the weighing unit 303 and an un-scanned input operation based on the imaging result of the camera 207 are detected simultaneously. In this case, if the first illegal input announcement and the second illegal input announcement are notified, it will be troublesome for the customer. Therefore, in this case, the notification unit 505 preferentially notifies either the first illegal input announcement or the second illegal input announcement. For example, the notification unit 505 preferentially notifies the first illegal input announcement. That is, when an un-scanned input operation is detected based on the measurement result of the weighing unit 303 and an un-scanned input operation is detected based on the imaging result of the camera 207, the notification unit 505 preferentially notifies the first illegal input announcement. Thereby, it is possible to prevent the same announcement from being made repeatedly, that is, to suppress excessive notifications.

[0309] (28) Example where the mobile terminal 60 and the cart device 70 do not communicate directly. In the above-described embodiment, an example in which the mobile terminal 60 and the cart device 70 communicate directly has been described. However, instead of or in addition to such a configuration, they do not necessarily need to communicate directly. For example, the cloud server 20 may manage the paired mobile terminal 60 and cart device 70, the mobile terminal 60 may be connected to the cloud server 20, and the cart device 70 may be connected to the cloud server 20. The transmission and reception of information between the mobile terminal 60 and the cart device 70 may be performed via the cloud server 20. For example, the mobile terminal 60 may receive the weighing result from the cart device 70 via the cloud server 20.

[0310] (29) Another example of the cart device. In the above-described embodiment, an example in which the cart device 70 weighs the merchandise placed on one placement unit 71 (FIG. 3) has been described. However, instead of or in addition to such a configuration, it is also possible to weigh the merchandise placed on a plurality of placement units.

[0311] FIG. 12B is an explanatory diagram showing another example of the cart device. As shown in FIG. 12B(A), the cart device 1200 includes an upper placement unit 71a, a lower placement unit 71b, a weighing device 72, and a holder unit 74. The upper placement unit 71a and the lower placement unit 71b can each place a shopping basket. The weighing device 72 weighs the articles (shopping basket and merchandise) placed on the upper placement unit 71a and the lower placement unit 71b.

[0312] In particular, as shown in FIG. 12B(B), the cart device 1200 includes a placement unit 1210. The placement unit 1210 integrally forms an upper placement portion 71a and a lower placement portion 71b. Further, the placement unit 1210 is configured to contact only the weighing device 72. Therefore, the weighing device 72 can detect a change in weight occurring in the upper placement portion 71a and the lower placement portion 71b and output it as a weighing result. However, since the upper placement portion 71a and the lower placement portion 71b are integrally formed by the placement unit 1210, when the weighing device 72 detects a change in weight, it cannot specify whether the change in weight is in the upper placement portion 71a or the lower placement portion 71b.

[0313] That is, when there is a change in the weight ratio, it is impossible to determine which of the upper and lower placement portions 71 (71a, 71b) has a change in weight. For this reason, the cart device 1200 cannot manage the weights of the placement portions 71 (71a, 71b) separately.

[0314] However, by using the image of the camera 207 provided in the mobile terminal 60, it is possible to determine which of the upper and lower placement portions 71 (71a, 71b) has a change in weight. Specifically, it is possible to perform this determination by using two elements: a change in weight and a change in the image.

[0315] For example, the usage status (such as illegal input, product removal, basket arrangement, etc.) of the upper placement portion 71a can be obtained from the image of the camera 207. Therefore, if the condition that both a change in weight and a change in the image are detected is satisfied, it can be determined that there is an incoming and outgoing of products in the upper placement portion 71a.

[0316] On the other hand, the lower placement portion 71b is below the upper placement portion 71a. Therefore, the usage status of the lower placement portion 71b is not imaged by the camera 207. Thus, if the condition that no change in the image is detected when a change in weight is detected is satisfied, it can be determined that there is an incoming and outgoing of products in the lower placement portion 71b.

[0317] By using such control, it becomes possible to distinguish and manage the products in the shopping basket on the upper placement part 71a and the products in the shopping basket on the lower placement part 71b. Specifically, the mobile terminal 60 can display and store the products in the shopping basket on the upper placement part 71a and the products in the shopping basket on the lower placement part 71b separately in the registration details.

[0318] For example, the mobile terminal 60 displays the products in the shopping basket on the upper placement part 71a and the products in the shopping basket on the lower placement part 71b separately. Separately displaying means, for example, attaching different characters (the character "upper" for the products on the upper placement part 71a and the character "lower" for the products on the lower placement part 71b), using different display colors, or displaying on different pages for the products on the upper placement part 71a and the products on the lower placement part 71b.

[0319] Thereby, when the customer checks for omissions in their shopping, they can easily identify from the registration details displayed on the mobile terminal 60 whether the products were placed in the shopping basket on the upper or lower part. Also, it is possible to easily check whether the target product is in the identified shopping basket.

[0320] Note that distinguishing and displaying the upper or lower part is also effective when calling the clerk at the time of settlement. For example, it is possible to determine whether the product for which the clerk is called is a product on the upper placement part 71a or a product on the lower placement part 71b. Therefore, it is possible to set the clerk call flag separately by type into a flag for the upper placement part 71a and a flag for the lower placement part 71b. The transaction status management device 40 and the settlement device 50 perform a clerk call according to the type of the flag. Thereby, when the clerk arrives, the clerk can easily identify whether the product to be confirmed is on the upper placement part 71a or the lower placement part 71b and perform the confirmation work efficiently. Note that distinguishing the upper or lower part is not limited to the display mode, and for example, instead of or in addition to the display mode, it may include the lighting mode of the signpost or the voice mode.

[0321] In this way, in the cart device 1200, it is possible to grasp the transaction state even when the lower placement part 71b is used. Therefore, compared with the case where only the upper placement part 71a is weighed (cart device 70), it is possible to guide the customer to a more detailed operation method and the contents of the placement part 71 (71a, 71b).

[0322] (30) An example of the quantity change screen. Next, an example of the quantity change screen displayed on the mobile terminal 60 will be described. The quantity change screen is a screen for accepting changes in the quantity of registered products. The quantity change screen is, for example, a screen in which, in the registration details screen (for example, the registration screen 650 in FIG. 6(E)), when a column with the product name in the registration information display area 642 is touched, a pop-up for accepting quantity changes is displayed. The pop-up includes operation elements (+ button and - button) for accepting increases and decreases in quantity and an operation element for accepting deletion of products. Further, when displaying the pop-up, other displays (for example, the imaging image display area 641 and the registration information display area 642, etc. in the registration screen 650) are displayed in gray scale so that the customer's attention is directed to the pop-up.

[0323] By displaying such a pop-up, the customer can easily change the quantity or delete the registered products.

[0324] Hereinafter, a summary of the embodiments will be described. [Title of the Invention] Program, System, Mobile Communication Terminal, and Information Processing Apparatus [Technical Field] The present invention relates to a program, a system, a mobile communication terminal, and an information processing apparatus. [Background Art] Conventionally, various techniques for wirelessly connecting a plurality of communication devices have been known. For example, there is known an information communication terminal that reads the MAC address of a device from an NFC tag attached to the device and transmits data with the IP address corresponding to the read MAC address as the destination (see, for example, Patent Document 1). In recent years, a system has also been known in which a customer registers products by himself / herself in a product display area using a shopping cart. [Prior Art Documents] [Patent Documents] [Patent Document 1] Japanese Patent No. 6375732 [Summary of the Invention] [Problems to be Solved by the Invention] However, in the prior art, there has been a case where announcements regarding the loading and unloading of products into / from a shopping cart cannot be appropriately notified. As a result, not only is there a risk that customers cannot shop comfortably, but there is also a risk that the work efficiency of store clerks decreases when they are called. For this reason, there has been a problem that the system cannot be efficiently operated in the prior art. The present invention has been made in view of such circumstances, and an object thereof is to provide a technology that can efficiently operate a system.

[0325] [Means for Solving the Problems] (1) In order to solve the above-described problems, a program according to an aspect of the present invention is a program that causes a computer to function as a system, and causes the computer to function as an acquisition unit that acquires product information of a product to be registered, a detection unit that detects that an article has been added to a cart, and a notification unit that notifies a predetermined announcement based on an acquisition state of the acquisition unit and a detection result of the detection unit, and the notification unit does not notify the announcement when a predetermined condition is satisfied. According to the above configuration, even if the shopping cart is placed on the cart device 70 after the mobile terminal 60 and the cart device 70 are connected and shopping is started, it is possible not to notify of an illegal input announcement. Therefore, it is possible to suppress anything that would impede comfortable shopping for the customer. Also, since it is possible not to call the store clerk at the time of settlement, it is possible to suppress a decrease in the work efficiency of the store clerk. For this reason, the sales system 1 can be operated efficiently.

[0326] (2) In the configuration of (1) above, the computer may be made to function as reception means for receiving the start of shopping, and the notification means may be configured not to notify the announcement within a predetermined period after the reception means receives the start. According to the above configuration, even if a shopping cart is placed on the cart device 70 within a predetermined period after receiving the start of shopping, it is possible not to notify of an illegal input announcement.

[0327] (3) In the configuration of (1) or (2) above, the computer may be made to function as reception means for receiving the start of shopping, and the notification means may be configured not to notify the announcement when the detection means first detects an addition of an article after the reception means receives the start. According to the above configuration, even if the first article is detected on the cart device 70 after receiving the start of shopping, it is possible not to notify of an illegal input announcement.

[0328] (4) In the configuration of (1) or (2) above, the detection means detects an increase in the weight in the cart, and the notification means may be configured not to notify the announcement when the weight detected by the detection means indicates an increase in a preset weight. According to the above configuration, even if a weight equivalent to that of a shopping cart is detected on the cart device 70 within a predetermined period after receiving the start of shopping, it is possible not to notify of an illegal input announcement.

[0329] (5) In the configuration of (1) or (2) above, the detection means may detect that an article has been added to the cart based on a variable fraud determination threshold value according to the total weight in the cart. According to the above configuration, an article can be detected with optimal accuracy according to the total weight. Therefore, it is possible to optimally detect fraud injection.

[0330] (6) In the configuration of (1) or (2) above, the computer may be made to function as a state detection means for detecting the moving state of the cart, and the detection means may detect that an article has been added to the cart based on a variable fraud determination threshold value according to the moving state detected by the state detection means. According to the above configuration, an article can be detected with optimal accuracy according to the moving state. Therefore, it is possible to suppress misdetection of fraud injection when the cart device 70 accelerates or decelerates.

[0331] (7) In order to solve the above-described problems, a system according to another aspect of the present invention includes an acquisition means for acquiring product information of a product to be registered, a detection means for detecting that an article has been added to the cart, a notification means for notifying a predetermined announcement based on an acquisition state of the acquisition means and a detection result of the detection means, and the notification means does not notify the announcement when a predetermined condition is satisfied. According to the above configuration, even if the shopping basket is placed on the cart device 70 after the portable terminal 60 and the cart device 70 are connected and shopping is started, it is possible not to notify a fraud injection announcement. Therefore, it is possible to suppress hindering comfortable shopping for customers. In addition, since it is possible not to make a clerk call at the time of settlement, it is possible to suppress a decrease in the work efficiency of the clerk. For this reason, the sales system 1 can be efficiently operated.

[0332] (8) To solve the above-described problems, a program according to another aspect of the present invention causes a computer as a mobile communication terminal to function as an acquisition unit that acquires product information of a product to be registered, a detection unit that detects that an article has been added to a cart, and a notification unit that notifies a predetermined announcement based on an acquisition state of the acquisition unit and a detection result of the detection unit, and the notification unit does not notify the announcement when a predetermined condition is satisfied. A program characterized by that. According to the above configuration, even if the shopping cart is placed on the cart device 70 after the mobile terminal 60 and the cart device 70 are connected and shopping is started, it is possible not to notify an illegal input announcement. Therefore, it is possible to suppress anything that hinders comfortable shopping for the customer. In addition, since it is possible not to make a clerk call at the time of settlement, it is possible to suppress a decrease in the work efficiency of the clerk. For this reason, the sales system 1 can be efficiently operated.

[0333] (9) To solve the above-described problems, a mobile communication terminal according to another aspect of the present invention includes an acquisition unit that acquires product information of a product to be registered, a detection unit that detects that an article has been added to a cart, and a notification unit that notifies a predetermined announcement based on an acquisition state of the acquisition unit and a detection result of the detection unit, and the notification unit does not notify the announcement when a predetermined condition is satisfied. A mobile communication terminal characterized by that. According to the above configuration, even if the shopping cart is placed on the cart device 70 after the mobile terminal 60 and the cart device 70 are connected and shopping is started, it is possible not to notify an illegal input announcement. Therefore, it is possible to suppress anything that hinders comfortable shopping for the customer. In addition, since it is possible not to make a clerk call at the time of settlement, it is possible to suppress a decrease in the work efficiency of the clerk. For this reason, the sales system 1 can be efficiently operated.

[0334] (10) To solve the above-described problems, an information processing apparatus according to another aspect of the present invention is an information processing apparatus that connects to a mobile communication terminal that can be used for registering products, and includes an acquisition unit that acquires product information of a product to be registered, a detection unit that detects that an item has been added to a cart, and a notification unit that notifies a predetermined announcement based on an acquisition state of the acquisition unit and a detection result of the detection unit. The notification unit does not notify the announcement when a predetermined condition is satisfied. The information processing apparatus is characterized by this. According to the above configuration, even if the shopping cart is placed on the cart device 70 after the mobile terminal 60 and the cart device 70 are connected and shopping is started, it is possible not to notify an unauthorized input announcement. Therefore, it is possible to suppress anything that hinders comfortable shopping for customers. In addition, since it is possible not to call a store clerk at the time of settlement, it is possible to suppress a decrease in the work efficiency of the store clerk. For this reason, the sales system 1 can be efficiently operated.

[0335] (11) To solve the above-described problems, a program according to another aspect of the present invention is a program that causes a computer to function as an information processing apparatus that connects to a mobile communication terminal that can be used for registering products, and causes the computer to function as an acquisition unit that acquires product information of a product to be registered, a detection unit that detects that an item has been added to a cart, and a notification unit that notifies a predetermined announcement based on an acquisition state of the acquisition unit and a detection result of the detection unit. The notification unit does not notify the announcement when a predetermined condition is satisfied. The program is characterized by this. According to the above configuration, even if the shopping cart is placed on the cart device 70 after the mobile terminal 60 and the cart device 70 are connected and shopping is started, it is possible not to notify an unauthorized input announcement. Therefore, it is possible to suppress anything that hinders comfortable shopping for customers. In addition, since it is possible not to call a store clerk at the time of settlement, it is possible to suppress a decrease in the work efficiency of the store clerk. For this reason, the sales system 1 can be efficiently operated.

[0336] In addition, all or part of each function (input / output, storage, processing (including judgment)) in the sales system 1 (portable terminal 60, cart device 70) described above may be realized in another device different from the device described as the execution subject of the function.

[0337] Specifically, in the above description, the configuration in which the portable terminal 60 includes each functional unit shown in FIG. 5 has been described. All or part of each functional unit may be provided in another computer device. For example, all or part of each functional unit may be provided in the store controller 30, may be provided in the cloud server 20, or may be provided in a computer device other than these. In addition, the computer device in which each functional unit is provided is not limited to a plurality of units, and may be one unit. For example, one computer device may include all of the functional units.

[0338] Specifically, for example, instead of the portable terminal 60, on the premise that the store controller 30 or the cloud server 20 notifies an unauthorized input announcement based on the acquisition status of the product information of the product to be registered and the detection result of the addition of an article on the cart device 70, it may be configured not to notify an unauthorized input announcement when a predetermined condition is satisfied.

[0339] In connection with the above, the portable terminal 60 may function as a so-called sink client specialized in the input / output interface part for various displays and the like. That is, the portable terminal 60 may receive various inputs (operations of the operator and detections of the device), transmit the input information (operation information, detection information, etc.) to the cloud server 20, receive the processing results of the cloud server 20 based on the input information (update screen information, control information of the device, etc.), and perform various outputs (display on the display unit, control of the device).

[0340] Note that a program for realizing the above-described sales system 1 (portable terminal 60 and cart device 70) may be recorded on a computer-readable storage medium, and the program may be read into a computer system and executed. Here, the "computer system" is assumed to include hardware such as an OS and peripheral devices. Further, the "computer-readable storage medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built in a computer system. Furthermore, the "computer-readable storage medium" also includes a volatile memory (RAM) inside a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line, and holds the program for a certain period of time. Also, the above program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the "transmission medium" for transmitting the program refers to a medium having a function of transmitting information such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. Also, the above program may be for realizing a part of the above-described functions. Furthermore, it may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in a computer system.

Explanation of Signs

[0341] 1…Sales system, 10…Headquarters server, 20…Cloud server, 30…Store controller, 40…Transaction status management device, 50…Settlement device, 60…Portable terminal, 501…Reading result acquisition unit, 502…Registration unit, 503…Detection result acquisition unit, 504…Motion detection unit, 505…Notification unit, 506…Mode setting unit, 507…Cancellation unit, 1301…Acquisition unit, 1302…Detection unit, 1303…Reception unit, 1304…Status detection unit

Claims

1. A program that causes a computer to function as a system, wherein the computer is caused to function as: an acquisition means for acquiring product information of a product to be registered; a detection means for detecting that an article has been added to the cart; a notification means for notifying a predetermined announcement based on the acquisition state of the acquisition means and the detection result of the detection means; and wherein the notification means does not notify the announcement when a predetermined condition is satisfied. A program characterized by the above.

2. The program according to claim 1, wherein the computer is caused to function as a reception means for receiving the start of shopping, and the notification means does not notify the announcement within a predetermined period after the reception means receives the start.

3. The program according to claim 1 or 2, wherein the computer is caused to function as a reception means for receiving the start of shopping, and the notification means does not notify the announcement when the addition of an article is first detected by the detection means after the reception means receives the start.

4. The program according to claim 1 or 2, wherein the detection means detects an increase in the weight in the cart, and the notification means does not notify the announcement when the weight detected by the detection means indicates an increase in a preset weight.

5. The program according to claim 1 or 2, wherein the detection means detects that an article has been added to the cart based on a variable fraud determination threshold value according to the total weight in the cart.

6. The program according to claim 1 or 2, wherein the computer is caused to function as a state detection means for detecting the movement state of the cart, and the detection means detects that an article has been added to the cart based on a variable fraud determination threshold value according to the movement state detected by the state detection means.

7. A system comprising: an acquisition means for acquiring product information of a product to be registered; a detection means for detecting that an article has been added to the cart; and a notification means for notifying a predetermined announcement based on the acquisition state of the acquisition means and the detection result of the detection means, wherein the notification means does not notify the predetermined announcement when a predetermined condition is satisfied.

8. A computer as a mobile communication terminal, the computer having: an acquisition means for acquiring product information of a product to be registered; a detection means for detecting that an article has been added to the cart; ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ Notification means for notifying a predetermined announcement based on the acquisition state of the acquisition means and the detection result of the detection means. Function as. When the notification means satisfies a predetermined condition, the notification means does not notify the announcement. A program characterized by this.

9. Acquisition means for acquiring product information of a product to be registered. Detection means for detecting that an article has been added to the cart. Notification means for notifying a predetermined announcement based on the acquisition state of the acquisition means and the detection result of the detection means. Comprising. When the notification means satisfies a predetermined condition, the notification means does not notify the announcement. A mobile communication terminal characterized by this.

10. An information processing apparatus connected to a mobile communication terminal that can be used for registering products, Acquisition means for acquiring product information of a product to be registered. Detection means for detecting that an article has been added to the cart. Notification means for notifying a predetermined announcement based on the acquisition state of the acquisition means and the detection result of the detection means. Comprising. When the notification means satisfies a predetermined condition, the notification means does not notify the announcement. An information processing apparatus characterized by this.

11. A program that causes a computer to function as an information processing apparatus connected to a mobile communication terminal that can be used for registering products, The computer, Acquisition means for acquiring product information of a product to be registered, Detection means for detecting that an article has been added to the cart, Notification means for notifying a predetermined announcement based on the acquisition state of the acquisition means and the detection result of the detection means. Function as. When the notification means satisfies a predetermined condition, the notification means does not notify the announcement. A program characterized by this.

Images