Commodity registration processing device and information processing device

Abstract

To provide a commodity registration processing device and an information processing device that can promote usage of a transaction management system by which a customer himself / herself performs commodity registration and accounting processing.SOLUTION: The commodity registration processing device includes input means, reading means, and entertainment operation execution means. The input means accepts input of a picked-up image related to a commodity. The reading means reads a commodity code of the commodity based on the picked-up image. A type related to an operation of exercising entertainment in correspondence to the commodity code is defined, and the entertainment operation execution means executes the operation of exercising entertainment in accordance with the type corresponding to the commodity code read by the reading means.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a product registration processing device and an information processing device. [Background technology]

[0002] In recent years, supermarkets and other stores have adopted transaction management systems that allow customers to pick up products from shelves and register them on the spot. One such transaction management system has been proposed, for example, using a shopping cart equipped with a tablet terminal and a scanner (see, for example, Patent Document 1).

[0003] A customer shopping in a store uses a scanner to scan a code symbol such as a barcode (hereinafter referred to as a "product barcode") attached to the product they wish to purchase. The product is registered based on the product code read by the scanner, and the registered product information (product name, price, etc.) is stored on a tablet device or a store server. The product information is then transferred to a cash register that processes the transaction when the customer pays. The customer makes the payment using the cash register that they operate themselves.

[0004] In addition, transaction management systems have been adopted that allow customers to make the above-mentioned purchases using their own mobile devices, such as smartphones, instead of the tablet devices and scanners provided by the store. In these transaction management systems, a shopping application program is installed on the customer's smartphone. The smartphone's camera then captures an image of the product barcode and reads the product code. The customer then uses the cash register to process the payment for the registered product themselves.

[0005] In recent years, the use of transaction management systems such as those mentioned above to register products and process transactions by customers themselves has become more common, but many customers are hesitant to use these systems because they place a greater burden on customers than traditional systems. For this reason, there is a need for improved UX (User Experience) to encourage customer adoption. Summary of the Invention [Problem to be solved by the invention]

[0006] The problem to be solved by the present invention is to provide a product registration processing device and an information processing device that can promote the use of a transaction management system in which customers themselves register products and perform accounting processes. [Means for solving the problem]

[0007] The product registration processing device according to the embodiment includes an input unit, a reading unit, and an entertainment action execution unit. The input unit receives an input of a captured image of a product. The reading unit reads a product code of the product based on the captured image. The entertainment action execution unit defines types of entertainment actions corresponding to the product codes, and executes the entertainment action corresponding to the type of entertainment action corresponding to the product code read by the reading unit. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an outline of a transaction management system according to the first embodiment. [Figure 2] FIG. 2 is a diagram showing an example of a checkout area of a store. [Figure 3] FIG. 3 is a block diagram showing an example of a main hardware configuration of the server device. [Figure 4] FIG. 4 is a diagram illustrating an example of the data configuration of the product master. [Figure 5] FIG. 5 is a diagram illustrating an example of the data configuration of the terminal management table. [Figure 6]FIG. 6 is a diagram illustrating an example of a data configuration of the transaction information management table. [Figure 7] FIG. 7 is a diagram illustrating an example of a data configuration of the mode management table. [Figure 8] FIG. 8 is a functional block diagram illustrating an example of a main functional configuration of the control unit of the server device. [Figure 9] 9 is a block diagram showing an example of the main hardware configuration of a mobile terminal. [Figure 10] FIG. 10 is a block diagram showing an example of a main functional configuration of a control unit of a mobile terminal. [Figure 11] FIG. 11 is a sequence chart showing an example of the flow of operations of the transaction management system. [Figure 12] FIG. 12 is a flowchart showing the control process of the server device. [Figure 13] FIG. 13 is a diagram showing an example of a transaction information display screen for a registered commodity. [Figure 14] FIG. 14 is a diagram showing an example of a checkout screen displayed on a mobile terminal. [Figure 15] FIG. 15 is a diagram illustrating an example of a data configuration of a product master according to the second embodiment. [Figure 16] FIG. 16 is a diagram showing an example of a transaction information display screen for a registered product. DETAILED DESCRIPTION OF THE INVENTION

[0009] (First embodiment) A product registration processing device and an information processing device according to a first embodiment will be described below. Note that the present invention is not limited to the embodiments described below. For example, in the embodiments described below, a server device that manages information on one or more stores will be described as an example of an information processing device, but this is not limiting. The information processing device may be a device such as a terminal device operated by a store clerk (hereinafter also referred to as an attendant terminal), or may be another device installed in the store. Also, in the embodiments described below, a mobile terminal owned by a customer will be described as an example of a product registration processing device, but this is not limiting. The product registration processing device may also be a mobile terminal provided by the store. Note that product registration refers to storing (registering) information on products purchased by customers.

[0010] The transaction management system of the first embodiment will be described below with reference to the drawings. FIG. 1 is a diagram showing an overview of a transaction management system 1 according to a first embodiment. The transaction management system 1 is used in a store that sells products, such as a supermarket. The transaction management system 1 has a server device 2 and a mobile self-checkout system 3. The server device 2 and the mobile self-checkout system 3 are connected to each other so that they can communicate with each other via a network such as the Internet.

[0011] The mobile self-checkout system 3 is a system employed in a single store and includes a mobile terminal 4 carried by a customer, a payment machine 5 that processes payments, and an attendant PC 6 that monitors the customer's transaction using the payment machine 5. The mobile terminal 4, payment machine 5, and attendant PC 6 are communicatively connected to one another via an in-store network such as a wired or wireless LAN (Local Area Network). The mobile terminal 4, payment machine 5, and attendant PC 6 are also communicatively connected to a server device 2 via the in-store network.

[0012] The mobile terminal 4 may be able to communicate with the server device 2 without going through the in-store network. Various other devices may also be connected to the in-store network. For example, the in-store network may be connected to a POS terminal where a store clerk performs operations related to product registration and payment, a self-service POS terminal where a customer performs operations related to product registration and payment, or a semi-self-service POS system where a store clerk performs operations related to product registration and a customer performs operations related to payment. Furthermore, the number of mobile terminals 4 and payment machines 5 is not limited to the example shown in the figure.

[0013] The server device 2 is, for example, a store server installed in the backroom of a store. The server device 2 receives store entry information from the mobile terminal 4. The store entry information includes the company code and store code of the store where the customer is located. By receiving the store entry information from the mobile terminal 4, the server device 2 can identify the store in which the mobile terminal 4 is located. The server device 2 issues a terminal code and a transaction code to the mobile terminal 4 that sent the store entry information and sends them to the mobile terminal 4. The terminal code is terminal identification information that identifies the mobile terminal 4, and the transaction code is transaction identification information that identifies the transaction.

[0014] The server device 2 also transmits mode information to the mobile terminal 4. The mode information is information that indicates the mode of the mobile self-checkout system 3 in the store where the customer is located. The mode information will be described in detail later.

[0015] The mobile terminal 4 is a terminal that the customer carries and operates to issue a product registration request to the server device 2 when placing a product to be purchased in the shopping cart. When the mobile terminal 4 transmits various information to the server device 2, the server device 2 can easily identify the mobile terminal 4 that transmitted the information by transmitting the terminal code. In this embodiment, multiple transaction codes are not issued to a single mobile terminal 4 while the customer is shopping. In other words, because there is a one-to-one correspondence between terminal codes and transaction codes, either one can have the function of the other.

[0016] Specifically, a transaction can be identified by a terminal code. Therefore, the terminal code is also an example of transaction identification information. Furthermore, the mobile terminal 4 can be identified by a transaction code. Therefore, the transaction code is also an example of terminal identification information. Therefore, in the following description, the terminal code and the transaction code can be interchangeable as appropriate. Furthermore, the server device 2 may issue only either the terminal code or the transaction code.

[0017] The server device 2 receives a registration request from the mobile terminal 4. The registration request includes the terminal code of the mobile terminal 4 that made the registration request and the product code read by the mobile terminal 4. The server device 2, which manages product information for each store, reads out product information corresponding to the product code included in the registration request received from the mobile terminal 4 and registers the product as a transaction target. In other words, the server device 2 registers the product information as part of the transaction information. The transaction information includes various information necessary for a customer to make a payment, such as product information. The product information includes information such as the product name, price, and vibration type. The vibration type is information that predefines the operation pattern for vibrating the mobile terminal 4. In this way, the server device 2 manages transaction information in real time for each customer, or in other words, for each terminal code.

[0018] The server device 2 transmits to the attendant PC 6, from among the transaction information it manages, transaction information of the store where the attendant PC 6 is installed (hereinafter also referred to as "store transaction information"). The server device 2 periodically receives store transaction information requests (hereinafter also referred to as "requests") from the attendant PC 6 at short intervals and transmits store transaction information in response to the store transaction information request. This allows the attendant PC 6 to obtain transaction information of its own store substantially in real time. The attendant PC 6 manages the status of each customer based on the obtained transaction information. Note that the server device 2 may also transmit store transaction information of the store whose transaction information has been updated to the attendant PC 6 itself every time it updates the transaction information. In this case, the attendant PC 6 does not need to transmit a store transaction information request.

[0019] The server device 2 also receives check information from the attendant PC 6. The check information indicates that an attendant has checked the items placed in the shopping cart for purchase by the customer, and includes transaction-specific information (transaction code or terminal code). In the following description, the check performed by the attendant on the purchased items at the entrance to the checkout area may be referred to as an "attendant check." The server device 2 stores the terminal code, transaction code, and check information in association with each other, thereby managing whether each transaction has been checked by an attendant.

[0020] The server device 2 also receives a transaction information request from the payment machine 5. The transaction information request is a request for transaction information for the customer to make a payment by operating the payment machine 5, and includes a transaction code that identifies the transaction to be paid. Upon receiving the transaction information request, the server device 2 determines whether the transaction identified by the transaction code included in the transaction information request (hereinafter also referred to as the target transaction) has been attendant checked.

[0021] If the target transaction has been attendant checked, the server device 2 sends transaction information for the target transaction to the payment machine 5. If the target transaction has not been attendant checked, the server device 2 does not send transaction information but instead sends error information to the payment machine 5. The error information indicates that the target transaction has not been attendant checked. This allows the server device 2 to allow the customer to make payment at the payment machine 5, provided that the transaction has been attendant checked in advance.

[0022] The server device 2 may be configured with multiple computers. In other words, the functions of the server device 2 may be distributed among multiple computers. The server device 2 may also be a cloud server installed on a cloud.

[0023] The mobile terminal 4 is a mobile terminal carried by a customer. In this embodiment, the mobile terminal 4 is configured as a smartphone owned by the customer. An application program for a mobile self-checkout system is installed on the mobile terminal 4. The mobile terminal 4 may be attached to a shopping cart that is moved by the customer and used.

[0024] The mobile terminal 4 captures an image of a code symbol, such as a barcode or two-dimensional code, attached to a product using the imaging unit 44 (see FIG. 9) and acquires a product code (product identification information) that identifies the product. Alternatively, the mobile terminal 4 captures an image of the product itself, identifies the product using a known general object recognition technology, and acquires the product code of the product. Alternatively, the mobile terminal 4 optically reads the product barcode to acquire the product code. The mobile terminal 4 then transmits registration request information to the server device 2 based on the acquired product code.

[0025] The payment machine 5 is a so-called self-service payment machine that is operated by the customer themselves. The payment machine 5 is equipped with a scanner unit that can read code symbols such as barcodes and two-dimensional codes. The payment machine 5 uses the scanner unit to read a transaction code from the payment barcode (hereinafter also referred to as the "payment barcode") on the payment screen displayed on the mobile terminal 4. The payment machine 5 sends a transaction information request including the read transaction code to the server device 2.

[0026] When the accounting machine 5 receives transaction information from the server device 2 in response to the transaction information request, it executes accounting processing based on the transaction information. The accounting processing is processing for paying for the products purchased by the customer. In the case of cash payments, accounting processing includes, for example, displaying transaction information, calculating the amount of change, and dispensing the change, while in the case of cashless payments, it includes sending and receiving various information to and from the payment server of the payment service provider.

[0027] When the payment machine 5 receives error information from the server device 2 in response to the transaction information request, the payment machine 5 displays the error information on its own display. The displayed error information may, for example, indicate that payment cannot be made because the attendant check has not been completed. The payment machine 5 sends and receives various information to and from the server device 2. If the payment machine 5 receives error information, it will not process the transaction.

[0028] The attendant PC 6 is operated by a store clerk such as an attendant and is an example of an attendant terminal. The attendant PC 6 is equipped with a scanner unit capable of reading code symbols. The attendant PC 6 uses the scanner unit to read a transaction code from the accounting barcode on the attendant check screen displayed on the mobile terminal 4. The attendant PC 6 obtains transaction information corresponding to the read transaction code from the server device 2 and displays it on the display unit.

[0029] The attendant performs an attendant check based on the transaction information displayed on the attendant PC 6. The attendant check is performed by operating the scanner unit to read the code symbols of the products contained in the shopping cart. The attendant check, for example, verifies whether the products contained in the shopping cart are registered. Hereinafter, products contained in the shopping cart but not registered are referred to as "unscanned products." For example, if the registered products (subjects of the transaction) include an age verification product, the attendant verifies the customer's age. If the transaction subjects include unregistered products, the attendant checks the unregistered products. An unregistered product is a product whose product information corresponding to the product code is not registered in the product master for some reason. Once the attendant check is completed, a "check completed" input is entered in the attendant PC 6. Once the "check completed" input is entered, the attendant PC 6 transmits check information to the server device 2. The attendant PC 6 may also perform the attendant check by capturing an image of the product itself or the product's code symbol.

[0030] If the attendant finds an unregistered product, he or she checks it in the attendant PC 6 and then moves to the payment machine 5 or dedicated register together with the customer. The attendant then operates the payment machine 5 or dedicated register to manually register the product information of the unregistered product as part of the transaction information.

[0031] Now, operation in a store will be described with reference to Figure 2. Figure 2 is a diagram showing an example of a checkout area in a store. The checkout area is an area where one or more checkout machines 5 are located, and customers who have completed product registration can pay for their products by operating the checkout machine 5 themselves. Near the entrance to the checkout area, in other words, on the customer's route to one of the checkout machines 5, an attendant and an attendant PC 6 operated by the attendant are located. Before customers use the checkout machine 5 to make a payment, the customer undergoes an attendant check by the attendant at the entrance to the checkout area. The attendant operates the attendant PC 6 to perform the attendant check.

[0032] Before making a payment at the payment machine 5, the customer presents the attendant check screen displayed on the mobile terminal 4 to the attendant. The attendant scans the payment barcode on the attendant check screen with the scanner unit 64 of the attendant PC 6. The attendant PC 6 obtains the transaction information corresponding to the transaction code read from the payment barcode from the server device 2 and displays it on the display unit. The attendant performs an attendant check based on the displayed transaction information. When the attendant check is completed, the attendant inputs a "check completed" message into the attendant PC 6. The attendant PC 6 then sends the check information to the server device 2.

[0033] Once the attendant check is complete, the customer can make payment at any of the payment machines 5. If a customer who has not yet completed the attendant check attempts to make a payment at a payment machine 5, error information is displayed on that payment machine 5 and the payment cannot be made. In this case, the customer must go to the location of the attendant PC 6 to undergo an attendant check. Since the attendant can perform an attendant check on each customer at the location where the attendant PC 6 is installed, the check process is simplified. In addition, the attendant can efficiently check unscanned items.

[0034] Next, the configurations of the server device 2, the mobile terminal 4, and the attendant PC 6 that constitute the transaction management system 1 will be described in detail.

[0035] First, the server device 2 will be described. Fig. 3 is a block diagram showing an example of the main hardware configuration of the server device 2. The server device 2 includes a control unit 20, a storage unit 21, a display unit 22, an operation unit 23, and a communication unit 24. The control unit 20, the storage unit 21, the display unit 22, the operation unit 23, and the communication unit 24 are connected to one another via a bus 25 or the like.

[0036] The control unit 20 is configured as a computer including a CPU (Central Processing Unit) 201, which is an example of a processor, a ROM (Read Only Memory) 202, and a RAM (Random Access Memory) 203. The CPU 201, the ROM 202, and the RAM 203 are connected to each other via a bus 25.

[0037] The CPU 201 controls the overall operation of the server device 2. The ROM 202 stores various programs, such as a program used to drive the CPU 201, and various data. The RAM 203 is used as a work area for the CPU 201, and loads various programs and data stored in the ROM 202 and the storage unit 21. The control unit 20 executes various control processes of the server device 2 by the CPU 201 operating in accordance with the control programs stored in the ROM 202 and the storage unit 21 and loaded in the RAM 203.

[0038] The storage unit 21 is configured with a storage medium such as a hard disk drive (HDD) or flash memory, and maintains its stored contents even when power is cut off. The storage unit 21 stores a control program 211, a product master 212, a terminal management table 213, a transaction information management table 215, and a mode management table 216.

[0039] The control program 211 is a program for realizing functions such as sending and receiving information to and from external devices such as the mobile terminal 4, the accounting machine 5, and the attendant PC 6, managing transaction information for each customer, and receiving a transaction information request and determining whether the transaction that is the subject of the transaction information request has been checked by the attendant.

[0040] The product master 212 is a master file that stores information about products sold at each store. The product master 212 is updated based on information obtained from each store. Because the products sold at each store change daily, the product master 212 is updated as appropriate by each store. Figure 4 is a diagram showing an example of the data configuration of the product master. The product master 212 stores company codes, store codes, product codes, product names, prices, and vibration types in association with each other.

[0041] The type of vibration is defined in advance as an operation pattern for vibrating the mobile terminal 4, for example, as shown below. 1. Short, weak vibrations 2. Short, strong vibrations 3. Long, weak vibrations 4. Long, strong vibrations 5. Two short, weak vibrations 6. Two short, strong vibrations 7. Two long, weak vibrations 8. Two long, strong vibrations 9. Vibration continues until operation is performed

[0042] The type of vibration is set depending on, for example, the price of the products sold at each store, whether the products sold at each store are on sale, and evaluation information of the products sold at each store.

[0043] Vibrations controlled according to the strength, duration, and number of repetitions of vibrations can strongly appeal to customers to motivate them to make a purchase. Therefore, the type of vibration is defined by changing at least one of the strength, duration, and number of repetitions of vibrations depending on the degree of appeal to customers.

[0044] It should be noted that if no vibration type is associated with the product code, it is not necessary to vibrate the mobile terminal 4.

[0045] The company code is information that identifies the company that operates the store that uses the transaction management system 1. The store code is information that identifies the store that uses the transaction management system 1. If multiple stores in a single company use the transaction management system 1, multiple store codes are associated with the company code.

[0046] The product code is an example of product identification information that identifies a product. Since multiple products are sold at one store, multiple product codes are associated with the store code. The product name is information that indicates the name of the product. The price is information that indicates the price of the product. The product name, price, and vibration type are associated one-to-one with the product code.

[0047] The terminal management table 213 is a data table that manages the mobile terminals 4 used in the mobile self-checkout system 3. Fig. 5 is a diagram showing an example of the data configuration of the terminal management table 213. The terminal management table 213 stores terminal codes, notification destinations, company codes, and store codes in association with each other.

[0048] The terminal code is information that identifies the mobile terminal 4 that uses the transaction management system 1. When the server device 2 receives store entry information from the mobile terminal 4, it issues a terminal code to the mobile terminal 4 and registers it in the terminal management table 213. The terminal code may be an identification number that the mobile terminal 4 itself has, such as an IMEI (International Mobile Equipment Identity). Issuing a terminal code exclusive to the transaction management system 1 has the advantage of reducing the number of digits in the terminal code, which makes it easier to manually enter the terminal code when it becomes necessary.

[0049] The notification destination is information indicating the notification destination of the mobile terminal 4, such as the communication address of the mobile terminal 4. The company code is information identifying the company that operates the store where the mobile terminal 4 is located. The store code is information identifying the store where the mobile terminal 4 is located. The notification destination, company code, and store code are registered based on the store entry information received from the mobile terminal 4. Of the information registered in the terminal management table 213, information related to the terminal codes of customers who have completed payment for a transaction may be sequentially deleted. In this case, the same terminal code can be used multiple times, thereby reducing the number of digits in the terminal code used.

[0050] The transaction information management table 215 is a data table that manages transaction information for each store for each transaction. The transaction information management table 215 is updated based on information from the mobile terminal 4, the payment machine 5, and the attendant PC 6. FIG. 6 shows an example of the data configuration of the transaction information management table 215. The transaction information management table 215 stores and associates the following: transaction code, terminal code, check-in time, payment instruction time, payment machine number, attendant check flag, transaction amount, payment completed flag, product information, registration time, and cancellation flag.

[0051] The transaction code is information that identifies the transaction. The terminal code is information that identifies the mobile terminal 4. When the server device 2 receives store entry information from the mobile terminal 4, it issues a transaction code and a terminal code and registers them in the transaction information management table 215. The check-in time is information that indicates the time when the customer entered the store, for example, the time when the server device 2 received the store entry information from the mobile terminal 4.

[0052] The transaction instruction time is information indicating the time when the server device 2 received the transaction instruction from the mobile terminal 4. The transaction machine number is information that identifies the transaction machine 5 that will perform the transaction processing for the corresponding transaction code. In other words, the transaction machine number is information that identifies the transaction machine 5 that read the corresponding transaction code from the transaction screen of the mobile terminal 4. The transaction machine number is registered based on a transaction information request from the transaction machine 5.

[0053] The transaction amount is information that indicates the total price of the products in one transaction. The transaction completed flag is information that indicates whether the payment for the transaction has been completed, in other words, whether the transaction processing by the payment machine 5 has been completed. The transaction completed flag is registered as "1" if the payment for the transaction has been completed, and "0" if it has not. The transaction completed flag is rewritten to "1" based on the transaction completion notification received from the payment machine 5.

[0054] Product information is information indicating the product code, product name, and price of a registered product. When multiple products are registered in one transaction, multiple pieces of product information are registered corresponding to the transaction code. The registration time is information indicating the time when the product information was registered. The cancellation flag is information indicating whether the product information has been canceled or not, and is registered as "1" if canceled, or "0" if not canceled. The cancellation flag is rewritten to "1" based on cancellation information from the mobile terminal 4. The cancellation information is information instructing the cancellation of a product registration, and includes the product code of the product registration to be canceled.

[0055] The mode management table 216 is a data table that manages the modes set in the mobile self-checkout system 3 of each store. The mode management table 216 is updated based on information obtained from each store. FIG. 7 is a diagram showing an example of the data configuration of the mode management table 216. The mode management table 216 stores company codes, store codes, and modes in association with each other.

[0056] As described above, the company code is information that identifies the company that operates the store, and the store code is information that identifies the store. The mode is information that indicates the mode set for the mobile self-checkout system 3, and information indicating either the front check mode or the normal mode is registered.

[0057] The front check mode is a mode for operations in which an attendant check is performed before the customer makes a payment at the payment machine 5, as described in FIG. 2. Specifically, the front check mode is a mode that allows the customer to process the payment at the payment machine 5 on the condition that the attendant check has been performed. The normal mode is a mode for conventional operations. Specifically, the normal mode is a mode that allows the customer to make a payment at the payment machine 5 without having to undergo attendant check. Each store can select either the front check mode or the normal mode to suit their operations.

[0058] Returning to FIG. 3, the hardware configuration of the server device 2 will be described.

[0059] The display unit 22 is configured, for example, with a liquid crystal panel, and displays various information, such as information stored in the product master 212, the terminal management table 213, the transaction information management table 215, and the mode management table 216, as needed.

[0060] The operation unit 23 is used to input information to the control unit 20, and is composed of, for example, a keyboard, a touch panel, a mouse, and the like.

[0061] The communication unit 24 is an interface for communicating with external devices such as the mobile terminal 4, the payment machine 5, and the attendant PC 6. By connecting the control unit 20 to an external device via the communication unit 24, the control unit 20 can send and receive information (data) to and from the external device.

[0062] Next, a description will be given of the functional configuration of the server device 2. Fig. 8 is a functional block diagram showing an example of the main functional configuration of the control unit 20 of the server device 2. The control unit 20 functions as an example of a transmitting / receiving means 2001, an information management means 2002, an information processing means 2003, and a mode setting means 2004, as a result of the CPU 201 operating in accordance with a control program stored in the ROM 202 or the storage unit 21. Note that each of these functions may be configured by hardware such as a dedicated circuit.

[0063] The transmission / reception means 2001 transmits and receives various information between the mobile terminal 4, the payment machine 5, and the attendant PC 6. For example, the transmission / reception means 2001 receives store entry information from the mobile terminal 4, and transmits a terminal code, a transaction code, and mode information to the mobile terminal 4 that is the sender of the store entry information.

[0064] The transmission / reception means 2001 receives a registration request including a terminal code and a product code from the mobile terminal 4, and in response transmits registered product information to the mobile terminal 4 that sent the registration request. The transmission / reception means 2001 receives a transaction instruction including a transaction code from the mobile terminal 4, and transmits the transaction amount of the transaction identified by the transaction code and an instruction to display an attendant check screen to the mobile terminal 4 that sent the transaction instruction. The transaction instruction is information indicating that product registration for one transaction has been completed. The instruction to display an attendant screen is information instructing the mobile terminal 4 to display a transaction barcode to be read by the attendant PC 6. The transaction amount may also be calculated by the mobile terminal 4.

[0065] The transmission / reception means 2001 periodically receives a store transaction information request including a store code from the attendant PC 6 at short intervals, and transmits transaction information for the store identified by the store code in response. This allows the attendant PC 6 to obtain transaction information for its own store substantially in real time. The unregistered product output means is included in the transmission / reception means 2001. That is, the unregistered product output means transmits transaction information for products that the determination means has determined are not registered to the attendant PC 6. Specifically, in response to the store transaction information request, the unregistered product output means transmits transaction information including transaction information for products that the determination means has determined are not registered, stored in the transaction information management table 215, to the attendant PC 6.

[0066] The transmission / reception means 2001 receives check information from the attendant PC 6. The check information is information indicating that the attendant check has been completed, and includes transaction-specific information (transaction code or terminal code). Based on the received check information, the transmission / reception means 2001 sends a checkout screen display instruction to the mobile terminal 4 of the customer whose attendant check has been completed. The checkout screen display instruction is information instructing the mobile terminal 4 to display a checkout barcode to be read by the payment machine 5.

[0067] The transmitting and receiving means 2001 receives a transaction information request including a transaction code from the payment machine 5, and transmits transaction information identified by the transaction code in response. The transmitting and receiving means 2001 functions as an example of a request receiving means that receives a transaction information request. The transmitting and receiving means 2001 also functions as an example of an output means that outputs transaction information. The transmitting and receiving means 2001 receives a transaction completion notice from the payment machine 5. The transaction completion notice is information indicating that payment for the transaction has been completed and includes the transaction code. The output means outputs the transaction information corresponding to the transaction code to the payment machine 5, provided that the transaction code included in the transaction information request received from the payment machine 5 is associated with check information.

[0068] The information management means 2002 manages various information such as information received by the transmission / reception means 2001. Here, managing information means writing or reading various information (data) to or from the storage unit 21.

[0069] For example, when the transmitting / receiving means 2001 receives store entry information, the information management means 2002 writes a terminal code and a transaction code into the terminal management table 213 and the transaction information management table 215. Also, when the transmitting / receiving means 2001 receives store entry information, the information management means 2002 reads out mode information corresponding to the store code included in the store entry information from the mode management table 216.

[0070] When the transmitting / receiving means 2001 receives a registration request, the information management means 2002 registers product information corresponding to the product code included in the registration request in the transaction information management table 215. Specifically, the information management means 2002 refers to the terminal management table 213 and reads out the company code and store code corresponding to the terminal code included in the registration request. The information management means 2002 then reads out product information associated with the company code and store code and corresponding to the product code included in the registration request from the product master 212, and registers the product information in the transaction information management table 215. The information management means 2002 functions as an example of a registration means that executes product registration. The product registration means is included in the information management means 2002. That is, the product registration means registers products purchased in one transaction. In this embodiment, the product registration means registers the products based on the code symbols captured by the mobile terminal 4 and the code symbols of unscanned products read by the attendant PC 6.

[0071] When the transmitting / receiving means 2001 receives a store transaction information request, the information management means 2002 extracts transaction information of the store identified by the store code included in the store transaction information request. Specifically, the information management means 2002 reads all terminal codes corresponding to the store code from the terminal management table 213. The information management means 2002 reads all transaction information corresponding to the read terminal codes from the transaction information management table 215.

[0072] When the transmitting / receiving means 2001 receives a transaction information request, the information management means 2002 reads out the transaction information identified by the transaction code included in the transaction information request. The information management means 2002 also determines (functions as a determination means) whether the product is an unscanned product based on the product code received from the attendant PC 6, and if it is an unscanned product, registers the product. The determination means determines, based on the product code received from the attendant PC 6, whether the product identified by the product code is registered. Specifically, the determination means determines, based on the product code received from the attendant PC 6 by the transmitting means, whether the product identified by the product code is stored (registered) in the transaction information management table 215.

[0073] Furthermore, when the transmitting / receiving means 2001 receives check information, the information management means 2002 rewrites the attendant check flag in the transaction information management table 215 corresponding to the transaction identification information (transaction code or terminal code) included in the check information to "1." The information management means 2002 writes or reads other information to or from the memory unit 21 as necessary. The transaction management means is included in the information management means 2002. That is, the transaction management means associates and stores a transaction code that identifies a transaction, transaction information related to a product registered by the product registration means, and check information received from the attendant PC 6. Specifically, the transaction management means associates and stores the transaction code, transaction information, and check information in the transaction information management table 215.

[0074] As described above, the information management means 2002 manages the transaction information management table 215, which stores transaction specific information (transaction code or terminal code), transaction information, and check information (attendant check flag) in association with each other, and is an example of a transaction management means.

[0075] The information processing means 2003 executes various information processing. For example, the information processing means 2003 calculates the transaction amount of one transaction. The information processing means 2003 also performs a process of assigning a transaction code and a terminal code and issues these transaction codes and terminal codes. The information processing means 2003 references the transaction information management table 215 to determine whether the transaction has been checked by an attendant.

[0076] The mode setting means 2004 sets the mode of the mobile self-checkout system 3 of each store to either the front check mode or the normal mode. Specifically, the mode setting means 2004 registers information indicating the front check mode or the normal mode in the mode management table 216 based on information acquired from the store.

[0077] Next, the mobile terminal 4 will be described in detail. Fig. 9 is a block diagram showing an example of the main hardware configuration of the mobile terminal 4. The mobile terminal 4 includes a control unit 40, a storage unit 41, a display unit 42, an operation unit 43, an imaging unit 44, and a communication unit 45. The control unit 40, the storage unit 41, the display unit 42, the operation unit 43, the imaging unit 44, the communication unit 45, and the vibration unit 47 are connected to one another via a bus 46 or the like.

[0078] The control unit 40 is configured as a computer including a CPU 401, which is an example of a processor, a ROM 402, and a RAM 403. The CPU 401, the ROM 402, and the RAM 403 are connected to one another via a bus .

[0079] The CPU 401 controls the overall operation of the mobile terminal 4. The ROM 402 stores various programs, such as a program used to drive the CPU 401, and various data. The RAM 403 is used as a work area for the CPU 401, and loads various programs and data stored in the ROM 402 and the storage unit 41. The control unit 40 executes various control processes for the mobile terminal 4 by the CPU 401 operating in accordance with the control programs stored in the ROM 402 and the storage unit 41 and loaded in the RAM 403.

[0080] The memory unit 41 is configured with a storage medium such as a HDD or flash memory, and maintains its contents even when the power is turned off. The memory unit 41 stores a control program 411, a terminal code section 412, a transaction information section 413, and a mode information section 414.

[0081] The control program 411 is an application program for a mobile self-checkout system, etc. The application program for the mobile self-checkout system causes the mobile terminal 4 to function as an input device for product registration. The application program for the mobile self-checkout system also causes the mobile terminal 4 to function as a checkout barcode display device.

[0082] The terminal code section 412 stores the terminal code received from the server device 2. The terminal code is issued by the server device 2 in response to the store entry information from the mobile terminal 4.

[0083] The transaction information unit 413 stores transaction information that associates a transaction code received from the server device 2 with product information registered in the server device 2. Specifically, the product information registered by the server device 2 is sequentially registered in the transaction information unit 413 in association with the transaction code.

[0084] The mode information unit 414 stores mode information received from the server device 2. The mode information unit 414 stores mode information received from the server device 2 in response to store entry information from the mobile terminal 4. The mode information is information that indicates the mode of the mobile self-checkout system 3 of the store where the mobile terminal 4 is located.

[0085] The operation unit 43 is configured, for example, with a touch panel provided on the surface of the display unit 42, and inputs information corresponding to the position touched by the user to the control unit 40. When the customer operates an operator displayed on the display unit 42, the operation unit 43 inputs information corresponding to the operator to the control unit 40.

[0086] The imaging unit 44 captures an image of a two-dimensional code, product barcode, or the like displayed at the entrance of a store, and inputs the image (or video) data (hereinafter also referred to as imaging data) obtained by capturing the image to the control unit 40. The control unit 40 reads store information from the image of the two-dimensional code, and reads the product code from the image of the product barcode. When the mobile terminal 4 recognizes the product code using so-called object recognition, the imaging unit 44 captures an image of the exterior of the product and inputs the image to the control unit 40.

[0087] The communication unit 45 is an interface for communicating with an external device such as the server device 2. The control unit 40 is connected to the external device via the communication unit 45, thereby enabling transmission and reception of information (data) with the external device.

[0088] Vibration unit 47 is configured with, for example, a motor, and vibrates according to the control of control unit 40. More specifically, vibration unit 47 operates under the control of control unit 40, varying at least one of the strength of vibration, the length of vibration time, and the number of times vibration is repeated.

[0089] Next, the functional configuration of the control unit 40 of the mobile terminal 4 will be described. Fig. 10 is a block diagram showing an example of the main functional configuration of the control unit 40 of the mobile terminal 4. The control unit 40 functions as a transmitting / receiving unit 4001, an input unit 4002, a reading unit 4003, an information management unit 4004, an information processing unit 4005, a display control unit 4006, and a vibration control unit 4007 when the CPU 401 operates in accordance with a control program stored in the ROM 402 or the storage unit 41. Note that each of these functions may be configured using hardware such as a dedicated circuit.

[0090] The transmitting / receiving means 4001 transmits and receives various information to and from the server device 2. For example, the transmitting / receiving means 4001 transmits store entry information to the server device 2, and receives a terminal code, a transaction code, and mode information from the server device 2.

[0091] The transmitting and receiving means 4001 transmits a registration request including a terminal code and a product code to the server device 2, and receives the registered product information, vibration type, and transaction amount as a response from the server device 2. The transmitting and receiving means 4001 transmits a transaction instruction including the transaction code to the server device 2, and receives the transaction amount of the transaction identified by the transaction code and an instruction to display the attendant check screen from the server device 2. The transmitting and receiving means 4001 receives the instruction to display the transaction screen and a transaction completion notification from the server device 2.

[0092] The input means 4002 accepts input of captured images of merchandise. Various information is input to the input means 4002 from the operation unit 43 and the imaging unit 44. For example, a transaction start instruction or a checkout instruction is input to the input means 4002 from the operation unit 43. In addition, the input means 4002 receives image data of a two-dimensional code displayed at the store entrance, image data of a merchandise barcode, etc. from the imaging unit 44.

[0093] The reading means 4003 reads the product code of the product based on the captured image. More specifically, the reading means 4003 extracts a two-dimensional code from the captured image data input to the input means 4002, decodes the two-dimensional code, and reads the store information. The reading means 4003 also extracts a product barcode from the captured image data input to the input means 4002, decodes the product barcode, and reads the product code. The decoding of the two-dimensional code or product barcode may be performed by the server device 2. In this case, the transmitting / receiving means 4001 transmits the captured image data of the two-dimensional code or barcode to the server device 2, and receives the store information and product code read by the server device 2 from the server device 2.

[0094] The information management means 4004 manages various information such as information received by the transmission / reception means 4001. Here, managing information means writing or reading various information (data) to or from the storage unit 41.

[0095] For example, the information management means 4004 writes the terminal code received by the transmission / reception means 4001 into the terminal code section 412. The information management means 4004 also writes the transaction code and product information received by the transmission / reception means 4001 into the transaction information section 413. Specifically, when the transmission / reception means 4001 receives a transaction code, the information management means 4004 writes the transaction code into the transaction information section 413. Then, every time the transmission / reception means 4001 receives product information registered in the server device 2, the information management means 4004 writes the product information in association with the transaction code into the transaction information section 413. The information management means 4004 writes the mode information received by the transmission / reception means 4001 into the mode information section 414.

[0096] The information processing means 4005 executes various information processes. For example, when the transmitting and receiving means 4001 receives an instruction to display an attendant check screen from the server device 2, the information processing means 4005 generates a billing barcode to be displayed on the display unit 42.

[0097] The display control means 4006 causes various information to be displayed on the display unit 42. For example, the display control means 4006 causes the display unit 42 to display the product information and transaction amount stored in the transaction information unit 413. The transaction amount may be obtained from the server device 2, or may be calculated by the information processing means 4005 based on the transaction information stored in the transaction information unit 413.

[0098] The vibration control means 4007 executes an entertaining operation by vibrating the vibration unit 47 in accordance with the type of vibration received by the transmitting / receiving means 4001. In other words, the vibration control means 4007 is an entertainment operation execution means in which the type of entertainment operation is defined in accordance with the product code, and which executes an entertaining operation in accordance with the type corresponding to the product code read by the reading means 4003.

[0099] If information indicating the front check mode is registered in the mode information unit 414, the display control means 4006 causes the display unit 42 to display an attendant check screen when a billing barcode is generated by the information processing means 4005. Then, the display control means 4006 causes the display unit 42 to display the billing screen when the transmission / reception means 4001 receives an instruction to display the billing screen.

[0100] If information indicating normal mode is registered in the mode information section 414, when the information processing means 4005 generates a billing barcode, the display control means 4006 causes the display unit 42 to display the billing screen without displaying the attendant check screen.

[0101] Although the configuration of the payment machine 5 and attendant PC 6 has not been described here, similar to the server device 2 and mobile terminal 4 described above, the payment machine 5 and attendant PC 6 are assumed to have a computer-configured control unit comprised of a CPU (an example of a processor), ROM, RAM, etc. The payment machine 5 and attendant PC 6 also have a storage unit such as an HDD or flash memory for storing various programs, a display unit comprised of a display device such as an LCD panel, an operation unit comprised of input devices such as a keyboard or touch panel, a scanner unit similar to the scanner unit 64, and a communication unit for communicating with external devices. The control units of the payment machine 5 and attendant PC 6 execute various processes by cooperating with the programs stored in the storage unit.

[0102] Next, an overview of the operation of the transaction management system 1 configured as described above will be explained. Figure 11 is a sequence chart showing an example of the flow of operation of the transaction management system 1. Note that this sequence chart shows the flow of operation when the mobile self-checkout system 3 is set to normal mode. The sequence chart also shows the flow of operation when the customer does not undergo attendant check by an attendant before making a payment at the accounting machine 5.

[0103] A customer starts an application program for the mobile self-checkout system (step S1). Next, the customer reads the store entry information on the mobile terminal 4 and inputs the start of the transaction (step S2). The mobile terminal 4 transmits the store entry information, including the company code, store code, and check-in time, to the server device 2 (step S3).

[0104] The server device 2 issues a terminal code and a transaction code (step S4). At this time, the server device 2 registers necessary information in the terminal management table 213 and the transaction information management table 215 based on the received store entry information. The server device 2 reads mode information of the store code included in the store entry information from the mode management table 216 (step S5). The server device 2 transmits the issued terminal code and transaction code, as well as the read mode information, to the mobile terminal 4 (step S6).

[0105] The mobile terminal 4 registers the received information (step S7). Specifically, the mobile terminal 4 registers the received terminal code in the terminal code section 412, the transaction code in the transaction information section 413, and the mode information in the mode information section 414. When the customer captures an image of the product barcode with the imaging section 44, the mobile terminal 4 acquires a product code that identifies the product (step S8). Note that the product code of a product without a barcode is input from the operation section 43.

[0106] The mobile terminal 4 transmits a registration request including the terminal code and the product code to the server device 2 (step S9). The mobile terminal 4 may transmit a registration request including the transaction code instead of or together with the terminal code to the server device 2. In the following description, it is assumed that the mobile terminal 4 transmits the terminal code together with information to the server device 2.

[0107] The server device 2 executes product registration based on the registration request. Specifically, the server device 2 reads product information corresponding to the product code included in the registration request from the product master 212 and registers the information in the transaction information management table 215 (step S10). The server device 2 transmits the read product information and the type of vibration corresponding to the product code to the mobile terminal 4 (step S11).

[0108] Here, with reference to FIG. 12, product registration performed by the server device 2 based on a registration request received from the mobile terminal 4, which is executed in steps S10 and S11, will be described. FIG. 12 is a flowchart showing the control process of the server device 2. As shown in FIG. 12, the control unit 20 of the server device 2 determines whether a registration request has been received from the mobile terminal 4 (step S121). If it is determined that a registration request has been received from the mobile terminal 4 (step S121: Yes), the control unit 20 reads product information of the product from the product master 212 based on the product code received at the same time, and executes product registration by registering the product in the transaction information management table 215, as the process of step S10 (step S122). Then, the control unit 20 (product registration means) transmits the registered product information and the type of vibration corresponding to the product code to the mobile terminal 4 (step S123). Then, the control unit 20 returns to S121.

[0109] If the control unit 20 of the server device 2 determines that the received signal is not a registration request (step S121: No), it executes processing according to the received signal (step S124).

[0110] Returning to the explanation of Figure 11, the mobile terminal 4 stores the received product information in the transaction information section 413 and displays a transaction information display screen (step S12). Note that the mobile terminal 4 may acquire transaction information including all product information related to this transaction that is registered by the server in the transaction information management table 215 each time it reads a product code.

[0111] Here, the transaction information display screen will be described. Fig. 13 is a diagram showing an example of a transaction information display screen for a registered product, displayed by the mobile terminal 4. The display unit 42 of the mobile terminal 4 displays a header section 421, a total information section 422, a product information section 423, and a footer section 424 on the transaction information display screen.

[0112] The header section 421 displays the company name "XX", the store name "△△ store", the text "Registering" indicating that the customer is currently shopping, etc. The header section 421 also has a terminal code section 4211 formed therein. The terminal code section 4211 displays the terminal code.

[0113] The total number and total price of registered products are displayed in the total information section 422. Products that have been registered but then cancelled are not included in the total number and total price.

[0114] The product information section 423 displays information about registered products and products whose product registration has been cancelled. The displayed product information includes the product name, price, tax rate, number of items, and additional information. The additional information may be, for example, information indicating an age verification product, but is set independently of the highlighted product. For products whose product registration has been cancelled, the product name, price, and number of items are crossed out.

[0115] The footer section 424 displays various controls. Specifically, the footer section 424 displays a "No barcode" icon, a "Scan" icon, and a "Pay" icon. The "No barcode" icon is an icon that displays a preset screen for registering products that do not have product barcodes. The "Scan" icon is an icon for capturing an image of a product barcode. The "Pay" icon is an icon for entering payment instructions.

[0116] Additionally, the mobile terminal 4 vibrates the vibration unit 47 in accordance with the type of vibration received (step S13). For example, the type of vibration is set in accordance with the price level of the products sold at each store, whether the products sold at each store are on sale, and evaluation information of the products sold at each store, and the vibration of the vibration unit 47 makes it possible to know the price level of the products, whether the products are on sale, evaluation information of the products, etc.

[0117] Returning to FIG. 11, the operation of the transaction management system 1 will now be outlined.

[0118] Every time the customer captures an image of the barcode attached to the product, the processing of steps S8 to S12 is repeated.

[0119] When the customer has completed product registration of the purchased product and operates the payment icon on the transaction information display screen, a payment instruction is input to the mobile terminal 4 (step S14). The mobile terminal 4 then transmits the payment instruction to the server device 2 (step S15).

[0120] The server device 2 updates the transaction information and calculates the transaction amount based on the received transaction instruction (step S16). Specifically, the server device 2 registers the transaction instruction time corresponding to the transaction code included in the transaction instruction in the transaction information management table 215. The server device 2 also calculates the transaction amount based on the product information corresponding to the transaction code. The server device 2 sends the calculated transaction amount and an instruction to display the attendant check screen to the mobile terminal 4 (step S17).

[0121] The mobile terminal 4 generates a checkout barcode indicating the transaction code (step S18). The mobile terminal 4 checks the mode of the mobile self-checkout system 3 by referring to the mode information unit 414 (step S19), and if the mode of the mobile self-checkout system 3 is the normal mode, the mobile terminal 4 displays a checkout screen on the display unit 42 (step S20).

[0122] Here, we will explain the checkout screen. Figure 14 is a diagram showing an example of the checkout screen displayed by the mobile terminal 4. The display unit 42 of the mobile terminal 4 displays a header section 421, a total information section 422, and a checkout barcode section 425 on the checkout screen.

[0123] The header section 421 displays the company name "XX", the store name "YY store", the words "Payment via checkout machine" indicating that the customer has entered payment instructions, and the terminal code. The header section 421 also has a terminal code section 4211 formed therein. The terminal code section 4211 displays the terminal code. The header section 421 also displays a back button 4212. The back button 4212 is an operator for returning the display to the previous screen. For example, on the payment screen, operating the back button 4212 causes the mobile terminal 4 to return the display to the transaction information display screen (see FIG. 13).

[0124] The total number and total price of registered products are displayed in the total information section 422. If discounted products are registered for the transaction for which the checkout instruction was entered, the total information section 422 also displays the total discount amount.

[0125] The accounting barcode section 425 displays a guidance message to the customer, such as "Please scan the accounting barcode on the screen with the scanner on the accounting machine." The accounting barcode section 425 also displays an illustration that gives the impression of reading the accounting barcode with the scanner on the accounting machine 5. When a customer sees the accounting screen, they will know that they need to go to the accounting machine 5 and scan the accounting barcode.

[0126] When a customer scans the transaction barcode section 425 displayed on the mobile terminal 4 with the scanner section of the transaction machine 5, the transaction barcode is input into the transaction machine 5 (step S21). The transaction machine 5 requests transaction information for the transaction code read from the transaction barcode from the server device 2 (step S22).

[0127] The server device 2 sends the transaction information corresponding to the transaction code included in the transaction information request to the payment machine 5 (step S23). At this time, the server device 2 stores the payment machine number in the transaction information management table 215 in association with the transaction code included in the transaction information request.

[0128] Upon receiving the transaction information, the payment machine 5 executes the payment process (step S24). Based on the customer's operation, the payment machine 5 executes payment processes related to cash payment or cashless payment. Note that if the customer's purchase includes unregistered items, for example, and attendant operation is required, the payment machine 5 may also be operated by the attendant. Once the payment process is complete, the payment machine 5 sends a payment completion notification to the server device 2 (step S25).

[0129] The server device 2 updates the transaction information based on the received transaction completion notice (step S26). Specifically, the server device 2 rewrites the transaction completed flag corresponding to the transaction code included in the transaction completion notice to "1" in the transaction information management table 215.

[0130] The server device 2 sends a transaction completion notification to the mobile terminal 4 (step S27). The server device 2 sends the transaction completion notification to the mobile terminal 4 identified by the terminal code corresponding to the transaction code included in the transaction completion notification received from the payment machine 5.

[0131] The mobile terminal 4 displays information indicating that the transaction has been completed on the display unit 42 (step S28).

[0132] According to this embodiment, when a customer uses a mobile terminal 4 in a store to scan a product and display the product name, price, etc. on the mobile terminal 4, the mobile terminal 4 vibrates according to the type of vibration, thereby enabling the implementation of a further UX (User Experience) that can instantly and intuitively encourage customer use, thereby promoting the use of a transaction management system in which customers themselves register products and handle transactions.

[0133] (Second embodiment) Next, a second embodiment will be described.

[0134] The second embodiment differs from the first embodiment in that when a customer uses a mobile terminal 4 to scan a product in the store and the product name, price, etc. are displayed on the mobile terminal 4, a color code is used to display the product on the screen, thereby encouraging customers to use the service immediately and intuitively. In the following explanation of the second embodiment, explanations of the same parts as in the first embodiment will be omitted, and only differences from the first embodiment will be explained.

[0135] 15 is a diagram showing an example of the data configuration of the product master according to the second embodiment. The product master 212 stores a company code, a store code, a product code, a product name, a price, a type of vibration, and also a type of color code in association with each other.

[0136] The type of color code is, for example, a predefined color that changes the color of the screen display of the mobile terminal 4. A color code is a code consisting of a string of characters used to represent a color. A color code is a string that expresses RGB values in hexadecimal notation to display a color in a computer language such as HTML.

[0137] For example, if the product is an orange-flavored beverage, a color code indicating orange is associated with it, and if it is a grape-flavored beverage, a color code indicating purple is associated with it.

[0138] 10 in this embodiment executes an entertaining operation by, for example, displaying on the display unit 42 the product information and transaction amount stored in the transaction information unit 413 according to the type of color code associated with the product code. In other words, the display control means 4006 is an entertaining operation execution means in which types of entertaining operations are defined corresponding to the product code, and which executes an entertaining operation according to the type corresponding to the product code read by the reading means 4003.

[0139] Then, in step S123 shown in FIG. 12, the control unit 20 (product registration means) transmits to the mobile terminal 4 the registered product information, the type of vibration, and the type of color code corresponding to the product code.

[0140] As a result, in step S12 shown in Figure 11, the mobile terminal 4 stores the received product information in the transaction information section 413, displays the transaction information display screen, and changes the color of the screen display of the mobile terminal 4 according to the type of color code received (step S12).

[0141] The transaction information display screen will now be described. Fig. 16 is a diagram showing an example of a transaction information display screen for a registered product, displayed by the mobile terminal 4. The display unit 42 of the mobile terminal 4 displays a header section 421, a total information section 422, a product information section 423, and a footer section 424 on the transaction information display screen, and changes the color of the screen display of the mobile terminal 4 according to the type of color code. In Fig. 16, the changed color is indicated by shading 426.

[0142] For example, if an orange-flavored beverage is registered as a product, the transaction information display screen will be displayed in orange, and if a grape-flavored beverage is registered as a product, the transaction information display screen will be displayed in purple.

[0143] According to this embodiment, when a customer uses a mobile terminal 4 in a store to scan a product and display the product name, price, etc. on the mobile terminal 4, the color of the screen display of the mobile terminal 4 can be changed according to the type of color code, thereby implementing a further UX (User Experience) that can instantly and intuitively encourage customer use, thereby promoting the use of a transaction management system in which customers themselves register products and handle accounting.

[0144] Specifically, when the store is crowded or the products look similar, it can be difficult to quickly identify the product being scanned using only the vibration of the first embodiment. For example, if two juices have similar container designs but come in different flavors, customers may mistake them for the wrong product and proceed to checkout without realizing it. In this case, by changing the color of the screen display on the mobile terminal 4 according to the type of color code, such as orange for an orange-flavored drink and purple for a grape-flavored drink, the risk of confusion can be reduced and the use of a transaction management system in which customers can register products and process checkouts themselves can be promoted.

[0145] In this embodiment, the color of the screen display of the mobile terminal 4 is changed depending on the type of color code, and the mobile terminal 4 is vibrated depending on the type of vibration, but this is not limited to this, and the mobile terminal 4 does not have to vibrate.

[0146] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims.

[0147] For example, in the embodiment, the server device 2 has been described as an example of an information processing device. However, this is not a limitation, and for example, the attendant PC 6 may be the information processing device. Also, for example, in the embodiment, the mobile terminal 4 has been described as an example of a product registration processing device. However, this is not a limitation, and for example, a self-service POS or the like may be the product registration processing device.

[0148] Furthermore, in a modified example, when the mobile terminal 4 is used simply as an input / output interface, the server device 2 may function as a product registration processing device. In this case, the server device 2 may include a reading means for reading a product code of a product based on a captured image input by the mobile terminal 4, and an output means for outputting to the mobile terminal 4 a command to execute an entertaining action corresponding to the type of entertaining action corresponding to the product code read by the reading means, based on a list defining the types of actions that provide entertainment corresponding to the product code.

[0149] Furthermore, the entertaining action according to the type of product code read by the reading means 4003 is not limited to vibrating the vibration unit according to the type of vibration or displaying an image on the display unit according to the type of color code, but may also include displaying a special image on the display unit or making a sound according to the type of sound.

[0150] The program executed by the server device 2 of the embodiment is provided as a file in an installable or executable format recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disc).

[0151] The program executed by the server device 2 of the embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. The program executed by the server device 2 of the embodiment may be provided or distributed via a network such as the Internet.

[0152] Furthermore, the program executed by the server device 2 of the embodiment may be provided by being pre-installed in a ROM or the like. [Explanation of symbols]

[0153] 2. Information processing equipment 4. Product registration processing equipment 42 Display section 47 Vibration unit 4002 Input means 4003 Reading means 4006 Entertainment action execution means 4007 Entertainment action execution means [Prior art documents] [Patent documents]

[0154] [Patent Document 1] Japanese Patent Publication No. 2020-67947

Claims

1. an input means for receiving an input of a captured image of a product; a reading means for reading a product code of the product based on the captured image; a means for performing an entertainment action in which a type of entertainment action is defined in accordance with the product code, and the means for performing an entertainment action in accordance with the type of entertainment action corresponding to the product code read by the reading means; A product registration processing device comprising:

2. A vibration unit is provided, the entertainment operation execution means vibrates the vibration unit in accordance with the type of vibration corresponding to the product code read by the reading means, based on a list in which types of vibration are defined corresponding to the product code; 2. The product registration processing device according to claim 1.

3. the entertainment operation execution means vibrates the vibration unit while varying at least one of the strength of vibration, the length of vibration time, and the number of times vibration is repeated.

3. The product registration processing device according to claim 2.

4. A display unit is provided, the entertainment operation execution means defines a type of color code corresponding to the product code, and displays an image on the display unit according to the type of color code corresponding to the product code read by the reading means; 2. The product registration processing device according to claim 1.

5. the entertainment operation execution means changes the color of the screen display of the display unit in accordance with the type of the color code corresponding to the product code read by the reading means; 5. The product registration processing device according to claim 4.

6. An information processing device connected to a mobile terminal via a network and receiving an input of a captured image of a commodity, a reading means for reading a product code of the product based on the captured image; an output means for outputting to the portable terminal a command to execute an entertainment action according to the type corresponding to the product code read by the reading means, based on a list in which types of entertainment actions corresponding to the product code are defined; An information processing device comprising:

Images