Information processing terminals

Abstract

Invention details;

Description

Information processing terminal and recording medium

[0001] An embodiment of the present invention relates to an information processing terminal and a recording medium.

[0002] A transaction processing system is already known in which, when a customer shops in a sales area where products are displayed, the customer operates a mobile terminal such as a smartphone or tablet terminal to input data related to the products they are purchasing.

[0003] This type of transaction processing system uses a dedicated self-checkout machine to process the payments of customers who have entered data on the purchased items they have placed in their shopping carts, etc. In this type of system, to prevent customers from forgetting to register items or from registering items incorrectly, a store clerk in the checkout area verifies the purchased items placed in the customer's shopping carts, etc., against the registered items.

[0004] However, it is difficult to verify the purchased products for all customers and all purchased products, so measures are needed to prevent forgetting to register in advance or fraudulent registration.

[0005] Japanese Patent Application Publication No. 2020-107122

[0006] The problem to be solved by the embodiments of the present invention is to provide a technique for preventing forgetting to register a product or preventing fraudulent registration.

[0007] FIG. 1 is a block diagram illustrating a schematic configuration of a transaction processing system according to an embodiment. FIG. 2 is a perspective view illustrating an example of a shopping cart according to an embodiment. FIG. 3 is a sequence diagram used to explain operations before a customer using the transaction processing system purchases. FIG. 4 is a sequence diagram used to explain operations during the customer's shopping and before payment. FIG. 5 is a sequence diagram used to explain operations during payment at the customer's dedicated payment machine. FIG. 6 is a schematic diagram illustrating an example of an entry code reading screen displayed on a smartphone according to an embodiment. FIG. 7 is a schematic diagram illustrating an example of a registration screen displayed on a smartphone according to an embodiment. FIG. 8 is a schematic diagram illustrating an example of a scanning screen displayed on a smartphone according to an embodiment. FIG. 9 is a schematic diagram illustrating an example of a registration screen displayed on a smartphone according to an embodiment. FIG. 10 is a schematic diagram illustrating an example of a payment screen displayed on a smartphone according to an embodiment. FIG. 11 is a block diagram illustrating an example of the configuration of a monitoring server according to an embodiment. FIG. 12 is a block diagram illustrating an example of the configuration of a smartphone according to an embodiment. FIG. 13 is a block diagram illustrating an example of the configuration of a monitoring terminal according to an embodiment. FIG. 14 is a diagram showing the main data structure of a first index file stored in a transaction data storage area according to an embodiment. FIG. 15 is a diagram showing the main data structure of a first transaction file stored in a transaction data storage area according to an embodiment. FIG. 16 is a diagram showing the main data structure of captured image management data stored in a captured image storage area according to an embodiment. FIG. 17 is a schematic diagram showing an example of a guidance screen displayed on a smartphone according to an embodiment. FIG. 18 is a flowchart showing an example of an information processing procedure by a smartphone according to an embodiment. FIG. 19 is a schematic diagram showing an example of an image capture guide screen displayed on a smartphone according to an embodiment. FIG. 20 is a flowchart showing another example of an information processing procedure by a smartphone according to an embodiment. FIG. 21 is a schematic diagram showing an example of a registered product details screen displayed on a monitoring terminal according to an embodiment. FIG. 22 is a schematic diagram showing an example of a registered product confirmation screen displayed on a monitoring terminal according to an embodiment.23 is a schematic diagram illustrating an example of a registered product confirmation screen displayed on a monitoring terminal according to an embodiment, and FIG. 24 is a flowchart illustrating an example of an information processing procedure by the monitoring terminal according to an embodiment. Embodiment

[0008] In one embodiment, the information processing terminal includes a determination unit, a display control unit, an acquisition unit, and a transmission unit. The determination unit determines whether information related to product registration satisfies the photography conditions. The display control unit displays automatic product photography guidance on the display unit based on the determination result of the determination unit. The acquisition unit acquires photographed image data of the photographed product based on the automatic photography of the product. The transmission unit transmits the photographed image data acquired by the acquisition unit.

[0009] An embodiment will be described below with reference to the drawings. This embodiment illustrates a transaction processing system in which, when a customer purchases a product at a sales floor where the products are displayed, the customer operates a mobile terminal, such as a smartphone, to input data related to the purchased product, and the customer also performs the transaction themselves using a dedicated cash register. The smartphone is an example of an information processing device operated by a customer. In the following description, the term "customer" may be interpreted as a user, consumer, or member.

[0010] (Configuration of Transaction Processing System 100) FIG. 1 is a block diagram showing a schematic configuration of transaction processing system 100 according to this embodiment. Transaction processing system 100 includes a server system 10 that uses cloud computing and a POS (Point of Sales) system 20 established at an affiliated store. Server system 10 and POS system 20 enable two-way data communication via a network 30 that uses the Internet Protocol. Network 30 is a wide-area network that uses public lines or dedicated lines as a relay network and wired local area networks (LANs), wireless LANs, mobile communication networks, mobile phone communication networks, etc. as access networks. Therefore, a smartphone 40 that uses a mobile phone communication network can access server system 10 via network 30.

[0011] A member store is a store that has signed a service contract with the management company of the server system 10. Note that FIG. 1 shows the POS system 20 of one member store. Needless to say, the POS systems of other member stores are similarly connected to the network 30. However, the POS systems of other member stores do not necessarily have the same configuration as the POS system 20 shown in FIG. 1. Some of the configuration of the POS system may differ depending on the member store.

[0012] The server system 10 comprises a database server 11, a management server 12, and a virtual POS server 13, with the servers connected to each other via a communication line 14. The server system 10 also connects a router 15 to the communication line 14, and is connected to a network 30 via the router 15.

[0013] The database server 11 is a computer that provides services for managing an affiliated store database 111, a member database 112, a first product master 113 for each affiliated store, and the like.

[0014] The member store database 111 is a collection of member store records created for each member store. Each member store record is a data record that records a unique store ID assigned to each member store and various data related to that member store. The data in the member store record includes the network address and other information required for data communication with that member store via the network 30.

[0015] Member database 112 is a collection of member records created for each consumer who has registered as a member to shop using transaction processing system 100. The member record is a data record that records a unique member ID assigned to each consumer and various data related to that consumer.

[0016] The first product master 113 of each affiliated store is a collection of product records created for each product sold at the corresponding affiliated store. The product record is a data record that records a unique product code assigned to each product and various data related to the product. The product record data includes the product name, price, etc. Each first product master 113 is uploaded from the POS system 20 of the corresponding affiliated store to the database server 11, for example, at a predetermined time before the store opens.

[0017] Incidentally, the first product master 113 may be managed by the virtual POS server 13. Also, the affiliated store database 111 and the member database 112 may be managed by the management server 12, and the database server 11 may be omitted.

[0018] The management server 12 is a computer that cooperates with the database server 11 and the virtual POS server 13 to provide a service for managing information related to transactions of customers who shop at affiliated stores using the transaction processing system 100. The virtual POS server 13 is a computer that provides a service for virtually registering sales data of products purchased by customers in accordance with a POS application. The main functions of the management server 12 and the virtual POS server 13 will be made clear in the operation explanation below.

[0019] The POS system 20 includes a store server 21, an accounting server 22, a monitoring terminal 23, a POS terminal 24, a dedicated accounting machine 25, and a monitoring server 26, all of which are connected via an in-store network 27. The POS system 20 also connects a router 28 to the in-store network 27, and is connected to a network 30 via this router 28. The POS system 20 also connects an access point 29 to the in-store network 27, and via this access point 29, enables data communication via wireless LAN with mobile terminals such as smartphones 40 and tablet terminals.

[0020] The store server 21 is a computer that provides services to manage sales information, product inventory information, order information, etc. of the affiliated store in which the POS system 20 is established, based on information on transactions settled at the affiliated store.

[0021] The store server 21 includes a second product master 211. The second product master 211 is a collection of product records created for each product sold at the affiliated store. The product record is a data record that records a unique product code assigned to each product and various data related to the product. The product record data includes the product name, price, etc. In other words, the second product master 211 becomes the first product master 113 when uploaded to the server system 10. However, if the price, etc. is changed during business hours, the second product master 211 reflects the change in data. Therefore, depending on the product, the price, etc. may differ between the first product master 113 and the second product master 211.

[0022] The store server 21 is a computer that provides a service supporting the member monitoring function performed by the monitoring terminal 23. The member monitoring function monitors the status of customers shopping using the transaction processing system 100. This member monitoring function displays a list of registered products for which customers have entered data using the smartphone 40 at the sales floor on the monitor of the monitoring terminal 23. Registered products are products for which customers have entered data using the smartphone 40 and have not yet been paid for. Registered products are also simply referred to as products. The monitoring terminal 23 displays monitoring images on the monitor. The monitoring images are images for monitoring information about registered products entered using the smartphone 40 and the status of the smartphone 40. The monitoring images include a list of registered products and photographed images of purchased products. Purchased products are products that customers have added to a shopping cart or other device that they plan to purchase and have not yet been paid for. The member monitoring function includes a function for comparing the information about registered products of a customer with the purchased products for monitored items. Monitored items include products or product registrations that are suspected of being forgotten to be registered or fraudulently registered. In addition, a warning is displayed on the monitor if an event that should be notified to a store clerk occurs as a result of the data entry. Events that should be notified to store staff include, for example, when a customer purchases alcohol, cigarettes, etc. that have age restrictions, or when a registration error occurs because the product code of the scanned barcode is not set in the second product master 211.

[0023] The accounting server 22 is a computer that provides services to support member accounting using the dedicated accounting machine 25. The functions of the accounting server 22 will be made clear in the operation explanation given below.

[0024] POS terminal 24 is a payment machine primarily used to settle transactions with customers who do not use transaction processing system 100. POS terminal 24 is operated by a store clerk. POS terminal 24 can also settle transactions with customers who use transaction processing system 100. Note that the POS terminal may be a semi-self-service POS terminal separated into a registration machine and a payment machine, with the registration machine operated by a store clerk and the payment machine operated by a customer. The POS terminal may also be a full-self-service POS terminal in which the registration process and payment process are performed by the customer themselves.

[0025] Dedicated accounting machine 25 is an accounting machine for settling transactions with customers who use transaction processing system 100. Dedicated accounting machine 25 is operated by the customer. Customers who do not use transaction processing system 100 cannot make payments at dedicated accounting machine 25.

[0026] The dedicated accounting machine 25 has the function of scanning accounting barcodes displayed on smartphones 40 used by customers using the transaction processing system 100, the function of processing payment amounts corresponding to various payment methods such as electronic money, credit cards, and cash, and the function of charging electronic money.

[0027] The monitoring server 26 is a computer that works in conjunction with the server system 10 to monitor information about registered products entered by customers using smartphones 40 at the sales floor. The monitoring server 26 works in conjunction with the store server 21 to process information to enable the member monitoring function of the monitoring terminal 23. The functions of the monitoring server 26 will be made clear in the operation description below. The monitoring server 26 is an example of an information processing device.

[0028] (Configuration of Shopping Cart) Figure 2 is a perspective view showing an example of a cart C according to one embodiment. The cart C includes a caster portion C1 for movement, a handle frame portion C2, and a basket holder C3. The caster portion C1 has four wheels for smooth movement on the floor. The handle frame portion C2 includes a pair of vertical frames C21, C21 erected on the rear wheel side of the caster portion C1, and a handle bar C22 connecting the upper ends of these vertical frames C21, C21. The basket holder C3 is located forward from the midpoint of the handle frame portion C2. A shopping basket BA provided by the store can be placed on the cart C on the basket holder C3 and below it.

[0029] A pole C4 is attached to one vertical frame C21 of the cart C. A stand 400 for a smartphone 40 is provided at the tip of the pole C4. A consumer using the cart C can place their own smartphone 40 on the stand 400 and go shopping.

[0030] (Operations of Transaction Processing System 100) Next, the main operations of the transaction processing system will be described. The operations will be explained in the order of advance preparation, before shopping, during shopping, before checkout, and checkout.

[0031] <Advance Preparation> A consumer who wishes to shop at an affiliated store using transaction processing system 100 first installs a dedicated application program (hereinafter referred to as the shopping app) on their smartphone 40 and registers as a member. Member registration is performed via network 30 with management server 12 of server system 10. Management server 12 issues a unique member ID to the consumer who has registered as a member, and registers a member record containing that member ID in member database 112. Management server 12 also notifies smartphone 40 of the consumer who has registered as a member of the member ID via network 30. Smartphone 40 stores the member ID in association with the shopping app.

[0032] By registering as a member, a consumer becomes a member. Members can register to use electronic money that can be used at affiliated stores. Registration is performed from smartphone 40 to management server 12 via network 30. Management server 12 records the electronic money ID of the electronic money that has been registered for use in the member record in which the member ID of the member is recorded. Note that registration to use electronic money is not mandatory.

[0033] <Before Shopping (See FIGS. 3 and 6)> Before entering an affiliated store, a member operates the smartphone 40 to launch the shopping app. When the shopping app is launched, the touch panel screen of the smartphone 40 transitions to a store entry code reading screen Sa (FIG. 6). The store entry code reading screen Sa is a screen for reading the store entry code Cin (FIG. 3) using the camera mounted on the smartphone 40.

[0034] The entry code Cin is prepared at the entrance of the affiliated store. For example, the entry code Cin is printed on paper and attached to the entrance. For example, the entry code Cin is displayed on a display placed at the entrance. The entry code Cin is setting information related to the affiliated store coded, for example, using a two-dimensional code system. The setting information includes a store ID, wireless LAN data, etc. set for the affiliated store. The wireless LAN data is an SSID, password, security information, etc. required for the smartphone 40 to connect to the access point 29 using the wireless LAN.

[0035] As shown in Figure 6, a camera activation button Ba is displayed on the store entry code reading screen Sa. The member touches the camera activation button Ba. This activates the camera on the smartphone 40, and the member points the camera lens at the store entry code Cin. The camera scans the store entry code Cin.

[0036] When the store entry code Cin is scanned, the smartphone 40 transmits a store entry request command CMa ( FIG. 3 ) to the management server 12 via the network 30. The store entry request command CMa includes at least the member ID and the store ID included in the store entry code Cin.

[0037] The management server 12 obtains the member ID from the store entry request command CMa and performs member authentication (ACT 1 in Figure 3). Member authentication is performed by confirming whether the member ID is managed as a valid member ID. For example, an invalid flag is recorded in a member record containing the member ID of a consumer who has lost their membership due to reasons such as a withdrawal request or fraudulent activity. If the management server 12 obtains, from the store entry request command CMa, the member ID of a member record in which an invalid flag is recorded, the management server 12 denies the member authentication. If the management server 12 obtains, from the store entry request command CMa, the member ID of a member record in which an invalid flag is not recorded, the management server 12 approves the member authentication.

[0038] The management server 12 determines whether to approve or deny the member authentication (ACT 2 in FIG. 3). If the member authentication is denied, the management server 12 returns an entry denial command CMb to the smartphone 40. The entry denial command CMb is sent to the smartphone 40 via the network 30. Upon receiving the entry denial command CMb, the smartphone 40 stops the shopping app. Therefore, the customer cannot perform so-called self-service shopping at the affiliated store, where the customer operates the smartphone 40 to input data related to the purchased items.

[0039] If the member authentication is approved, the management server 12 issues a transaction ID (ACT 3 in Figure 3). The transaction ID is a unique ID assigned to each purchase, i.e., the transaction of buying and selling goods, made by a member at an affiliated store. For example, a unique transaction ID is issued by combining a store code, a date, and a serial number. The management server 12 associates the member ID and store ID acquired from the store entry request command CMa with the issued transaction ID and records them in the linkage table 70 (Figure 3). In other words, the linkage table 70 is a data table that associates the member ID of a consumer making a self-service purchase with the store ID of the affiliated store where the purchase was made and the unique transaction ID issued for that transaction.

[0040] The management server 12 replies with a store entry approval command CMc to the smartphone 40. The store entry approval command CMc is sent to the smartphone 40 via the network 30. Upon receiving the store entry approval command CMc, the smartphone 40 connects to the access point 29 via wireless LAN using the wireless LAN data acquired from the store entry code Cin. When the smartphone 40 is connected to the access point 29 via wireless LAN, the touch panel screen transitions to a shopping start screen. The shopping start screen is a screen that prompts the consumer to start shopping. A shopping start button is displayed on the shopping start screen.

[0041] Meanwhile, the management server 12 that sent the store entry approval command CMc sends a transaction file creation instruction command CMd to the virtual POS server 13. The creation instruction command CMd includes the store ID and transaction ID that are stored in association with the member ID in the linkage table 70. Upon receiving the creation instruction command CMd, the virtual POS server 13 creates a transaction file 80 (FIG. 3) in its memory. The virtual POS server 13 then writes the store ID and transaction ID included in the creation instruction command CMd into the transaction file 80. The transaction file 80 is a data file that records sales data for products purchased by a member identified by the transaction ID in a transaction with that member, and payment data for the settlement amount of that transaction.

[0042] <During Shopping (See FIGS. 4, 7, 8, and 9)> After checking the shopping start screen, the member touches the start shopping button. This transitions the touch panel screen to the registration screen Sb (FIG. 7). As shown in FIG. 7, the registration screen Sb displays the total number of registered items and the total price. However, because no purchased items have yet been registered, both the total number of registered items and the total price are "0." The registration screen Sb also displays a no barcode button Bb, a scan button Bc, and a checkout button Bd. The no barcode button Bb is a button that is touched when entering data for an item that does not have a barcode. The scan button Bc is a button that is touched when entering data for an item that does have a barcode. The checkout button Bd is a button that is touched when completing shopping and instructing checkout. However, because no items have yet been registered, the checkout button Bd is inoperable. For example, the checkout button Bd is grayed out. The checkout button Bd may also be erased.

[0043] When a member finds a product they wish to purchase in a sales area where products are displayed, they check whether the product has a barcode BC (FIG. 4). If the product has a barcode BC, the member touches the scan button Bc. When the scan button Bc is touched, the touch panel screen transitions to the scanning screen Sc (FIG. 8). As shown in FIG. 8, the scanning screen Sc displays a frame ARa indicating the barcode reading area. Also displayed are a no barcode button Bb and a back button Be. The back button Be is a button that is touched to cancel scanning of the barcode BC.

[0044] The member operates the smartphone 40 so that the barcode BC of the purchased product is within the frame ARa. When the barcode BC is within the frame ARa, the camera of the smartphone 40 scans the barcode BC.

[0045] After scanning the barcode BC, the smartphone 40 transmits a registration request command CMe (FIG. 4) to the management server 12 via the wireless LAN. The registration request command CMe includes the member ID and the barcode BC data, i.e., barcode data. The registration request command CMe is received by the access point 29 and then transmitted from the router 28 to the management server 12 via the network 30.

[0046] The management server 12 searches the linkage table 70 for the member ID included in the registration request command CMe to obtain the store ID and transaction ID associated with the member ID. The management server 12 then sends the registration request command CMf, in which the member ID has been replaced with the store ID and transaction ID, to the virtual POS server 13.

[0047] The virtual POS server 13 obtains the store ID, transaction ID, and barcode data from the registration request command CMf. The virtual POS server 13 then obtains a product code from the barcode data. The virtual POS server 13 searches the first product master 113 of the affiliated store identified by the store ID to obtain a product record containing the product code. Based on the product data in the product record, the virtual POS server 13 then registers product sales data, including the product code, product type, product name, price, sales quantity, sales amount, etc., in the transaction file 80, which contains the store ID and transaction ID.

[0048] The management server 12 obtains the transaction file 80 in which product sales data is registered from the virtual POS server 13. The management server 12 then sends a registration response command CMg ( FIG. 4 ) to the smartphone 40 that sent the registration request command CMe. The registration response command CMg includes the data of the transaction file 80 obtained from the virtual POS server 13. The registration response command CMg is sent from the router 15 to the POS system 20 via the network 30, and then from the access point 29 to the smartphone 40.

[0049] When the smartphone 40 receives the registration response command CMg, the touch panel screen transitions to a registration screen Sd (FIG. 9). The registration screen Sd is the screen displayed when the product sales data for the first product AAA has been registered in the transaction file 80. As shown in FIG. 9, the registration screen Sd displays the sales price of product AAA, "¥100," and the number of items sold, "1 item." The total number of items becomes "1 item," and the total amount becomes "¥100." The checkout button Bd can also be pressed.

[0050] After that, the member touches the scan button Bc to scan the barcode of each subsequent purchased item. This causes the management server 12 and virtual POS server 13 to operate in the same manner as above. As a result, the registration screen Sd displays the name of the purchased item, the sales price, the number of items sold, and the total number and price.

[0051] As mentioned above, the sales price of the product sales data stored in the transaction file 80 is calculated based on the price in the first product master 113. Even if a price change occurs during business hours, the price change is not reflected in the first product master 113. Therefore, the sales price and total price displayed on the registration screen Sd may differ from the amount based on the current price. Therefore, the sales price and total price displayed on the registration screen Sd are merely considered as a reference price during shopping.

[0052] If the purchased item does not have a barcode attached, the member touches the No Barcode button Bb. A list of items without barcodes is then displayed on the touch panel of the smartphone 40, and the member selects the item to purchase from the list. A registration request command CMe containing the item ID of the purchased item is then sent to the management server 12. Subsequent operations are the same as when the item's barcode BC is scanned with the smartphone 40.

[0053] <Before Checkout (see FIGS. 4 and 10)> After shopping in the sales area, a member moves on to checkout by touching the checkout button Bd on the registration screen Sd. When the checkout button Bd is touched, the smartphone 40 sends a checkout request command CMh (FIG. 4) to the management server 12 via the wireless LAN. The checkout request command CMh includes the member ID. The checkout request command CMh is received by the access point 29 and transmitted from the router 28 to the management server 12 via the network 30.

[0054] The management server 12 issues an accounting code (ACT 11 in FIG. 4). The accounting code is, for example, a combination of date, time, and a serial number, and no duplicate accounting codes are issued within at least one business day. The management server 12 generates a first image Ca (ACT 12 in FIG. 4) (ACT 10 in FIG. 4). The first image Ca is an image of the accounting code converted into a barcode, that is, an image of an accounting barcode.

[0055] The management server 12 sends an accounting approval command CMi to the smartphone 40 that sent the accounting request command CMh. The accounting approval command CMi includes a first image Ca.

[0056] The billing approval command CMi is sent to the POS system 20 via the network 30, and then from the access point 29 to the smartphone 40 via the wireless LAN. When the smartphone 40 receives the billing approval command CMi, the touch panel screen changes to the billing screen Se ( FIG. 10 ). As shown in FIG. 10 , the billing screen Se displays the first image Ca. The billing screen Se also displays an End button Bf. The End button Bf is touched to cancel the billing.

[0057] The management server 12 also obtains the store ID and transaction ID stored in the linkage table 70 in association with the member ID obtained from the transaction request command CMh. The management server 12 then obtains a transaction file 80 containing the store ID and transaction ID from the virtual POS server 13. The management server 12 then transmits the transaction file 80 and accounting code to the POS system 20 of the affiliated store identified by the store ID. The transaction file 80 and accounting code data are then transmitted via the network 30 to the store server 21 of the corresponding affiliated store. The store server 21 then transfers the transaction file 80 and accounting code data received from the management server 12 to the accounting server 22. The accounting server 22 stores the transaction file 80 in memory in association with the accounting code.

[0058] <Payment (see FIG. 5)> After checking the payment screen Se, the member uses the dedicated payment machine 25 to pay using various payment methods such as electronic money, credit card, or cash.

[0059] The operation of a transaction using the dedicated accounting machine 25 will be described using Figure 5. The member scans the first image Ca on the transaction screen Se, i.e., the transaction barcode, with the scanner of the dedicated accounting machine 25. The transaction barcode data, known as barcode data BCD (Figure 5), is then sent from the dedicated accounting machine 25 to the transaction server 22.

[0060] The accounting server 22 obtains the accounting code from the barcode data BCD (Act 21 in Figure 5). The accounting server 22 then retrieves the transaction file 80 associated with the accounting code from memory (Act 22 in Figure 5). The accounting server 22 then transmits the transaction file 80 to the dedicated accounting machine 25.

[0061] The dedicated accounting machine 25 recalculates the payment amount by referencing the second product master 211 managed by the store server 21. Specifically, the dedicated accounting machine 25 obtains the product code registered in the transaction file 80. The dedicated accounting machine 25 then searches the second product master 211 to obtain the price of the product record containing that product code. The dedicated accounting machine 25 multiplies that price by the sales quantity registered in the transaction file 80 along with the product code to calculate the sales amount of the purchased product identified by that product code. The dedicated accounting machine 25 performs the above process for all product codes registered in the transaction file 80. The dedicated accounting machine 25 then adds up the sales amounts of all purchased products to calculate the payment amount.

[0062] The dedicated payment machine 25 displays the recalculated payment amount on its display and waits for the customer to select a payment method (ACT 32 in Figure 5). The recalculated payment amount may differ from the total amount displayed on the smartphone 40. Even in this case, the total amount displayed on the smartphone 40 is only a reference amount, so the customer will pay the payment amount displayed on the dedicated payment machine 25.

[0063] The member selects a payment method. For example, if cash is selected, the dedicated accounting machine 25 executes a payment process to pay the settlement amount in cash (ACT 33 in FIG. 5). For example, if credit card is selected, the dedicated accounting machine 25 executes a payment process to pay the settlement amount by credit card. Note that these payment processes are well known, so detailed explanations will be omitted here.

[0064] When the payment process is complete, the dedicated accounting machine 25 sends a payment completion notification command CMj to the accounting server 22. The payment completion notification command CMj includes payment data. For example, in the case of a cash payment, the payment data includes the amount of the deposit, the amount of change, etc. In the case of a credit card payment, the payment data includes the amount of the credit card payment, etc.

[0065] The accounting server 22 registers the payment data in the transaction file 80. The accounting server 22 also sets an end status in the transaction file 80. The transaction file 80 with the end status set is saved in the recording unit of the accounting server 22 or the store server 21.

[0066] 11 is a block diagram showing a schematic configuration example of the monitoring server 26 according to one embodiment. The monitoring server 26 includes a processor 261, a main memory 262, an auxiliary storage unit 263, a communication interface 264, and a transmission path 265. The processor 261, the main memory 262, the auxiliary storage unit 263, and the communication interface 264 are capable of communicating with each other via the transmission path 265. The monitoring server 26 is a computer constituted by the processor 261, the main memory 262, the auxiliary storage unit 263, and the transmission path 265 connecting these.

[0067] The processor 261 corresponds to the central part of the computer. The processor 261 controls each part to realize various functions of the monitoring server 26 in accordance with an operating system and application programs. The processor 261 may be a processing circuit such as a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), or a field programmable gate array (FPGA)). The processor 261 is not limited to being configured as a single processing circuit, and may also be configured as a combination of multiple processing circuits.

[0068] The main memory 262 corresponds to the main storage portion of the computer. The main memory 262 includes a nonvolatile memory area and a volatile memory area. The main memory 262 stores an operating system and application programs in the nonvolatile memory area. The main memory 262 may also store data required for the processor to execute processes to control each part in either the nonvolatile or volatile memory area. The main memory 262 uses the volatile memory area as a work area where data can be rewritten by the processor as appropriate. For example, the nonvolatile memory area is ROM (Read Only Memory). The volatile memory area is RAM (Random Access Memory).

[0069] The auxiliary storage unit 263 corresponds to the auxiliary storage portion of the computer. For example, an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), a HDD (Hard Disc Drive), or an SSD (Solid State Drive) is used as the auxiliary storage unit 263. The auxiliary storage unit 263 stores data used by the processor 261 when performing various processes and data created by the processes of the processor 261. The auxiliary storage unit 263 may also store the application programs described above.

[0070] The communication interface 264 performs data communication in accordance with a predetermined communication protocol with each unit connected to the in-store network 27. As the communication interface 264, for example, a well-known communication device for a LAN can be applied.

[0071] The transmission path 265 includes an address bus, a data bus, and control signal lines, and transmits data and control signals exchanged between the connected components.

[0072] The auxiliary storage unit 263 includes a transaction data storage area 2631 , a photography condition storage area 2632 , and a photographed image storage area 2633 .

[0073] The transaction data storage area 2631 stores first transaction data based on data stored in the virtual POS server 13. The first transaction data is an example of information related to product registration via multiple smartphones 40. The information related to product registration includes information related to products registered via the smartphone 40 before payment and information related to product registration via the smartphone 40. The information related to product registration includes information indicating the product type, product price, and registered points. The product type includes information indicating products with age restrictions, such as alcohol and tobacco. The price indicates the unit price of the product. The registered points indicate the total points of the product registered by the member. The information related to product registration includes information related to product registration operations via the smartphone 40 and information related to the time associated with product registration via the smartphone 40. The information related to product registration operations includes information related to editing, such as adding or deleting registered products, information related to operations to register products without barcodes, information related to operations to transition to checkout processing, and location information of the location where the product registration operation was performed. The information related to time includes information indicating the duration of stay, the time of the most recent operation, etc., as described below.

[0074] The first transaction data includes a first index file and a first transaction file. The first transaction data includes data corresponding to second transaction data stored in each smartphone 40, which will be described later. The first index file is data associated with multiple first transaction files. The first index file is a collection of index file records created for each terminal ID. The first index file includes data corresponding to second index files stored in each smartphone 40, which will be described later. The index file record is a data record that associates and records a terminal ID with a transaction ID, stay time, most recent operation time, registered points, status, and accounting machine ID, etc.

[0075] The terminal ID is a unique code assigned to each smartphone 40 to individually identify each smartphone 40. The transaction ID is a unique code assigned to each first transaction file to individually identify the first transaction file, which records transactions made using the smartphone 40. The transaction ID is set in the first transaction file each time the first transaction file is created. The transaction ID is associated with the member ID and store ID, as in the linkage table 70. The stay time indicates the time elapsed since the member logged in. The most recent operation time indicates the time when the member last operated the smartphone 40. For example, the most recent operation time indicates the time when the member registered the last product. The status is a terminal status that indicates the state of the smartphone 40. Terminal statuses represent "waiting," "registering," and "checkout." "Waiting" refers to the state from when the previous member has finished checking out until the next member logs in. "Registering" refers to the state from when the member logs in until the checkout is approved. The state before the checkout is approved is also referred to as the state before the checkout process is performed. "Checkout in progress" is the state from when the checkout is approved until it is completed. The checkout machine ID is a unique code assigned to each checkout machine to identify it individually. The first index file may contain information such as the total price of registered products in addition to the above items. The first index file is associated with the first transaction file using the transaction ID as a key. Details of the first index file will be described later.

[0076] The first transaction file is a collection of transaction file records created for each transaction ID. The transaction file record is a data record that records the transaction ID in association with product sales data. The product sales data includes the product code, product type, product name, price, number of items sold, sales amount, etc. The first transaction file may be data generated in the same way as transaction file 80. The first transaction file is updated each time a product is registered by a member. Details of the first transaction file will be described later.

[0077] The photographing condition storage area 2632 stores photographing conditions. The photographing conditions indicate conditions for photographing purchased items using the smartphone 40. The photographing conditions include at least one of conditions related to the item and conditions related to item registration. The photographing conditions are conditions related to the item to be monitored or conditions related to item registration. The product conditions are conditions to be compared with information about the item. The product conditions include, for example, conditions related to the number of points, price, and type of registered item. The condition related to the number of items may be, for example, a fixed number such as "5 points," or may be points at regular intervals such as "every 5-point increment." If the condition related to the number of items is every 5-point increment, the condition related to the number of items includes registered points that are multiples of 5, such as 5 points, 10 points, or 15 points. Note that the interval does not have to be constant. The interval can be appropriately set, such as narrowing or widening as the registered number of items increases. The condition related to the number of items includes, for example, the first time the number of items of the registered item reaches a predetermined number. The first time the number of points of a registered product reaches a predetermined number includes, for example, the first time the number of points of a registered product reaches 5, 10, or 15. The predetermined number includes multiples of 5, such as 5, 10, or 15. The predetermined number may be a number at regular intervals, or may be a number set randomly. A condition regarding the amount is, for example, a high-priced product such as "1,000 yen or more." A condition regarding the type is, for example, "alcoholic beverages."

[0078] The conditions related to product registration include conditions related to product registration operations and conditions related to time. The conditions related to product registration operations are conditions that are compared with information related to product registration operations. The conditions related to product registration operations include, for example, conditions related to editing, such as adding, deleting, or canceling registered products, conditions related to operations to register products without barcodes, conditions related to operations to transition to checkout, and conditions related to location information of the location where the product registration operation was performed. Examples of editing conditions include "adding the number of sales units of a registered product" and "canceling a registered product." The condition related to operations to register products without barcodes is, for example, "the no barcode button being operated." The condition related to operations to transition to checkout is, for example, "the checkout button being operated." The condition related to location information of the location where the product registration operation was performed is, for example, "the location where the product was registered is different from the display position of the registered product." The time condition is a condition that is compared with information related to time. The time condition includes, for example, conditions related to stay time and conditions related to the time of the most recent operation. The stay time condition is, for example, "stay time exceeding a certain period of time." The condition regarding the immediately preceding operation time is, for example, "a certain period of time has elapsed since the immediately preceding operation time." The certain period of time can be set as appropriate.

[0079] The photographing conditions may be set in advance, or may be set or updated as appropriate by a store manager or the like.

[0080] The photographed image storage area 2633 stores photographed image management data. The photographed image management data includes photographed image data taken by the smartphone 40. The photographed image data includes data of images of products purchased by the member who owns the smartphone 40. The photographed image storage area 2633 may store photographed image data indicating multiple photographed images in chronological order. The photographed image management data is updated each time photographed image data is acquired by the acquisition unit 2612. The photographed image storage area 2633 stores photographed image management data in which photographed image data is associated with information related to the photograph at which the photographed image data was acquired. The information related to the photograph includes information related to the photographing conditions, such as "5th item" or "10th item," information related to the photograph, such as the position of the shopping cart, the time of photographing, etc. The position of the shopping cart includes information such as the top or bottom of the cart.

[0081] The hardware configuration of the monitoring server 26 is not limited to the above configuration, and the monitoring server 26 allows the omission or modification of the above components and the addition of new components as appropriate.

[0082] 12 is a block diagram schematically illustrating an example configuration of a smartphone 40 according to an embodiment. The smartphone 40 includes a processor 401, a main memory 402, an auxiliary storage unit 403, a touch panel 404, a camera 405, an audio output device 406, a wireless communication unit 407, a mobile communication unit 408, and a transmission path 409. The processor 401 is capable of communicating with the main memory 402, the auxiliary storage unit 403, the touch panel 404, the camera 405, the audio output device 406, the wireless communication unit 407, and the mobile communication unit 408 via the transmission path 409. The processor 401, the main memory 402, and the auxiliary storage unit 403 are connected via the transmission path 409 to form a computer for controlling the smartphone 40. The processor 401, the main memory 402, the auxiliary storage unit 403, and the transmission path 409 have generally the same functions as the processor 261, the main memory 262, the auxiliary storage unit 263, and the transmission path 265, and therefore a description thereof will be omitted. The smartphone 40 is an example of an information processing terminal.

[0083] The touch panel 404 functions as an operation device and a display device of the smartphone 40. The touch panel 404 is an example of a display unit that displays information or a notification unit that visually notifies information.

[0084] The camera 405 includes an optical system and an image sensor, and generates image data representing an image within a field of view formed by the optical system using the image sensor. The camera 405 is an example of an imaging unit.

[0085] The audio output device 406 is a device capable of outputting sound under the control of the processor 401. The audio output device 406 is an example of an audio output unit that outputs information by voice or a notification unit that notifies information audibly.

[0086] The wireless communication unit 407 transmits and receives data via wireless communication in accordance with a wireless communication protocol to and from the access point 29. As the wireless communication unit 407, for example, a well-known communication device conforming to the IEEE 802.11 standard can be used.

[0087] The mobile communication unit 408 is an interface for data communication via the network 30. As the mobile communication unit 408, for example, a well-known communication device for performing data communication via a mobile communication network can be used.

[0088] The auxiliary storage unit 403 includes a smartphone POS application 4031, which is one of the information processing programs, a transaction data storage area 4032, and an image capture condition storage area 4033. The auxiliary storage unit 403 is an example of a storage section.

[0089] The smartphone POS app 4031 is an application program that describes information processing for causing the smartphone 40 to function as a user interface for the POS system 20. The smartphone POS app 4031 is used in common by multiple smartphones 40.

[0090] The transaction data storage area 4032 stores second transaction data based on data stored in the virtual POS server 13. The second transaction data is an example of information related to product registration via the smartphone 40. The second transaction data includes a second index file and a second transaction file. The second index file and the second transaction file include information related to products registered via the smartphone 40. The second index file is made up of data that associates a terminal ID, a transaction ID, a stay time, a time of the most recent operation, the number of registered items, a status, an accounting machine ID, etc.

[0091] The terminal ID is a unique code set to identify the smartphone 40. The transaction ID is a unique code set for each second transaction file to individually identify the second transaction file that records transactions performed using the smartphone 40. The transaction ID is set in the second transaction file each time the second transaction file is created. The transaction ID is associated with the member ID and the store ID, similar to the linkage table 70. The second index file includes index file records from the first index file stored in the transaction data storage area 2631 of the monitoring server 26, which are associated with the terminal ID corresponding to each smartphone 40.

[0092] The second transaction file is composed of data that associates transaction IDs with product sales data. The product sales data includes product codes, product types, product names, prices, sales units, sales amounts, etc. The second transaction file may be data generated in the same manner as the transaction file 80. The second transaction file is updated each time a product is registered by a member. The second transaction file includes transaction file records from the first transaction file stored in the transaction data storage area 2631 of the monitoring server 26 that are associated with transaction IDs corresponding to each smartphone 40.

[0093] The photographing condition storage area 4033 stores photographing conditions. The photographing conditions are photographing conditions received from the monitoring server 26. The photographing conditions may be photographing conditions according to the user (customer) of the smartphone 40, the store where the smartphone 40 is used, the time when the smartphone 40 is used, etc., among the photographing conditions stored in the photographing condition storage area 2632 of the monitoring server 26. Different photographing conditions may be set based on the store, the user, the time of entry into the store, etc. The photographing conditions may be stored in the main memory 402.

[0094] The hardware configuration of the smartphone 40 is not limited to the above-described configuration. The smartphone 40 allows the above-described components to be omitted or changed, and new components to be added, as appropriate.

[0095] The following describes each unit implemented in the above-mentioned processor 401. The processor 401 implements a receiving unit 4010, a determining unit 4011, a display control unit 4012, an imaging control unit 4013, an acquiring unit 4014, a storage control unit 4015, and a transmitting unit 4016. The units implemented in the processor 401 can also be referred to as each function. The units implemented in the processor 401 can also be referred to as being implemented in a control unit including the processor 401 and the main memory 402.

[0096] The receiving unit 4010 receives the photographing conditions from the monitoring server 26 via the wireless communication unit 407 before the customer starts shopping. Before the customer starts shopping is, for example, before the customer is able to register a product. Before the customer starts shopping is, for example, when the smartphone 40 receives a store entry approval command CMc from the management server 12. In this case, the receiving unit 4010 receives the photographing conditions from the monitoring server 26 based on the reception of the store entry approval command CMc.

[0097] The determination unit 4011 determines whether the second transaction data satisfies the photographing conditions.

[0098] The display control unit 4012 displays automatic photographing guidance for the product on the touch panel 404 based on the determination result of the determination unit 4011. The automatic photographing guidance is, for example, a notification indicating that the product will be automatically photographed. The automatic photographing guidance is, for example, text information such as "Photographing will be taken" or "Photographing will be taken in 5 seconds." The automatic photographing guidance may include any type of notification, such as a symbol, an icon, audio, or video. If the automatic photographing guidance is audio, the processor 401 outputs the automatic photographing guidance to the audio output device 406. If the notification prompting photography is video, the processor 401 outputs the automatic photographing guidance to the touch panel 404 and the audio output device 406. The automatic photographing guidance may include photographing guidance. The photographing guidance includes guidance indicating the photographing range. The photographing guidance may include text information such as "Please move so that the product is within the photographing range." The photographing guidance includes guidance prompting the user to photograph multiple shopping carts. The photography guide may include text information such as "Is there a shopping basket in the lower level of the cart?", "We will take a photo of the lower level basket. Please move the camera so that the lower level basket is within the photography range." The customer follows the photography guide and moves smartphone 40 so that the lower level basket is within the photography range of camera 405.

[0099] Note that the display control unit 4012 may display a notification prompting the customer to take a photo on the touch panel 404 instead of the automatic photo-taking guidance. The notification prompting the customer to take a photo is, for example, text information such as "Please take a photo" to prompt the customer to take a photo. The notification prompting the customer to take a photo may include any type of notification, such as a symbol, an icon, audio, or video. If the notification prompting the customer to take a photo is audio, the processor 401 outputs instructions regarding the photographing of the product to the audio output device 406. If the notification prompting the customer to take a photo is video, the processor 401 outputs instructions regarding the photographing of the product to the touch panel 404 and the audio output device 406.

[0100] Based on the determination by the determination unit 4011 that the second transaction data satisfies the photographing conditions, the photographing control unit 4013 outputs a photographing instruction for the product to the camera 405. The photographing instruction for the product is an instruction for the processor 401 to control the camera 405. In response to the photographing instruction for the product, the processor 401 activates the camera 405 and controls the camera 405 to automatically photograph the product.

[0101] The acquisition unit 4014 acquires photographed image data of the photographed product based on the automatic photographing of the product. The acquisition unit 4014 acquires photographed image data of the photographed product based on the automatic photographing of the product under the control of the photographing control unit 4013.

[0102] The storage control unit 4015 stores the photographed image data acquired by the acquisition unit 4014 in the auxiliary storage unit 403. The storage control unit 4015 deletes the photographed image data when the photographed image data is transmitted to the monitoring server 26 by the transmission unit 4016, which will be described later. The storage control unit 4015 holds the photographed image data until the transmission unit 4016 transmits the photographed image data to the monitoring server 26. The storage control unit 4015 may delete the photographed image data after a certain period of time has elapsed since the photographed image data was acquired. The certain period of time is, for example, one day.

[0103] The transmitting unit 4016 transmits the photographed image data acquired by the acquiring unit 4014 to the monitoring server 26. If the photographed image data could not be transmitted to the monitoring server 26, the transmitting unit 4016 retransmits the photographed image data that could not be transmitted to the monitoring server 26. If photographed image data acquired in the past is stored in the auxiliary storage unit 403, the transmitting unit 4016 transmits the photographed image data acquired in the past to the monitoring server 26. The photographed image data acquired in the past is photographed image data that was acquired in the past but has not been transmitted to the monitoring server 26. The photographed image data acquired in the past may be photographed image data captured during the same transaction, or may be photographed image data captured during a different transaction. The different transaction may be, for example, a different transaction on the same day, or a transaction on a different day.

[0104] (Configuration of Monitoring Terminal 23) FIG. 13 is a block diagram illustrating an example configuration of the monitoring terminal 23 according to one embodiment. The monitoring terminal 23 includes a processor 231, a main memory 232, an auxiliary storage unit 233, a touch panel 234, an audio output device 235, a communication interface 236, and a transmission path 237. The processor 231 is capable of communicating with the main memory 232, the auxiliary storage unit 233, the touch panel 234, the audio output device 235, and the communication interface 236 via the transmission path 237. The processor 231, the main memory 232, and the auxiliary storage unit 233 are connected via the transmission path 237 to form a computer for controlling the monitoring terminal 23. The functions of the processor 231, the main memory 232, the auxiliary storage unit 233, and the transmission path 237 are generally equivalent to those of the processor 261, the main memory 262, the auxiliary storage unit 263, and the transmission path 265, and therefore will not be described here.

[0105] The touch panel 234 functions as an operation device and a display device for the monitoring terminal 23. The touch panel 234 is an example of a display unit that displays information or a notification unit that visually notifies information.

[0106] The audio output device 235 is a device that can output sound under the control of the processor 231. The audio output device 235 is an example of an audio output unit that outputs information by voice or a notification unit that notifies information audibly.

[0107] The communication interface 236 performs data communication in accordance with a predetermined communication protocol with each unit connected to the in-store network 27. As the communication interface 236, for example, a well-known communication device for a LAN can be applied.

[0108] The hardware configuration of the monitoring terminal 23 is not limited to the above configuration, and the monitoring terminal 23 allows the above components to be omitted or changed, and new components to be added, as appropriate.

[0109] The following describes each unit implemented in the processor 231. The processor 231 implements a receiving unit 2310 and a display control unit 2311. The units implemented in the processor 231 can also be referred to as functions. The units implemented in the processor 231 can also be referred to as being implemented in a control unit including the processor 231 and the main memory 232.

[0110] The receiving unit 2310 receives captured image data from the captured image storage area 2633 of the monitoring server 26 via the access point 29. The receiving unit 2310 updates the captured image data every time the captured image data is received from the smartphone 40.

[0111] The display control unit 2311 displays an attendant image on the touch panel 234 based on the captured image data. The attendant image includes, for example, a registered product details screen and a registered product confirmation screen. The registered product details screen shows details of registered products for each customer. The registered product details screen includes information such as the order in which the products are registered, the product name, the number of registered products, and the price. The registered product confirmation screen shows an image of the captured product. The registered product confirmation screen includes, for example, thumbnail images of the captured product images, enlarged images of the selected product images, etc. The display control unit 2311 updates the attendant image every time the captured image data is updated. The display control unit 2311 displays a captured image based on the captured image data on the touch panel 234 based on a display instruction from the attendant. The attendant may be interpreted as a store clerk, a user, or a person.

[0112] An example of the configuration of the first index file will be described below: Fig. 14 is a diagram showing the main data structure of the first index file stored in the transaction data storage area 2631 according to an embodiment.

[0113] The first index file includes a "Terminal ID" field, a "Transaction ID" field, a "Dwell Time" field, a "Last Operation Time" field, a "Registered Points" field, a "Status" field, and a "Payment Machine ID" field. Each of the multiple terminal IDs is associated with a transaction ID, stay time, last operation time, registered points, status, and payment machine ID as an index file record. For example, the smartphone 40 with terminal ID "00001" is associated with transaction ID "1." The smartphone 40 with terminal ID "00001" indicates that the stay time, which is the elapsed time since login, is "8 minutes," and the last operation time, which is the last time the smartphone 40 was operated, is "14:10." The smartphone 40's registered points are "5," and the status indicates "Registering," which indicates that the payment process has not yet been performed. In this example, the smartphone 40 with terminal ID "00001" is in a state before the payment process has been performed, so it is not associated with a payment machine, and the payment machine ID field is blank. The information included in the first index file can be set as appropriate. The monitoring server 26 updates the first index file as appropriate. Note that the configuration example of the second index file stored in the transaction data storage area 4032 of the smartphone 40 includes only the index file records related to the corresponding smartphone 40 among the configuration examples of the first index file described above. For example, the smartphone 40 with the terminal ID "00001" stores only the index file records associated with the terminal ID "00001" in the transaction data storage area 4032.

[0114] An example of the configuration of the first transaction file will be described below: Fig. 15 is a diagram showing the main data structure of the first transaction file stored in the transaction data storage area 2631 according to an embodiment.

[0115] The first transaction file includes a "Transaction ID" field, a "Product Code" field, a "Product Name" field, a "Product Type" field, a "Price" field, a "Number of Items Sold" field, and a "Sales Amount" field. Each of the multiple transaction IDs is associated as a transaction file record with the transaction ID, product code, product type, product name, price, number of items sold, and sales amount. The first index file and the first transaction file are associated using the "Transaction ID" as a key. The information contained in the first transaction file can be set as appropriate. The monitoring server 26 updates the first transaction file as appropriate. Note that an example configuration of the second transaction file stored in the transaction data storage area 4032 of the smartphone 40 includes only information related to the corresponding smartphone 40 from the above-described example configuration of the first transaction file. For example, a smartphone 40 with terminal ID "00001" stores only the first transaction file record for the "Transaction ID" associated with terminal ID "00001" in the transaction data storage area 4032.

[0116] An example of the configuration of the captured image management data will be described below: Fig. 16 is a diagram showing the main data structure of the captured image management data stored in the captured image storage area 2633 according to one embodiment.

[0117] The captured image management data includes a "transaction ID" field and an "image" field. The "image" field sets captured image data. Each of the multiple transaction IDs is associated with the captured image data as a captured image data record. The monitoring server 26 may store the captured image data in the captured image storage area 2633 in chronological order based on the time the captured image data was acquired. The captured image management data is associated with the first index file and the first transaction file using the "transaction ID" as a key. The monitoring server 26 updates the captured image management data appropriately each time captured image data is acquired.

[0118] (Guidance Screen) FIG. 17 is a schematic diagram showing an example of a guidance screen Sf displayed on the smartphone 40 according to an embodiment.

[0119] In response to the satisfaction of the photographing conditions, the smartphone 40 outputs automatic photographing guidance for the product to the touch panel 404. Fig. 17 shows a guidance screen Sf on which the automatic photographing guidance is displayed. As shown in Fig. 17, the guidance screen Sf displays a frame ARb indicating the photographing area for the product and an area ARc indicating the automatic photographing guidance.

[0120] The frame line ARb is set, for example, so that the entire shopping cart fits within it. The member, for example, operates the smartphone 40 so that the purchased items placed in the shopping cart fit within the frame line ARb. According to this example, the smartphone 40 can prompt the member to photograph the items along the frame line ARb. This allows the smartphone 40 to acquire photographed image data photographed within a relatively consistent range. This reduces variation in the photographed images of the items. An attendant checking the photographed images of the items on the monitoring terminal 23 can easily compare multiple photographed images taken in chronological order.

[0121] Area ARc is an area that includes, for example, a display indicating the timing of automatic shooting. Area ARc may also include, for example, a countdown display until the timing of automatic shooting. The countdown display in FIG. 17 includes "5," indicating that there are five seconds left until the timing of automatic shooting. The countdown display changes in display mode as time passes. The countdown display may be a number display, or may be a display that has a display mode that changes as time passes, such as a symbol, icon, or bar.

[0122] The smartphone 40 does not need to display the frame line ARb. In this case, the smartphone 40 may automatically detect the area of ​​the shopping cart and set the area so that the shopping cart falls within the shooting range of the camera 405.

[0123] The guidance screen Sf may include a photo button. The member can manually take a photo of the product by touching the photo button. For example, the member touches the photo button when the purchased product is within the frame ARb. When the member touches the photo button, the purchased product is photographed by the camera 405 of the smartphone 40.

[0124] (Operation of Smartphone 40) The following describes the procedure for information processing by the smartphone 40. Note that the processing procedure described below is merely an example, and each process may be modified as much as possible. Furthermore, steps in the processing procedure described below may be omitted, replaced, or added as appropriate depending on the embodiment.

[0125] The following process is performed during shopping. The following process is assumed to be performed after the user (customer) of the smartphone 40 registers a product and before moving on to the checkout process. The customer uses the camera 405 to read the code symbol attached to a product displayed in the store and registers the product. Information about the registered product is stored in the virtual POS server 13 each time a product is registered by a member. Information about the registered product is also stored in the transaction data storage area 4032 of the smartphone 40 linked to the virtual POS server 13. Assume that the customer is registering a product using the smartphone 40 with terminal ID "00001" in FIG. 14. The smartphone 40 with terminal ID "00001" stores only the transaction data from the smartphone 40 with that terminal ID in the transaction data storage area 4032.

[0126] In the following example, we will explain a case where the photography condition is a condition related to the number of points of a product. Assume that the condition related to the number of points of a product is set as the first time the number of points of a registered product reaches a predetermined number. Let us assume that the predetermined number is a multiple of 5, such as 5 points, 10 points, or 15 points.

[0127] FIG. 18 is a flowchart showing an example of a procedure for information processing by the smartphone 40 according to an embodiment. The determination unit 4011 determines whether the second transaction data satisfies the photographing conditions (ACT 1). In ACT 1, for example, the determination unit 4011 references the index file record associated with the terminal ID "00001" stored in the second index file and compares the "registered number of items" with the conditions related to the number of items of the product. If the determination unit 4011 determines that the "registered number of items" of the product registered in the second index file satisfies the photographing conditions (ACT 101: YES), the process transitions from ACT 101 to ACT 102. If the determination unit 4011 determines that the "registered number of items" of the product registered in the second index file does not satisfy the photographing conditions (ACT 101: NO), the process repeats ACT 101.

[0128] For example, the determination unit 4011 compares the registered number of points "5" from the second index file associated with the terminal ID "00001" with the condition related to the number of points of the product. In this example, the determination unit 4011 determines that the "registered number of points" of the product registered in the second index file satisfies the photographing condition, and proceeds to YES in ACT101.

[0129] The display control unit 4012 displays automatic photography guidance for the product on the touch panel 404 based on the determination result of the determination unit 4011 (ACT102). In ACT102, for example, the display control unit 4012 displays a notification indicating that automatic photography will be performed on the touch panel 404. The display control unit 4012 may also display a countdown indicating the timing for automatic photography. If the automatic photography guidance is audio, the processor 401 outputs the automatic photography guidance to the audio output device 406. If the automatic photography guidance is video, the processor 401 outputs the automatic photography guidance to the touch panel 404 and the audio output device 406.

[0130] The photography control unit 4013 controls the camera 405 to photograph the product (ACT103). In ACT103, for example, the photography control unit 4013 outputs a photography instruction for the product to the camera 405. The photography control unit 4013 may photograph the product in response to obtaining the determination result by the determination unit 4011. The photography control unit 4013 may photograph the product based on the timing for automatic photography being reached. The timing for automatic photography may be after a predetermined time has elapsed since the automatic photography guidance was displayed. The predetermined time is, for example, 5 seconds. The photography control unit 4013 may determine whether the product has been photographed by automatic photography. If the photography control unit 4013 determines that the product has been photographed successfully, the process transitions from ACT103 to ACT104. If the photography control unit 4013 determines that the product has not been photographed successfully, the process returns from ACT103 to ACT102. In this case, the display control unit 4012 displays the automatic photography guidance for the product on the touch panel 404. The smartphone 40 may repeat the process from ACT 102 to ACT 103 until the product is successfully photographed.

[0131] The smartphone 40 may repeat the processes in ACT102 and ACT103 until all of the shopping carts have been photographed. In this case, if there is a shopping cart in the lower tier of the cart, the display control unit 4012 may display a photographing guide on the touch panel 404 to prompt the customer to photograph the lower tier. The photographing guide prompting the customer to photograph the lower tier may be, for example, "If there is a second basket, press the 'Photograph the next basket' button." FIG. 19 shows an example of the photographing guide display. The photographing guide screen Sfa shown in FIG. 19 includes text information indicating the photographing guide, a "Retake photograph" button Baa, a "Photograph the next basket" button Bab, and a "Done" button Bac. The text information may include, for example, information such as "If there is a second basket, press the 'Photograph the next basket' button." The "Retake photograph" button Baa is a button that allows the customer to retake a photograph of the shopping cart. The "Photograph the next basket" button Bab is a button that allows the customer to photograph the lower tier basket if there is a lower tier basket. The "Complete" button Bac is a button for completing the photographing. For example, if there is a lower car, the customer follows the photographing guide and selects the "Photograph the next car" button Bab. In response to the customer selecting the "Photograph the next car" button Bab, the display control unit 4012 displays on the touch panel 404 a notification indicating that the lower car will be automatically photographed.

[0132] The acquisition unit 4014 acquires photographed image data of photographed products based on automatic photographing of the products (ACT 104). In ACT 104, for example, the acquisition unit 4014 acquires photographed image data of products photographed by the camera 405. The acquisition unit 4014 acquires additional information related to the photographed image data. The additional information includes information such as the time the photographed image data was captured, the photographing conditions, and the position of the basket. The additional information includes information such as "3:30 PM," "fifth registered product," and "top row." The acquisition unit 4014 acquires the first photographed image data captured by the camera 405 as photographed image data for the top row. The acquisition unit 4014 may also acquire photographed image data captured by the camera 405 as photographed image data for the bottom row when a customer operates the "Photograph next basket" button.

[0133] The storage control unit 4015 stores the acquired photographed image data of the product in the auxiliary storage unit 403 (ACT 105). In ACT 105, for example, the storage control unit 4015 associates the acquired photographed image data of the product with the transaction ID and additional information and stores them in chronological order in the auxiliary storage unit 403.

[0134] The transmitting unit 4016 transmits the captured image data acquired by the acquiring unit 4014 to the monitoring server 26 (ACT 106). In ACT 106, for example, the transmitting unit 4016 associates the captured image data with a transaction ID and additional information and transmits the data to the monitoring server 26. The monitoring server 26 outputs the captured image data, transaction ID, and additional information to the monitoring terminal 23. The monitoring terminal 23 generates an attendant image based on the acquired image data and displays it on the touch panel of the monitoring terminal 23. The monitoring image includes captured images of the product associated with the transaction data. The monitoring image may include multiple captured images in chronological order based on captured image data captured at different times. The transmitting unit 4016 may compress the captured image data and transmit it to the monitoring server 26.

[0135] During one transaction, the processor 401 repeats the processes in ACT101 to ACT106 each time the second transaction data satisfies the image capture condition. In this way, when the processor 401 repeats the processes in ACT101 to ACT106 multiple times during one transaction, the monitoring image may include multiple captured images based on captured image data captured at different times in chronological order. In this case, an attendant checking the captured images of the products on the monitoring terminal 23 can confirm the changes in the state of the shopping cart associated with the change in the registered number of products as the registered number increases. Here, the description has been given using an example in which the image capture condition is a condition related to the number of products, such as "reaching a predetermined number for the first time." However, this is not limiting. For example, if the image capture condition is "reaching a predetermined number," the processor 401 may capture the product each time the registered number of products reaches the predetermined number. For example, if the predetermined number is "5," the processor 401 may capture the product when the registered number of products reaches five, the product registration is subsequently canceled, and the registered number reaches "5" again. Even if the photographing conditions are the various conditions described above other than the condition related to the number of items, the processor 401 repeats the processes in ACT101 to ACT106 every time the second transaction data satisfies the photographing conditions during one transaction.

[0136] 20 is a flowchart illustrating another example of the procedure of information processing by the smartphone according to an embodiment. The following processing is information processing related to the transmission of captured image data.

[0137] The transmitting unit 4016 determines whether the transmission of the captured image data to the monitoring server 26 was successful (ACT 201). In ACT 201, for example, the transmitting unit 4016 determines whether the captured image data was transmitted to the monitoring server 26 within a predetermined time. If the transmitting unit 4016 determines that the transmission of the captured image data was successful (ACT 201: YES), the process transitions from ACT 201 to ACT 203. If the transmitting unit 4016 determines that the transmission of the captured image data was not successful (ACT 201: NO), the process transitions from ACT 201 to ACT 202. The transmitting unit 4016 retransmits the captured image data that could not be transmitted.

[0138] The transmitting unit 4016 determines whether or not the retransmission of the captured image data to the monitoring server 26 has been successful (ACT 202). In ACT 202, for example, the transmitting unit 4016 determines whether or not the captured image data has been transmitted to the monitoring server 26 within a predetermined time. If the transmitting unit 4016 determines that the retransmission of the captured image data has been successful (ACT 202: YES), the process transitions from ACT 202 to ACT 203. If the transmitting unit 4016 determines that the retransmission of the captured image data has not been successful (ACT 202: NO), the process ends.

[0139] The transmission unit 4016 determines whether previously acquired photographed image data is stored in the auxiliary storage unit 403 (ACT 203). For example, a case will be described in which transmission of photographed image data taken when the number of registered points was 10 was successful, but photographed image data taken when the number of registered points was 5 has not been transmitted to the monitoring server 26. The auxiliary storage unit 403 stores photographed image data taken when the number of registered points was 5. The transmission unit 4016 obtains the photographed image data taken when the number of registered points was 5 from the auxiliary storage unit 403.

[0140] If the transmitting unit 4016 determines that previously acquired photographed image data is stored in the auxiliary storage unit 403 (ACT 203: YES), the process transitions from ACT 13 to ACT 14. If the transmitting unit 4016 determines that previously acquired photographed image data is not stored in the auxiliary storage unit 403 (ACT 203: NO), the process transitions from ACT 13 to ACT 15.

[0141] The transmitting unit 4016 transmits the acquired photographed image data to the monitoring server 26 (ACT 204). In ACT 204, for example, the transmitting unit 4016 associates the photographed image data with a transaction ID and additional information and transmits the data to the monitoring server 26. The transmitting unit 4016 transmits the photographed image data captured when the number of registered points reached five to the monitoring server 26. The monitoring server 26 outputs the photographed image data, transaction ID, and additional information to the monitoring terminal 23. The monitoring terminal 23 updates the attendant image based on the acquired image data.

[0142] The storage control unit 4015 deletes the captured image data transmitted by the transmission unit 4016 from the auxiliary storage unit 403 (ACT 205).

[0143] If the transmission unit 4016 determines that the transmission or retransmission of the captured image data to the monitoring server 26 was not successful, the display control unit 4012 may pop up a warning message on the touch panel 404. The warning message may include text information such as "Image not transmitted" or "Please call a store clerk." When the customer presses the payment button, the transmission unit 4016 may determine whether any captured image data has failed to be transmitted. If the transmission unit 4016 determines that any captured image data has failed to be transmitted, the display control unit 4012 may display a warning message on the touch panel 404. Based on the warning message, the attendant can check the registered products using the monitoring terminal 23. After the attendant has confirmed the products, the smartphone 40 may perform a payment process. The payment process may include, for example, a checkout process and display of a checkout code using the smartphone 40.

[0144] (Attendant Screen) Fig. 21 is a schematic diagram showing an example of a registered product details screen Sg displayed on the monitoring terminal 23 according to one embodiment. The monitoring terminal 23 displays the registered product details screen Sg on the touch panel 234 based on captured image data acquired from the monitoring server 26. The registered product details screen Sg is an example of an attendant image. The monitoring terminal 23 is used by an attendant.

[0145] The registered product details screen Sg includes registered product information such as the order in which the products were registered, the product name, quantity, price, and notes. The registered product details screen Sg may be a list of registered product information. The order in which the products were registered indicates the order in which the products were registered by the member. The quantity indicates the number of registered products. The registered product information includes marks Ma and Mb. Mark Ma indicates products that require confirmation by an attendant, such as age verification products. Mark Mb indicates products that meet the photography conditions. The registered product details screen Sg includes a confirmation button Bg and an OK button Bh.

[0146] By selecting the mark Mb, the attendant can check detailed information about the product to which the mark Mb is attached. The detailed information about the product includes, for example, a photographed image of the product. In response to the attendant's selection of the mark Mb, the monitoring terminal 23 may transition the display screen of the touch panel 234 from the registered product details screen Sg to a registered product confirmation screen. In response to the attendant's selection of an area displaying a product name, the monitoring terminal 23 may transition the display screen of the touch panel 234 from the registered product details screen Sg to the registered product confirmation screen. The area displaying the product name may be a row containing the product name in the registered product details list. The attendant's selection of the area displaying the product name corresponds to selecting a record of the registered product. The monitoring terminal 23 may transition the display screen of the touch panel 234 from the registered product details screen Sg to the registered product confirmation screen based on the selection of the registered product record. In this case, the monitoring terminal 23 displays, in the photographed image area ARe of the registered product confirmation screen, a photographed image taken at a time close to the registration time of the selected registered product. In response to the attendant selecting the mark Ma, the monitoring terminal 23 may transition the display screen of the touch panel 234 from the registered product details screen Sg to the registered product confirmation screen.

[0147] The attendant can return from the registered product details screen Sg to the original screen by selecting the OK button Bh. In response to the attendant selecting the OK button Bh, the monitoring terminal 23 transitions the display screen of the touch panel 234 from the registered product details screen Sg to the original screen (not shown). The original screen may be, for example, an image including the registration status of multiple members.

[0148] The attendant can confirm detailed information about the product by selecting the confirmation button Bg. In response to the attendant selecting the confirmation button Bg, the monitoring terminal 23 changes the display screen of the touch panel 234 from the registered product details screen Sg to a registered product confirmation screen.

[0149] 22 is a schematic diagram showing an example of a registered product confirmation screen Sh displayed on the monitoring terminal 23 according to an embodiment. In response to an attendant selecting a mark Mb on the registered product details screen Sg, the monitoring terminal 23 displays the registered product confirmation screen Sh on the touch panel 234. In response to an attendant selecting an area displaying a product name, the monitoring terminal 23 may also display the registered product confirmation screen Sh on the touch panel 234. The registered product confirmation screen Sh is an example of an attendant image. The registered product confirmation screen Sh includes a thumbnail image area ARd and a captured image area ARe. The registered product confirmation screen Sh includes a back button Bi and an OK button Bj.

[0150] The thumbnail image area ARd includes thumbnail images that are reduced versions of captured images based on the captured image data of the products. The thumbnail images may include identification information that identifies the captured image data. The identification information includes, for example, the capture conditions. In the example of FIG. 22 , each thumbnail image includes the registered number of products as identification information. The identification information may include information indicating the location of the shopping cart. For example, the identification information may include "5th item," "top row," etc. The identification information may include information indicating the circumstances under which the image was captured. The circumstances under which the image was captured include, for example, product cancellation, cancellation / correction, checkout, etc. The identification information is included in additional information related to the captured image data. The monitoring terminal 23 may display thumbnail images corresponding to the images displayed in the captured image area ARe in an identifiable display format. In the example of FIG. 22 , the monitoring terminal 23 displays a thumbnail image corresponding to the "10th item" image displayed in the captured image area ARe in an identifiable display format. The thumbnail image area ARd is not limited to thumbnail images and may include symbols, icons, etc. that identify the captured images.

[0151] The captured image area ARe includes a captured image of the product selected by the attendant at the time of photographing. The captured image area ARe may be an enlarged image of the captured image. The attendant can check the captured image of the selected product at the time of photographing from the image displayed in the captured image area ARe. The attendant can check the captured image and the number of registered products and the number of products included in the shopping cart.

[0152] The attendant can select a thumbnail image included in the thumbnail image area ARd and display the captured image corresponding to the selected thumbnail image in the captured image area ARe. In response to the selection of a thumbnail image by the attendant, the monitoring terminal 23 displays the corresponding captured image in the captured image area ARe.

[0153] The attendant can return to the original screen by selecting the back button Bi. The original screen may be the registered product details screen Sg, or may be a registered product confirmation screen when another product is selected by the attendant. In response to the attendant selecting the back button Bi, the monitoring terminal 23 transitions the display screen of the touch panel 234 from the registered product confirmation screen Sh to the original screen.

[0154] The attendant can return from the registered product confirmation screen Sh to the registered product details screen Sg by selecting the OK button Bj. In response to the attendant selecting the OK button Bj, the monitoring terminal 23 transitions the display screen of the touch panel 234 from the registered product confirmation screen Sh to the registered product details screen Sg.

[0155] FIG. 23 is a schematic diagram showing an example of a registered product confirmation screen Si displayed on the monitoring terminal 23 according to an embodiment. In response to an attendant selecting the Confirm button Bg on the registered product details screen Sg, the monitoring terminal 23 displays the registered product confirmation screen Si on the touch panel 234. The registered product confirmation screen Si is an example of an attendant image. As in FIG. 22 , the registered product confirmation screen Si includes a thumbnail image area ARf and a captured image area ARg. In this example, the monitoring terminal 23 displays the most recently captured image in the captured image area ARg. As in FIG. 22 , the registered product confirmation screen Si includes a back button Bi and an OK button Bj. The most recently captured image is the image most recently captured in chronological order.

[0156] Like the thumbnail image area ARd, the thumbnail image area ARf includes thumbnail images that are reduced versions of captured images based on the captured image data of the products. The monitoring terminal 23 may display thumbnail images corresponding to the images displayed in the captured image area ARg in an identifiable display manner. In the example of Fig. 23, the monitoring terminal 23 displays a thumbnail image corresponding to the most recently captured image displayed in the captured image area ARg in an identifiable display manner. The thumbnail image area ARf is not limited to thumbnail images and may include symbols, icons, or the like that allow the captured image to be identified.

[0157] The captured image area ARg includes the most recent captured image. The captured image area ARg may be an enlarged image of the captured image. The attendant can check the most recent captured image of the product from the image displayed in the captured image area ARg. The attendant can check the captured image and the number of registered products and the number of products included in the shopping cart.

[0158] The attendant can select a thumbnail image included in the thumbnail image area ARf and display the captured image corresponding to the selected thumbnail image in the captured image area ARg. In response to the selection of a thumbnail image by the attendant, the monitoring terminal 23 displays the corresponding captured image in the captured image area ARg.

[0159] (Operation of monitoring terminal 23) The processing procedure by the monitoring terminal 23 will be described. FIG. 24 is a flowchart showing an example of the procedure for information processing by the monitoring terminal 23 according to one embodiment. Note that the processing procedure described below is merely an example, and each process may be modified as much as possible. Furthermore, steps in the processing procedure described below may be omitted, replaced, or added as appropriate depending on the embodiment.

[0160] The following process is performed during the above-described shopping. The receiving unit 2310 receives captured image data from the monitoring server 26 via the in-store network 27. The receiving unit 2310 determines whether the captured image data received from the monitoring server 26 has been updated (ACT 301). If the receiving unit 2310 determines that the captured image data has been updated (ACT 301: YES), the process transitions from ACT 301 to ACT 302. If the receiving unit 2310 determines that the captured image data has not been updated (ACT 301: NO), the process repeats ACT 301.

[0161] The display control unit 2311 updates the attendant image based on the captured image data (ACT 302). In ACT 302, for example, the display control unit 2311 displays a mark indicating that captured image data is available for a product that meets the image capture conditions on the registered product details screen. The mark may be, for example, an icon or a symbol indicating that captured image data is available. The display control unit 2311 is not limited to a mark, and may use any display mode that can identify products that meet the image capture conditions. The display mode may include character color, size, font, enclosed character, character decoration such as brightness or luminance, background color, background brightness or luminance, background pattern, frame color, blinking display, etc.

[0162] The display control unit 2311 determines whether the attendant has input a display instruction for the registered product confirmation screen (ACT 303). The display instruction includes the attendant pressing a button or the like on the registered product details screen to display the registered product confirmation screen. The display instruction includes the attendant selecting an area on the registered product details screen that shows products that meet the photography conditions. The area showing products that meet the photography conditions corresponds to the area on the registered product details screen Sg where the product name is displayed or the mark Mb. The display instruction includes the attendant selecting a record of a registered product. For example, if the display control unit 2311 determines that a display instruction has been input (ACT 303: YES), the process transitions from ACT 303 to ACT 304. If the receiving unit 2310 determines that a display instruction has not been input (ACT 303: NO), the process ends.

[0163] The display control unit 2311 displays a registered product confirmation screen on the touch panel 234 based on the display instruction (ACT 304). In ACT 304, for example, the display control unit 2311 displays a different registered product confirmation screen on the touch panel 234 in response to the display instruction. For example, a case will be described in which the display instruction is to select an area showing products that satisfy the shooting conditions. The display control unit 2311 displays a registered product confirmation screen Sh as shown in FIG. 22 on the touch panel 234. The registered product confirmation screen includes, for example, thumbnail images of captured images arranged in chronological order in the order in which the shooting conditions are satisfied. The registered product confirmation screen includes enlarged images of captured images of products selected by the attendant. A case will be described in which the display instruction is to input a button for displaying the registered product confirmation screen. The button for displaying the registered product confirmation screen corresponds to the confirmation button Bg on the registered product details screen Sg. The display control unit 2311 displays a registered product confirmation screen as shown in FIG. 23 on the touch panel 234. The registered product confirmation screen includes thumbnail images of the captured images arranged in chronological order in the order in which the image capturing conditions were met, for example. The registered product confirmation screen may also include an enlarged image of the most recent captured image.

[0164] In addition, the monitoring terminal 23 may store the captured image data in the auxiliary memory unit 233 and display an attendant image on the touch panel 234 based on the stored captured image data, or may display an attendant image on the touch panel 234 using the web client function based on the captured image data stored in the monitoring server 26.

[0165] (Effects of the Transaction Processing System 100) According to this embodiment, the smartphone 40 determines whether information related to product registration satisfies the image capture conditions, displays automatic product image capture guidance based on the determination result, acquires image data of the captured product based on the automatic image capture of the product, and transmits the acquired image data. Thus, when the image capture conditions are met, the smartphone 40 can automatically capture images of products in the shopping cart and transmit the captured images to the monitoring server 26. Therefore, the smartphone 40 can warn the customer not to forget to register products or to register them improperly. The smartphone 40 can also display automatic product image capture guidance to inform the customer that the product will be photographed. The customer can know when the product will be photographed, thereby preventing the customer from forgetting to register products or registering them improperly. In this way, the smartphone 40 can prevent the customer from forgetting to register products or registering them improperly. The monitoring server 26 can also manage the automatically captured image data. The attendant can check the customer's registered products based on the captured images, using the attendant image displayed on the monitoring terminal 23.

[0166] According to this embodiment, the smartphone 40 can automatically photograph a product when the number of registered products reaches a predetermined number for the first time. This allows the smartphone 40 to omit automatic photographing of the product when the same photographing condition is met multiple times. For example, if the photographing condition is a registered product number of 5, and after the registered product number reaches 5, the customer changes the registered product number by canceling or otherwise changing it, the smartphone 40 will not perform automatic photographing when the product number reaches 5 again. Therefore, the smartphone 40 can omit the automatic photographing process when the same photographing condition is met multiple times. Furthermore, the smartphone 40 can eliminate the annoyance customers feel when automatic photographing is performed multiple times.

[0167] According to this embodiment, the smartphone 40 can receive the photographing conditions before the customer starts shopping. This allows the smartphone 40 to set different photographing conditions depending on the store, the customer, the time of entry, etc. Therefore, the smartphone 40 can easily change the photographing condition settings even if the operations differ from store to store.

[0168] According to this embodiment, the smartphone 40 can transmit captured image data stored in the storage unit to the monitoring server 26. This allows the smartphone 40 to retransmit captured image data stored in the storage unit that has not been transmitted previously to the monitoring server 26. Therefore, the smartphone 40 can supplement the captured image data by transmitting the captured image data on different occasions. The monitoring server 26 can easily manage the captured image data.

[0169] According to this embodiment, the smartphone 40 can transmit captured image data and additional information related to the captured image data to the monitoring server 26. This allows the smartphone 40 to associate the captured image data with information related to the shooting, such as the shooting conditions, and transmit it to the monitoring server 26. The monitoring server 26 can manage the captured image data and information related to the shooting, such as the shooting conditions, in association with each other. The attendant can check the customer's registered products based on the attendant image displayed on the monitoring terminal 23, the captured image, and the additional information.

[0170] Although the embodiment of the transaction processing system 100 has been described above, the embodiment is not limited to this.

[0171] In this embodiment, the smartphone operated by the customer in the sales area may be a tablet terminal attached to a shopping cart. In this case, the tablet terminal has a built-in camera or an external camera. The smartphone operated by the customer may be a smartphone loaned to the customer by the store or a smartphone owned by the customer.

[0172] In this embodiment, the smartphone operated by a customer who has registered as a member has been described as an example, but the present invention is not limited to this. A customer may register a product using a smartphone without registering as a member.

[0173] In this embodiment, the server system 10 is constructed using cloud computing. In this regard, the POS system 20 may also include the functions of the server system 10. In other words, it is possible to construct the transaction processing system 100 in one store.

[0174] In this embodiment, the server system 10 is configured from a database server 11, a management server 12, and a virtual POS server 13. The server system 10 may also be configured as a single server that integrates the functions of the database server 11, the management server 12, and the virtual POS server 13.

[0175] Similarly, in the POS system 20 of each store, rather than dividing the functions among the store server 21, accounting server 22, and monitoring server 26, the functions of the store server 21, accounting server 22, and monitoring server 26 may be consolidated into a single server.

[0176] The information processing terminal according to the above-described embodiments may be expressed as follows. (1) An information processing terminal comprising: a determination unit that determines whether information related to product registration satisfies a photography condition; a display control unit that causes an automatic product photography guidance to be displayed on a display unit based on a determination result of the determination unit; an acquisition unit that acquires photographed image data of the product photographed based on the automatic photography of the product; and a transmission unit that transmits the photographed image data acquired by the acquisition unit. (2) The information processing terminal according to (1), wherein the photography condition includes the number of registered products reaching a predetermined number for the first time. (3) The information processing terminal according to (1) or (2), further comprising a receiving unit that receives the photography condition before a user starts shopping. (4) The information processing terminal according to any of (1) to (3), wherein the transmission unit transmits the photographed image data stored in a storage unit. (5) The information processing terminal according to any of (1) to (4), wherein the transmission unit transmits the photographed image data and additional information related to the photographed image data. (6) An information processing program that enables a computer to execute the following functions: a determination function that determines whether information regarding product registration satisfies the photography conditions; a display control function that displays automatic product photography guidance based on the determination result; an acquisition function that acquires photographed image data of the photographed product based on the automatic photography of the product; and a transmission function that transmits the photographed image data.

[0177] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope of the invention and the scope of the inventions and their equivalents as defined in the claims.

Claims

DEPCT681. An information processing terminal comprising: a decision-making unit configured to determine whether product registration information meets the imaging conditions; a display control unit configured to enable the display unit to show automatic imaging instructions for the product based on the decision of the decision-making unit; a seeking unit configured to seek photographic data of the photographed product based on automatic product imaging; and a transmission unit configured to transmit the photographic data sought by the seeking unit.

2. An information processing terminal under claim 1 where the imaging conditions include the condition that the number of registered products reaches a predetermined number for the first time.

3. An information processing terminal under claim 1 which also includes a receiving unit configured to receive the imaging conditions before the user begins the purchase process.4.Terminal for processing information under claim 1, where the transmission unit is configured to transmit captured image data stored in storage unit 5. Terminal for processing information under claim 1, where the transmission unit is configured to transmit captured image data and additional information about the captured image data 6. Storage medium containing the information processing program which enables the computer to perform the following functions: a determination function which determines whether the product registration information meets the imaging conditions; a display control function which displays automatic imaging instructions for the product based on the determination result; a search function which automatically searches for captured image data of the photographed product based on the product imaging; and a transmission function which transmits the captured image data.