Application program, information processing system, store terminal device, and display control method

Abstract

To effectively raise awareness among users about relevant information related to affiliated stores. [Solution] An application program that causes a computer in a store terminal device equipped with a display unit to perform the following processes: to obtain a code image used in a first electronic payment service, which includes identification information for identifying a member store; and to cause the store terminal device to display a first interface screen on the display unit, which includes the code image along with related information related to the member store.

Description

Technical Field

[0001] The present invention relates to an application program, an information processing system, a store terminal device, and a display control method.

Background Art

[0002] Conventionally, an advertisement screen of a product is distributed and displayed on a settlement terminal of a store such as a convenience store. When a consumer who is a customer purchases the advertised product within a certain period from the display of the advertisement screen during the settlement process at the settlement terminal, it is determined that the product advertisement has succeeded, and a fee is received from the advertiser as a success reward (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional technology, there are cases where users cannot be made aware of the displayed information.

[0005] The present invention has been made in consideration of such circumstances, and one of the objectives is to provide an application program, an information processing system, a store terminal device, and a display control method that can effectively make users aware of related information related to franchise stores.

Means for Solving the Problems

[0006] One aspect of the present invention is an application program that causes a computer in a store terminal device equipped with a display unit to perform the following processes: to cause the computer to acquire a code image used in a first electronic payment service, which includes identification information for identifying a merchant; and to cause the store terminal device to display a first interface screen on the display unit, which includes the code image along with related information related to the merchant. [Effects of the Invention]

[0007] According to one aspect of the present invention, it is possible to provide an application program, an information processing system, a store terminal device, and a display control method that can effectively make users aware of relevant information related to affiliated stores. [Brief explanation of the drawing]

[0008] [Figure 1] This diagram shows an example of a configuration for implementing an electronic payment service. [Figure 2] This is a sequence diagram (part 1) illustrating the general flow of electronic payments. [Figure 3] This is a sequence diagram (part 2) illustrating the general flow of electronic payments. [Figure 4] This is a diagram showing the configuration of payment server 100. [Figure 5] This figure shows an example of the contents of user information 172. [Figure 6] This figure shows an example of the contents of merchant / store information 176. [Figure 7] This diagram shows an example of the configuration of the first store terminal device 50. [Figure 8] This figure shows an example of the functional configuration of the first store terminal device 50. [Figure 9] This diagram illustrates the display and processing in the first state. [Figure 10] This diagram illustrates the display and processing in the second state. [Figure 11]It is a sequence diagram showing an example of the processing flow executed by the first store terminal device 50, the user terminal device 10, and the mediation server 300. [Figure 12] It is a diagram for explaining an example of the processing flow executed by the first store terminal device 50. [Figure 13] It is a diagram for explaining the first store terminal device 50 of the modification example. [Figure 14] It is a diagram showing the interface screen in the first state. [Figure 15] It is a diagram showing the interface screen in the second state. [Figure 16] It is a sequence diagram (1) showing an example of the processing flow related to the generation of related information. [Figure 17] It is a diagram showing an example of an interface screen related to the creation of an advertisement. [Figure 18] It is a sequence diagram (2) showing an example of the processing flow related to the generation of related information. [Figure 19] It is a diagram showing an example of an interface screen related to the creation of an advertisement. [Figure 20] It is a sequence diagram (3) showing an example of the processing flow related to the generation of related information. [Figure 21] It is a diagram showing an example of an interface screen related to the creation of an advertisement. [Figure 22] It is a diagram for explaining the voice output by the first store terminal device 50. [Figure 23] [[ID=第36]]It is a sequence diagram showing an example of the process in which voice is output in electronic payment by user scanning. [Figure 24] It is a diagram showing an example of the content of the voice information SI. [Figure 25] It is a sequence diagram showing another example of the process in which voice is output in electronic payment by user scanning.

Embodiments for Carrying Out the Invention

[0009] <First Embodiment> The following describes embodiments of the application program, information processing system, store terminal device, and display control method of the present invention with reference to the drawings. Various devices such as the "server" mentioned below, which provide services to users or perform internal analysis, may be implemented by a distributed group of devices, and the operators of each device may be different. Furthermore, the owner of the hardware of the devices (the provider of the cloud server) and the operator that actually operates them may also be different. The application program and the payment server work together to provide electronic payment services. In the following description, the application program will be referred to as the payment app. The electronic payment service is a service that supports payment for the purchase of goods and services at a store. A store is, for example, a physical store (real store) that exists in the real world, but it may also include a virtual store for e-commerce. A virtual store may include one provided by an entity different from the operator of the electronic payment service. In that case, when settling a purchase at the virtual store, the system is controlled to transition to the interface screen of the electronic payment service. In the electronic payment service, stores are treated as belonging to, for example, affiliated merchants (brands), and processing such as payment when a purchase is made at a store is mainly carried out between the user and the affiliated merchant. Alternatively, payment and other processing may be conducted between the user and the store.

[0010] [Electronic payment service] Figure 1 shows an example of the configuration of an electronic payment system that implements electronic payment services. The electronic payment service is implemented with a payment server 100 at its center. The electronic payment system that implements the electronic payment service includes, for example, one or more user terminal devices 10, one or more first store terminal devices 50, one or more second store terminal devices 70, a payment server 100, a generation device 200, and an intermediary server 300. These devices communicate with each other, for example, via a network NW. The network NW includes, for example, the Internet, a LAN (Local Area Network), a wireless base station, and provider equipment.

[0011] Some or all of the functional components included in the electronic payment system may be distributed across multiple devices in any form, or integrated into any device. For example, some or all of the functional components of the payment server 100 may be included in other devices. The intermediary server 300 may be omitted. The payment server 100 and the intermediary server 300 may be integrated. The intermediary server 300 may have some or all of the functional components of the payment server 100.

[0012] [User terminal device] The user terminal device 10 is, for example, a portable terminal device such as a smartphone or tablet. The user terminal device 10 is a computer device having at least optical reading function, communication function, display function, input reception function, and program execution function. In the following description, the components for realizing these functions will be referred to as a camera, communication device, touch panel, CPU (Central Processing Unit), etc. In the user terminal device 10, the payment application 20 is executed by a processor such as the CPU, and it operates in cooperation with the payment server 100 to provide electronic payment services to the user. The payment application 20 is installed on the user terminal device 10, for example, from an application store, and controls the camera, communication device, touch panel, etc.

[0013] [Store Terminal Device #1] The first store terminal device 50 is installed, for example, in a store. The first store terminal device 50 is a computer device having at least a product price acquisition function, an optical reading function, a program execution function, and a communication function. The first store terminal device 50 may include a so-called POS (Point of Sale) device, and the product price acquisition function and optical reading function may be realized by the POS device. The store code image 60 is placed in the store and is a code image (code information) such as a QR code (registered trademark) printed on a paper or plastic medium. The store code image 60 may also be displayed on a display placed in the store (this may also be the display of a terminal device such as a smartphone). The first store terminal device (store terminal device) 50 or the second store terminal device (store terminal device) 70 described later may have the functional configuration shown in Figures 7 and 8 described later.

[0014] [Second store terminal device] The second store terminal device 70 is used by the operator of the affiliated store. The second store terminal device 70 is a smartphone, tablet, personal computer, etc. The affiliated store interface 72 operates on the second store terminal device 70. The affiliated store interface 72 may be an affiliated store application or a browser. The affiliated store interface 72 accepts coupon settings etc. from the affiliated store operator and transmits them to the payment server 100. The second store terminal device 70, which is a smartphone, has the function of displaying a code image corresponding to a store code image by running the affiliated store application, or reading a code image displayed by the user terminal device 10.

[0015] [Generation device] The generator 200 is a model that has been trained on training data such as text and images. It is a so-called generative AI (Artificial Intelligence). The generator 200 generates content such as text, images, audio, and video based on a given prompt. The generator 200 is a model that has been trained to generate content in response to a given prompt.

[0016] [Payment Server] The payment server 100 implements electronic payment based on payment information received from the user terminal device 10 or the first store terminal device 50. The first store terminal device 50 may include a POS device and a merchant server, in which case payment information is transmitted from the POS device to the payment server 100 via the merchant server. In the following description, this distinction will not be made, and it will be assumed that payment information is transmitted from the first store terminal device 50.

[0017] Figures 2 and 3 are sequence diagrams illustrating the general flow of electronic payments. There may be two patterns for electronic payments: Pattern 1 and Pattern 2. Details of Pattern 1, shown in Figure 2, will be discussed later.

[0018] In the case of Pattern 1 shown in Figure 2 (hereinafter referred to as user scan), the user terminal device 10 decodes the store code image 60 using its optical reading function (S1). The store code image 60 contains information about the store URL (Uniform Resource Locator). This store URL is an electronic payment service domain to which information that can identify the store has been added, and is associated with the merchant ID and store ID, etc., at the payment server 100 (described later). The payment application 20 sends first payment information, including the store URL and account ID, to the payment server 100 (S2). The payment server 100 searches for store information (described later) from the merchant ID and store ID corresponding to the store URL, obtains the merchant name and store name information (S3), and sends it to the payment application 20 (S4). The user enters the payment amount into the user terminal device 10 on the screen where the merchant name and store name are displayed (S5). The user terminal device 10 then generates second payment information, including at least the payment amount, and sends it to the payment server 100 (S6). The payment server 100 performs electronic payment based on the received second payment information (S7). The payment server 100 then sends a payment completion notification (information for displaying the payment completion screen) to the payment application 20 (S8), and the payment application 20 displays the payment completion screen (S9). If the store code image 60 is displayed on a display in the store or on the display unit of the first store terminal device 50, the store code image 60 may include payment amount information as well as the store URL. In this case, the procedure for the user to enter the payment amount is omitted, and the payment amount information is included in the first payment information and sent to the payment server 100. Merchant name and store name information may be included and displayed on the payment completion screen.

[0019] In the case of Pattern 2 shown in Figure 3 (hereinafter referred to as Store Scan), when the payment app 20 is launched, when a payment operation is performed in the payment app 20, when it is time for an automatic update (for example, every minute), and at other times, the payment app 20 sends a request to the payment server 100 to issue a one-time code (S11). The payment server 100 generates a one-time code (S12) and sends it to the payment app 20 (S13). The payment app 20 displays a code image such as a QR code or barcode that was generated based on the one-time code (S14). The user holds the display surface of the user terminal device 10 over the first store terminal device 50 (presents it), and the first store terminal device 50 decodes the code image using its optical reading function and obtains the one-time code, etc. (S15). Then, the first store terminal device 50 generates payment information including the one-time code, payment amount, merchant ID, store ID, etc., and sends it to the payment server 100 (S16). The payment amount information is obtained in advance by barcode scanning or manual input. Based on the received information, the payment server 100 identifies the user corresponding to the one-time code and performs the electronic payment (S17). The payment server 100 then sends a payment completion notification to the payment app 20 (S18), and the payment app 20 displays a payment completion screen (S19).

[0020] Furthermore, electronic payment may be performed using only one of the above patterns. Also, the "account ID" explained in Figure 2 may be other information that can be used as user identification information (for example, a phone number). In addition, the issuance of a one-time code may be omitted during store scanning, and the payment app 20 may display a code image generated based on the user's account ID. In that case, the payment server 100 will identify the user corresponding to the account ID instead of identifying the user corresponding to the one-time code.

[0021] [Payment Server Functional Configuration] Figure 4 is a diagram of the configuration of the payment server 100. The payment server 100 includes, for example, a communication unit 110, a content provision unit 120, a payment processing unit 130, an information management unit 140, an information processing unit 150, and a storage unit 170. Components other than the communication unit 110 and the storage unit 170 are realized, for example, by a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), GPU (Graphics Processing Unit), and SOC (System On Chip), or by the cooperation of software and hardware. The program may be stored in advance on a storage device such as an HDD (Hard Disk Drive) or flash memory (a storage device equipped with a non-transient storage medium), or it may be stored on a removable storage medium such as a DVD or CD-ROM (a non-transient storage medium) and installed on the storage device when the storage medium is inserted into the drive device.

[0022] The storage unit 170 can be an HDD, flash memory, RAM (Random Access Memory), etc. The storage unit 170 may also be a NAS (Network Attached Storage) device that the payment server 100 can access via the network. The storage unit 170 stores information such as user information 172, content information 174, merchant / store information 176, and template information 178. Some of this information may also be stored in the storage unit of the user terminal device 10.

[0023] The communication unit 110 is a communication interface for connecting to a network NW. The communication unit 110 is, for example, a network interface card.

[0024] The content provider unit 120, for example, has the functionality of a web server and provides information (content) for displaying various screens of the electronic payment service to the user terminal device 10. The content provider unit 120 reads the necessary content from the content information 174 as appropriate and provides it to the user terminal device 10. The user terminal device 10 accepts various inputs from the user while the content is being played by the payment application 20 and transmits the aforementioned payment information to the payment server 100. The above content may also be generated by the payment application 20. In this case, the content provider unit 120 provides the payment application 20 with the information necessary for generating the content.

[0025] The payment processing unit 130 performs payment processing based on payment information transmitted by the user terminal device 10 or the first store terminal device 50. The payment processing unit 130 performs payment processing while referring to the user information 172.

[0026] [User information] Figure 5 shows an example of the contents of User Information 172. User Information 172 is an example of user registration information. User Information 172 includes, for example, user URL, account ID, telephone number, password, as well as information such as email address, user ID, name, address, date of birth, registration date, charge balance, credit payment settings, credit payment limit, credit payment amount, available credit payment amount, payment method settings, bank account, credit card number, charge history information, and payment history information. The user URL is used for money transfer processing between users. When registering for a new electronic payment service, registration of a telephone number and password is mandatory. The account ID is issued to the user by the payment server 100, and the user ID is an ID that the user can set at will (or does not have to set). Similarly, the email address and name, address, and date of birth are also information that the user can set at will (or does not have to set). The registration date is the date the user registered for the electronic payment service (the date the account was created). Hereafter, the user instance (electronic payment account) to which this information is associated will be referred to as an account.

[0027] The charge balance is information indicating the balance of electronic money set by the user by sending money to their account in advance. Methods of sending money include sending from an ATM (Automatic Teller Machine) of a designated provider (bank) and sending from a registered bank account. The credit payment setting indicates whether or not the user has completed the settings to enable electronic payments by credit card, and is set to either "Completed" or "Not Completed". The credit payment limit is the monthly limit for credit payments, the credit payment amount is the amount already used for credit payments in the current month, and the available credit payment amount is the amount available for credit payments in the current month, calculated by subtracting the credit payment amount from the credit payment limit. While the diagram shows only one credit payment limit, in reality there are also daily limits, and the lower of these may be set as the credit payment limit. Further details on credit payments will be described later. The payment method setting indicates whether the user will use electronic payment with the charge balance or payment by credit card at that time. The bank account and credit card number information, respectively, refers to the bank account or credit card number (account number, card number) to which funds can be deposited into the electronic payment service. The charge history information is a record of when the user has previously sent money to the electronic payment service to increase the charge balance. The payment history information shows the details of each payment made by the user (date and time, store ID of the store where the purchase was made, payment amount, payment method, etc.).

[0028] [Franchise / Store Information] Figure 6 shows an example of the contents of the merchant / store information 176. The merchant / store information 176 includes, for example, a first table 176A in which the merchant ID and store ID are associated with the store URL, a second table 176B in which the merchant name and sales amount (as described above) are associated with the merchant ID, and a third table 176C in which the store name is associated with the store ID. In addition to this information, the merchant / store information 176 may also include information such as the merchant or store category, the store's location, and payment patterns.

[0029] [Electronic payment] When the payment processing unit 130 obtains payment information from the user terminal device 10 or the first store terminal device 50, it refers to the user information 172 to obtain the user's "payment method setting". For users whose "payment method setting" is set to "charge balance", the payment processing unit 130 performs electronic payment as follows. For example, the payment processing unit 130 performs electronic payment by decreasing the charge balance, which is managed in association with the user ID, and increasing the value of the merchant's sales proceeds item. The merchant's sales proceeds item value is not used as electronic money itself, for example, but the amount corresponding to the sales proceeds item value is transferred to the bank account in a cycle according to the agreement between the merchant and the electronic payment service. The merchant may receive the sales proceeds as electronic money. In this case, the payment server 100 manages the account (wallet) corresponding to the merchant ID, the electronic money balance of the account, and the sales proceeds history for each payment method in association.

[0030] The payment processing unit 130 performs electronic payment as follows for users whose "settings information" is set to "credit payment". Credit payment is a payment method that cooperates with a credit card company, which is a separate entity from the operator of the electronic payment service, and allows electronic payment that does not depend on the charge balance within the credit limit. In order to use the credit payment service, it may be required to obtain a credit card provided by the operator of the electronic payment service. The payment processing unit 130 adds the payment amount to the credit payment usage amount in the user information 172 and subtracts the above payment amount from the available credit payment amount. If the payment amount exceeds the available credit payment amount, an error notification is sent back to the payment app. The amount used by credit payment is settled, for example, in a lump sum for one month on the payment date of the following month, for example, by direct debit from a bank account. This processing is carried out by the operator of the credit card company.

[0031] The Information Management Unit 140 acquires information provided by other server devices and terminal devices. Based on the information acquired from the user terminal device 10 and the second store terminal device 70, the Information Management Unit 140 manages user information 172 and affiliated store / store information 176. The Information Management Unit 140 performs operations such as adding, editing, and deleting new records for user information 172 and affiliated store / store information 176.

[0032] The processing performed by the payment server 100 described above may also be performed by the intermediary server 300. For example, depending on the merchant's contract type, the first store terminal device 50 may perform electronic payments in cooperation with the intermediary server 300, or the first store terminal device 50 may perform electronic payments in cooperation with the payment server 100. When electronic payments are performed in cooperation with the intermediary server 300, the results of the electronic payment processing are provided from the intermediary server 300 to the payment server 100 at predetermined intervals and managed by the payment server 100.

[0033] [composition] Figure 7 shows an example of the configuration of the first store terminal device 50. In the following explanation, the direction opposite to the vertical direction will be referred to as the Z direction, the width direction (longitudinal direction) of the first store terminal device 50 will be referred to as the Y direction, and the direction perpendicular to the Z and Y directions will be referred to as the X direction. Subsequent figures will also be explained based on these directions.

[0034] In Figure 7, it is assumed that the first store terminal device 50 is placed in a location facing the customer, such as a store counter. For example, the first store terminal device 50 is installed so that its negative X-direction side faces the customer. The customer is positioned in the negative X-direction and has their gaze directed in the positive X-direction. The store staff are positioned, for example, in the positive X-direction relative to the first store terminal device 50 and have their gaze directed in the negative X-direction.

[0035] The first store terminal device 50 comprises a base 51 and a main body 53. The main body 53 is placed in a predetermined position on the positive Z-direction surface of the base 51 (or inserted into a recess not shown), thereby stabilizing in an upright position in the Z-direction or at a predetermined angle in the X-direction. This state is referred to as the "first state." In the first state, the battery (not shown) of the main body 53 is charged by electrically connecting the power transmission unit (not shown) of the base 51 and the power receiving unit of the main body 53.

[0036] The base 51 has a predetermined height and stabilizes the main unit 53 when it is placed on it. The base 51 is connected to the power supply unit, for example, by a wire, and power is supplied from the power supply unit.

[0037] The main body 53 is, for example, a rectangle having a predetermined thickness. The main body 53 is a rectangle (or approximately rectangular) having a predetermined thickness, such as a smartphone. The shape of the main body 53 is not limited to a rectangle; it may be other shapes. A display unit 56 is provided on the first side surface of the rectangle of the main body 53 (the ZY plane in the negative X direction). The display unit 56 is a touch panel display. In Figure 7, the main body 53 is placed on a base 51, for example, with the display unit 56 facing in the negative X direction. A card insertion section 57 is provided on the XY plane (thickness portion) in the Z direction of the main body 53 placed on the base 51.

[0038] [Functional Configuration] Figure 8 shows an example of the functional configuration of the first store terminal device 50. The first store terminal device 50 includes, for example, a speaker S, a first communication unit 54, a second communication unit 55, a display unit 56, a card insertion unit 57, a control unit 58, and a storage unit 59.

[0039] Speaker S outputs sound based on the control of control unit 58. First communication unit 54 communicates with payment server 100, intermediary server 300, etc. via network NW. Second communication unit 55 performs communication using Near Field Communication (NFC) technology. When a device (smartphone or media) equipped with a contactless IC (Integrated Circuit) chip is held over the first store terminal device 50, the second communication unit 55 communicates with the contactless IC chip to obtain information stored in the memory area of ​​the contactless IC chip or to provide information to the contactless IC chip.

[0040] The display unit 56 displays information corresponding to operations performed on the display unit 56, the status of the main unit 53, and the control of the control unit 58. For example, a credit card is inserted into the card insertion unit 57. The main unit 53 acquires information about the credit card inserted into the card insertion unit 57 and provides the acquired information to the payment server 100, the intermediary server 300, etc.

[0041] The control unit 58 is implemented, for example, by a hardware processor such as a CPU executing a program (software). Some or all of these components may be implemented by hardware (circuit parts) such as LSIs, ASICs, FPGAs, GPUs, or SOCs, or by the cooperation of software and hardware. The program may be stored in advance in a storage device such as an HDD or flash memory (a storage device equipped with a non-transient storage medium), or it may be stored in a removable storage medium such as a DVD or CD-ROM (a non-transient storage medium) and installed in the storage device when the storage medium is mounted in a drive device. The storage unit 59 is an HDD, flash memory, RAM, etc. The storage unit 59 may be a NAS device that the main unit 53 can access via a network. The storage unit 59 stores a store application program (store app) CI. The store app CI is an example of an "application program" executed by the control unit 58 described above.

[0042] The control unit 58 controls the various functional configurations of the first store terminal device 50. For example, the control unit 58 controls the speaker S, the display unit 56, the first communication unit 54, the second communication unit 55, etc. The control unit 58 also executes various electronic payment methods, such as electronic payment using NFC and credit card payment.

[0043] [overview] The display unit 56 of the first store terminal device 50 displays a code image used in the first electronic payment service when the first store terminal device 50 (for example, the main unit 53) is in a first state, and displays an interface screen for accepting electronic payments by credit card, which is the second electronic payment service, when the first store terminal device 50 is in a second state. This interface screen accepts input of the payment amount, credit card PIN, and electronic signature.

[0044] The second state is a state in which the position of the first store terminal device 50 has been moved from the position of the first state. The first state is, for example, a state in which the main body 53 is placed on the base 51. The second state is a state in which the main body 53 is separated from the base 51. The first and second states are not limited to these, and may be any state that has been set in advance.

[0045] For example, in the first state, the main body 53 and the base 51 are electrically connected, and in the second state, the electrical connection is released. The control unit 58 detects this state and determines that the state has changed from the first state to the second state. The second state may be a state in which the unit has moved from the first state. For example, the main body 53 may be equipped with a sensor that detects changes in the position of the main body 53, such as an acceleration sensor, and the control unit 58 may detect the second state based on the detection result of the sensor.

[0046] [Display and processing in the first state] Figure 9 is a diagram illustrating the display and processing in the first state. (11) The main unit 53 is placed on the base 51 in the first state. In the first state, a code image is displayed on the display unit 56. The display unit 56 is oriented towards customers visiting the store. When a customer makes an electronic payment, they operate the user terminal device 10 to capture an image of the code. (12) The display unit of the user terminal device 10 displays store information and an interface screen for entering the amount of electronic payment, as shown in the figure. When the amount is entered on the interface screen and the electronic payment process proceeds, the user terminal device 10 and the payment server 100 (or intermediary server 300) communicate to perform the electronic payment. (13) Once the electronic payment is completed, the display unit of the user terminal device 10 will be notified that the electronic payment has been completed.

[0047] (14) As with (13) above, when the electronic payment is completed, the display unit 56 of the main unit 53 is notified of information indicating that the electronic payment has been completed, and the speaker S of the main unit 53 outputs an audio signal indicating that the electronic payment has been completed. In other words, in the first state, when the first store terminal device 50 obtains payment completion information from the intermediary server 300 or payment server 100 that performs the electronic payment for the first electronic payment service, indicating that the electronic payment for the electronic payment service (first electronic payment service) has been completed, it outputs an audio signal indicating that the electronic payment has been completed.

[0048] As described above, by placing the first store terminal device 50 so that customers can capture images of the code, customer convenience can be improved. Furthermore, since the first store terminal device 50 notifies the store of the completion of the electronic payment via voice and display, the store can easily recognize that the electronic payment has been completed, thereby improving the convenience of the store.

[0049] [Display and processing in the second state] Figure 10 is a diagram illustrating the display and processing in the second state. (21) The state in which the main unit 53 is removed from the base 51 is the second state. In the second state, the code image is not displayed on the display unit 56, and the interface screen for credit card payment is automatically displayed. For example, if a customer wishes to use credit card payment, the store staff removes the main unit 53 from the base 51. (22) After removing the main unit 53 from the base 51 by lifting it, for example, in the plus Z direction, the main unit 53 is rotated in the Y direction so that the display unit 56 faces the store staff (towards the minus X direction). The display unit 56 automatically displays the credit card payment interface screen in response to the main unit 53 changing to the second state. The store staff enters the amount on the interface screen and performs the predetermined operation (for example, the operation to confirm the amount).

[0050] (23) When the above-mentioned operations are performed, the display unit 56 displays an interface screen prompting the user to insert or touch a credit card. At this time, the store staff rotates the main unit 53 so that the display unit 56 is horizontal to the ground. This positions the card insertion section 57 in a direction that makes it easy for the customer to insert a credit card in the plus X direction.

[0051] Furthermore, in interface screen (22), the card insertion section 57 is positioned upwards so that store staff can read the letters and numbers, whereas in interface screen (23), the card insertion section 57 is positioned downwards so that customers can read the letters and numbers. For example, the amount displayed in interface screen (22) is reversed in an animated display by a predetermined operation by store staff (for example, the operation to confirm the amount) and displayed as in interface screen (23). In other words, the display unit 56 displays the payment amount in a second orientation, which is the payment amount reversed relative to the first orientation, after the payment amount has been entered in the first orientation. In the above process, the position of the card insertion section 57 is above the payment amount in the first orientation and below the payment amount in the second orientation.

[0052] (24) When a customer makes a credit card payment and the intermediary server 300 and the first store terminal device 50 cooperate to process the credit card payment, the display unit 56 displays information indicating that the credit card payment has been approved, and the speaker S outputs a similar sound. The orientation of the characters and numbers displayed at this time may be such that the card insertion unit 57 is at the bottom or at the top. (25) After the credit card payment is completed, when the store staff places the main unit 53 on the base 51 to enter the first state, the display unit 56 automatically displays a code image. The display unit 56 displays an interface screen for making electronic payments by credit card in accordance with the change from the first state to the second state, and after the electronic payment by credit card is made, it automatically displays the code image when it changes from the second state to the first state.

[0053] As described above, when a credit card payment is made, the interface screen automatically displays the credit card payment interface screen when the first store terminal device 50 is returned to the second state. Furthermore, store staff can provide information to customers to facilitate credit card payments and make it easier for customers to insert their credit cards without having to rotate the main unit 53. In addition, when the main unit 53 is returned from the second state to the first state, the code image is automatically displayed. These processes improve convenience for both the store and the customer.

[0054] [Sequence Diagram] Figure 11 is a sequence diagram showing an example of the processing flow performed by the first store terminal device 50, the user terminal device 10, and the intermediary server 300. Processing from S50 to S54 is an example of electronic payment being performed by an electronic payment service. Processing from S56 to S62 is a process in which credit card payment is performed.

[0055] First, the first store terminal device 50 displays a code image in the first state (S50). Next, the electronic payment is performed by the processes S1 to S9 in Figure 2 described above. When the intermediary server 300 performs the electronic payment, it provides payment completion information to the first store terminal device 50 (S52). The first store terminal device 50 outputs payment completion information in response to having received the payment completion information (S54). For example, the first store terminal device 50 displays or outputs information indicating that the payment has been completed. The payment completion information is also provided to the user terminal device 10, and the user terminal device 10 also displays or outputs information indicating that the payment has been completed.

[0056] When a customer makes a credit card payment, the store staff removes the main unit 53 from the base 51 to put the first store terminal device 50 into the second state, and the control unit 58 transitions the main unit 53 from the first mode to the second mode. The first mode is the mode executed when the first store terminal device 50 is in the first state, and a code image is displayed on the display unit 56. The second mode is the mode in which the credit card payment interface screen is displayed. After the payment amount is entered on this interface screen and the prescribed operations are performed, the staff turns the card insertion section 57 of the main unit 53 towards the customer.

[0057] When a customer refers to the credit card payment interface screen and inserts a credit card into the card slot 57 or touches the credit card to the display unit 56, the first store terminal device 50 requests the intermediary server 300 to process the payment (S58). The intermediary server 300 executes the payment process based on the credit card number, payment amount, and merchant information obtained from the first store terminal device 50 (S60). The first store terminal device 50 obtains the result of the payment process from the intermediary server 300 and outputs the payment result information via voice and display (S62).

[0058] As described above, electronic payments using electronic payment services or credit card payments can be easily made at the store.

[0059] [flowchart] Figure 12 is a diagram illustrating an example of the processing flow performed by the first store terminal device 50. First, the control unit 58 determines whether or not it is in the first mode (S100). If it is in the first mode (first state), the control unit 58 displays a code image on the display unit 56 (S102). Next, the control unit 58 determines whether or not it has obtained payment completion information from the intermediary server 300 or the payment server 100 (S104). If payment completion information has not been obtained, the process in S106 is skipped. If payment completion information has been obtained, the control unit 58 outputs audio and images indicating that the payment has been completed (S106).

[0060] Next, the control unit 58 determines whether the first store terminal device 50 has changed to a predetermined state (S108). A change to a predetermined state means, for example, that the first store terminal device 50 has changed to a second state. A change to a predetermined state is not limited to the above, but may also mean that the position of the main unit 53 has been shifted from the position of the first state, that a predetermined operation (operation of a predetermined button) has been performed, or that the orientation of the main unit 53 has been changed (the display unit 56 has been turned toward the store staff).

[0061] When the first store terminal device 50 changes to a predetermined state, the control unit 58 transitions the mode from the first mode to the second mode (S110) and displays an interface screen for accepting credit card payments on the display unit 56 (S112). Next, the control unit 58 works in cooperation with the intermediary server 300 to execute the payment process in response to the operation on the interface screen (S114). Next, the control unit 58 displays information indicating the result of the payment process on the display unit 56 in response to receiving payment completion information from the intermediary server 300. This completes the processing of one routine in this flowchart.

[0062] As described above, the control unit 58 can improve convenience for customers and store staff by switching modes according to the state of the first store terminal device 50 to facilitate credit card payments.

[0063] In addition, the first store terminal device 50 may display advertisements on the display unit 56 in the first mode. For example, campaigns or special offers for electronic payment services may be displayed.

[0064] Furthermore, the first store terminal device 50 may be configured to allow the customer to select an electronic payment method in response to their operation. For example, in the first state (first mode), the display unit 56 may be provided with a button that displays a screen for performing electronic payment with another electronic payment service along with a code image, or an interface screen for performing electronic payment with another electronic payment service may be displayed by swiping. The display unit 56 may, for example, display a code image of another electronic payment service, or it may display an interface screen for performing electronic payment using NFC. For example, when a code image is displayed and the user holds an IC card or the like over the device, electronic payment using NFC may be performed.

[0065] <Example 1> In the example described above, the card insertion section 57 is provided on the positive Z side of the main body 53 in the first state. In the modified example, the card insertion section 57 is provided on the negative Z side (base 51 side) of the main body 53 in the first state.

[0066] Figure 13 is a diagram illustrating a modified example of the first store terminal device 50. (31) In a modified example, the first state is not upright, but rather the display unit 56 (main body 53) is placed on the base 51 such that it is tilted in the plus X direction. (32) When a credit card payment is made, the store staff pulls the main unit 53 in the +X direction to enter the second state, and the first store terminal device 50 transitions to the second mode. (33) The store staff rotates the main body 53 so that the card insertion section 57 of the main body 53 on the base 51 side is positioned in the plus Z direction. At this time, an interface screen for credit card payment is displayed. On the interface screen, letters and numbers are displayed so that the direction of the card insertion section 57 is facing upwards. (34) When a store staff member enters the payment amount and performs a predetermined operation (for example, confirming the amount), and rotates the main unit 53 to make it horizontal so that the card insertion section 57 is facing the customer, an interface screen containing information prompting the customer to insert a card into the card insertion section 57 or touch the credit card to the main unit 53 is displayed on the display unit 56. At this time, the characters and numbers on the interface screen are displayed so that the direction opposite to the card insertion section 57 (plus X direction) is facing upwards.

[0067] In this modified version, the card insertion section 57 is located on the opposite side. This also improves user convenience.

[0068] Furthermore, the first store terminal device 50 is designed to accommodate any orientation of the card insertion section 57 when the main unit 53 is placed on the base 51, and this orientation may be selected by the store. For example, the store may set the orientation in which the main unit 53 is placed by operating the first store terminal device 50, thereby determining the orientation of characters and numbers on the interface screen according to that orientation. For example, if the mode is set so that the main unit 53 is placed with the card insertion section 57 on the base 51 side, the characters and numbers will be displayed with the card insertion section 57 rotated so that it is in the +Z direction, as explained in (33) of Figure 13, with the +Z direction being the top. As described above, the first store terminal device 50 can accommodate different placement and display methods for ease of use by the store.

[0069] <Modification 2> If the main unit 53 of the first store terminal device 50 is removed from the base 51 during a set time period (for example, outside of business hours), the first store terminal device 50 may notify the merchant interface 72 or other predetermined terminal devices that the main unit 53 has been removed, or it may restrict the use of the first store terminal device 50 during the above time period. This can deter unintended use by the merchant from a security standpoint.

[0070] According to the first embodiment described above, the first store terminal device 50 can improve user convenience by displaying a code image used in the first electronic payment service on the display unit 56 when the first store terminal device 50 is in a first state, and by displaying an interface screen that accepts electronic payment by credit card, which is the second electronic payment service, when the first store terminal device 50 is in a second state where its position has been moved from the position in the first state.

[0071] <Second Embodiment> In the second embodiment, relevant information related to the merchant is displayed on the display unit along with the code image. The following will mainly explain the differences from the first embodiment.

[0072] The control unit 58 (first store terminal device 50) performs the process of acquiring a code image (the process of acquiring information for display) and the process of causing the first store terminal device 50 to display a first interface screen on the display unit, which includes related information related to the merchant along with the code image in the first state. For example, the control unit 58 acquires related information generated by the payment server 100 (store management device), which manages information related to the merchant's electronic payment in the electronic payment service, either directly or via another device, and displays the acquired related information on the display unit of the first interface screen. For example, the control unit 58 generates related information in cooperation with either or both of the payment server 100, which provides electronic payment services in response to the administrator's operation, and the generation device 200 (generation AI), which executes the instructed task, and provides the related information to the first store terminal device 50 for display on the display unit. This makes it possible to effectively make users aware of related information related to the merchant.

[0073] Related information includes one or more of the following: advertisements for member stores, advertisements for stores related to member stores, and job postings for member stores or stores related to member stores. For example, such advertisements and job postings can be drawn to users. Related information is displayed, for example, below or above the code image. For example, the code image is placed in the center or near the center of the screen, and the related information is displayed below or above it.

[0074] In response to the change in state from a first state where the main body 53 of the first store terminal device 50 is placed on the base 51 to a second state where the main body 53 is separated from the base 51, the control unit 58 automatically displays a second interface screen on the display unit 56, which accepts electronic payments by credit card, a second electronic payment service, and includes relevant information related to the merchant. This allows users to effectively be aware of relevant information related to the merchant even when making electronic payments by credit card.

[0075] [Interface screen in the first state] Figure 14 shows the interface screen in the first state. Interface screen IF1 includes a code image in which identification information for identifying the merchant is encoded, and related information R1. Related information R1 is an advertisement related to the merchant (or an advertisement for a store related to the merchant). Advertisements include things like store openings, events, discounts, campaigns, and the launch of new products or services.

[0076] Interface screen IF2 includes a code image containing encoded identification information for identifying the franchisee, and related information R2. Related information R2 is job information for the franchisee or stores related to the franchisee. Job information includes information on recruitment for part-time or full-time employees, and recruitment for franchise membership.

[0077] As described above, in the first state, the first store terminal device 50 displays related information along with the code image. Users making payments at the store naturally focus on the related information in order to capture the code image. This effectively makes users aware of the related information associated with the merchant.

[0078] [Interface screen in the second state] Figure 15 shows the interface screen in the second state. Interface screens IF3 and IF4 are screens for credit card payment. Interface screen IF3 includes a display prompting the user to bring the credit card close to the display unit 56 and related information R1. Interface screen IF4 includes a display prompting the user to bring the credit card close to the display unit 56 and related information R2. Interface screens IF3 and IF4 may also include a display prompting the user to pass the magnetic portion through a predetermined location (swipe).

[0079] As described above, in the second state, the first store terminal device 50 displays a message prompting the user to bring the credit card closer to the display unit, along with related information. When a user makes a payment at the store, they naturally pay attention to the related information when they bring the credit card closer to the display unit 56. This effectively makes the user aware of related information concerning the merchant.

[0080] Furthermore, the related information displayed in the first state and the related information displayed in the second state may be different. For example, the administrator of the first store terminal device 50 may operate the first store terminal device 50 or the second store terminal device 70 to set the related information to be displayed in each state. This makes it possible to provide users with effective information according to the payment type. For example, since the age group that uses electronic payment with code images is young and many are students, information about part-time job openings may be set as related information for the first state, and since the users who use electronic payment with credit cards are mostly company employees, information about new stores may be set as related information for the second state.

[0081] [Sequence diagram for generating related information (1)] Figure 16 is a sequence diagram (1) showing an example of the processing flow for generating related information. The first store terminal device 50, the second store terminal device 70, and the payment server 100 work together to display the related information on the display unit 56 of the first store terminal device 50. In the following explanation, the related information will be described as an advertisement as an example.

[0082] First, the second store terminal device 70 (merchant interface 72) accepts an operation from the store manager to instruct the creation of an advertisement (S200). Next, the second store terminal device 70 sends the creation instruction to the payment server 100 (S202). Next, the payment server 100 obtains template information 178 (S204) and provides the obtained template information 178 to the second store terminal device 70 (S206). The template information 178 is a list of templates related to relevant information. For example, the list of templates is prepared for each category of advertisement or job posting. For example, multiple templates are prepared, such as backgrounds suitable for the opening of a new store or the launch of a new menu.

[0083] The administrator refers to a list of templates provided by the payment server 100, operates the second store terminal device 70 to select the desired template, and creates an advertisement (S208). Next, the second store terminal device 70 provides the created advertisement to the payment server 100 (S210).

[0084] The payment server 100 performs image analysis and text analysis of the advertisement to determine whether the advertisement meets the criteria (S212). The review may be performed by a human. If the advertisement meets the criteria, the payment server 100 provides the advertisement to the first store terminal device 50 (store application CI) (S214). For example, the store application CI of the first store terminal device 50 and the merchant interface 72 of the second store terminal device 70 cooperate via the payment server 100, and the relevant information is displayed on the first store terminal device 50. Note that the first store terminal device 50 and the second store terminal device 70 may exchange relevant information via wireless or wired communication without going through the payment server 100. Next, the first store terminal device 50 displays the provided advertisement in either the first or second state (S216).

[0085] As described above, each device can work together to display relevant information in either the first or second state on the first store terminal device 50. This makes it possible to effectively make users aware of relevant information related to the affiliated store.

[0086] [Screen transition (1)] Figure 17 shows an example of an interface screen related to advertisement creation. The second store terminal device 70 displays interface screen IF11, which contains template information provided by the payment server 100, on its display unit. Interface screen IF11 is a list of provided templates. For example, an administrator can find a template that closely matches their image by selecting a template category. After a template is selected, interface screen IF12 is displayed.

[0087] Interface screen IF12 is a screen for entering text to be superimposed on the template. The administrator can operate the second store terminal device 70 to enter desired text information such as "New store opening". After the text information is entered, the second store terminal device 70 displays interface screen IF13.

[0088] Interface screen IF13 includes a pre-confirmation ad with text information overlaid on a template, operation buttons for changing the size and position of the text information, and a confirmation button. Administrators can change the size and position of the text by operating the operation buttons, and the changes are reflected in the pre-confirmation ad on interface screen IF13. Once the ad content is finalized, the administrator can confirm the ad by operating the confirmation button and proceed to review.

[0089] As described above, the administrator can easily create advertisements by operating the second store terminal device 70. Alternatively, the first store terminal device 50 may be operated to create advertisements instead of the second store terminal device 70 (the same applies to other examples).

[0090] [Sequence diagram for generating related information (2)] Figure 18 is a sequence diagram (2) showing an example of the processing flow for generating related information. In this process, the generation device 200 generates the related information. In the following explanation, the related information will be described as an advertisement as an example.

[0091] First, the second store terminal device 70 (merchant interface 72) accepts an operation from the store manager to instruct the creation of an advertisement (S300). Next, the second store terminal device 70 sends the creation instruction to the payment server 100 (S302). Next, the payment server 100 sends the creation instruction to the generation device 200 (S304). Next, the generation device 200 creates the advertisement based on the creation instruction (S306). Next, the generation device 200 provides the created advertisement to the payment server 100 (S308).

[0092] Next, the payment server 100 provides the advertisement to the second store terminal device 70 (S310). Next, the second store terminal device 70 allows the administrator to review the provided advertisement, and if the confirmation button is pressed, it provides the confirmation result and the advertisement to the payment server 100 (S312, S314). Next, the payment server 100 performs image analysis and text analysis of the advertisement to determine whether the advertisement meets the criteria (S316). If the advertisement meets the criteria, the payment server 100 provides the advertisement to the first store terminal device 50 (store app CI) (S318). Next, the first store terminal device 50 displays the provided advertisement in either the first or second state (S320).

[0093] As described above, each device can work together to display relevant information in either the first or second state on the first store terminal device 50. This effectively makes users aware of relevant information related to the affiliated store. For example, in this process, the generation device 200 creates the advertisement, thus reducing the administrator's workload.

[0094] [Screen transition (2)] Figure 19 shows an example of an interface screen related to advertisement creation. The second store terminal device 70 displays interface screen IF15 on its display unit. Interface screen IF15 is a screen that asks whether to create an advertisement using a template or using the generation device 200. If the administrator selects to create an advertisement using the generation device 200, the second store terminal device 70 displays interface screen IF16 on its display unit.

[0095] The interface screen IF16 includes an advertisement created by the generation device 200, a modification button for modifying the advertisement, and a button for confirming the advertisement as an advertisement. If the modification button is pressed, the administrator can modify the advertisement by operating the second store terminal device 70. If the confirmation button is pressed, the second store terminal device 70 requests the payment server 100 to review the advertisement.

[0096] As described above, the administrator can easily create advertisements by operating the second store terminal device 70.

[0097] [Sequence diagram for generating related information (3)] Figure 20 is a sequence diagram (3) showing an example of the processing flow for generating related information. In this process, related information is generated using a template and a generation device 200. In the following explanation, the related information will be described as an advertisement as an example.

[0098] First, the second store terminal device 70 (merchant interface 72) accepts an operation from the store manager to instruct the creation of an advertisement (S400). Next, the second store terminal device 70 sends the creation instruction to the payment server 100 (S402). Next, the payment server 100 obtains template information 178 (S404) and provides the obtained template information 178 to the second store terminal device 70 (S406).

[0099] The administrator refers to a list of templates provided by the payment server 100, operates the second store terminal 70 to select a desired template, and creates an advertisement (S408). For example, the administrator inputs the content of the advertisement into the second store terminal 70. For example, this could include information such as a new store opening in August, a new product launch next week, or other specific details. Next, the second store terminal 70 provides the template and the entered content to the payment server 100 (S410).

[0100] Next, the payment server 100 sends a creation instruction to the generation device 200 along with the template and the entered content (S412). Next, the generation device 200 creates an advertisement based on the template content and the creation instruction (S414). Next, the generation device 200 provides the created advertisement to the payment server 100 (S416).

[0101] Next, the payment server 100 provides the advertisement to the second store terminal device 70 (S418). Next, the second store terminal device 70 allows the administrator to review the provided advertisement, and if the confirmation button is pressed, it provides the confirmation result and the advertisement to the payment server 100 (S420, S422). Next, the payment server 100 performs image analysis and text analysis of the advertisement to determine whether the advertisement meets the criteria (S424). If the advertisement meets the criteria, the payment server 100 provides the advertisement to the first store terminal device 50 (store app CI) (S426). Next, the first store terminal device 50 displays the provided advertisement in either the first or second state (S428).

[0102] As described above, each device works in conjunction to display relevant information in either the first or second state on the first store terminal device 50. This effectively makes users aware of relevant information related to the affiliated store. For example, in this process, the generation device 200 creates advertisements based on templates and content entered by the administrator, reducing the administrator's workload and creating relevant information that better aligns with the administrator's image.

[0103] [Screen transition (2)] Figure 21 shows an example of an interface screen related to advertisement creation. The second store terminal device 70 displays interface screen IF21 on its display unit. Interface screen IF21 is a screen that asks whether to create an advertisement using a template or using the generation device 200. If the administrator selects to create an advertisement using the generation device 200, a list of templates is displayed. If the administrator selects a template by operating the second store terminal device 70, the second store terminal device 70 displays interface screen IF22 on its display unit.

[0104] The interface screen IF22 includes a template selected by the administrator and an input field for entering the content of the advertisement. When the administrator operates the second store terminal device 70 to enter the content of the advertisement and performs a predetermined operation, the generation device 200 generates the advertisement based on the template and the entered content. For example, the payment server 100 gives the generation device 200 a predetermined prompt, such as "Please use the attached template image and create an advertisement advertising that the XX store will open in August." The generation device 200 creates the advertisement based on the prompt.

[0105] Interface screen IF23 includes an advertisement created by the generation device 200, a modification button for modifying the advertisement, and a button for confirming the advertisement as an advertisement. If the modification button is pressed, the administrator can modify the advertisement by operating the second store terminal device 70. If the confirmation button is pressed, the second store terminal device 70 requests the payment server 100 to review the advertisement.

[0106] As described above, the administrator can easily create advertisements that match their intentions by operating the second store terminal device 70.

[0107] In the example above, if there is no relevant information specified by the merchant, the payment server 100 may display advertisements (such as campaigns) related to the electronic payment service on the first store terminal device 50.

[0108] In the example above, the merchant's manager may operate the first store terminal 50 or the second store terminal 70 to display selected relevant information from among multiple pieces of relevant information, such as advertisements, job postings, and other campaigns created by the merchant, on the display unit of the first store terminal 50. For example, multiple pieces of relevant information are stored in the memory of the first store terminal 50, the second store terminal 70, or the payment server 100, and the relevant information selected from these is displayed along with a code image (or credit card payment information). This allows users to display their preferred relevant information or relevant information that is appropriate to their situation.

[0109] Furthermore, the related information displayed may vary depending on the time of day, or it may change every few seconds. These settings can be configured by the store manager by operating the first store terminal device 50 or the second store terminal device 70. This allows for the display of various related information, providing users with information tailored to their preferences.

[0110] In the example above, it was explained that related information is displayed for a code image and credit card information, but instead (or in addition to this), related information may be displayed together with information about other electronic payments. For example, related information may be displayed on the payment screen for a debit card or other electronic money.

[0111] [Voice output corresponding to electronic payment] The control unit 58 of the first store terminal device 50 executes the following processes: to acquire a code image used in the first electronic payment service, which includes identification information for identifying the merchant; and to display a first interface screen including the code image on the display unit of the first store terminal device 50 in the first state. Furthermore, the control unit 58 executes the following processes: to acquire a payment completion notification from the payment server, which is transmitted when the user's user terminal device 10 reads the code image and performs the first electronic payment in cooperation with the payment server 100 that performs the first electronic payment of the first electronic payment service; and to output a sound related to the first electronic payment, which is different from the voice indicating the completion of the first electronic payment, to the speaker S (output unit) in response to the acquisition of the payment completion notification.

[0112] The audio notification for the completion of the first electronic payment is an audio message indicating that an electronic payment has been made using an electronic payment service. For example, it might be a beeping sound or a specific sound like "○○ Pay" that indicates that the electronic payment has been made by that particular electronic payment service.

[0113] The audio related to the first electronic payment service is an audio notification related to the first electronic payment service. The notification audio is an audio notification indicating that a lottery ticket can be drawn using the first electronic payment service, an audio notification indicating that a benefit has been applied to the first electronic payment service, or an audio notification indicating that a benefit has been granted to the first electronic payment service. Examples of notification audio include "Scratch Chance" indicating that a lottery ticket can be drawn using the electronic payment service, "Coupon Applied" indicating that a coupon for the electronic payment service has been applied, and "Coupon Acquired" indicating that a benefit has been obtained through electronic payment using the electronic payment service. The notification audio is an example of a notification related to the user.

[0114] Figure 22 is a diagram illustrating the sounds output by the first store terminal device 50. For example, when a user reads a code image displayed on the first store terminal device 50 using the payment app 20 and makes an electronic payment, first an audio message indicating the completion of the electronic payment (payment completion sound), such as "○○ Pay," is output, followed by an audio message notifying the user of a scratch-off chance or similar.

[0115] As described above, since an audio message confirming the completion of electronic payment is output, merchants and users can easily and reliably recognize that the electronic payment has been properly made. This helps to prevent goods or services from being provided without electronic payment. Furthermore, since an announcement audio message is output, users can easily recognize services (e.g., lotteries) and benefits related to electronic payment. This improves user satisfaction with electronic payment. Merchants can also help improve user satisfaction by outputting announcement audio messages, encouraging users to use their merchants. In this way, the first store terminal device 50 can improve convenience for both merchants and users.

[0116] [Sequence diagram (1)] The payment server 100 determines whether or not to output an audio notification about the first electronic payment, which is an audio message related to the first electronic payment, to the first store terminal device 50, based on the merchant identification information for identifying the merchant of the first electronic payment service and the user identification information for identifying the user, which have been read and transmitted by the user terminal device 10 of the user after the user terminal device 10 reads the code image, and the information associated with the merchant identification information and the user identification information managed by the first electronic payment service. If the payment server 100 determines that the notification audio should be output, it provides the first store terminal device 50 with an instruction to output the notification audio in accordance with the completion of the first electronic payment.

[0117] Figure 23 is a sequence diagram showing an example of the process in which voice is output during electronic payment by user scanning. First, the user terminal device 10 decodes the store code image 60 using its optical reading function (S1). Next, the payment application 20 sends first payment information, including the terminal ID, store URL, and account ID, to the payment server 100 (S2#). The terminal ID is, for example, identification information for the first store terminal device 50 or identification information for identifying the store application CI of the first store terminal device 50. For example, the terminal ID is encoded in the store code image.

[0118] Next, the payment server 100 searches for store information using the merchant ID and store ID corresponding to the store URL to obtain the merchant name and store name information (S3) and sends it to the payment application 20 (S4). The user enters the payment amount into the user terminal device 10 on the screen where the merchant name and store name are displayed (S5). The user terminal device 10 then generates second payment information, which includes at least the payment amount, and sends it to the payment server 100 (S6).

[0119] Next, the payment server 100 performs electronic payment based on the received second payment information (S7). For example, information indicating that a merchant or store is a service-eligible merchant or store is associated with the merchant ID or store ID in the merchant / store information 176. Service eligibility refers to information indicating that a store is eligible for the lottery or that a store provides coupons to users. User conditions or payment conditions may be defined for whether these apply. User conditions include the type of payment and user attributes. For example, the service may apply to all stores, and user conditions may be associated with it. For example, a user who pays by credit card may be eligible for the lottery service. Payment conditions include amounts such as a payment of 500 yen or more, or conditions such as three or more payments at a designated merchant. The payment server 100 determines whether a user is eligible for the service by referring to the merchant / store information 176 and user information 172 as described above. Furthermore, the payment server 100 determines whether or not a coupon usable at the merchant is associated with the user information 172, and if a coupon is associated, it performs an electronic payment using the coupon.

[0120] Then, the payment server 100 sends a payment completion notification to the payment app 20 (S8-1), and the payment app 20 displays a payment completion screen and outputs an audio message indicating the completion of the electronic payment (S9-1).

[0121] Furthermore, the payment server 100 sends a payment completion notification to the first store terminal device 50 (S8-2). The payment application 20 displays a payment completion screen and outputs an audio message indicating the completion of the electronic payment, followed by an announcement audio message (S9-2). Either or both of the payment completion notification audio and the announcement audio may be stored in the memory of the first store terminal device 50, or they may be provided by the payment server 100 when the payment completion notification is sent. When the first store terminal device 50 receives the payment completion notification, it may output the payment completion audio and announcement audio that are pre-stored in its memory, or it may output the payment completion audio that is pre-stored in its memory and output the announcement audio obtained from the payment server 100.

[0122] For example, voice information SI may be stored in the storage unit of the first store terminal device 50 and the storage unit 170 of the payment server 100. Figure 24 is a diagram showing an example of the contents of voice information SI. Voice information SI is a diagram showing the correspondence between flags and the voices to be output. For example, if the flag is 1 (or there is no flag), a payment completion notification is output. If the flag is 2, in addition to the payment completion notification, the voice of notification 1 (e.g., scratch chance) is output. If the flag is 3, in addition to the payment completion notification, the voice of notification 2 (e.g., coupon has been applied) is output. If the flag is 4, the voice of notification 4 (e.g., coupon has been acquired) is output.

[0123] The payment server 100 refers to the voice information SI to identify the notification applicable to the user, sets a flag for the identified notification, and sends it to the first store terminal device 50. Priority may be set in the voice information SI. If multiple notifications are applied, the flag with higher priority may be set, or multiple flags may be sent and multiple voice messages may be output. The first store terminal device 50 refers to the voice information SI and outputs a notification that matches the flag set and sent by the payment server 100. For example, the first store terminal device 50 outputs a payment completion notification and a notification at a timing predetermined in the store application CI. For example, it outputs a notification a predetermined time after outputting the payment completion notification. The timing of the voice messages may be provided by the payment server 100 or may be predetermined.

[0124] As described above, the first store terminal device 50 can improve convenience for affiliated stores or users by outputting announcements.

[0125] The timing at which notifications are output may differ depending on the type of notification. For example, Notification 1 is output a first predetermined time after the payment completion notification. For example, Notification 3 is output a second predetermined time after the payment completion notification. For example, Notification 2 is output before the payment completion notification, and the payment completion notification is output a third predetermined time after that. As described above, the first store terminal device 50 changes the timing at which it outputs notifications depending on the type of notification.

[0126] As described above, changing the timing of notifications makes it possible to appeal to users more effectively with electronic payment services and improves user satisfaction. For example, if a coupon is applied, if the user recognizes that the coupon has been applied and then recognizes that the electronic payment has been made, they will feel that they have made a good deal by using the coupon, which improves user convenience. If the user recognizes that they have been able to draw a lottery or have received a coupon after recognizing that the electronic payment has been made, their satisfaction with the purchase will be further improved. As described above, the first store terminal device 50 can further improve user satisfaction and convenience by outputting notification audio at the timing corresponding to the notification.

[0127] [Sequence Diagram (2)] If the first store terminal device 50 outputs an audio notification of payment completion, the user terminal device 10 may omit outputting the audio notification of payment completion. The payment server 100 performs the processes (1) and (2) when the user's user terminal device 10 reads the code image displayed on the display unit of the first store terminal device 50 and sends a request for the first electronic payment. (1) Upon completion of the first electronic payment, the payment server 100 sends a notification of completion of the first electronic payment to the first store terminal device 50, thereby notifying the first store terminal device 50 that the first electronic payment has been completed and causing the first store terminal device 50 to output an audio message indicating completion of the electronic payment in cooperation with the store application CI. (2) In response to the completion of the first electronic payment, the payment server 100 sends a notification of completion of the first electronic payment to the user terminal device 10, which is a notification of completion of the first electronic payment and does not output an audio message indicating the completion of the first electronic payment, thereby notifying the user terminal device 10 that the first electronic payment has been completed and preventing the user terminal device 10 from outputting an audio message indicating the completion of the first electronic payment.

[0128] When the user's user terminal device 10 reads a code image displayed on a medium different from the display unit of the first store terminal device (for example, a plate or other medium different from the first store terminal device 50) and transmits a request for the first electronic payment, the process in (3) is performed. (3) Upon completion of the first electronic payment, the payment server 100 sends a notification of completion of the first electronic payment to the user terminal device 10, which is a notification of completion of the first electronic payment and causes the user terminal device 10 to output an audio message indicating the completion of the first electronic payment.

[0129] Figure 25 is a sequence diagram showing another example of the process in which audio is output during electronic payment by user scanning. The process is the same as that described in Figure 23 above. After processing S1-S7, the payment server 100 sends a payment completion notification to the payment application 20 (S8-1), and the payment application 20 displays a payment completion screen (S9-1#). At this time, the payment server 100 does not cause the payment application 20 to output an audio message indicating the completion of the electronic payment. For example, if the payment server 100 causes the first store terminal device 50 to output a payment completion notification, it does not cause the user terminal device 10 to output a payment completion notification. For example, if the terminal ID is included in the first payment information, the payment server 100 may instruct the user terminal device 10 not to output a payment completion notification. Such instructions include, for example, sending a flag indicating that the payment completion notification should not be output, or not sending a flag indicating that the payment completion notification should be output. In the merchant / store information 176, information indicating whether or not a merchant is the target merchant may be associated with the merchant ID or store ID. If the store is a participating merchant, it will display the store code image on the first store terminal device 50, and in this case, the payment server 100 will not notify the user terminal device 10 of the completion of payment.

[0130] Furthermore, the payment server 100 sends a payment completion notification to the first store terminal device 50 (S8-2). The payment application 20 displays a payment completion screen and outputs an audio message indicating the completion of the electronic payment, followed by an announcement audio message (S9-2).

[0131] As described above, when the payment server 100 sends a payment completion notification to the first store terminal device 50, it does not output a payment completion notification to the user terminal device 10, thereby preventing users from feeling inconvenienced.

[0132] [Other examples] The payment server 100 may cause the first store terminal device 50 to output a corresponding voice response to the payment completion notification output by the user terminal device 10. For example, if the user terminal device 10 outputs "○○ Pay", the first store terminal device 50 will output a voice response such as "Great!".

[0133] When the user terminal device 10 reads the code image displayed on the display unit of the first store terminal device 50 and sends a request for the first electronic payment, the payment server 100 sends a notification of completion of the first electronic payment to the user terminal device 10, which outputs an audio message indicating the completion of the first electronic payment, thereby notifying the user terminal device 10 that the first electronic payment has been completed and causing the first store terminal device 50 to output a first audio message indicating the completion of the first electronic payment. Furthermore, the payment server 100 sends a notification of completion of the first electronic payment to the first store terminal device 50, which notifies the first store terminal device 50 that the first electronic payment has been completed and causes the first store terminal device 50 to output a second audio message indicating the completion of the first electronic payment in cooperation with the store application CI of the first store terminal device 50. The first audio message is a notification that the first electronic payment has been made, and the second audio message is an audio message in response to the first audio message.

[0134] The first store terminal device 50 may, for example, output the second audio message along with the audio message of the payment completion notification when it receives a payment completion notification from the payment server 100, or it may output the second audio message without outputting the audio message of the payment completion notification. Alternatively, the audio output scenario may be determined based on a flag sent from the payment server 100. The audio output scenario may also be determined by the store manager operating the first store terminal device 50.

[0135] Furthermore, the above voice output scenarios may be set by the merchant's administrator. For example, a merchant may register its own voice and set up a scenario using this voice. For instance, the merchant's administrator may set it to output its own voice "△△" in place of (or in addition to) the payment completion notification voice in response to the payment completion notification, or to output the "△△" voice immediately after the payment completion notification voice is output. The voice information is stored in the memory unit of the first store terminal device 50, and the system outputs a voice corresponding to the instruction based on a predetermined instruction.

[0136] Furthermore, multiple audio messages may be provided to replace (or in addition to) the payment completion notification audio, and these may be output in a pre-set order for each payment completion notification, or they may be output randomly.

[0137] As described above, store managers can have appropriate voice messages output for each store, thereby improving the advertising effectiveness of the store or franchisee and creating a sense of familiarity with customers.

[0138] According to the second embodiment described above, by causing the computer of the first store terminal device 50 equipped with a display unit to perform the following processes: causing the store application CI to acquire a code image used in the first electronic payment service, which includes identification information for identifying the merchant; and causing the store terminal device to display a first interface screen on the display unit in a first state, which includes related information related to the merchant along with the code image, the related information related to the merchant can be effectively made aware of to the user.

[0139] According to the second embodiment described above, the convenience of merchants or users can be improved by having the computer of a store terminal device equipped with a display unit perform the following processes: causing the store application CI to acquire a code image used in the first electronic payment service, which includes identification information for identifying a merchant; causing the store terminal device to display a first interface screen including the code image on the display unit in a first state; obtaining a payment completion notification from the payment server, which is transmitted when the user's user terminal device reads the code image and performs the first electronic payment in cooperation with the payment server that performs the first electronic payment of the first electronic payment service; and, in response to obtaining the payment completion notification, outputting a sound related to the first electronic payment, which is different from the sound of completion of the first electronic payment, to the output unit.

[0140] Although embodiments for carrying out the present invention have been described above using examples, the present invention is not limited in any way to these embodiments, and various modifications and substitutions can be made without departing from the spirit of the present invention. [Explanation of symbols]

[0141] 10. User terminal device 20 Payment Apps 50. First store terminal device 51 Pedestal 53 Main unit 57 Card slot 58 Control Unit 100 Payment Servers 120 Content Provision Department 130 Payment Processing Unit 140 Information Management Department CI Store App

Claims

1. A computer for a store terminal device comprising a main body with a display unit and a base on which the main body is placed, A process to obtain a code image used in the first electronic payment service, which includes identification information for identifying the merchant, In a first state in which the main unit is placed on the base, a process is performed to display a first interface screen on the display unit that includes the code image along with related information related to the affiliated store, The process of displaying a second interface screen on the display unit that accepts electronic payments by credit card, which is a second electronic payment service, in a second state in which the main unit is separated from the base, To execute Application program.

2. The second interface screen includes relevant information related to the merchant, The application program according to claim 1.

3. The aforementioned related information includes one or more of the following: advertisements relating to the affiliated store, advertisements for stores related to the affiliated store, and job postings for the affiliated store or stores related to the affiliated store. The application program according to claim 1.

4. To the aforementioned computer, A process to display the second interface screen on the display unit in response to a change from the first state to the second state, After an electronic payment is made using the aforementioned credit card, if the state changes from the second state to the first state, the process of automatically displaying the first interface screen on the display unit is executed. The application program according to claim 3.

5. To the aforementioned computer, In response to the change from a first state in which the main unit is placed on the base to a second state in which the main unit is separated from the base, the system executes a process to display on the display unit, in place of the first interface screen, the second interface screen which accepts electronic payments by credit card, a second electronic payment service, and which includes relevant information related to the merchant. The application program according to claim 1 or 2.

6. To the aforementioned computer, The relevant information generated by the store management device that manages information regarding the electronic payments of the merchants in the electronic payment service is to be obtained directly or via other devices. The first interface screen, including the acquired related information, is displayed on the display unit. An application program according to any one of claims 1 to 4.

7. An application program according to any one of claims 1 to 4, The system includes a store management device that manages information regarding the electronic payments of the merchants in the electronic payment service, The store management device, in response to an operation by the administrator, transmits an instruction to a generating AI that performs a specified task via the payment server that provides the electronic payment service, to generate the relevant information, to cause the generating AI to generate the relevant information, and to retrieve the relevant information generated by the generating AI in order to display it on the display unit. Information processing system.

8. A store terminal device comprising a main body having a display unit and a base on which the main body is placed, A process to obtain a code image used in the first electronic payment service, which includes identification information for identifying the merchant, In a first state in which the main unit is placed on the base, a process is performed to display a first interface screen on the display unit that includes the code image along with related information related to the affiliated store, The process of displaying a second interface screen on the display unit that accepts electronic payments by credit card, which is a second electronic payment service, in a second state in which the main unit is separated from the base, A store terminal device that performs this operation.

9. A computer for a store terminal device comprising a main body with a display unit and a base on which the main body is placed, A process to obtain a code image used in the first electronic payment service, which includes identification information for identifying the merchant, In a first state in which the main unit is placed on the base, a process is performed to display a first interface screen on the display unit that includes the code image along with related information related to the affiliated store, The process of displaying a second interface screen on the display unit that accepts electronic payments by credit card, which is a second electronic payment service, in a second state in which the main unit is separated from the base, A display control method that performs the following.

Images