Electronic payment system, electronic payment method, and program

Abstract

To improve the voice-based operability of an application providing an electronic settlement function.SOLUTION: An information processing device controls the operation of an application program that operates on a user's terminal device based on voice information of the user that is input to the terminal device, and includes: an acquisition unit configured to acquire text data of voice information that is input to the terminal device, and indicates the content of an utterance related to what the user wants to achieve using the application program; and a function specification unit configured to input the text data based on learning results obtained by learning a relation between various functions of the application program and items that can be achieved by the various functions and specify a function to cause the application program to execute it in order to achieve what the user wants to achieve.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to Electronic payment system, electronic payment a method, and a program to the and the like.

Background Art

[0002] Conventionally, a settlement device that supports a user to perform settlement by electronic payment using a voice reading function has been proposed (for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional technology, it was possible to support a user to perform settlement by electronic payment by reading out the price of a product by voice, but the range of actions that could be supported was limited and not necessarily highly convenient.

[0005] The present invention has been made in consideration of such circumstances, and an object thereof is to provide a method and a program that can improve the operability by voice of an application that provides an electronic payment function. Electronic payment system, electronic payment a method, and a program to the and the like.

Means for Solving the Problems

[0006] One aspect of the present invention is an information processing apparatus that controls the operation of an application program operating on a user's terminal device based on voice information of the user input to the terminal device, the information processing apparatus including: an acquisition unit that acquires text data of the voice information that is the voice information input to the terminal device and indicates the content of a statement regarding what the user desires to achieve using the application program; and a function specifying unit that inputs the text data and specifies a function to be executed by the application program in order to achieve what the user desires to achieve, based on a learning result obtained by learning the relationship between various functions of the application program and matters that can be achieved by the various functions.

Advantages of the Invention

[0007] According to one aspect of the present invention, it is possible to improve the operability by voice of an application that provides an electronic payment function. Electronic payment system, electronic payment Method, and Program to the Can be provided.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of the information processing apparatus, information processing method, program, and information processing system of the present invention will be described with reference to the drawings. Various apparatuses such as "server", "management apparatus", "information providing apparatus", etc., which provide services to users or perform internal analysis, may be realized by a decentralized group of apparatuses, and the operators of each apparatus may be different. Also, the holder of the hardware of the apparatus (provider of the cloud server) and the operator who actually operates the apparatus may be different. The application program and the payment server cooperate to provide an electronic payment service. In the following description, the application program is referred to as a payment app. The electronic payment service is a service that supports payments related to the purchase of goods and services in a store. A store is, for example, a physical store (actual store) existing in the real space, but may also include a virtual store for e-commerce. The virtual store may include those provided by a party different from the operator of the electronic payment service. In that case, at the time of payment for shopping in the virtual store, it is controlled to transition to the interface screen of the electronic payment service. In the electronic payment service, a store is, for example, treated as belonging to a franchise (brand), and processing such as payment when a purchase action is performed in the store is mainly carried out between the user and the franchise. Instead of this, processing such as payment may be carried out between the user and the store.

[0010] In addition, the payment app and the conversion server cooperate to provide an operation interface for the payment app by voice. The payment app inputs the user's voice and transmits the voice data to the conversion server. The conversion server recognizes what the user wants to achieve by using the payment app based on the user's voice data, determines a command for operating the payment app so that what the user wants to achieve is realized, generates command information for causing the payment app to execute the command, and transmits the command information to the payment app. The payment app operates based on the command information received from the conversion server and cooperates with the payment server, thereby realizing what the user wants to achieve. In the following description, the case where the conversion server is configured as a separate device from the payment server will be described, but the payment server may have the functions of the conversion server. Also, the payment app may have the functions of the conversion server.

[0011] [Electronic Payment Service] FIG. 1 is a diagram showing an example of a configuration for realizing an electronic payment service. The electronic payment service is realized centering around a payment server 100. The payment server 100 communicates with each of, for example, one or more user terminal devices 10, one or more first store terminal devices 50, and one or more second store terminal devices 70 via a network NW. The network NW includes, for example, the Internet, a LAN (Local Area Network), a wireless base station, a provider device, and the like.

[0012] The user terminal device 10 is a portable terminal device such as a smartphone or a tablet terminal. The user terminal device 10 is a computer device having at least an optical reading function, a communication function, a display function, an input reception function, and a program execution function. In the following description, the configurations for realizing these functions are respectively referred to as a camera, a communication device, a touch panel, a CPU (Central Processing Unit), etc. In the user terminal device 10, the payment application 20 is executed by a processor such as a CPU, and it operates to provide an electronic payment service to the user in cooperation with the payment server 100. The payment application 20 is installed in the user terminal device 10 from an application store, for example, and controls a camera, a communication device, a touch panel, etc.

[0013] Also, the user terminal device 10 communicates with the conversion server 200 via the network NW. The payment application 20 provides the user with an operation support function for the payment application 20 by voice (hereinafter referred to as the "voice operation function") in cooperation with the conversion server 200. Details of the voice operation function will be described later.

[0014] The first store terminal device 50 is installed in a store, for example. The first store terminal device 50 is a computer device having at least a product price acquisition function, an optical reading function, a program execution function, and a communication function. The first store terminal device 50 includes a so-called POS (Point of Sale) device, and the product price acquisition function and the optical reading function may be realized by the POS device. The store code image 60 is placed in the store and is a code image such as a QR code (registered trademark) printed on a paper or plastic medium. Note that the store code image 60 may be displayed by a display placed in the store (which may be a display of a terminal device such as a smartphone).

[0015] The second store terminal device 70 is used by the operator of the franchise store. The second store terminal device 70 is a smartphone, a tablet terminal, a personal computer, or the like. In the second store terminal device 70, the interface 72 for franchise stores operates. The interface 72 for franchise stores may be an application for franchise stores or a browser. The interface 72 for franchise stores accepts settings of coupons, etc. by the operator of the franchise store and transmits them to the payment server 100. The second store terminal device 70 that is a smartphone has functions such as displaying a code image corresponding to the store code image or reading the code image displayed by the user terminal device 10 by executing an application for franchise stores.

[0016] The payment server 100 realizes electronic payment based on the payment information received from the user terminal device 10 or the first store terminal device 50. The first store terminal device 50 may include a POS device and a franchise store server. In that case, the payment information is transmitted from the POS device to the payment server 100 via the franchise store server. In the following description, without particularly distinguishing this, it is assumed that the payment information is transmitted from the first store terminal device 50.

[0017] FIG. 2 and FIG. 3 are sequence diagrams illustrating a rough flow of electronic payment. There may be two patterns, pattern 1 and pattern 2, in electronic payment.

[0018] In the case of Pattern 1 shown in FIG. 2 (hereinafter referred to as user scan), the user terminal device 10 in the state where the settlement application 20 is started decodes the store code image 60 by means of an optical reading function (S1). The store code image 60 contains information on the store URL (Uniform Resource Locator). This store URL is obtained by adding information capable of identifying the store to the domain of the electronic payment service, and is associated with the franchise store ID, store ID, etc. in the payment server 100 (described later). The settlement application 20 transmits first settlement information including the store URL and the account ID to the settlement server 100 (S2). The settlement server 100 searches for store information (described later) from the franchise store ID and store ID corresponding to the store URL, acquires information on the franchise store name and store name (S3), and transmits it to the settlement application 20 (S4). The user inputs the settlement amount into the user terminal device 10 on the screen where the franchise store name and store name are displayed (S5). Then, the user terminal device 10 generates second settlement information including at least the settlement amount and transmits it to the settlement server 100 (S6). The settlement server 100 performs an electronic settlement based on the received second settlement information (S7). Then, the settlement server 100 transmits a settlement completion notice (information for displaying a settlement completion screen) to the settlement application 20 (S8), and the settlement application 20 displays a settlement completion screen (S9). Note that when the store code image 60 is displayed by a display placed in the store, the store code image 60 may contain not only the store URL but also settlement amount information. In this case, the procedure for the user to input the settlement amount is omitted, and the settlement amount information is included in the first settlement information and transmitted to the settlement server 100. Information on the franchise store name and store name may be included and displayed on the settlement completion screen.

[0019] In the case of Pattern 2 shown in FIG. 3 (hereinafter referred to as store scan), when the payment application 20 is launched, when a payment operation is performed in the payment application 20, when the automatic update timing (for example, every minute) arrives, and at other timings, the payment application 20 sends a request for issuing a one-time code to the payment server 100 (S11). The payment server 100 generates a one-time code (S12) and sends it to the payment application 20 (S13). The payment application 20 displays a code image such as a QR code or a barcode generated based on the one-time code (S14). The user shields (presents) the display surface of the user terminal device 10 against the first store terminal device 50, and the first store terminal device 50 decodes the code image by means of an optical reading function and acquires a one-time code or the like (S15). Then, the first store terminal device 50 generates payment information including a one-time code, a payment amount, a franchise store ID, a store ID, etc., and sends it to the payment server 100 (S16). The information on the payment amount has been acquired in advance by barcode reading, manual input, or the like. The payment server 100 identifies the user corresponding to the one-time code based on the received information and performs an electronic payment (S17). Then, the payment server 100 sends a payment completion notification to the payment application 20 (S18), and the payment application 20 displays a payment completion screen (S19).

[0020] Note that the electronic payment may be performed in only one of the above patterns. Also, the "account ID" described in FIG. 2 may be other information (for example, a telephone number) that can be used as the identification information of the user. Further, in the store scan, the issuance of the one-time code may be omitted, and the payment application 20 may display a code image generated based on the user's account ID. In that case, instead of identifying the user corresponding to the one-time code, the payment server 100 identifies the user corresponding to the account ID.

[0021] [Payment Server] FIG. 4 is a configuration diagram of the settlement server 100 according to the first embodiment. The settlement server 100 includes, for example, a communication unit 110, a settlement content providing unit 120, a settlement processing unit 130, an information management unit 140, and a storage unit 170. Components other than the communication unit 110 and the storage unit 170 are realized, for example, by a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware (including a circuit unit; circuitry) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), or GPU (Graphics Processing Unit), or may be realized by the cooperation of software and hardware. The program may be stored in advance in a storage device (a storage device having a non-transitory storage medium) such as an HDD (Hard Disk Drive) or a flash memory, or may be stored in a removable storage medium (a non-transitory storage medium) such as a DVD or a CD-ROM, and may be installed in the storage device when the storage medium is mounted on a drive device.

[0022] The storage unit 170 is an HDD, a flash memory, a RAM (Random Access Memory), or the like. The storage unit 170 may be a NAS (Network Attached Storage) device accessible by the settlement server 100 via a network. Information such as user information 172, settlement content information 174, and affiliated store / store information 176 is stored in the storage unit 170.

[0023] The communication unit 110 is a communication interface for connecting to the network NW. The communication unit 110 is, for example, a network interface card.

[0024] The settlement content providing unit 120 has, for example, the function of a web server and provides information (content) for displaying various screens of the electronic payment service to the user terminal device 10. The settlement content providing unit 120 appropriately reads necessary content from the settlement content information 174 and provides it to the user terminal device 10. The user terminal device 10 receives various inputs by the user in a state where the content is reproduced by the payment application 20, and transmits the above-mentioned settlement information and the like to the payment server 100.

[0025] The settlement processing unit 130 performs settlement processing based on the settlement information transmitted by the user terminal device 10 or the first store terminal device 50. The settlement processing unit 130 performs settlement processing while referring to the user information 172.

[0026] FIG. 5 is a diagram showing an example of the content of the user information 172. The user information 172 is an example of the user's registration information. The user information 172 includes, for example, a user URL, an account ID, a phone number, a password, as well as an email address, a user ID, name, address, date of birth, registration date, charge balance, post-payment setting, post-payment limit, post-payment usage amount, post-payment available amount, payment method setting, bank account, credit card number, charge history information, settlement history information, and other information that are associated. The user URL is used for money transfer processing between users. When newly registering for the electronic payment service, registration of a phone number and a password is required. The account ID is issued to the user by the payment server 100, and the user ID is an ID that the user can optionally set (it is not necessary to set). Similarly, the email address, and the name, address, and date of birth are also information that the user can optionally set (it is not necessary to set). The registration date is the date when the user registered for the electronic payment service (the date when the account was created). Hereinafter, an instance of the user (electronic payment account) in which these pieces of information are associated is referred to as an account.

[0027] The remaining balance of the charge indicates the information of the remaining balance of the electronic money set by the user's advance transfer to the account. As means of transfer, there are transfers from ATMs (Automatic Teller Machines) of designated operators (banks), transfers from registered bank accounts, etc. The post-payment setting indicates whether the setting for enabling electronic payment by post-payment has been completed or not, and is set to either "completed" or "not completed". The post-payment limit is the limit amount of post-payment available per month. The post-payment used amount is the amount of post-payment already used in the current month. The available post-payment amount is the amount of post-payment available in the current month obtained by subtracting the post-payment used amount from the post-payment limit. Although only one post-payment limit is shown in the figure, in reality, there are further upper limits per day, etc., and the lower of them may be set as the post-payment limit. Further details of the post-payment will be described later. The payment method setting is the setting information indicating whether the user performs an electronic payment using the remaining balance of the charge or a payment by post-payment at that time. Each of the bank account and credit card number is the information (account number, card number) of the bank account or credit card number that can receive deposits for the electronic payment service. The charge history information is the history of the user's advance transfer to the electronic payment service to increase the remaining balance of the charge. The settlement history information is the information showing the breakdown of the settlements made by the user (date and time, store ID of the store where the purchase action was performed, settlement amount, payment method, etc.) for each settlement.

[0028] Figure 6 is a diagram showing an example of the content of the affiliated store / store information 176. The affiliated store / store information 176 includes, for example, a first table 176A in which an affiliated store ID and a store ID are associated with a store URL, a second table 176B in which an affiliated store name and sales amount (described above) are associated with the affiliated store ID, and a third table 176C in which a store name is associated with the store ID. In addition to these information, the affiliated store / store information 176 may include information such as the category of the affiliated store or store, the location of the store, and the settlement pattern.

[0029] The information management unit 140 manages user information 172 and franchise / store information 176 based on the information acquired from the user terminal device 10 and the second store terminal device 70. The information management unit 140 adds, edits, deletes, etc. new records for the user information 172 and the franchise / store information 176.

[0030] [Electronic payment] When the settlement processing unit 130 acquires settlement information from the user terminal device 10 or the first store terminal device 50, it refers to the user information 172 to acquire the "settlement method setting" of the user. For users whose "settlement method setting" is set to "charge balance", the settlement processing unit 130 performs electronic payment as follows. The settlement processing unit 130 performs electronic payment, for example, by reducing the charge balance managed in association with the user ID and increasing the item value of the franchise's sales amount. The item value of the franchise's sales amount is not, for example, itself used as electronic money, and the amount corresponding to the item value of the sales amount is remitted to the bank account in a cycle according to the agreement between the franchise and the electronic payment service.

[0031] For users whose "setting information" is set to "postpaid", the settlement processing unit 130 performs electronic payment as follows. Postpaid is set separately from "credit payment" through cooperation with a credit card company, which is a separate entity from the operator of the electronic payment service. The operator of the electronic payment service acts as the creditor and allows electronic payment that does not depend on the charge balance within the range of the postpaid limit. In order to receive the postpaid service, it may be required to obtain a credit card provided by the operator of the electronic payment service. The amount used for postpaid is settled in one lump sum on the payment date of the following month, for example, by direct debit from the bank account. In this case, the settlement processing unit 130 performs provisional settlement by adding the settlement amount to the postpaid usage amount and subtracting the same amount from the available postpaid amount, and at the closing date, performs the process of direct debiting the settlement for the current month on the payment date of the following month as described above, or requests the operator of the credit card company to perform the process. If the settlement amount exceeds the available postpaid amount at the time of provisional settlement, an error notification is returned to the settlement application 20.

[0032] [Operation Support Function for Voice-Based Payment App (Voice Operation Function)] FIG. 7 is a diagram showing an example of the functional configuration of a system that realizes the voice operation function of the payment app 20. Further, FIG. 8 is a sequence chart showing an example of the flow of processing for realizing the voice operation function in cooperation with the payment app 20, the conversion server 200, and the payment server 100. Hereinafter, the flow of the sequence chart will be described while explaining the content of the processing of each functional unit with appropriate reference to FIG. 7. It is assumed that the user terminal device 10 has the payment app 20 already launched at the start point of the sequence chart.

[0033] First, the user operates the payment app 20 to activate the voice input function and transitions the payment app 20 to the voice input waiting state (S21). The user speaks to the user terminal device 10 what the user wants to achieve using the payment app 20, and inputs the content of what the user wants to achieve as voice information into the payment app 20 (S22). For this input of voice information, it is assumed that the user terminal device 10 is equipped with a microphone. The payment app 20 has a voice input function 21, and this voice input function 21 inputs the user's voice information to generate voice data (S23). The payment app 20 transmits the generated voice data to the conversion server 200 (S24).

[0034] Subsequently, in the conversion server 200, the voice / text conversion unit 210 converts the voice data into text data by performing processes such as acoustic analysis, phoneme extraction, and conversion of phonemes into words on the voice data received from the user terminal device 10 (S25). This conversion process (voice recognition process) may be realized using any voice recognition technology. Here, the voice / text conversion unit 210 is an example of an "acquisition unit".

[0035] Next, in the conversion server 200, the mapping information output unit 220 generates mapping information based on the text data generated by the voice / text conversion unit 210 (S26). The mapping information is information for the settlement application 20 to recognize the command to be executed for what the user wants to achieve by the command conversion function 22. In other words, the mapping information can be said to be information that maps what the user wants to achieve to the commands executed by the settlement application 20. Here, the mapping information output unit 220 is an example of a "function specifying unit", and the command is an example of a "function". Also, the voice input function 21 is an example of a "voice input unit", and the command conversion function 22 is an example of a "recognition unit".

[0036] Here, the mapping information may be any information as long as the settlement application 20 can recognize the command to be executed. For example, the mapping information is represented by the identification information of the command. In this case, the settlement application 20 can recognize the command to be executed based on the identification information indicated by the mapping information. Also, for example, the mapping information may be represented by the command name (command character string). In this case, the settlement application 20 may execute the command character string indicated by the mapping information as it is. The mapping information may include command parameters as necessary.

[0037] For example, when it is recognized that a certain user wants to "pay the purchase price with the remaining recharge amount for product B in store A", parameters such as the identification information of store A (an example of a franchise store), the identification information of product B, and the settlement method may be included in the mapping information together with the command character string (which may also be identification information) of the settlement process. Furthermore, when the sales amount of product B is recognized in the conversion server 200, the information on the settlement amount may also be included in the mapping information as a parameter. The conversion server 200 may be configured to communicate with, for example, the settlement server 100 or the system of the franchise store to obtain information such as the sales amount.

[0038] The mapping information output unit 220 can be configured as, for example, a conversational engine (such as a chatbot) that inputs text data indicating the content of what the user has said regarding what the user wants to achieve, and returns command information for causing the payment application 20 to execute a command for achieving what the user wants to achieve. Such a conversational engine can be constructed by, for example, a natural language understanding platform (NLP: Neuro Linguistic Processing) such as a dialog flow, various functions (commands) that the payment application 20 has, and a machine learning algorithm (ML: Machine Learning) that learns the relationship between the various functions and the matters realized by the various functions, that is, an NLP / ML engine. The mapping information output unit 220 can, for example, identify the function to be executed by the payment application 20 in order to achieve what the user wants to achieve by inputting the above text data into such a conversational engine (an example of the learning result).

[0039] By being configured as such a conversational engine, the mapping information output unit 220 can flexibly and accurately recognize various requests of the user and generate command information for realizing them. By providing such command information, the payment application 20 can perform the operations necessary to realize the requests expressed by the user in various ways. The mapping information output unit 220 transmits the generated mapping information to the user terminal device 10 (S27).

[0040] Subsequently, in the user terminal device 10, the payment application 20 recognizes the command to be executed based on the mapping information received from the conversion server 200 by means of the command conversion function (S28). The payment application 20 executes the process for realizing what the user wants to achieve by executing the command recognized from the mapping information (S29). Here, the command executed by the payment application 20 may be one whose processing is completed by the payment application 20 alone (S29A), or may be one that cooperates with the payment server 100 (S29B).

[0041] According to the embodiments described above, the operability of an application that provides an electronic payment function by voice can be improved. Further, due to such an improvement in operability, for example, a person who cannot release their hand at present, a person with poor eyesight, etc. can operate the payment application 20 by voice and perform a payment even if they let go of their hand or close their eyes.

[0042] <Modification Example> In the above embodiment, the case where the payment application 20 includes the command conversion function 22 has been described. However, the command conversion function 22 may be provided on the conversion server 200 side. In this case, the conversion server 200 inputs the mapping information output by the mapping information output unit 220 to the command conversion function 22, thereby recognizing the command to be executed by the payment application 20. The conversion server 200 may be configured to notify the recognized command to the payment application 20 and cause the payment application 20 to execute the command notified from the conversion server 200. Further, in this case, the mapping information output unit 220 may be configured integrally with the command conversion function 22 and output a command to be executed by the payment application 20 in response to the input of text data.

[0043] When the payment application 20 recognizes, based on the mapping information supplied from the conversion server 200, a command for realizing what the user wants to realize by the command conversion function 22, before executing the command, the payment application 20 may be configured to notify the user of the content of the command to be executed by voice. In order to perform such a notification, the user terminal device 10 may include a speaker.

[0044] The conversion server 200 may be configured to obtain information necessary for executing a command from a user when executing a command for realizing what the user wants to realize. For example, when the mapping information output unit 220 recognizes that there are a plurality of command candidates to be executed by the settlement application 20 from text data, the mapping information output unit 220 may request the settlement application 20 to provide supplementary information for determining which command should be executed. Also, for example, when the mapping information output unit 220 recognizes a command to be executed by the settlement application 20 from text data but lacks information that should be a parameter of the command, the mapping information output unit 220 may request the settlement application 20 to provide supplementary information for supplementing the deficiency. In this case, for example, the conversion server 200 generates a question sentence for obtaining supplementary information and transmits it to the settlement application 20, and the settlement application 20 outputs the question sentence as voice. The settlement application 20 inputs the user's answer to the question sentence as voice and transmits the voice data to the conversion server 200. The mapping information output unit 220 determines a command to be executed by the settlement application 20 by selecting and supplementing the command based on the text data indicating the content of the user's answer. In this way, the conversion server 200 may be configured to recognize a command for realizing what the user has realized through dialogue with the user. Thereby, the conversion server 200 can more accurately recognize a command for realizing what the user has realized.

[0045] The settlement application 20 (or the conversion server 200) may be provided with a voiceprint authentication function for authenticating the user by voice. The settlement application 20 (or the conversion server 200) may be configured to provide a voice operation function to a user authenticated by voiceprint authentication.

[0046] As described above, the embodiments for carrying out the present invention have been described using the embodiments. However, the present invention is not limited to such embodiments at all, and various modifications and substitutions can be made without departing from the gist of the present invention.

Explanation of Reference Numerals

[0047] 10 User terminal device 20 Payment App 21 Voice Input Function 22 Command Conversion Function 50 First Store Terminal Device 60 Store Code Image 70 Second Store Terminal Device 72 Interface for Franchisees 100 Payment Server 110 Communication Department 120 Payment Content Provision Department 130 Payment Processing Department 140 Information Management Department 170 Memory Department 172 User Information 174 Payment Content Information 176 Franchise / Store Information 200 Conversion Server 210 Text Conversion Department 220 Mapping Information Output Department

Claims

Claim 1 An application program operating on a user's terminal device, the application program being a payment application that provides an electronic payment service to the user in cooperation with a payment server, the payment server, and a conversion server that provides an operation interface for the payment application by voice in cooperation with the payment application, wherein the payment application includes a voice input unit that inputs the user's voice and supplies voice data related to the voice to the conversion server, a command conversion unit that converts mapping information supplied from the conversion server into a command to be executed in order to realize what the user wants to achieve using the electronic payment service in cooperation with the payment server, and the conversion server includes a voiceprint authentication unit that authenticates the user based on the voice data, a text conversion unit that converts voice information including the content spoken by the user regarding the matter into text data based on the voice data supplied from the payment application, a mapping information output unit constructed by a conversation engine combining a natural language understanding platform and a machine learning algorithm for learning the relationship between commands of the payment application and matters that can be realized in the electronic payment service, and configured to input the text data and output a command for realizing the matter, and the payment application performs an operation for realizing the matter in cooperation with the payment server by executing the command converted from the mapping information by the command conversion unit, the command conversion unit outputs the mapping information when the user is authenticated by the voiceprint authentication unit based on the voice data of the user, An electronic payment system. Claim 2 The text conversion unit obtains voice data of the voice information from the terminal device and obtains text data of the voice information by performing voice recognition processing on the voice data. The electronic payment system according to claim 1. Claim 3 When the mapping information output unit lacks information for identifying a function to be executed by the application program in the text data, it obtains supplementary information for supplementing the deficiency from the terminal device by having an additional conversation with the user through the conversation engine. The electronic payment system according to claim 2.

4. In an electronic payment system including a payment application which is an application program operating on a user's terminal device and which provides an electronic payment service to the user in cooperation with a payment server, the payment server, and a conversion server which provides an operation interface for the payment application by voice in cooperation with the payment application, The payment application: A voice input step of inputting the voice of the user and supplying voice data related to the voice to the conversion server; A command conversion step of converting, based on the mapping information supplied from the conversion server, a matter that the user wants to achieve by using the electronic payment service into a command to be executed in order for the payment application to achieve it in cooperation with the payment server; The conversion server: A voiceprint authentication step of authenticating the user based on the voice data; A text conversion step of converting voice information including the content spoken by the user regarding the matter into text data based on the voice data supplied from the payment application; A mapping information output step of outputting the mapping information indicating the identification information of the command for achieving the matter by inputting the text data by a mapping information output unit constructed by a conversation engine combining a natural language understanding platform and a machine learning algorithm for learning the relationship between the commands of the payment application and the matters that can be achieved in the electronic payment service; An electronic payment method for executing: The payment application performs an operation for achieving the matter in cooperation with the payment server by executing the command converted from the mapping information in the command conversion step; The command conversion step outputs the mapping information when the user is authenticated in the voiceprint authentication step based on the voice data of the user. Electronic payment method. According to claim 5, an application program that operates on a user's terminal device, which is a payment application that provides an electronic payment service to the user in cooperation with a payment server, the payment server, and a conversion server that provides an operation interface for the payment application by voice in cooperation with the payment application. In the electronic payment system comprising: In the payment application, A voice input step of inputting the user's voice and supplying voice data related to the voice to the conversion server; A command conversion step of converting, based on the mapping information supplied from the conversion server, the matter that the user wants to achieve by using the electronic payment service into a command to be executed by the payment application in cooperation with the payment server; To execute, In the conversion server, A voiceprint authentication step of authenticating the user based on the voice data; A text conversion step of converting voice information including the content spoken by the user regarding the matter into text data based on the voice data supplied from the payment application; A mapping information output step of inputting the text data and outputting the mapping information indicating the identification information of the command for realizing the matter by a mapping information output unit constructed by a conversation engine combining a natural language understanding platform and a machine learning algorithm for learning the relationship between the commands of the payment application and the matters that can be realized in the electronic payment service; A program for causing the above to be executed, By executing the command converted from the mapping information in the command conversion step, causing the payment application to perform an operation for realizing the matter in cooperation with the payment server; The command conversion step outputs the mapping information when the user is authenticated by the voiceprint authentication step based on the voice data of the user; A program for the above purpose.

Images