system

Abstract

We provide the system. [Solution] A means of managing and providing currency conversion data to enable mobile terminal payments from communication terminals in countries visited by users of other countries, A means by which a communication terminal receives the product price and calculates the price converted to the user's home currency based on exchange rate conversion data, A means for users to register and securely store financial institution information on a mobile device, A means by which, when a user makes a payment using information from a registered financial institution, a communication terminal that receives a command from a mobile terminal communicates with the financial institution to execute the payment, A means of notifying the mobile terminal of the payment result, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of the chatbot's character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is a problem that the convenience is greatly impaired because users visiting from other countries cannot immediately convert to their own currency in payments in the visited country and physical presentation of cash or financial institutions is required. Also, due to the high dependence on cash, it causes the burden of carrying back surplus local currency and the inconvenience of being unable to use financial institution settlement means in some places.

Means for Solving the Problems

[0005] This invention provides a function that allows users from other countries to instantly convert the price of goods they purchase in their destination country into their own currency by using a communication terminal and a mobile terminal. Furthermore, by registering and securely managing financial institution information on the mobile terminal, it provides a means to complete payments via the communication terminal without physically presenting a financial institution's information. This enables users to make payments quickly and conveniently, reducing the inconvenience associated with payments in their destination country.

[0006] "Users from other countries" refers to people who are visiting from their own country or another country, not the country of their destination.

[0007] A "communication terminal" is a device used for sending and receiving data, and in this system, it is responsible for currency conversion and payment mediation.

[0008] A "mobile terminal" is a portable electronic device that allows users to input product prices and issue instructions for financial transactions via an application.

[0009] "Exchange rate conversion data" refers to information necessary for converting the values ​​between different currencies, and includes the latest exchange rates.

[0010] "Financial institution information" refers to information necessary for making payments, such as card numbers, expiration dates, and security codes.

[0011] "Payment result" refers to information indicating whether the payment processing by the financial institution was successful or unsuccessful.

[0012] An "electronic receipt" is a purchase record generated in digital format, providing the user with proof of payment confirmation. [Brief explanation of the drawing]

[0013] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2]It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Embodiments for Carrying Out the Invention

[0014] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0017] In the following embodiments, a labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0018] In the following embodiments, a labeled storage is one or more non-volatile storage devices that store various programs, various parameters, and the like. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0019] In the following embodiments, a labeled communication I / F (Interface) is an interface that includes a communication processor, an antenna, and the like. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0021] [First Embodiment]

[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0034] This invention is a system that allows foreigners to check prices in their own currency and make payments smoothly through financial institutions when visiting a country. The system mainly consists of communication terminals and mobile terminals, improving the convenience for visitors when purchasing goods. The specific operation of the system is described below.

[0035] The server periodically retrieves currency conversion data from external currency providers via the internet and stores it in a database. This ensures that when users make payments in a foreign country they are visiting, they can always convert their currency to their local currency based on the latest exchange rate.

[0036] The terminal receives the product price based on the user's input and sends that price to the server. The server uses internally stored currency conversion data to convert the price to the user's local currency and returns the result to the terminal. This allows the user to intuitively understand the product price in their own currency.

[0037] Users access the system using a mobile device and securely register their financial institution information. This information is tokenized by the server and stored in a secure format, allowing users to make payments without having to take out a physical card when needed.

[0038] Upon receiving a payment request from the terminal, the server references the user's financial institution information and requests payment authorization from the financial institution. Once authorization is obtained, the server notifies the terminal of the payment result, which the user can then verify.

[0039] For example, if a user visiting Japan from the United States wants to purchase an item costing 5,000 yen, they enter 5,000 yen into their mobile terminal. The terminal sends this information to a server, which then displays the price converted to US dollars (for example, approximately $45). When the user makes a payment using a credit card they registered in advance within the app, the server requests authorization from the financial institution. Upon successful payment, an electronic receipt is generated and sent to the terminal. This allows users to enjoy shopping quickly and efficiently.

[0040] The following describes the processing flow.

[0041] Step 1:

[0042] The server periodically retrieves the latest exchange rate data from external exchange rate providers and stores it in its database. This ensures that visitors always have access to the most up-to-date rates when making payments.

[0043] Step 2:

[0044] The terminal provides an interface for users to input the price of goods or services in Japanese yen. Once the user enters the price, the terminal sends that information to the server.

[0045] Step 3:

[0046] The server begins calculations to perform currency conversion based on the received price in Japanese yen. Using the latest exchange rate stored in the database, it converts the price in Japanese yen to the user's local currency (e.g., US dollars).

[0047] Step 4:

[0048] The server sends the converted price to the terminal, which then displays it to the user. The user can then verify the amount in their own currency.

[0049] Step 5:

[0050] Users register their credit card information in advance on their mobile device. This information is securely tokenized and stored in the server's database, eliminating the need to physically present the card at the time of payment.

[0051] Step 6:

[0052] Once the user confirms the purchase, the device sends a payment request to the server. The request includes the amount in the converted local currency and tokenized credit card information.

[0053] Step 7:

[0054] Based on the received payment request, the server requests approval from the financial institution for payment processing. Upon receiving a response from the financial institution, the server sends the result (approval or rejection) to the terminal.

[0055] Step 8:

[0056] The terminal notifies the user of the payment result. Once the payment is approved, the terminal generates an electronic receipt and displays it to the user to confirm the completion of the transaction.

[0057] (Example 1)

[0058] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0059] It is difficult for users visiting other countries to intuitively understand the value of local currency in their own currency and to make safe and quick payments. Furthermore, there is a lack of methods to ensure the security of financial institution information, which leads to concerns about conducting transactions abroad.

[0060] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0061] This invention includes a server that manages and provides currency conversion data to enable mobile terminal payments from an information processing device in the country the user is visiting, a means for the information processing device to receive the buying and selling price and calculate the price converted to the user's home currency based on the currency conversion data, and a means for securely storing financial institution information using tokenization technology. This makes it possible for users to purchase goods in foreign countries without worrying about exchange rates and to make secure payments.

[0062] "Currency conversion data" refers to information on exchange rates used to convert the monetary values ​​between different countries.

[0063] An "information processing device" refers to an electronic device that has functions such as acquiring, processing, storing, and transmitting data.

[0064] A "mobile device" refers to a device that a user can carry with them and use for communication and information processing.

[0065] "Financial institution information" refers to data related to financial services used in transactions, such as credit card information and bank account information.

[0066] "Tokenization technology" refers to a data encryption technique that replaces the original data with a random string of characters in order to protect it.

[0067] "Payment result" refers to a notification or information indicating whether the payment was successful.

[0068] An "electronic certificate" refers to a purchase history certificate provided in digital format.

[0069] The embodiment for carrying out this invention mainly consists of an information processing device (server), a mobile terminal (user's smartphone or tablet), and network technology for communication between them.

[0070] Operation of information processing equipment (server)

[0071] The server periodically retrieves the latest currency conversion data from an external currency provider. This data is accessible via an API and stored in a database on the server. The server receives product prices from mobile devices, uses the stored, up-to-date currency conversion data to calculate the price in its local currency, and sends the result to the mobile device. It also securely manages financial institution information using tokenization technology and securely communicates with financial institutions when receiving payment requests.

[0072] Operation of mobile devices (such as the user's smartphone)

[0073] Users access the system using their mobile devices and enter product prices using an application. They can also register their financial institution information within the application; this information is tokenized by the server and stored securely. After confirming the converted price, users make payments using their registered financial institution information. Upon completion of payment, the device generates an electronic receipt based on the settlement result and displays it to the user, allowing them to confirm the result with confidence.

[0074] Specific example

[0075] Consider a scenario where a user visiting Japan from the United States purchases Japanese sweets. When purchasing an item costing 5,000 yen, the user enters the price into their mobile device, and the application sends the data to a server. The server then converts 5,000 yen to US dollars based on the latest exchange rate (for example, approximately 45 dollars) and returns the result to the device. The user completes the payment using a credit card registered in advance within the app, and an electronic receipt is sent to the device. Through this process, the user can enjoy shopping with peace of mind thanks to real-time price conversion and secure payment.

[0076] Example of a prompt

[0077] "Using a scenario where an American tourist visiting Japan purchases a 5,000 yen item at a store in Japan, please explain how the system performs real-time currency conversion and payment."

[0078] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0079] Step 1:

[0080] The server retrieves currency conversion data. The server accesses external currency providers via the internet and obtains the latest exchange rate data through APIs. The retrieved data is stored in a database on the server, which serves as the basis for subsequent currency conversions. The input is API access from the currency provider, and the output is the retrieved exchange rate information.

[0081] Step 2:

[0082] The user enters the product price using a mobile device. This price information is entered as the starting data for the user's desired transaction. The user enters the price via the application interface, and this data is sent from the device to the server. The input from the device is product price data, and the data received by the server is the output.

[0083] Step 3:

[0084] The server performs a conversion process based on the received product price. Using the latest stored exchange rate, the server performs a data calculation to convert the product price into the user's local currency. The input is the product price sent by the user, and the output is the converted price in the user's local currency. The server sends this conversion result back to the terminal.

[0085] Step 4:

[0086] The terminal displays the conversion result sent from the server. Upon receiving this result, the terminal displays the price in the user's local currency on the screen for the user to verify. The input is the conversion result data from the server, and the output is the display on the terminal.

[0087] Step 5:

[0088] The user proceeds to the payment process. The user confirms the price in their local currency displayed in the application and makes the payment using their registered financial institution information. This operation involves sending a payment request to the server via the terminal. The input is the user's selection and confirmation, and the output is the submission of the payment request.

[0089] Step 6:

[0090] The server processes the payment. Based on the received payment request, it uses tokenized financial institution information to request approval from the specified financial institution. The input is the user's payment request and securely stored financial institution information, and the output is the result of payment approval or rejection.

[0091] Step 7:

[0092] The server notifies the terminal of the payment result. If the payment is successful or unsuccessful, it sends the result to the terminal and generates an electronic certificate, which is then sent to the terminal if successful. The input is the payment result from the financial institution, and the output is the notification to the terminal and the transmission of the electronic certificate.

[0093] Step 8:

[0094] The terminal displays the received payment result to the user. If successful, it provides the user with an electronic receipt to confirm the completion of the transaction. Input is a notification from the server, and output is a display on the terminal screen.

[0095] (Application Example 1)

[0096] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0097] When international travelers visit a country, the process of converting between local and their own currencies is cumbersome, making it difficult to intuitively grasp prices when purchasing goods. Furthermore, the need for physical card payments raises security concerns. To address these issues, there is a need for a system that allows travelers to quickly check product prices in their own currency and complete payments safely and smoothly.

[0098] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0099] This invention includes a server with means for managing and providing currency conversion data to enable mobile information processing device payments from information processing devices in areas visited by travelers from other countries; means for the information processing device to receive the value of goods and calculate the value converted to the traveler's home currency based on the currency conversion data; and means for the mobile information processing device to display the value of goods converted to its home currency to the traveler, receive a purchase command, and quickly complete the payment. This enables travelers to understand the price in their home currency when purchasing goods locally and to make payments safely and smoothly.

[0100] "Travelers from other countries" refers to people who are visiting from a country different from the region they are going to.

[0101] "Information processing equipment" refers to terminals and servers used to receive and process data.

[0102] "Mobile information processing equipment" refers to portable devices that users can use while on the move.

[0103] "Currency conversion data" refers to data that shows the conversion ratio between different currencies.

[0104] "Commercial value" refers to the price or value of a product being purchased.

[0105] A "financial organization" refers to a group that provides financial services, such as credit card companies and banks.

[0106] "Payment" refers to the act of paying for goods or services.

[0107] "Local currency" refers to the currency used in the country where the traveler resides.

[0108] An "electronic receipt" is a certificate of transaction issued electronically after payment is completed.

[0109] The system implementing this invention mainly consists of an information processing device, a mobile information processing device, and a server. The information processing device receives the commodity value and, in cooperation with the server, calculates the value converted to the traveler's home currency based on currency conversion data. The server plays a crucial role in this conversion process, and the currency conversion data is periodically obtained from a currency exchange provider API such as Fixer.io.

[0110] Mobile information processing devices are portable terminals, such as smartphones, that travelers use to verify the value of goods and make payments. Payments are made securely and quickly based on information from registered financial institutions. When a traveler issues a purchase order, the server handles communication with the financial institution and notifies the mobile information processing device of the completion of the payment.

[0111] As a concrete example, when a traveler from the United States purchases goods in Japan, they input the value of the goods into a mobile information processing device. The device and server then work together to display the price converted to US dollars. The traveler can then complete the payment simply by tapping the purchase button using their already registered credit card information. This allows travelers to shop smoothly without being bothered by local currency.

[0112] An example of a prompt message generated using an AI model is: "Please propose an app design that displays the amount entered by the user in their local currency and allows for secure payment completion. Input: Product price (local currency), Output: Price displayed in local currency, payment completion message, and electronic receipt."

[0113] In this way, travelers can experience intuitive pricing based on the local currency and secure, safe payment in the countries they visit.

[0114] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0115] Step 1:

[0116] The user inputs the value of a product into a mobile information processing device. The input value is in local currency. This input data is transmitted to the information processing device.

[0117] Step 2:

[0118] The information processing device transmits the product value to the server. The server uses currency conversion data obtained from the currency provider API to convert from the local currency to the user's home currency. Data calculations are performed here to calculate the price in the home currency. This calculation result is then sent back to the information processing device.

[0119] Step 3:

[0120] The information processing device displays the price in the user's local currency, received from the server. The user confirms this displayed price and presses the purchase button. This generates a purchase command, and the process proceeds to the next payment stage.

[0121] Step 4:

[0122] Upon receiving a purchase order, the server uses the registered financial institution's information to communicate the settlement request to the financial institution. Here, the server uses tokenized data to ensure secure communication.

[0123] Step 5:

[0124] Upon receiving payment approval from a financial institution, the server notifies the mobile information processing device of the payment result. As output of the processing, a message indicating payment success or failure is generated.

[0125] Step 6:

[0126] The mobile information processing device receives the payment result from the server and notifies the user. If the payment is successful, the mobile information processing device generates an electronic receipt and displays it to the user. This electronic receipt includes information such as the purchased items, price, and payment date and time.

[0127] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0128] This invention is a system that integrates an emotion engine that recognizes user emotions, in addition to conventional currency conversion and payment methods, to make the payment experience smoother for users visiting from other countries. This system improves user convenience and satisfaction through the cooperation of communication terminals and mobile terminals.

[0129] The server retrieves the latest exchange rates via the internet and stores them in a database. This exchange rate data is used for real-time currency conversion when making payments in the visited country.

[0130] The terminal sends the product price entered by the user to the server, and based on that information, it retrieves the amount converted to the user's local currency using the latest exchange rate. This allows the user to check the product price in their own currency.

[0131] Users can pre-register their financial institution information on a mobile terminal and make payments using tokenized data. This process allows visitors to complete transactions without physically presenting their cards.

[0132] The device is equipped with an emotion engine that recognizes the user's emotions in real time from their facial expressions and voice. For example, if the device detects signs of user dissatisfaction, the server can adjust the notification method and return a more reassuring message.

[0133] As a concrete example, let's say a user visiting Japan from the United States purchases an item costing 5,000 yen. When 5,000 yen is entered into the mobile terminal, the terminal sends this information to the server and displays it as approximately $45. At the same time, the emotion engine analyzes the user's facial expressions, and if it detects signs of reassurance, the payment process proceeds as usual, followed by approval. On the other hand, if the user shows signs of anxiety, the terminal enhances the verification process and displays additional information to reassure the user. Through this entire process, visitors can make payments with peace of mind and convenience, and enjoy their shopping experience at their destination.

[0134] The following describes the processing flow.

[0135] Step 1:

[0136] The server periodically retrieves the latest exchange rate data from an external exchange rate provider and stores it in its database. This allows visitors to make payments based on the most up-to-date rates.

[0137] Step 2:

[0138] The terminal provides a user interface for users to input the price of goods or services in Japanese yen. Once the user enters the price, that information is sent to the server.

[0139] Step 3:

[0140] The server converts the received price in Japanese yen to the user's local currency using the latest stored exchange rate. The conversion result is sent to the terminal and displayed to the user.

[0141] Step 4:

[0142] Users choose to make payments based on financial institution information pre-registered on their mobile devices. This information is tokenized, thus ensuring security.

[0143] Step 5:

[0144] The device's built-in emotion engine activates, analyzing the user's facial expressions and vocalizations in real time to recognize their emotional state. Based on this analysis, the device adjusts the displayed content and notification methods.

[0145] Step 6:

[0146] The terminal sends a payment request to the server and issues a command to authorize the payment through the registered financial institution. The server receives authorization from the financial institution, and if the payment is successful, it sends the result to the terminal.

[0147] Step 7:

[0148] The device notifies the user of successful payment and, based on the user's emotional state as determined by the emotion engine, provides the user with additional feedback and information.

[0149] Step 8:

[0150] The terminal generates an electronic receipt indicating the completion of the transaction and displays it to the user. This allows the user to visually confirm that the transaction has been successfully completed.

[0151] (Example 2)

[0152] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0153] Traditional international payment systems have made the payment experience at destinations cumbersome for users, with currency conversion and language barriers hindering a comfortable service experience. Furthermore, the need to present a physical card raises security concerns, and the lack of consideration for user emotions during such transactions significantly reduces satisfaction.

[0154] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0155] In this invention, the server includes means for managing and providing currency conversion data to enable mobile device payments from the information processing device in countries visited by users from other countries; means for the information processing device to receive product prices and calculate the price converted to the user's home currency based on the currency conversion data; means for the user to register and securely store financial institution information on the mobile device; means for the information processing device to communicate with the financial institution and execute the payment when the user makes a payment using the registered financial institution information, after receiving instructions from the mobile device; and means for the mobile device to detect the user's emotions and notify the information processing device based on predetermined conditions. This enables visitors to make payments safely and smoothly, and to obtain higher satisfaction and a sense of security through responses that respond to their emotions.

[0156] "Users from other countries" refers to individuals who reside in a country different from their destination and are visiting that country.

[0157] An "information processing device" is a device that manages, provides, and communicates data, and includes data center equipment such as servers.

[0158] A "mobile device" is a device that is portable and has payment functionality, regardless of location, and includes smartphones and tablets.

[0159] "Currency conversion data" refers to a dataset containing currency exchange rate information between different countries, and it is assumed that this data will be updated in real time.

[0160] "Financial institution information" refers to personal financial information used for payments such as credit cards and bank accounts.

[0161] "Emotion detection" refers to the process of analyzing the user's characteristics, such as facial expressions and voice tone, in real time to recognize their emotional state.

[0162] A "response message" refers to the text of a notification or information that is generated based on the detected emotion and presented to the user.

[0163] This invention is a system designed to allow users visiting from other countries to make payments comfortably at their destination. This system involves a server, terminals, and user devices working together to provide real-time currency conversion and sentiment recognition capabilities.

[0164] The server is responsible for retrieving exchange rate information from global financial data providers via an internet connection and storing it in a database. The server periodically retrieves exchange rate information using APIs and provides the functionality to convert currencies using the latest exchange rates. Through this process, visitors can check product prices in foreign countries in their own currency.

[0165] The terminal has the function of sending product price information entered by the user to a server. The price information, converted to the user's local currency, is received from the server and displayed on the terminal's screen. Furthermore, the terminal is equipped with a camera and microphone, which are used by an emotion engine that recognizes the user's emotions in real time. For example, if a sense of security is detected, the normal procedure proceeds, and if anxiety is detected, additional information is displayed to provide the user with reassurance.

[0166] Users can conduct secure, tokenized transactions by registering their financial institution information with a mobile terminal in advance. This eliminates the need to physically present a card, enabling smooth and secure payments.

[0167] A concrete example would be a user visiting Japan from the United States who wants to purchase an item costing 5,000 yen. In this case, the user enters 5,000 yen into the terminal, and the server returns the amount converted to approximately $45, which is then displayed on the terminal. If the user feels reassured, the payment will be completed as usual. However, if anxiety is detected, additional information can be displayed to reassure the user.

[0168] Example of a prompt

[0169] "Please tell me how to make payments at the client's location smoother."

[0170] "How can we implement payment methods that take into account the visitor's feelings?"

[0171] This system allows visitors to enjoy shopping at their destination with peace of mind.

[0172] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0173] Step 1:

[0174] The server retrieves the latest exchange rate information from external financial data providers via the internet. This information is stored in a database on the server. The input is the currency rate obtained from the financial data provider, and the output is the latest exchange rate information stored in the database. The server periodically performs this process via an API, automatically updating the rates.

[0175] Step 2:

[0176] The terminal receives the price of the item the user is purchasing. This price information is sent from the terminal to the server, where it is converted to the user's local currency using the latest exchange rate. The input is the item price entered on the terminal, and the output is the converted price in the user's local currency. The server performs currency conversion in real time and returns the result to the terminal.

[0177] Step 3:

[0178] Users register their financial institution information on a mobile terminal and authenticate using tokenized information when making payments. The input is the pre-registered financial institution information, and the output is the token information necessary to execute the payment. Users can initiate payment using the terminal and complete transactions using secure tokens.

[0179] Step 4:

[0180] After receiving a payment instruction, the terminal communicates with a server to contact the financial institution. The server connects with the financial institution and executes the payment. The input is the payment instruction from the user, and the output is the result of the completed transaction. Once the server approves the transaction, it notifies the terminal of the payment result.

[0181] Step 5:

[0182] The device's built-in emotion engine analyzes the user's facial expressions and voice to detect emotions. The input is the user's facial expressions and voice, and the output is the detected emotion data. Specifically, it analyzes feelings of security and anxiety, and provides the user with a response based on the results.

[0183] Step 6:

[0184] The server generates an appropriate response message based on emotion data from the terminal and sends it to the terminal. The input is the detected emotion data, and the output is the response message presented to the user. For example, the server generates a message that promotes reassurance and displays it on the terminal.

[0185] This series of steps ensures that visitors can conduct transactions safely and smoothly and receive service that takes their feelings into consideration.

[0186] (Application Example 2)

[0187] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0188] When visitors from other countries purchase goods in their destination country, they often experience anxiety due to prices displayed in different currencies and the complexities of the payment process. In particular, they frequently face difficulties with calculations due to unfamiliarity with the local currency and concerns about the security of card payments. There is a need to provide systems that alleviate these anxieties and inconveniences for users and create a comfortable payment experience.

[0189] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0190] This invention includes a server with means for managing and providing currency conversion information to enable portable information processing device payments from an information processing device to a country visited by a user from another country; means for the information processing device to receive the price of goods and calculate the price converted to the user's home country currency based on the currency conversion information; and means for integrating a psychological state recognition device into the portable information processing device to determine the user's emotions and optimize the method of visualizing information according to the emotional state. As a result, even when shopping in a foreign country, users can understand the price in their own currency and reduce anxiety at the time of payment. Furthermore, it enables feedback according to the psychological state, promoting a comfortable and secure payment experience.

[0191] "Other countries" refers to countries or regions other than the visitor's usual place of residence.

[0192] A "portable information processing device" refers to an electronic device that can be carried by the user and allows for information processing anywhere.

[0193] An "information processing device" refers to an electronic device used for data management, calculation, storage, and communication.

[0194] "Currency conversion information" refers to information that includes exchange rate data between different currencies and is used to compare the value of currencies at a specific point in time.

[0195] A "psychological state recognition device" refers to a device that determines a user's emotions and psychological state from their facial expressions and voice.

[0196] "Emotional state" refers to the psychological reactions and emotions exhibited by a user, and is characterized by the elements that define them.

[0197] "Optimizing the method of visualizing information" refers to adjusting the content and format of the information displayed according to the user's psychological state, and presenting it in the most appropriate way.

[0198] "Payment procedures" refer to a series of operations and communications performed to pay for goods or services.

[0199] The system of this invention is designed to allow visitors from other countries to make payments conveniently at their destination. This system consists of multiple components, each performing its own unique function.

[0200] First, the server is responsible for acquiring the latest currency conversion information and storing it in its database. The server periodically updates exchange rates via the internet, enabling real-time currency conversion, allowing users to accurately understand the currency exchange rates between the country they are visiting and their own country. The server also receives product prices transmitted from portable information processing devices, performs currency conversion based on that information, and calculates and returns the price in the user's own currency in an easy-to-understand format.

[0201] The portable information processing device is equipped with a psychological state recognition system to support the user's payment experience. This system uses cameras and microphones to analyze the user's facial expressions and voice, determining their emotions in real time. If the psychological state recognition system detects anxiety in the user, it provides feedback to adjust the way information is visualized, thereby providing the user with a sense of security. This feature allows users to proceed with payments in a relaxed state.

[0202] As a concrete example, consider a scenario where a user purchases goods at a store while traveling. For instance, if a user visiting Japan from the United States attempts to purchase a 5,000 yen item, the portable information processing device receives and displays the price converted to approximately $45 from the server. Simultaneously, a psychological state recognition device reads the user's facial expression, and if it confirms a sense of security, it allows the user to proceed with the normal payment process. On the other hand, if the user expresses anxiety, it visualizes additional information to enhance the user's sense of security. In this way, the system improves the user experience.

[0203] An example of a prompt to input into a generative AI model is: "Design an electronic payment app that allows visitors to shop comfortably in a foreign country. It should have features that recognize user emotions in real time and optimize the payment experience."

[0204] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0205] Step 1:

[0206] The user enters the product price into the portable information processing device. The entered price data is then prepared for transmission to the server. The portable information processing device processes the price data into a packet format and sends it to the server.

[0207] Step 2:

[0208] The server performs a calculation to convert the product price data received from the portable information processing device into the user's local currency using the latest currency conversion information stored in its own database. The latest exchange rate data is used for this calculation. The converted price information is then transmitted from the server to the portable information processing device.

[0209] Step 3:

[0210] The user's portable information processing device displays the converted price in their local currency, received from the server. During this process, a psychological state recognition device operates on the portable information processing device, capturing the user's facial expressions and voice via camera and microphone, and performing emotion analysis. The acquired data is used to determine the user's emotional state in real time.

[0211] Step 4:

[0212] If the psychological state recognition device identifies the user's emotional state as anxiety, the portable information processing device performs data processing to adjust the display interface and show additional information to promote a sense of security. Specifically, it reduces the user's anxiety by displaying details of payment procedures and warranty information.

[0213] Step 5:

[0214] After receiving feedback tailored to their psychological state, the user authorizes the payment using tokenized data on a portable information processing device. The portable information processing device sends this payment authorization data to a server, which connects with a financial institution to execute the actual payment. The payment result is then notified from the server to the portable information processing device.

[0215] Step 6:

[0216] The portable information processing device generates an electronic record based on the received payment result and presents it to the user. The generated electronic record confirms the completion of the transaction and is stored in a format that the user can refer to.

[0217] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0218] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0219] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0220] [Second Embodiment]

[0221] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0222] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0223] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0224] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0225] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0226] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0227] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0228] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0229] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0230] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0231] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0232] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0233] This invention is a system that allows foreigners to check prices in their own currency and make payments smoothly through financial institutions when visiting a country. The system mainly consists of communication terminals and mobile terminals, improving the convenience for visitors when purchasing goods. The specific operation of the system is described below.

[0234] The server periodically retrieves currency conversion data from external currency providers via the internet and stores it in a database. This ensures that when users make payments in a foreign country they are visiting, they can always convert their currency to their local currency based on the latest exchange rate.

[0235] The terminal receives the product price based on the user's input and sends that price to the server. The server uses internally stored currency conversion data to convert the price to the user's local currency and returns the result to the terminal. This allows the user to intuitively understand the product price in their own currency.

[0236] Users access the system using a mobile device and securely register their financial institution information. This information is tokenized by the server and stored in a secure format, allowing users to make payments without having to take out a physical card when needed.

[0237] Upon receiving a payment request from the terminal, the server references the user's financial institution information and requests payment authorization from the financial institution. Once authorization is obtained, the server notifies the terminal of the payment result, which the user can then verify.

[0238] For example, if a user visiting Japan from the United States wants to purchase an item costing 5,000 yen, they enter 5,000 yen into their mobile terminal. The terminal sends this information to a server, which then displays the price converted to US dollars (for example, approximately $45). When the user makes a payment using a credit card they registered in advance within the app, the server requests authorization from the financial institution. Upon successful payment, an electronic receipt is generated and sent to the terminal. This allows users to enjoy shopping quickly and efficiently.

[0239] The following describes the processing flow.

[0240] Step 1:

[0241] The server periodically retrieves the latest exchange rate data from external exchange rate providers and stores it in its database. This ensures that visitors always have access to the most up-to-date rates when making payments.

[0242] Step 2:

[0243] The terminal provides an interface for users to input the price of goods or services in Japanese yen. Once the user enters the price, the terminal sends that information to the server.

[0244] Step 3:

[0245] The server begins calculations to perform currency conversion based on the received price in Japanese yen. Using the latest exchange rate stored in the database, it converts the price in Japanese yen to the user's local currency (e.g., US dollars).

[0246] Step 4:

[0247] The server sends the converted price to the terminal, which then displays it to the user. The user can then verify the amount in their own currency.

[0248] Step 5:

[0249] Users register their credit card information in advance on their mobile device. This information is securely tokenized and stored in the server's database, eliminating the need to physically present the card at the time of payment.

[0250] Step 6:

[0251] Once the user confirms the purchase, the device sends a payment request to the server. The request includes the amount in the converted local currency and tokenized credit card information.

[0252] Step 7:

[0253] Based on the received payment request, the server requests approval from the financial institution for payment processing. Upon receiving a response from the financial institution, the server sends the result (approval or rejection) to the terminal.

[0254] Step 8:

[0255] The terminal notifies the user of the payment result. Once the payment is approved, the terminal generates an electronic receipt and displays it to the user to confirm the completion of the transaction.

[0256] (Example 1)

[0257] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0258] It is difficult for users visiting other countries to intuitively understand the value of local currency in their own currency and to make safe and quick payments. Furthermore, there is a lack of methods to ensure the security of financial institution information, which leads to concerns about conducting transactions abroad.

[0259] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0260] This invention includes a server that manages and provides currency conversion data to enable mobile terminal payments from an information processing device in the country the user is visiting, a means for the information processing device to receive the buying and selling price and calculate the price converted to the user's home currency based on the currency conversion data, and a means for securely storing financial institution information using tokenization technology. This makes it possible for users to purchase goods in foreign countries without worrying about exchange rates and to make secure payments.

[0261] "Currency conversion data" refers to information on exchange rates used to convert the monetary values ​​between different countries.

[0262] An "information processing device" refers to an electronic device that has functions such as acquiring, processing, storing, and transmitting data.

[0263] A "mobile device" refers to a device that a user can carry with them and use for communication and information processing.

[0264] "Financial institution information" refers to data related to financial services used in transactions, such as credit card information and bank account information.

[0265] "Tokenization technology" refers to a data encryption technique that replaces the original data with a random string of characters in order to protect it.

[0266] "Payment result" refers to a notification or information indicating whether the payment was successful.

[0267] An "electronic certificate" refers to a purchase history certificate provided in digital format.

[0268] The embodiment for carrying out this invention mainly consists of an information processing device (server), a mobile terminal (user's smartphone or tablet), and network technology for communication between them.

[0269] Operation of information processing equipment (server)

[0270] The server periodically retrieves the latest currency conversion data from an external currency provider. This data is accessible via an API and stored in a database on the server. The server receives product prices from mobile devices, uses the stored, up-to-date currency conversion data to calculate the price in its local currency, and sends the result to the mobile device. It also securely manages financial institution information using tokenization technology and securely communicates with financial institutions when receiving payment requests.

[0271] Operation of mobile devices (such as the user's smartphone)

[0272] Users access the system using their mobile devices and enter product prices using an application. They can also register their financial institution information within the application; this information is tokenized by the server and stored securely. After confirming the converted price, users make payments using their registered financial institution information. Upon completion of payment, the device generates an electronic receipt based on the settlement result and displays it to the user, allowing them to confirm the result with confidence.

[0273] Specific example

[0274] Consider a scenario where a user visiting Japan from the United States purchases Japanese sweets. When purchasing an item costing 5,000 yen, the user enters the price into their mobile device, and the application sends the data to a server. The server then converts 5,000 yen to US dollars based on the latest exchange rate (for example, approximately 45 dollars) and returns the result to the device. The user completes the payment using a credit card registered in advance within the app, and an electronic receipt is sent to the device. Through this process, the user can enjoy shopping with peace of mind thanks to real-time price conversion and secure payment.

[0275] Example of a prompt

[0276] "Using a scenario where an American tourist visiting Japan purchases a 5,000 yen item at a store in Japan, please explain how the system performs real-time currency conversion and payment."

[0277] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0278] Step 1:

[0279] The server retrieves currency conversion data. The server accesses an external foreign exchange provider via the Internet and obtains the latest exchange rate data through an API. The retrieved data is stored in the database within the server, which serves as the basic data for subsequent currency conversions. The input is the API access from the foreign exchange provider, and the output is the obtained exchange rate information.

[0280] Step 2:

[0281] The user inputs the product price using a mobile terminal. This price information is input as the starting data for the transaction desired by the user. The user inputs the price via the application interface, and the data is sent from the terminal to the server. The input from the terminal is the data of the product price, and the data reception at the server is the output.

[0282] Step 3:

[0283] The server executes a conversion process based on the received product price. The server performs a data calculation to convert the product price into the user's home currency using the saved latest exchange rate. The input is the product price sent from the user, and the output is the converted home currency price. The server sends this conversion result back to the terminal.

[0284] Step 4:

[0285] The terminal displays the conversion result sent from the server. Upon receiving this result, the terminal displays the price in the user's home currency on the screen for the user to confirm. The input is the conversion result data from the server, and the output is the display on the terminal.

[0286] Step 5:

[0287] The user proceeds to the payment process. The user confirms the price in their local currency displayed in the application and makes the payment using their registered financial institution information. This operation involves sending a payment request to the server via the terminal. The input is the user's selection and confirmation, and the output is the submission of the payment request.

[0288] Step 6:

[0289] The server processes the payment. Based on the received payment request, it uses tokenized financial institution information to request approval from the specified financial institution. The input is the user's payment request and securely stored financial institution information, and the output is the result of payment approval or rejection.

[0290] Step 7:

[0291] The server notifies the terminal of the payment result. If the payment is successful or unsuccessful, it sends the result to the terminal and generates an electronic certificate, which is then sent to the terminal if successful. The input is the payment result from the financial institution, and the output is the notification to the terminal and the transmission of the electronic certificate.

[0292] Step 8:

[0293] The terminal displays the received payment result to the user. If successful, it provides the user with an electronic receipt to confirm the completion of the transaction. Input is a notification from the server, and output is a display on the terminal screen.

[0294] (Application Example 1)

[0295] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0296] When international travelers visit a country, the process of converting between local and their own currencies is cumbersome, making it difficult to intuitively grasp prices when purchasing goods. Furthermore, the need for physical card payments raises security concerns. To address these issues, there is a need for a system that allows travelers to quickly check product prices in their own currency and complete payments safely and smoothly.

[0297] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0298] This invention includes a server with means for managing and providing currency conversion data to enable mobile information processing device payments from information processing devices in areas visited by travelers from other countries; means for the information processing device to receive the value of goods and calculate the value converted to the traveler's home currency based on the currency conversion data; and means for the mobile information processing device to display the value of goods converted to its home currency to the traveler, receive a purchase command, and quickly complete the payment. This enables travelers to understand the price in their home currency when purchasing goods locally and to make payments safely and smoothly.

[0299] "Travelers from other countries" refers to people who are visiting from a country different from the region they are going to.

[0300] "Information processing equipment" refers to terminals and servers used to receive and process data.

[0301] "Mobile information processing equipment" refers to portable devices that users can use while on the move.

[0302] "Currency conversion data" refers to data that shows the conversion ratio between different currencies.

[0303] "Commercial value" refers to the price or value of a product being purchased.

[0304] A "financial organization" refers to a group that provides financial services, such as credit card companies and banks.

[0305] "Settlement" refers to the act of paying the price for goods or services.

[0306] "Home currency" refers to the currency used in the country where the traveler resides.

[0307] "Electronic receipt" is a certificate of transaction electronically issued after the completion of settlement.

[0308] The system for implementing this invention mainly consists of an information processing device, a mobile information processing device, and a server. The information processing device receives the commodity value and, in cooperation with the server, calculates the value converted into the traveler's home currency based on currency conversion data. The server plays an important role in this conversion process, and the currency conversion data is regularly obtained from a foreign exchange provider API such as Fixer.io.

[0309] The mobile information processing device is a portable terminal such as a smartphone. The traveler uses this terminal to confirm the commodity value and conduct settlement. The settlement is carried out safely and quickly based on the information of the registered financial organization. When the traveler issues a purchase command, the server is responsible for communicating with the financial organization and notifies the mobile information processing device of the completion of the settlement.

[0310] As a specific example, when a traveler visiting from the United States purchases goods in Japan, when the commodity value is input on the mobile information processing device, with the cooperation of the information processing device and the server, the price converted into US dollars is displayed. The traveler can complete the payment simply by tapping the purchase button using the already registered credit card information. As a result, the traveler can shop smoothly without being bothered by the local currency.

[0311] As an example of a prompt sentence using a generative AI model, there is "Please propose the design of an app that displays the amount entered by the user in the home currency and safely completes the settlement. Input: Commodity price (local currency), Output: Price display in the home currency, Settlement completion message and electronic receipt".

[0312] In this way, travelers can experience intuitive pricing based on the local currency and secure, safe payment in the countries they visit.

[0313] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0314] Step 1:

[0315] The user inputs the value of a product into a mobile information processing device. The input value is in local currency. This input data is transmitted to the information processing device.

[0316] Step 2:

[0317] The information processing device transmits the product value to the server. The server uses currency conversion data obtained from the currency provider API to convert from the local currency to the user's home currency. Data calculations are performed here to calculate the price in the home currency. This calculation result is then sent back to the information processing device.

[0318] Step 3:

[0319] The information processing device displays the price in the user's local currency, received from the server. The user confirms this displayed price and presses the purchase button. This generates a purchase command, and the process proceeds to the next payment stage.

[0320] Step 4:

[0321] Upon receiving a purchase order, the server uses the registered financial institution's information to communicate the settlement request to the financial institution. Here, the server uses tokenized data to ensure secure communication.

[0322] Step 5:

[0323] Upon receiving payment approval from a financial institution, the server notifies the mobile information processing device of the payment result. As output of the processing, a message indicating payment success or failure is generated.

[0324] Step 6:

[0325] The mobile information processing device receives the payment result from the server and notifies the user. If the payment is successful, the mobile information processing device generates an electronic receipt and displays it to the user. This electronic receipt includes information such as the purchased items, price, and payment date and time.

[0326] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0327] This invention is a system that integrates an emotion engine that recognizes user emotions, in addition to conventional currency conversion and payment methods, to make the payment experience smoother for users visiting from other countries. This system improves user convenience and satisfaction through the cooperation of communication terminals and mobile terminals.

[0328] The server retrieves the latest exchange rates via the internet and stores them in a database. This exchange rate data is used for real-time currency conversion when making payments in the visited country.

[0329] The terminal sends the product price entered by the user to the server, and based on that information, it retrieves the amount converted to the user's local currency using the latest exchange rate. This allows the user to check the product price in their own currency.

[0330] Users can pre-register their financial institution information on a mobile terminal and make payments using tokenized data. This process allows visitors to complete transactions without physically presenting their cards.

[0331] The device is equipped with an emotion engine that recognizes the user's emotions in real time from their facial expressions and voice. For example, if the device detects signs of user dissatisfaction, the server can adjust the notification method and return a more reassuring message.

[0332] As a concrete example, let's say a user visiting Japan from the United States purchases an item costing 5,000 yen. When 5,000 yen is entered into the mobile terminal, the terminal sends this information to the server and displays it as approximately $45. At the same time, the emotion engine analyzes the user's facial expressions, and if it detects signs of reassurance, the payment process proceeds as usual, followed by approval. On the other hand, if the user shows signs of anxiety, the terminal enhances the verification process and displays additional information to reassure the user. Through this entire process, visitors can make payments with peace of mind and convenience, and enjoy their shopping experience at their destination.

[0333] The following describes the processing flow.

[0334] Step 1:

[0335] The server periodically retrieves the latest exchange rate data from an external exchange rate provider and stores it in its database. This allows visitors to make payments based on the most up-to-date rates.

[0336] Step 2:

[0337] The terminal provides a user interface for users to input the price of goods or services in Japanese yen. Once the user enters the price, that information is sent to the server.

[0338] Step 3:

[0339] The server converts the received price in Japanese yen to the user's local currency using the latest stored exchange rate. The conversion result is sent to the terminal and displayed to the user.

[0340] Step 4:

[0341] Users choose to make payments based on financial institution information pre-registered on their mobile devices. This information is tokenized, thus ensuring security.

[0342] Step 5:

[0343] The device's built-in emotion engine activates, analyzing the user's facial expressions and vocalizations in real time to recognize their emotional state. Based on this analysis, the device adjusts the displayed content and notification methods.

[0344] Step 6:

[0345] The terminal sends a payment request to the server and issues a command to authorize the payment through the registered financial institution. The server receives authorization from the financial institution, and if the payment is successful, it sends the result to the terminal.

[0346] Step 7:

[0347] The device notifies the user of successful payment and, based on the user's emotional state as determined by the emotion engine, provides the user with additional feedback and information.

[0348] Step 8:

[0349] The terminal generates an electronic receipt indicating the completion of the transaction and displays it to the user. This allows the user to visually confirm that the transaction has been successfully completed.

[0350] (Example 2)

[0351] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0352] Traditional international payment systems have made the payment experience at destinations cumbersome for users, with currency conversion and language barriers hindering a comfortable service experience. Furthermore, the need to present a physical card raises security concerns, and the lack of consideration for user emotions during such transactions significantly reduces satisfaction.

[0353] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0354] In this invention, the server includes means for managing and providing currency conversion data to enable mobile device payments from the information processing device in countries visited by users from other countries; means for the information processing device to receive product prices and calculate the price converted to the user's home currency based on the currency conversion data; means for the user to register and securely store financial institution information on the mobile device; means for the information processing device to communicate with the financial institution and execute the payment when the user makes a payment using the registered financial institution information, after receiving instructions from the mobile device; and means for the mobile device to detect the user's emotions and notify the information processing device based on predetermined conditions. This enables visitors to make payments safely and smoothly, and to obtain higher satisfaction and a sense of security through responses that respond to their emotions.

[0355] "Users from other countries" refers to individuals who reside in a country different from their destination and are visiting that country.

[0356] An "information processing device" is a device that manages, provides, and communicates data, and includes data center equipment such as servers.

[0357] A "mobile device" is a device that is portable and has payment functionality, regardless of location, and includes smartphones and tablets.

[0358] "Currency conversion data" refers to a dataset containing currency exchange rate information between different countries, and it is assumed that this data will be updated in real time.

[0359] "Financial institution information" refers to personal financial information used for payments such as credit cards and bank accounts.

[0360] "Emotion detection" refers to the process of analyzing the user's characteristics, such as facial expressions and voice tone, in real time to recognize their emotional state.

[0361] A "response message" refers to the text of a notification or information that is generated based on the detected emotion and presented to the user.

[0362] This invention is a system designed to allow users visiting from other countries to make payments comfortably at their destination. This system involves a server, terminals, and user devices working together to provide real-time currency conversion and sentiment recognition capabilities.

[0363] The server is responsible for retrieving exchange rate information from global financial data providers via an internet connection and storing it in a database. The server periodically retrieves exchange rate information using APIs and provides the functionality to convert currencies using the latest exchange rates. Through this process, visitors can check product prices in foreign countries in their own currency.

[0364] The terminal has the function of sending product price information entered by the user to a server. The price information, converted to the user's local currency, is received from the server and displayed on the terminal's screen. Furthermore, the terminal is equipped with a camera and microphone, which are used by an emotion engine that recognizes the user's emotions in real time. For example, if a sense of security is detected, the normal procedure proceeds, and if anxiety is detected, additional information is displayed to provide the user with reassurance.

[0365] Users can conduct secure, tokenized transactions by registering their financial institution information with a mobile terminal in advance. This eliminates the need to physically present a card, enabling smooth and secure payments.

[0366] A concrete example would be a user visiting Japan from the United States who wants to purchase an item costing 5,000 yen. In this case, the user enters 5,000 yen into the terminal, and the server returns the amount converted to approximately $45, which is then displayed on the terminal. If the user feels reassured, the payment will be completed as usual. However, if anxiety is detected, additional information can be displayed to reassure the user.

[0367] Example of a prompt

[0368] "Please tell me how to make payments at the client's location smoother."

[0369] "How can we implement payment methods that take into account the visitor's feelings?"

[0370] This system allows visitors to enjoy shopping at their destination with peace of mind.

[0371] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0372] Step 1:

[0373] The server retrieves the latest exchange rate information from external financial data providers via the internet. This information is stored in a database on the server. The input is the currency rate obtained from the financial data provider, and the output is the latest exchange rate information stored in the database. The server periodically performs this process via an API, automatically updating the rates.

[0374] Step 2:

[0375] The terminal receives the price of the item the user is purchasing. This price information is sent from the terminal to the server, where it is converted to the user's local currency using the latest exchange rate. The input is the item price entered on the terminal, and the output is the converted price in the user's local currency. The server performs currency conversion in real time and returns the result to the terminal.

[0376] Step 3:

[0377] Users register their financial institution information on a mobile terminal and authenticate using tokenized information when making payments. The input is the pre-registered financial institution information, and the output is the token information necessary to execute the payment. Users can initiate payment using the terminal and complete transactions using secure tokens.

[0378] Step 4:

[0379] After receiving a payment instruction, the terminal communicates with a server to contact the financial institution. The server connects with the financial institution and executes the payment. The input is the payment instruction from the user, and the output is the result of the completed transaction. Once the server approves the transaction, it notifies the terminal of the payment result.

[0380] Step 5:

[0381] The device's built-in emotion engine analyzes the user's facial expressions and voice to detect emotions. The input is the user's facial expressions and voice, and the output is the detected emotion data. Specifically, it analyzes feelings of security and anxiety, and provides the user with a response based on the results.

[0382] Step 6:

[0383] The server generates an appropriate response message based on emotion data from the terminal and sends it to the terminal. The input is the detected emotion data, and the output is the response message presented to the user. For example, the server generates a message that promotes reassurance and displays it on the terminal.

[0384] This series of steps ensures that visitors can conduct transactions safely and smoothly and receive service that takes their feelings into consideration.

[0385] (Application Example 2)

[0386] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0387] When visitors from other countries purchase goods in their destination country, they often experience anxiety due to prices displayed in different currencies and the complexities of the payment process. In particular, they frequently face difficulties with calculations due to unfamiliarity with the local currency and concerns about the security of card payments. There is a need to provide systems that alleviate these anxieties and inconveniences for users and create a comfortable payment experience.

[0388] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0389] This invention includes a server with means for managing and providing currency conversion information to enable portable information processing device payments from an information processing device to a country visited by a user from another country; means for the information processing device to receive the price of goods and calculate the price converted to the user's home country currency based on the currency conversion information; and means for integrating a psychological state recognition device into the portable information processing device to determine the user's emotions and optimize the method of visualizing information according to the emotional state. As a result, even when shopping in a foreign country, users can understand the price in their own currency and reduce anxiety at the time of payment. Furthermore, it enables feedback according to the psychological state, promoting a comfortable and secure payment experience.

[0390] "Other countries" refers to countries or regions other than the visitor's usual place of residence.

[0391] A "portable information processing device" refers to an electronic device that can be carried by the user and allows for information processing anywhere.

[0392] An "information processing device" refers to an electronic device used for data management, calculation, storage, and communication.

[0393] "Currency conversion information" refers to information that includes exchange rate data between different currencies and is used to compare the value of currencies at a specific point in time.

[0394] A "psychological state recognition device" refers to a device that determines a user's emotions and psychological state from their facial expressions and voice.

[0395] "Emotional state" refers to the psychological reactions and emotions exhibited by a user, and is characterized by the elements that define them.

[0396] "Optimizing the method of visualizing information" refers to adjusting the content and format of the information displayed according to the user's psychological state, and presenting it in the most appropriate way.

[0397] "Payment procedures" refer to a series of operations and communications performed to pay for goods or services.

[0398] The system of this invention is designed to allow visitors from other countries to make payments conveniently at their destination. This system consists of multiple components, each performing its own unique function.

[0399] First, the server is responsible for acquiring the latest currency conversion information and storing it in its database. The server periodically updates exchange rates via the internet, enabling real-time currency conversion, allowing users to accurately understand the currency exchange rates between the country they are visiting and their own country. The server also receives product prices transmitted from portable information processing devices, performs currency conversion based on that information, and calculates and returns the price in the user's own currency in an easy-to-understand format.

[0400] The portable information processing device is equipped with a psychological state recognition system to support the user's payment experience. This system uses cameras and microphones to analyze the user's facial expressions and voice, determining their emotions in real time. If the psychological state recognition system detects anxiety in the user, it provides feedback to adjust the way information is visualized, thereby providing the user with a sense of security. This feature allows users to proceed with payments in a relaxed state.

[0401] As a concrete example, consider a scenario where a user purchases goods at a store while traveling. For instance, if a user visiting Japan from the United States attempts to purchase a 5,000 yen item, the portable information processing device receives and displays the price converted to approximately $45 from the server. Simultaneously, a psychological state recognition device reads the user's facial expression, and if it confirms a sense of security, it allows the user to proceed with the normal payment process. On the other hand, if the user expresses anxiety, it visualizes additional information to enhance the user's sense of security. In this way, the system improves the user experience.

[0402] An example of a prompt to input into a generative AI model is: "Design an electronic payment app that allows visitors to shop comfortably in a foreign country. It should have features that recognize user emotions in real time and optimize the payment experience."

[0403] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0404] Step 1:

[0405] The user enters the product price into the portable information processing device. The entered price data is then prepared for transmission to the server. The portable information processing device processes the price data into a packet format and sends it to the server.

[0406] Step 2:

[0407] The server performs a calculation to convert the product price data received from the portable information processing device into the user's local currency using the latest currency conversion information stored in its own database. The latest exchange rate data is used for this calculation. The converted price information is then transmitted from the server to the portable information processing device.

[0408] Step 3:

[0409] The user's portable information processing device displays the converted price in their local currency, received from the server. During this process, a psychological state recognition device operates on the portable information processing device, capturing the user's facial expressions and voice via camera and microphone, and performing emotion analysis. The acquired data is used to determine the user's emotional state in real time.

[0410] Step 4:

[0411] If the psychological state recognition device identifies the user's emotional state as anxiety, the portable information processing device performs data processing to adjust the display interface and show additional information to promote a sense of security. Specifically, it reduces the user's anxiety by displaying details of payment procedures and warranty information.

[0412] Step 5:

[0413] After receiving feedback tailored to their psychological state, the user authorizes the payment using tokenized data on a portable information processing device. The portable information processing device sends this payment authorization data to a server, which connects with a financial institution to execute the actual payment. The payment result is then notified from the server to the portable information processing device.

[0414] Step 6:

[0415] The portable information processing device generates an electronic record based on the received payment result and presents it to the user. The generated electronic record confirms the completion of the transaction and is stored in a format that the user can refer to.

[0416] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0417] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0418] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0419] [Third Embodiment]

[0420] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0421] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0422] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0423] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0424] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0425] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0426] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0427] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0428] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0429] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0430] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0431] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0432] This invention is a system that allows foreigners to check prices in their own currency and make payments smoothly through financial institutions when visiting a country. The system mainly consists of communication terminals and mobile terminals, improving the convenience for visitors when purchasing goods. The specific operation of the system is described below.

[0433] The server periodically retrieves currency conversion data from external currency providers via the internet and stores it in a database. This ensures that when users make payments in a foreign country they are visiting, they can always convert their currency to their local currency based on the latest exchange rate.

[0434] The terminal receives the product price based on the user's input and sends that price to the server. The server uses internally stored currency conversion data to convert the price to the user's local currency and returns the result to the terminal. This allows the user to intuitively understand the product price in their own currency.

[0435] Users access the system using a mobile device and securely register their financial institution information. This information is tokenized by the server and stored in a secure format, allowing users to make payments without having to take out a physical card when needed.

[0436] Upon receiving a payment request from the terminal, the server references the user's financial institution information and requests payment authorization from the financial institution. Once authorization is obtained, the server notifies the terminal of the payment result, which the user can then verify.

[0437] For example, if a user visiting Japan from the United States wants to purchase an item costing 5,000 yen, they enter 5,000 yen into their mobile terminal. The terminal sends this information to a server, which then displays the price converted to US dollars (for example, approximately $45). When the user makes a payment using a credit card they registered in advance within the app, the server requests authorization from the financial institution. Upon successful payment, an electronic receipt is generated and sent to the terminal. This allows users to enjoy shopping quickly and efficiently.

[0438] The following describes the processing flow.

[0439] Step 1:

[0440] The server periodically retrieves the latest exchange rate data from external exchange rate providers and stores it in its database. This ensures that visitors always have access to the most up-to-date rates when making payments.

[0441] Step 2:

[0442] The terminal provides an interface for users to input the price of goods or services in Japanese yen. Once the user enters the price, the terminal sends that information to the server.

[0443] Step 3:

[0444] The server begins calculations to perform currency conversion based on the received price in Japanese yen. Using the latest exchange rate stored in the database, it converts the price in Japanese yen to the user's local currency (e.g., US dollars).

[0445] Step 4:

[0446] The server sends the converted price to the terminal, which then displays it to the user. The user can then verify the amount in their own currency.

[0447] Step 5:

[0448] Users register their credit card information in advance on their mobile device. This information is securely tokenized and stored in the server's database, eliminating the need to physically present the card at the time of payment.

[0449] Step 6:

[0450] Once the user confirms the purchase, the device sends a payment request to the server. The request includes the amount in the converted local currency and tokenized credit card information.

[0451] Step 7:

[0452] Based on the received payment request, the server requests approval from the financial institution for payment processing. Upon receiving a response from the financial institution, the server sends the result (approval or rejection) to the terminal.

[0453] Step 8:

[0454] The terminal notifies the user of the payment result. Once the payment is approved, the terminal generates an electronic receipt and displays it to the user to confirm the completion of the transaction.

[0455] (Example 1)

[0456] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0457] It is difficult for users visiting other countries to intuitively understand the value of local currency in their own currency and to make safe and quick payments. Furthermore, there is a lack of methods to ensure the security of financial institution information, which leads to concerns about conducting transactions abroad.

[0458] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0459] This invention includes a server that manages and provides currency conversion data to enable mobile terminal payments from an information processing device in the country the user is visiting, a means for the information processing device to receive the buying and selling price and calculate the price converted to the user's home currency based on the currency conversion data, and a means for securely storing financial institution information using tokenization technology. This makes it possible for users to purchase goods in foreign countries without worrying about exchange rates and to make secure payments.

[0460] "Currency conversion data" refers to information on exchange rates used to convert the monetary values ​​between different countries.

[0461] An "information processing device" refers to an electronic device that has functions such as acquiring, processing, storing, and transmitting data.

[0462] A "mobile device" refers to a device that a user can carry with them and use for communication and information processing.

[0463] "Financial institution information" refers to data related to financial services used in transactions, such as credit card information and bank account information.

[0464] "Tokenization technology" refers to a data encryption technique that replaces the original data with a random string of characters in order to protect it.

[0465] "Payment result" refers to a notification or information indicating whether the payment was successful.

[0466] An "electronic certificate" refers to a purchase history certificate provided in digital format.

[0467] The embodiment for carrying out this invention mainly consists of an information processing device (server), a mobile terminal (user's smartphone or tablet), and network technology for communication between them.

[0468] Operation of information processing equipment (server)

[0469] The server periodically retrieves the latest currency conversion data from an external currency provider. This data is accessible via an API and stored in a database on the server. The server receives product prices from mobile devices, uses the stored, up-to-date currency conversion data to calculate the price in its local currency, and sends the result to the mobile device. It also securely manages financial institution information using tokenization technology and securely communicates with financial institutions when receiving payment requests.

[0470] Operation of mobile devices (such as the user's smartphone)

[0471] Users access the system using their mobile devices and enter product prices using an application. They can also register their financial institution information within the application; this information is tokenized by the server and stored securely. After confirming the converted price, users make payments using their registered financial institution information. Upon completion of payment, the device generates an electronic receipt based on the settlement result and displays it to the user, allowing them to confirm the result with confidence.

[0472] Specific example

[0473] Consider a scenario where a user visiting Japan from the United States purchases Japanese sweets. When purchasing an item costing 5,000 yen, the user enters the price into their mobile device, and the application sends the data to a server. The server then converts 5,000 yen to US dollars based on the latest exchange rate (for example, approximately 45 dollars) and returns the result to the device. The user completes the payment using a credit card registered in advance within the app, and an electronic receipt is sent to the device. Through this process, the user can enjoy shopping with peace of mind thanks to real-time price conversion and secure payment.

[0474] Example of a prompt

[0475] "Using a scenario where an American tourist visiting Japan purchases a 5,000 yen item at a store in Japan, please explain how the system performs real-time currency conversion and payment."

[0476] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0477] Step 1:

[0478] The server retrieves currency conversion data. The server accesses external currency providers via the internet and obtains the latest exchange rate data through APIs. The retrieved data is stored in a database on the server, which serves as the basis for subsequent currency conversions. The input is API access from the currency provider, and the output is the retrieved exchange rate information.

[0479] Step 2:

[0480] The user enters the product price using a mobile device. This price information is entered as the starting data for the user's desired transaction. The user enters the price via the application interface, and this data is sent from the device to the server. The input from the device is product price data, and the data received by the server is the output.

[0481] Step 3:

[0482] The server performs a conversion process based on the received product price. Using the latest stored exchange rate, the server performs a data calculation to convert the product price into the user's local currency. The input is the product price sent by the user, and the output is the converted price in the user's local currency. The server sends this conversion result back to the terminal.

[0483] Step 4:

[0484] The terminal displays the conversion result sent from the server. Upon receiving this result, the terminal displays the price in the user's local currency on the screen for the user to verify. The input is the conversion result data from the server, and the output is the display on the terminal.

[0485] Step 5:

[0486] The user proceeds to the payment process. The user confirms the price in their local currency displayed in the application and makes the payment using their registered financial institution information. This operation involves sending a payment request to the server via the terminal. The input is the user's selection and confirmation, and the output is the submission of the payment request.

[0487] Step 6:

[0488] The server processes the payment. Based on the received payment request, it uses tokenized financial institution information to request approval from the specified financial institution. The input is the user's payment request and securely stored financial institution information, and the output is the result of payment approval or rejection.

[0489] Step 7:

[0490] The server notifies the terminal of the payment result. If the payment is successful or unsuccessful, it sends the result to the terminal and generates an electronic certificate, which is then sent to the terminal if successful. The input is the payment result from the financial institution, and the output is the notification to the terminal and the transmission of the electronic certificate.

[0491] Step 8:

[0492] The terminal displays the received payment result to the user. If successful, it provides the user with an electronic receipt to confirm the completion of the transaction. Input is a notification from the server, and output is a display on the terminal screen.

[0493] (Application Example 1)

[0494] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0495] When international travelers visit a country, the process of converting between local and their own currencies is cumbersome, making it difficult to intuitively grasp prices when purchasing goods. Furthermore, the need for physical card payments raises security concerns. To address these issues, there is a need for a system that allows travelers to quickly check product prices in their own currency and complete payments safely and smoothly.

[0496] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0497] This invention includes a server with means for managing and providing currency conversion data to enable mobile information processing device payments from information processing devices in areas visited by travelers from other countries; means for the information processing device to receive the value of goods and calculate the value converted to the traveler's home currency based on the currency conversion data; and means for the mobile information processing device to display the value of goods converted to its home currency to the traveler, receive a purchase command, and quickly complete the payment. This enables travelers to understand the price in their home currency when purchasing goods locally and to make payments safely and smoothly.

[0498] "Travelers from other countries" refers to people who are visiting from a country different from the region they are going to.

[0499] "Information processing equipment" refers to terminals and servers used to receive and process data.

[0500] "Mobile information processing equipment" refers to portable devices that users can use while on the move.

[0501] "Currency conversion data" refers to data that shows the conversion ratio between different currencies.

[0502] "Commercial value" refers to the price or value of a product being purchased.

[0503] A "financial organization" refers to a group that provides financial services, such as credit card companies and banks.

[0504] "Payment" refers to the act of paying for goods or services.

[0505] "Local currency" refers to the currency used in the country where the traveler resides.

[0506] An "electronic receipt" is a certificate of transaction issued electronically after payment is completed.

[0507] The system implementing this invention mainly consists of an information processing device, a mobile information processing device, and a server. The information processing device receives the commodity value and, in cooperation with the server, calculates the value converted to the traveler's home currency based on currency conversion data. The server plays a crucial role in this conversion process, and the currency conversion data is periodically obtained from a currency exchange provider API such as Fixer.io.

[0508] Mobile information processing devices are portable terminals, such as smartphones, that travelers use to verify the value of goods and make payments. Payments are made securely and quickly based on information from registered financial institutions. When a traveler issues a purchase order, the server handles communication with the financial institution and notifies the mobile information processing device of the completion of the payment.

[0509] As a concrete example, when a traveler from the United States purchases goods in Japan, they input the value of the goods into a mobile information processing device. The device and server then work together to display the price converted to US dollars. The traveler can then complete the payment simply by tapping the purchase button using their already registered credit card information. This allows travelers to shop smoothly without being bothered by local currency.

[0510] An example of a prompt message generated using an AI model is: "Please propose an app design that displays the amount entered by the user in their local currency and allows for secure payment completion. Input: Product price (local currency), Output: Price displayed in local currency, payment completion message, and electronic receipt."

[0511] In this way, travelers can experience intuitive pricing based on the local currency and secure, safe payment in the countries they visit.

[0512] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0513] Step 1:

[0514] The user inputs the value of a product into a mobile information processing device. The input value is in local currency. This input data is transmitted to the information processing device.

[0515] Step 2:

[0516] The information processing device transmits the product value to the server. The server uses currency conversion data obtained from the currency provider API to convert from the local currency to the user's home currency. Data calculations are performed here to calculate the price in the home currency. This calculation result is then sent back to the information processing device.

[0517] Step 3:

[0518] The information processing device displays the price in the user's local currency, received from the server. The user confirms this displayed price and presses the purchase button. This generates a purchase command, and the process proceeds to the next payment stage.

[0519] Step 4:

[0520] Upon receiving a purchase order, the server uses the registered financial institution's information to communicate the settlement request to the financial institution. Here, the server uses tokenized data to ensure secure communication.

[0521] Step 5:

[0522] Upon receiving payment approval from a financial institution, the server notifies the mobile information processing device of the payment result. As output of the processing, a message indicating payment success or failure is generated.

[0523] Step 6:

[0524] The mobile information processing device receives the payment result from the server and notifies the user. If the payment is successful, the mobile information processing device generates an electronic receipt and displays it to the user. This electronic receipt includes information such as the purchased items, price, and payment date and time.

[0525] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0526] This invention is a system that integrates an emotion engine that recognizes user emotions, in addition to conventional currency conversion and payment methods, to make the payment experience smoother for users visiting from other countries. This system improves user convenience and satisfaction through the cooperation of communication terminals and mobile terminals.

[0527] The server retrieves the latest exchange rates via the internet and stores them in a database. This exchange rate data is used for real-time currency conversion when making payments in the visited country.

[0528] The terminal sends the product price entered by the user to the server, and based on that information, it retrieves the amount converted to the user's local currency using the latest exchange rate. This allows the user to check the product price in their own currency.

[0529] Users can pre-register their financial institution information on a mobile terminal and make payments using tokenized data. This process allows visitors to complete transactions without physically presenting their cards.

[0530] The device is equipped with an emotion engine that recognizes the user's emotions in real time from their facial expressions and voice. For example, if the device detects signs of user dissatisfaction, the server can adjust the notification method and return a more reassuring message.

[0531] As a concrete example, let's say a user visiting Japan from the United States purchases an item costing 5,000 yen. When 5,000 yen is entered into the mobile terminal, the terminal sends this information to the server and displays it as approximately $45. At the same time, the emotion engine analyzes the user's facial expressions, and if it detects signs of reassurance, the payment process proceeds as usual, followed by approval. On the other hand, if the user shows signs of anxiety, the terminal enhances the verification process and displays additional information to reassure the user. Through this entire process, visitors can make payments with peace of mind and convenience, and enjoy their shopping experience at their destination.

[0532] The following describes the processing flow.

[0533] Step 1:

[0534] The server periodically retrieves the latest exchange rate data from an external exchange rate provider and stores it in its database. This allows visitors to make payments based on the most up-to-date rates.

[0535] Step 2:

[0536] The terminal provides a user interface for users to input the price of goods or services in Japanese yen. Once the user enters the price, that information is sent to the server.

[0537] Step 3:

[0538] The server converts the received price in Japanese yen to the user's local currency using the latest stored exchange rate. The conversion result is sent to the terminal and displayed to the user.

[0539] Step 4:

[0540] Users choose to make payments based on financial institution information pre-registered on their mobile devices. This information is tokenized, thus ensuring security.

[0541] Step 5:

[0542] The device's built-in emotion engine activates, analyzing the user's facial expressions and vocalizations in real time to recognize their emotional state. Based on this analysis, the device adjusts the displayed content and notification methods.

[0543] Step 6:

[0544] The terminal sends a payment request to the server and issues a command to authorize the payment through the registered financial institution. The server receives authorization from the financial institution, and if the payment is successful, it sends the result to the terminal.

[0545] Step 7:

[0546] The device notifies the user of successful payment and, based on the user's emotional state as determined by the emotion engine, provides the user with additional feedback and information.

[0547] Step 8:

[0548] The terminal generates an electronic receipt indicating the completion of the transaction and displays it to the user. This allows the user to visually confirm that the transaction has been successfully completed.

[0549] (Example 2)

[0550] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0551] Traditional international payment systems have made the payment experience at destinations cumbersome for users, with currency conversion and language barriers hindering a comfortable service experience. Furthermore, the need to present a physical card raises security concerns, and the lack of consideration for user emotions during such transactions significantly reduces satisfaction.

[0552] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0553] In this invention, the server includes means for managing and providing currency conversion data to enable mobile device payments from the information processing device in countries visited by users from other countries; means for the information processing device to receive product prices and calculate the price converted to the user's home currency based on the currency conversion data; means for the user to register and securely store financial institution information on the mobile device; means for the information processing device to communicate with the financial institution and execute the payment when the user makes a payment using the registered financial institution information, after receiving instructions from the mobile device; and means for the mobile device to detect the user's emotions and notify the information processing device based on predetermined conditions. This enables visitors to make payments safely and smoothly, and to obtain higher satisfaction and a sense of security through responses that respond to their emotions.

[0554] "Users from other countries" refers to individuals who reside in a country different from their destination and are visiting that country.

[0555] An "information processing device" is a device that manages, provides, and communicates data, and includes data center equipment such as servers.

[0556] A "mobile device" is a device that is portable and has payment functionality, regardless of location, and includes smartphones and tablets.

[0557] "Currency conversion data" refers to a dataset containing currency exchange rate information between different countries, and it is assumed that this data will be updated in real time.

[0558] "Financial institution information" refers to personal financial information used for payments such as credit cards and bank accounts.

[0559] "Emotion detection" refers to the process of analyzing the user's characteristics, such as facial expressions and voice tone, in real time to recognize their emotional state.

[0560] A "response message" refers to the text of a notification or information that is generated based on the detected emotion and presented to the user.

[0561] This invention is a system designed to allow users visiting from other countries to make payments comfortably at their destination. This system involves a server, terminals, and user devices working together to provide real-time currency conversion and sentiment recognition capabilities.

[0562] The server is responsible for retrieving exchange rate information from global financial data providers via an internet connection and storing it in a database. The server periodically retrieves exchange rate information using APIs and provides the functionality to convert currencies using the latest exchange rates. Through this process, visitors can check product prices in foreign countries in their own currency.

[0563] The terminal has the function of sending product price information entered by the user to a server. The price information, converted to the user's local currency, is received from the server and displayed on the terminal's screen. Furthermore, the terminal is equipped with a camera and microphone, which are used by an emotion engine that recognizes the user's emotions in real time. For example, if a sense of security is detected, the normal procedure proceeds, and if anxiety is detected, additional information is displayed to provide the user with reassurance.

[0564] Users can conduct secure, tokenized transactions by registering their financial institution information with a mobile terminal in advance. This eliminates the need to physically present a card, enabling smooth and secure payments.

[0565] A concrete example would be a user visiting Japan from the United States who wants to purchase an item costing 5,000 yen. In this case, the user enters 5,000 yen into the terminal, and the server returns the amount converted to approximately $45, which is then displayed on the terminal. If the user feels reassured, the payment will be completed as usual. However, if anxiety is detected, additional information can be displayed to reassure the user.

[0566] Example of a prompt

[0567] "Please tell me how to make payments at the client's location smoother."

[0568] "How can we implement payment methods that take into account the visitor's feelings?"

[0569] This system allows visitors to enjoy shopping at their destination with peace of mind.

[0570] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0571] Step 1:

[0572] The server retrieves the latest exchange rate information from external financial data providers via the internet. This information is stored in a database on the server. The input is the currency rate obtained from the financial data provider, and the output is the latest exchange rate information stored in the database. The server periodically performs this process via an API, automatically updating the rates.

[0573] Step 2:

[0574] The terminal receives the price of the item the user is purchasing. This price information is sent from the terminal to the server, where it is converted to the user's local currency using the latest exchange rate. The input is the item price entered on the terminal, and the output is the converted price in the user's local currency. The server performs currency conversion in real time and returns the result to the terminal.

[0575] Step 3:

[0576] Users register their financial institution information on a mobile terminal and authenticate using tokenized information when making payments. The input is the pre-registered financial institution information, and the output is the token information necessary to execute the payment. Users can initiate payment using the terminal and complete transactions using secure tokens.

[0577] Step 4:

[0578] After receiving a payment instruction, the terminal communicates with a server to contact the financial institution. The server connects with the financial institution and executes the payment. The input is the payment instruction from the user, and the output is the result of the completed transaction. Once the server approves the transaction, it notifies the terminal of the payment result.

[0579] Step 5:

[0580] The device's built-in emotion engine analyzes the user's facial expressions and voice to detect emotions. The input is the user's facial expressions and voice, and the output is the detected emotion data. Specifically, it analyzes feelings of security and anxiety, and provides the user with a response based on the results.

[0581] Step 6:

[0582] The server generates an appropriate response message based on emotion data from the terminal and sends it to the terminal. The input is the detected emotion data, and the output is the response message presented to the user. For example, the server generates a message that promotes reassurance and displays it on the terminal.

[0583] This series of steps ensures that visitors can conduct transactions safely and smoothly and receive service that takes their feelings into consideration.

[0584] (Application Example 2)

[0585] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0586] When visitors from other countries purchase goods in their destination country, they often experience anxiety due to prices displayed in different currencies and the complexities of the payment process. In particular, they frequently face difficulties with calculations due to unfamiliarity with the local currency and concerns about the security of card payments. There is a need to provide systems that alleviate these anxieties and inconveniences for users and create a comfortable payment experience.

[0587] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0588] This invention includes a server with means for managing and providing currency conversion information to enable portable information processing device payments from an information processing device to a country visited by a user from another country; means for the information processing device to receive the price of goods and calculate the price converted to the user's home country currency based on the currency conversion information; and means for integrating a psychological state recognition device into the portable information processing device to determine the user's emotions and optimize the method of visualizing information according to the emotional state. As a result, even when shopping in a foreign country, users can understand the price in their own currency and reduce anxiety at the time of payment. Furthermore, it enables feedback according to the psychological state, promoting a comfortable and secure payment experience.

[0589] "Other countries" refers to countries or regions other than the visitor's usual place of residence.

[0590] A "portable information processing device" refers to an electronic device that can be carried by the user and allows for information processing anywhere.

[0591] An "information processing device" refers to an electronic device used for data management, calculation, storage, and communication.

[0592] "Currency conversion information" refers to information that includes exchange rate data between different currencies and is used to compare the value of currencies at a specific point in time.

[0593] A "psychological state recognition device" refers to a device that determines a user's emotions and psychological state from their facial expressions and voice.

[0594] "Emotional state" refers to the psychological reactions and emotions exhibited by a user, and is characterized by the elements that define them.

[0595] "Optimizing the method of visualizing information" refers to adjusting the content and format of the information displayed according to the user's psychological state, and presenting it in the most appropriate way.

[0596] "Payment procedures" refer to a series of operations and communications performed to pay for goods or services.

[0597] The system of this invention is designed to allow visitors from other countries to make payments conveniently at their destination. This system consists of multiple components, each performing its own unique function.

[0598] First, the server is responsible for acquiring the latest currency conversion information and storing it in its database. The server periodically updates exchange rates via the internet, enabling real-time currency conversion, allowing users to accurately understand the currency exchange rates between the country they are visiting and their own country. The server also receives product prices transmitted from portable information processing devices, performs currency conversion based on that information, and calculates and returns the price in the user's own currency in an easy-to-understand format.

[0599] The portable information processing device is equipped with a psychological state recognition system to support the user's payment experience. This system uses cameras and microphones to analyze the user's facial expressions and voice, determining their emotions in real time. If the psychological state recognition system detects anxiety in the user, it provides feedback to adjust the way information is visualized, thereby providing the user with a sense of security. This feature allows users to proceed with payments in a relaxed state.

[0600] As a concrete example, consider a scenario where a user purchases goods at a store while traveling. For instance, if a user visiting Japan from the United States attempts to purchase a 5,000 yen item, the portable information processing device receives and displays the price converted to approximately $45 from the server. Simultaneously, a psychological state recognition device reads the user's facial expression, and if it confirms a sense of security, it allows the user to proceed with the normal payment process. On the other hand, if the user expresses anxiety, it visualizes additional information to enhance the user's sense of security. In this way, the system improves the user experience.

[0601] An example of a prompt to input into a generative AI model is: "Design an electronic payment app that allows visitors to shop comfortably in a foreign country. It should have features that recognize user emotions in real time and optimize the payment experience."

[0602] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0603] Step 1:

[0604] The user enters the product price into the portable information processing device. The entered price data is then prepared for transmission to the server. The portable information processing device processes the price data into a packet format and sends it to the server.

[0605] Step 2:

[0606] The server performs a calculation to convert the product price data received from the portable information processing device into the user's local currency using the latest currency conversion information stored in its own database. The latest exchange rate data is used for this calculation. The converted price information is then transmitted from the server to the portable information processing device.

[0607] Step 3:

[0608] The user's portable information processing device displays the converted price in their local currency, received from the server. During this process, a psychological state recognition device operates on the portable information processing device, capturing the user's facial expressions and voice via camera and microphone, and performing emotion analysis. The acquired data is used to determine the user's emotional state in real time.

[0609] Step 4:

[0610] If the psychological state recognition device identifies the user's emotional state as anxiety, the portable information processing device performs data processing to adjust the display interface and show additional information to promote a sense of security. Specifically, it reduces the user's anxiety by displaying details of payment procedures and warranty information.

[0611] Step 5:

[0612] After receiving feedback tailored to their psychological state, the user authorizes the payment using tokenized data on a portable information processing device. The portable information processing device sends this payment authorization data to a server, which connects with a financial institution to execute the actual payment. The payment result is then notified from the server to the portable information processing device.

[0613] Step 6:

[0614] The portable information processing device generates an electronic record based on the received payment result and presents it to the user. The generated electronic record confirms the completion of the transaction and is stored in a format that the user can refer to.

[0615] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0616] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0617] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0618] [Fourth Embodiment]

[0619] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0620] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0621] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0622] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0623] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0624] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0625] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0626] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0627] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0628] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0629] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0630] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0631] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0632] This invention is a system that allows foreigners to check prices in their own currency and make payments smoothly through financial institutions when visiting a country. The system mainly consists of communication terminals and mobile terminals, improving the convenience for visitors when purchasing goods. The specific operation of the system is described below.

[0633] The server periodically retrieves currency conversion data from external currency providers via the internet and stores it in a database. This ensures that when users make payments in a foreign country they are visiting, they can always convert their currency to their local currency based on the latest exchange rate.

[0634] The terminal receives the product price based on the user's input and sends that price to the server. The server uses internally stored currency conversion data to convert the price to the user's local currency and returns the result to the terminal. This allows the user to intuitively understand the product price in their own currency.

[0635] Users access the system using a mobile device and securely register their financial institution information. This information is tokenized by the server and stored in a secure format, allowing users to make payments without having to take out a physical card when needed.

[0636] Upon receiving a payment request from the terminal, the server references the user's financial institution information and requests payment authorization from the financial institution. Once authorization is obtained, the server notifies the terminal of the payment result, which the user can then verify.

[0637] For example, if a user visiting Japan from the United States wants to purchase an item costing 5,000 yen, they enter 5,000 yen into their mobile terminal. The terminal sends this information to a server, which then displays the price converted to US dollars (for example, approximately $45). When the user makes a payment using a credit card they registered in advance within the app, the server requests authorization from the financial institution. Upon successful payment, an electronic receipt is generated and sent to the terminal. This allows users to enjoy shopping quickly and efficiently.

[0638] The following describes the processing flow.

[0639] Step 1:

[0640] The server periodically retrieves the latest exchange rate data from external exchange rate providers and stores it in its database. This ensures that visitors always have access to the most up-to-date rates when making payments.

[0641] Step 2:

[0642] The terminal provides an interface for users to input the price of goods or services in Japanese yen. Once the user enters the price, the terminal sends that information to the server.

[0643] Step 3:

[0644] The server begins calculations to perform currency conversion based on the received price in Japanese yen. Using the latest exchange rate stored in the database, it converts the price in Japanese yen to the user's local currency (e.g., US dollars).

[0645] Step 4:

[0646] The server sends the converted price to the terminal, which then displays it to the user. The user can then verify the amount in their own currency.

[0647] Step 5:

[0648] Users register their credit card information in advance on their mobile device. This information is securely tokenized and stored in the server's database, eliminating the need to physically present the card at the time of payment.

[0649] Step 6:

[0650] Once the user confirms the purchase, the device sends a payment request to the server. The request includes the amount in the converted local currency and tokenized credit card information.

[0651] Step 7:

[0652] Based on the received payment request, the server requests approval from the financial institution for payment processing. Upon receiving a response from the financial institution, the server sends the result (approval or rejection) to the terminal.

[0653] Step 8:

[0654] The terminal notifies the user of the payment result. Once the payment is approved, the terminal generates an electronic receipt and displays it to the user to confirm the completion of the transaction.

[0655] (Example 1)

[0656] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0657] It is difficult for users visiting other countries to intuitively understand the value of local currency in their own currency and to make safe and quick payments. Furthermore, there is a lack of methods to ensure the security of financial institution information, which leads to concerns about conducting transactions abroad.

[0658] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0659] This invention includes a server that manages and provides currency conversion data to enable mobile terminal payments from an information processing device in the country the user is visiting, a means for the information processing device to receive the buying and selling price and calculate the price converted to the user's home currency based on the currency conversion data, and a means for securely storing financial institution information using tokenization technology. This makes it possible for users to purchase goods in foreign countries without worrying about exchange rates and to make secure payments.

[0660] "Currency conversion data" refers to information on exchange rates used to convert the monetary values ​​between different countries.

[0661] An "information processing device" refers to an electronic device that has functions such as acquiring, processing, storing, and transmitting data.

[0662] A "mobile device" refers to a device that a user can carry with them and use for communication and information processing.

[0663] "Financial institution information" refers to data related to financial services used in transactions, such as credit card information and bank account information.

[0664] "Tokenization technology" refers to a data encryption technique that replaces the original data with a random string of characters in order to protect it.

[0665] "Payment result" refers to a notification or information indicating whether the payment was successful.

[0666] An "electronic certificate" refers to a purchase history certificate provided in digital format.

[0667] The embodiment for carrying out this invention mainly consists of an information processing device (server), a mobile terminal (user's smartphone or tablet), and network technology for communication between them.

[0668] Operation of information processing equipment (server)

[0669] The server periodically retrieves the latest currency conversion data from an external currency provider. This data is accessible via an API and stored in a database on the server. The server receives product prices from mobile devices, uses the stored, up-to-date currency conversion data to calculate the price in its local currency, and sends the result to the mobile device. It also securely manages financial institution information using tokenization technology and securely communicates with financial institutions when receiving payment requests.

[0670] Operation of mobile devices (such as the user's smartphone)

[0671] Users access the system using their mobile devices and enter product prices using an application. They can also register their financial institution information within the application; this information is tokenized by the server and stored securely. After confirming the converted price, users make payments using their registered financial institution information. Upon completion of payment, the device generates an electronic receipt based on the settlement result and displays it to the user, allowing them to confirm the result with confidence.

[0672] Specific example

[0673] Consider a scenario where a user visiting Japan from the United States purchases Japanese sweets. When purchasing an item costing 5,000 yen, the user enters the price into their mobile device, and the application sends the data to a server. The server then converts 5,000 yen to US dollars based on the latest exchange rate (for example, approximately 45 dollars) and returns the result to the device. The user completes the payment using a credit card registered in advance within the app, and an electronic receipt is sent to the device. Through this process, the user can enjoy shopping with peace of mind thanks to real-time price conversion and secure payment.

[0674] Example of a prompt

[0675] "Using a scenario where an American tourist visiting Japan purchases a 5,000 yen item at a store in Japan, please explain how the system performs real-time currency conversion and payment."

[0676] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0677] Step 1:

[0678] The server retrieves currency conversion data. The server accesses external currency providers via the internet and obtains the latest exchange rate data through APIs. The retrieved data is stored in a database on the server, which serves as the basis for subsequent currency conversions. The input is API access from the currency provider, and the output is the retrieved exchange rate information.

[0679] Step 2:

[0680] The user enters the product price using a mobile device. This price information is entered as the starting data for the user's desired transaction. The user enters the price via the application interface, and this data is sent from the device to the server. The input from the device is product price data, and the data received by the server is the output.

[0681] Step 3:

[0682] The server performs a conversion process based on the received product price. Using the latest stored exchange rate, the server performs a data calculation to convert the product price into the user's local currency. The input is the product price sent by the user, and the output is the converted price in the user's local currency. The server sends this conversion result back to the terminal.

[0683] Step 4:

[0684] The terminal displays the conversion result sent from the server. Upon receiving this result, the terminal displays the price in the user's local currency on the screen for the user to verify. The input is the conversion result data from the server, and the output is the display on the terminal.

[0685] Step 5:

[0686] The user proceeds to the payment process. The user confirms the price in their local currency displayed in the application and makes the payment using their registered financial institution information. This operation involves sending a payment request to the server via the terminal. The input is the user's selection and confirmation, and the output is the submission of the payment request.

[0687] Step 6:

[0688] The server processes the payment. Based on the received payment request, it uses tokenized financial institution information to request approval from the specified financial institution. The input is the user's payment request and securely stored financial institution information, and the output is the result of payment approval or rejection.

[0689] Step 7:

[0690] The server notifies the terminal of the payment result. If the payment is successful or unsuccessful, it sends the result to the terminal and generates an electronic certificate, which is then sent to the terminal if successful. The input is the payment result from the financial institution, and the output is the notification to the terminal and the transmission of the electronic certificate.

[0691] Step 8:

[0692] The terminal displays the received payment result to the user. If successful, it provides the user with an electronic receipt to confirm the completion of the transaction. Input is a notification from the server, and output is a display on the terminal screen.

[0693] (Application Example 1)

[0694] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0695] When international travelers visit a country, the process of converting between local and their own currencies is cumbersome, making it difficult to intuitively grasp prices when purchasing goods. Furthermore, the need for physical card payments raises security concerns. To address these issues, there is a need for a system that allows travelers to quickly check product prices in their own currency and complete payments safely and smoothly.

[0696] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0697] This invention includes a server with means for managing and providing currency conversion data to enable mobile information processing device payments from information processing devices in areas visited by travelers from other countries; means for the information processing device to receive the value of goods and calculate the value converted to the traveler's home currency based on the currency conversion data; and means for the mobile information processing device to display the value of goods converted to its home currency to the traveler, receive a purchase command, and quickly complete the payment. This enables travelers to understand the price in their home currency when purchasing goods locally and to make payments safely and smoothly.

[0698] "Travelers from other countries" refers to people who are visiting from a country different from the region they are going to.

[0699] "Information processing equipment" refers to terminals and servers used to receive and process data.

[0700] "Mobile information processing equipment" refers to portable devices that users can use while on the move.

[0701] "Currency conversion data" refers to data that shows the conversion ratio between different currencies.

[0702] "Commercial value" refers to the price or value of a product being purchased.

[0703] A "financial organization" refers to a group that provides financial services, such as credit card companies and banks.

[0704] "Payment" refers to the act of paying for goods or services.

[0705] "Local currency" refers to the currency used in the country where the traveler resides.

[0706] An "electronic receipt" is a certificate of transaction issued electronically after payment is completed.

[0707] The system implementing this invention mainly consists of an information processing device, a mobile information processing device, and a server. The information processing device receives the commodity value and, in cooperation with the server, calculates the value converted to the traveler's home currency based on currency conversion data. The server plays a crucial role in this conversion process, and the currency conversion data is periodically obtained from a currency exchange provider API such as Fixer.io.

[0708] Mobile information processing devices are portable terminals, such as smartphones, that travelers use to verify the value of goods and make payments. Payments are made securely and quickly based on information from registered financial institutions. When a traveler issues a purchase order, the server handles communication with the financial institution and notifies the mobile information processing device of the completion of the payment.

[0709] As a concrete example, when a traveler from the United States purchases goods in Japan, they input the value of the goods into a mobile information processing device. The device and server then work together to display the price converted to US dollars. The traveler can then complete the payment simply by tapping the purchase button using their already registered credit card information. This allows travelers to shop smoothly without being bothered by local currency.

[0710] An example of a prompt message generated using an AI model is: "Please propose an app design that displays the amount entered by the user in their local currency and allows for secure payment completion. Input: Product price (local currency), Output: Price displayed in local currency, payment completion message, and electronic receipt."

[0711] In this way, travelers can experience intuitive pricing based on the local currency and secure, safe payment in the countries they visit.

[0712] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0713] Step 1:

[0714] The user inputs the value of a product into a mobile information processing device. The input value is in local currency. This input data is transmitted to the information processing device.

[0715] Step 2:

[0716] The information processing device transmits the product value to the server. The server uses currency conversion data obtained from the currency provider API to convert from the local currency to the user's home currency. Data calculations are performed here to calculate the price in the home currency. This calculation result is then sent back to the information processing device.

[0717] Step 3:

[0718] The information processing device displays the price in the user's local currency, received from the server. The user confirms this displayed price and presses the purchase button. This generates a purchase command, and the process proceeds to the next payment stage.

[0719] Step 4:

[0720] Upon receiving a purchase order, the server uses the registered financial institution's information to communicate the settlement request to the financial institution. Here, the server uses tokenized data to ensure secure communication.

[0721] Step 5:

[0722] Upon receiving payment approval from a financial institution, the server notifies the mobile information processing device of the payment result. As output of the processing, a message indicating payment success or failure is generated.

[0723] Step 6:

[0724] The mobile information processing device receives the payment result from the server and notifies the user. If the payment is successful, the mobile information processing device generates an electronic receipt and displays it to the user. This electronic receipt includes information such as the purchased items, price, and payment date and time.

[0725] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0726] This invention is a system that integrates an emotion engine that recognizes user emotions, in addition to conventional currency conversion and payment methods, to make the payment experience smoother for users visiting from other countries. This system improves user convenience and satisfaction through the cooperation of communication terminals and mobile terminals.

[0727] The server retrieves the latest exchange rates via the internet and stores them in a database. This exchange rate data is used for real-time currency conversion when making payments in the visited country.

[0728] The terminal sends the product price entered by the user to the server, and based on that information, it retrieves the amount converted to the user's local currency using the latest exchange rate. This allows the user to check the product price in their own currency.

[0729] Users can pre-register their financial institution information on a mobile terminal and make payments using tokenized data. This process allows visitors to complete transactions without physically presenting their cards.

[0730] The device is equipped with an emotion engine that recognizes the user's emotions in real time from their facial expressions and voice. For example, if the device detects signs of user dissatisfaction, the server can adjust the notification method and return a more reassuring message.

[0731] As a concrete example, let's say a user visiting Japan from the United States purchases an item costing 5,000 yen. When 5,000 yen is entered into the mobile terminal, the terminal sends this information to the server and displays it as approximately $45. At the same time, the emotion engine analyzes the user's facial expressions, and if it detects signs of reassurance, the payment process proceeds as usual, followed by approval. On the other hand, if the user shows signs of anxiety, the terminal enhances the verification process and displays additional information to reassure the user. Through this entire process, visitors can make payments with peace of mind and convenience, and enjoy their shopping experience at their destination.

[0732] The following describes the processing flow.

[0733] Step 1:

[0734] The server periodically retrieves the latest exchange rate data from an external exchange rate provider and stores it in its database. This allows visitors to make payments based on the most up-to-date rates.

[0735] Step 2:

[0736] The terminal provides a user interface for users to input the price of goods or services in Japanese yen. Once the user enters the price, that information is sent to the server.

[0737] Step 3:

[0738] The server converts the received price in Japanese yen to the user's local currency using the latest stored exchange rate. The conversion result is sent to the terminal and displayed to the user.

[0739] Step 4:

[0740] Users choose to make payments based on financial institution information pre-registered on their mobile devices. This information is tokenized, thus ensuring security.

[0741] Step 5:

[0742] The device's built-in emotion engine activates, analyzing the user's facial expressions and vocalizations in real time to recognize their emotional state. Based on this analysis, the device adjusts the displayed content and notification methods.

[0743] Step 6:

[0744] The terminal sends a payment request to the server and issues a command to authorize the payment through the registered financial institution. The server receives authorization from the financial institution, and if the payment is successful, it sends the result to the terminal.

[0745] Step 7:

[0746] The device notifies the user of successful payment and, based on the user's emotional state as determined by the emotion engine, provides the user with additional feedback and information.

[0747] Step 8:

[0748] The terminal generates an electronic receipt indicating the completion of the transaction and displays it to the user. This allows the user to visually confirm that the transaction has been successfully completed.

[0749] (Example 2)

[0750] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0751] Traditional international payment systems have made the payment experience at destinations cumbersome for users, with currency conversion and language barriers hindering a comfortable service experience. Furthermore, the need to present a physical card raises security concerns, and the lack of consideration for user emotions during such transactions significantly reduces satisfaction.

[0752] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0753] In this invention, the server includes means for managing and providing currency conversion data to enable mobile device payments from the information processing device in countries visited by users from other countries; means for the information processing device to receive product prices and calculate the price converted to the user's home currency based on the currency conversion data; means for the user to register and securely store financial institution information on the mobile device; means for the information processing device to communicate with the financial institution and execute the payment when the user makes a payment using the registered financial institution information, after receiving instructions from the mobile device; and means for the mobile device to detect the user's emotions and notify the information processing device based on predetermined conditions. This enables visitors to make payments safely and smoothly, and to obtain higher satisfaction and a sense of security through responses that respond to their emotions.

[0754] "Users from other countries" refers to individuals who reside in a country different from their destination and are visiting that country.

[0755] An "information processing device" is a device that manages, provides, and communicates data, and includes data center equipment such as servers.

[0756] A "mobile device" is a device that is portable and has payment functionality, regardless of location, and includes smartphones and tablets.

[0757] "Currency conversion data" refers to a dataset containing currency exchange rate information between different countries, and it is assumed that this data will be updated in real time.

[0758] "Financial institution information" refers to personal financial information used for payments such as credit cards and bank accounts.

[0759] "Emotion detection" refers to the process of analyzing the user's characteristics, such as facial expressions and voice tone, in real time to recognize their emotional state.

[0760] A "response message" refers to the text of a notification or information that is generated based on the detected emotion and presented to the user.

[0761] This invention is a system designed to allow users visiting from other countries to make payments comfortably at their destination. This system involves a server, terminals, and user devices working together to provide real-time currency conversion and sentiment recognition capabilities.

[0762] The server is responsible for retrieving exchange rate information from global financial data providers via an internet connection and storing it in a database. The server periodically retrieves exchange rate information using APIs and provides the functionality to convert currencies using the latest exchange rates. Through this process, visitors can check product prices in foreign countries in their own currency.

[0763] The terminal has the function of sending product price information entered by the user to a server. The price information, converted to the user's local currency, is received from the server and displayed on the terminal's screen. Furthermore, the terminal is equipped with a camera and microphone, which are used by an emotion engine that recognizes the user's emotions in real time. For example, if a sense of security is detected, the normal procedure proceeds, and if anxiety is detected, additional information is displayed to provide the user with reassurance.

[0764] Users can conduct secure, tokenized transactions by registering their financial institution information with a mobile terminal in advance. This eliminates the need to physically present a card, enabling smooth and secure payments.

[0765] A concrete example would be a user visiting Japan from the United States who wants to purchase an item costing 5,000 yen. In this case, the user enters 5,000 yen into the terminal, and the server returns the amount converted to approximately $45, which is then displayed on the terminal. If the user feels reassured, the payment will be completed as usual. However, if anxiety is detected, additional information can be displayed to reassure the user.

[0766] Example of a prompt

[0767] "Please tell me how to make payments at the client's location smoother."

[0768] "How can we implement payment methods that take into account the visitor's feelings?"

[0769] This system allows visitors to enjoy shopping at their destination with peace of mind.

[0770] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0771] Step 1:

[0772] The server retrieves the latest exchange rate information from external financial data providers via the internet. This information is stored in a database on the server. The input is the currency rate obtained from the financial data provider, and the output is the latest exchange rate information stored in the database. The server periodically performs this process via an API, automatically updating the rates.

[0773] Step 2:

[0774] The terminal receives the price of the item the user is purchasing. This price information is sent from the terminal to the server, where it is converted to the user's local currency using the latest exchange rate. The input is the item price entered on the terminal, and the output is the converted price in the user's local currency. The server performs currency conversion in real time and returns the result to the terminal.

[0775] Step 3:

[0776] Users register their financial institution information on a mobile terminal and authenticate using tokenized information when making payments. The input is the pre-registered financial institution information, and the output is the token information necessary to execute the payment. Users can initiate payment using the terminal and complete transactions using secure tokens.

[0777] Step 4:

[0778] After receiving a payment instruction, the terminal communicates with a server to contact the financial institution. The server connects with the financial institution and executes the payment. The input is the payment instruction from the user, and the output is the result of the completed transaction. Once the server approves the transaction, it notifies the terminal of the payment result.

[0779] Step 5:

[0780] The device's built-in emotion engine analyzes the user's facial expressions and voice to detect emotions. The input is the user's facial expressions and voice, and the output is the detected emotion data. Specifically, it analyzes feelings of security and anxiety, and provides the user with a response based on the results.

[0781] Step 6:

[0782] The server generates an appropriate response message based on emotion data from the terminal and sends it to the terminal. The input is the detected emotion data, and the output is the response message presented to the user. For example, the server generates a message that promotes reassurance and displays it on the terminal.

[0783] This series of steps ensures that visitors can conduct transactions safely and smoothly and receive service that takes their feelings into consideration.

[0784] (Application Example 2)

[0785] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0786] When visitors from other countries purchase goods in their destination country, they often experience anxiety due to prices displayed in different currencies and the complexities of the payment process. In particular, they frequently face difficulties with calculations due to unfamiliarity with the local currency and concerns about the security of card payments. There is a need to provide systems that alleviate these anxieties and inconveniences for users and create a comfortable payment experience.

[0787] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0788] This invention includes a server with means for managing and providing currency conversion information to enable portable information processing device payments from an information processing device to a country visited by a user from another country; means for the information processing device to receive the price of goods and calculate the price converted to the user's home country currency based on the currency conversion information; and means for integrating a psychological state recognition device into the portable information processing device to determine the user's emotions and optimize the method of visualizing information according to the emotional state. As a result, even when shopping in a foreign country, users can understand the price in their own currency and reduce anxiety at the time of payment. Furthermore, it enables feedback according to the psychological state, promoting a comfortable and secure payment experience.

[0789] "Other countries" refers to countries or regions other than the visitor's usual place of residence.

[0790] A "portable information processing device" refers to an electronic device that can be carried by the user and allows for information processing anywhere.

[0791] An "information processing device" refers to an electronic device used for data management, calculation, storage, and communication.

[0792] "Currency conversion information" refers to information that includes exchange rate data between different currencies and is used to compare the value of currencies at a specific point in time.

[0793] A "psychological state recognition device" refers to a device that determines a user's emotions and psychological state from their facial expressions and voice.

[0794] "Emotional state" refers to the psychological reactions and emotions exhibited by a user, and is characterized by the elements that define them.

[0795] "Optimizing the method of visualizing information" refers to adjusting the content and format of the information displayed according to the user's psychological state, and presenting it in the most appropriate way.

[0796] "Payment procedures" refer to a series of operations and communications performed to pay for goods or services.

[0797] The system of this invention is designed to allow visitors from other countries to make payments conveniently at their destination. This system consists of multiple components, each performing its own unique function.

[0798] First, the server is responsible for acquiring the latest currency conversion information and storing it in its database. The server periodically updates exchange rates via the internet, enabling real-time currency conversion, allowing users to accurately understand the currency exchange rates between the country they are visiting and their own country. The server also receives product prices transmitted from portable information processing devices, performs currency conversion based on that information, and calculates and returns the price in the user's own currency in an easy-to-understand format.

[0799] The portable information processing device is equipped with a psychological state recognition system to support the user's payment experience. This system uses cameras and microphones to analyze the user's facial expressions and voice, determining their emotions in real time. If the psychological state recognition system detects anxiety in the user, it provides feedback to adjust the way information is visualized, thereby providing the user with a sense of security. This feature allows users to proceed with payments in a relaxed state.

[0800] As a concrete example, consider a scenario where a user purchases goods at a store while traveling. For instance, if a user visiting Japan from the United States attempts to purchase a 5,000 yen item, the portable information processing device receives and displays the price converted to approximately $45 from the server. Simultaneously, a psychological state recognition device reads the user's facial expression, and if it confirms a sense of security, it allows the user to proceed with the normal payment process. On the other hand, if the user expresses anxiety, it visualizes additional information to enhance the user's sense of security. In this way, the system improves the user experience.

[0801] An example of a prompt to input into a generative AI model is: "Design an electronic payment app that allows visitors to shop comfortably in a foreign country. It should have features that recognize user emotions in real time and optimize the payment experience."

[0802] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0803] Step 1:

[0804] The user enters the product price into the portable information processing device. The entered price data is then prepared for transmission to the server. The portable information processing device processes the price data into a packet format and sends it to the server.

[0805] Step 2:

[0806] The server performs a calculation to convert the product price data received from the portable information processing device into the user's local currency using the latest currency conversion information stored in its own database. The latest exchange rate data is used for this calculation. The converted price information is then transmitted from the server to the portable information processing device.

[0807] Step 3:

[0808] The user's portable information processing device displays the converted price in their local currency, received from the server. During this process, a psychological state recognition device operates on the portable information processing device, capturing the user's facial expressions and voice via camera and microphone, and performing emotion analysis. The acquired data is used to determine the user's emotional state in real time.

[0809] Step 4:

[0810] If the psychological state recognition device identifies the user's emotional state as anxiety, the portable information processing device performs data processing to adjust the display interface and show additional information to promote a sense of security. Specifically, it reduces the user's anxiety by displaying details of payment procedures and warranty information.

[0811] Step 5:

[0812] After receiving feedback tailored to their psychological state, the user authorizes the payment using tokenized data on a portable information processing device. The portable information processing device sends this payment authorization data to a server, which connects with a financial institution to execute the actual payment. The payment result is then notified from the server to the portable information processing device.

[0813] Step 6:

[0814] The portable information processing device generates an electronic record based on the received payment result and presents it to the user. The generated electronic record confirms the completion of the transaction and is stored in a format that the user can refer to.

[0815] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0816] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0817] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0818] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0819] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0820] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0821] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0822] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0823] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0824] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0825] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0826] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0827] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0828] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0829] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0830] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0831] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0832] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0833] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0834] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0835] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0836] The following is further disclosed regarding the embodiments described above.

[0837] (Claim 1)

[0838] A means of managing and providing currency conversion data to enable mobile terminal payments from communication terminals in countries visited by users of other countries,

[0839] A means by which a communication terminal receives the product price and calculates the price converted to the user's home currency based on exchange rate conversion data,

[0840] A means for users to register and securely store financial institution information on a mobile device,

[0841] A means by which, when a user makes a payment using information from a registered financial institution, a communication terminal that receives a command from a mobile terminal communicates with the financial institution to execute the payment,

[0842] A means of notifying the mobile terminal of the payment result,

[0843] A system that includes this.

[0844] (Claim 2)

[0845] The system according to claim 1, wherein the communication terminal periodically updates exchange rate conversion data and automatically obtains the latest exchange rate.

[0846] (Claim 3)

[0847] The system according to claim 1, wherein a mobile terminal generates an electronic receipt based on the received payment result and displays it to the user.

[0848] "Example 1"

[0849] (Claim 1)

[0850] A means of managing and providing currency conversion data to enable mobile terminal payments from information processing devices in the countries visited by users,

[0851] A means by which an information processing device receives the buying and selling price and calculates the price converted to the user's home currency based on currency conversion data,

[0852] A means for users to register and securely store financial institution information on their mobile devices,

[0853] A means by which, when a user makes a payment using information from a registered financial institution, an information processing device that receives a command from a mobile terminal communicates with the financial institution to execute the payment,

[0854] A means of notifying the payment result on a mobile device,

[0855] A means of securely storing financial institution information using tokenization technology,

[0856] A system that includes this.

[0857] (Claim 2)

[0858] The system according to claim 1, wherein the information processing device periodically updates currency conversion data and automatically obtains the latest exchange rate.

[0859] (Claim 3)

[0860] The system according to claim 1, wherein a mobile device generates an electronic certificate based on the received payment result and displays it to the user.

[0861] "Application Example 1"

[0862] (Claim 1)

[0863] A means of managing and providing currency conversion data to enable mobile information processing device payments from information processing devices in areas visited by travelers from other countries,

[0864] A means by which an information processing device receives product value and calculates its value converted to the traveler's home currency based on currency conversion data,

[0865] A means for travelers to register and securely store financial organization information on mobile information processing devices,

[0866] A means by which, when a traveler makes a payment using information from a registered financial organization, an information processing device receives instructions from a mobile information processing device and communicates with the financial organization to execute the payment.

[0867] A means of notifying a mobile information processing device of the payment result,

[0868] A mobile information processing device displays the value of goods converted into the local currency to travelers, receives purchase orders, and completes payments quickly.

[0869] A system that includes this.

[0870] (Claim 2)

[0871] The system according to claim 1, wherein the information processing equipment periodically updates currency conversion data and automatically obtains the latest currency rates.

[0872] (Claim 3)

[0873] The system according to claim 1, wherein a mobile information processing device generates an electronic receipt based on the received payment result and displays it to the traveler.

[0874] "Example 2 of combining an emotion engine"

[0875] (Claim 1)

[0876] A means of managing and providing currency conversion data to enable mobile device payments from information processing devices in countries visited by users of other countries,

[0877] A means by which an information processing device receives product prices and calculates the price converted to the user's home currency based on currency conversion data,

[0878] A means for users to register and securely store financial institution information on a mobile device,

[0879] A means by which, when a user makes a payment using information from a registered financial institution, an information processing device receives a command from a mobile device, communicates with the financial institution, and executes the payment.

[0880] A means of notifying a mobile device of the payment result,

[0881] A mobile device includes means for detecting the user's emotions and notifying an information processing device based on predetermined conditions,

[0882] The information processing device includes means for generating a response message based on detected emotions and transmitting it to a mobile device,

[0883] A system that includes this.

[0884] (Claim 2)

[0885] The system according to claim 1, wherein the information processing device periodically updates currency conversion data and automatically obtains the latest currency rate.

[0886] (Claim 3)

[0887] The system according to claim 1, wherein a mobile device generates and displays an electronic receipt to the user based on the payment result received.

[0888] "Application example 2 when combining with an emotional engine"

[0889] (Claim 1)

[0890] A means of managing and providing currency conversion information to enable payment via portable information processing device from an information processing device in a country visited by users from another country,

[0891] A means by which an information processing device receives the price of an item and calculates the price converted to the user's home currency based on currency conversion information,

[0892] A means for users to record and securely store financial institution information on a portable information processing device,

[0893] A means by which, when a user makes a payment using recorded financial institution information, the information processing device receives a command from a portable information processing device, communicates with the financial institution, and executes the payment.

[0894] A means for notifying a portable information processing device of the payment result,

[0895] A means for integrating a psychological state recognition device into a portable information processing device, determining the user's emotions, and optimizing the method of visualizing information according to the emotional state,

[0896] A system that includes this.

[0897] (Claim 2)

[0898] The system according to claim 1, wherein the information processing device periodically updates currency conversion information and automatically obtains the latest exchange rate.

[0899] (Claim 3)

[0900] The system according to claim 1, wherein a portable information processing device generates an electronic record based on the received payment result and displays it to the user. [Explanation of symbols]

[0901] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of managing and providing currency conversion data to enable mobile terminal payments from communication terminals in countries visited by users of other countries, A means by which a communication terminal receives the product price and calculates the price converted to the user's home currency based on exchange rate conversion data, A means for users to register and securely store financial institution information on a mobile device, A means by which, when a user makes a payment using information from a registered financial institution, a communication terminal that receives a command from a mobile terminal communicates with the financial institution to execute the payment, A means of notifying the mobile terminal of the payment result, A system that includes this.

2. The system according to claim 1, wherein the communication terminal periodically updates exchange rate conversion data and automatically obtains the latest exchange rate.

3. The system according to claim 1, wherein a mobile terminal generates an electronic receipt based on the received payment result and displays it to the user.

Images