System

Abstract

A system is provided.SOLUTION: A system comprising: a household account book recording unit that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database unit that stores payment information and manually input expenditure information; a search unit that searches for a purchase history in units of products and presents a result of the search; a proposal unit that provides a profitable coupon and store information based on the purchase history; and a unit that automatically transfers surplus money to asset management based on setting of expenditure.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, managing household expenses is an important issue for many families. While expenses increase due to rising prices and tax hikes, household finances can be strained if expenses are not managed efficiently. Especially with the widespread use of electronic payments, it is not easy to centrally manage multiple payment methods and keep track of detailed spending. Furthermore, a lack of information to efficiently manage expenses and reduce waste makes household management cumbersome overall. There is a need for a system that solves these issues and automates and streamlines household management. [Means for solving the problem]

[0005] The present invention is a system that includes a household account book recording means that automatically records payment information in cooperation with a specific electronic payment system, a database means that stores payment information and manually entered expenditure information, a search means that searches purchase history by product and presents the results, a suggestion means that provides advantageous coupons and store information based on the purchase history, and a means that automatically transfers surplus funds to asset management based on expenditure settings. Furthermore, by adding a linking means that records payment information via credit card or direct debit in the database means and a means that acquires product information using JAN codes and records the acquired information in the database means, household expenditure management can be made even more efficient. In this way, users can centrally manage multiple payment methods, clearly understand their expenditures, and receive information to reduce wasteful spending.

[0006] An "electronic payment system" is a system for conducting payment transactions without using cash via the Internet or a dedicated application.

[0007] A "household account book recording means" is a function or device for automatically or manually recording payment information and managing household income and expenditure.

[0008] "Database Means" means a system for systematically organizing and storing collected payment information and manually entered expenditure information.

[0009] The "search means" is a function or device for searching expenditure information stored in a database based on specific conditions and presenting the results to the user.

[0010] The "suggestion means" is a function or device for providing and presenting advantageous coupons and store information based on the user's purchase history.

[0011] An "asset management instrument" is a function or device that automatically transfers surplus funds to an asset management destination based on a set expenditure budget.

[0012] The "linking means" is a function or device for linking the database means with other payment means such as credit cards and account transfers, and recording payment information.

[0013] The "JAN code" is an internationally standardized product identification code, a barcode used to uniquely identify product information. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] The embodiment of the present invention starts by linking with a specific electronic payment system. Specific embodiments of the functions of the present invention and the processing of the programs are explained below in natural language.

[0036] Automatic household accounting

[0037] The terminal makes the payment

[0038] A user makes a payment using an electronic payment system (e.g., an electronic wallet in a mobile app). This includes paying for goods or services in a store via an electronic payment system.

[0039] The server receives and records the data

[0040] After the payment is completed, the terminal sends the payment information to the server. The server receives this payment information, analyzes it, and records it in the household accounting database. For example, data such as the payment date and time, amount, store name, and purchased item (using JAN code) are recorded.

[0041] Linking other payment methods

[0042] User enters other payments

[0043] Users can manually enter cash payments or other electronic payment methods (e.g., credit card, direct debit) within the app, which then sends these inputs to the server.

[0044] The server records the data in a database

[0045] The server receives the manually entered payment information and records it appropriately in the household accounting database.

[0046] Purchase history management and search function

[0047] History management for each product

[0048] The server organizes purchase history by product using the JAN code included in each payment information, allowing users to record in detail when, where and which products they purchased.

[0049] User searches purchase history

[0050] When a user searches for a specific product or category in the app, the server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[0051] Example: When a user searches for past purchase history of "milk," the server retrieves all purchase history related to "milk" from the household accounting database and displays details such as purchase date, store name, and price.

[0052] Providing discount coupons and store information

[0053] The server generates the proposal

[0054] The server analyzes the user's purchase history and generates relevant coupons and local store information based on past purchasing patterns and specific product categories.

[0055] Present suggestions to the user

[0056] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[0057] Example: For the item "bread" that a user frequently purchases, useful information is provided to the user by presenting discount coupons and information on new bakeries.

[0058] Asset management setup and transfer

[0059] The user sets up asset management

[0060] Users can set a monthly budget within the app and set up settings to transfer any surplus funds to an asset management account, such as automatically transferring 5,000 yen to a savings account every month.

[0061] Server manages budget and spending

[0062] The server manages the user's set budget and actual expenditure information, and checks the surplus at the end of the month.

[0063] Linking with asset management API

[0064] At the end of the month, the server automatically sends a request to transfer any surplus funds to the asset management destination via the API of the affiliated asset management service.

[0065] Example: A user sets a budget for book purchases, and if they have any money left over that month, the surplus is automatically transferred to a mutual fund account.

[0066] With each of the above functions, users can automatically manage their spending and manage their household finances efficiently. Furthermore, by managing detailed purchase histories and providing information on special offers, spending can be optimized, and surplus funds can be utilized for asset management, improving overall household management. In this way, the present invention is a system that aims to automate and streamline household finance management.

[0067] The processing flow will be explained below.

[0068] Step 1:

[0069] A user pays for goods and services at a store using a specific electronic payment system.

[0070] Step 2:

[0071] After the payment is completed, the terminal retrieves the payment information, which includes details such as the payment date and time, amount, store name, and purchased items (using JAN codes).

[0072] Step 3:

[0073] The terminal transmits the acquired payment information to the server using the HTTPS protocol.

[0074] Step 4:

[0075] The server receives the payment information from the terminal and checks the data for consistency, including the validity of the amount and date.

[0076] Step 5:

[0077] The server records the payment information, whose integrity has been confirmed, in the database. The server then inserts the payment date and time, amount, store name, and purchased product information into the household account book database.

[0078] Step 6:

[0079] A user manually enters a cash payment or other electronic payment (such as a credit card or direct debit) within the app.

[0080] Step 7:

[0081] The payment information entered by the user is sent from the terminal to the server.

[0082] Step 8:

[0083] The server receives the manually entered payment information and records it in a database.

[0084] Step 9:

[0085] The server analyzes the JAN code of the purchased item and obtains the product information. This information is then updated in the database.

[0086] Step 10:

[0087] The server organizes purchase history by product and allows users to search for purchase history by specific criteria.

[0088] Step 11:

[0089] A user searches their purchase history for a specific product or category within the app.

[0090] Step 12:

[0091] The server retrieves the relevant purchase history from the household account book database and sends the results to the user's terminal.

[0092] Step 13:

[0093] The server analyzes the user's purchase history and generates relevant discount coupons and store information.

[0094] Step 14:

[0095] The server sends the generated coupons and store information in JSON format to the user's device and presents them to the user.

[0096] Step 15:

[0097] Users set a monthly budget within the app and set up their surplus funds to be transferred to asset management.

[0098] Step 16:

[0099] The terminal transmits the set budget information to the server.

[0100] Step 17:

[0101] The server compares the set budget with actual spending and identifies any surplus at the end of the month.

[0102] Step 18:

[0103] The server makes a request through the API of its partner asset management service to transfer the surplus funds to the user's asset management account.

[0104] By following these steps, users can automatically record and manage their expenses, and also obtain useful information and manage their assets automatically.

[0105] Example 1

[0106] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0107] In recent years, the spread of electronic payment systems has made daily payments easier and faster, but at the same time, it has created the challenge of making spending management more complex. Traditional household accounting is often done manually, requiring time and effort, and is prone to omissions and input errors. There is also a demand for integrated systems with more advanced functions, such as the ability to search purchase history, provide discount coupons, and automate asset management, in addition to managing spending information. However, there is still a problem in that the technology to effectively integrate and automate these functions is insufficient.

[0108] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0109] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a proposal means that provides advantageous discount coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; a proposal generation means that generates coupons and store information based on specific product categories and notifies the user's terminal; and an asset management linking means that manages the user's set budget and actual expenditures at the end of the month and transfers surplus funds to an affiliated asset management service. This automates the user's expenditure management, streamlines daily household management, and provides comprehensive support ranging from advantageous information to asset management.

[0110] A "specific electronic payment system" is a system that, unlike general payment methods, completes transactions using dedicated electronic devices and applications.

[0111] The "household account book recording means" is a device or software that has the function of automatically collecting payment information made by the user and recording it in the form of a household account book.

[0112] "Payment Information" refers to information regarding the date, time, amount, location of a payment, and the item purchased.

[0113] "Manually entered expenditure information" refers to information about expenditures that is manually entered by a user via an application.

[0114] "Database Measures" means the systems and software used to store and manage payment information and manually entered expenditure information.

[0115] "Purchase history by product" refers to the history of past purchases of a specific product, such as the date, time, place, and amount.

[0116] "Search means" refers to a function or device that allows a user to search for specific information.

[0117] A "discount coupon" is a coupon that allows you to receive a discount when purchasing goods or services.

[0118] "Store information" refers to information about stores that users can visit (location, business hours, products sold, etc.).

[0119] The "proposing means" refers to a function or device for providing useful information (discount coupons, store information, etc.) to the user.

[0120] "Surplus" refers to the difference between the budget set by the user and the amount of expenditure that is less than the budget set by the user.

[0121] "Asset management" refers to a series of tasks and activities aimed at increasing assets by managing income or surplus funds.

[0122] The "proposal generating means" refers to a function or device for generating coupons and store information based on a user's purchase history or a specific product category, and notifying the user of the coupons and store information.

[0123] "Asset management linkage means" refers to functions and devices that link with affiliated asset management services and automatically transfer surplus funds to the investment destination.

[0124] The present invention is a household management system that starts by linking with an electronic payment system. To implement this system, specific hardware and software are used to collect, analyze, record, search, propose, and link asset management data.

[0125] Hardware and software used

[0126] 1. Terminal (user's mobile device):

[0127] E-wallet app: Used by users to make payments.

[0128] Household accounting app: An app for manually entering payment information, searching purchase history, and setting up settings.

[0129] 2. Server:

[0130] Data receiving and analysis system: Receives and analyzes payment information and manually entered information sent from the user's device.

[0131] Database System: A system for storing payment information and manually entered information.

[0132] Proposal generation system: A system for generating coupons and store information based on purchase history.

[0133] Asset management collaboration system: Collaborates with affiliated asset management services to automatically transfer surplus funds.

[0134] Explanation of program processing

[0135] Automatic household accounting

[0136] When a user uses an electronic wallet app to purchase goods or services at a store, the device sends payment information (payment date and time, amount, store name, and JAN code of the purchased goods) to the server. The server analyzes the received information and records it in the household account book database.

[0137] Example: A user buys bread for 500 yen at a convenience store at 2 p.m. one day, and the information is automatically recorded in the household account book.

[0138] Linking other payment methods

[0139] Users manually enter cash payments and credit card information using forms within the household accounting app, which is then sent from the device to the server and recorded in a database.

[0140] Example: If a user manually enters "Purchase bread for 500 yen with cash at a convenience store on March 1, 2023," that information will be reflected in the household account book.

[0141] Purchase history management and search function

[0142] The server uses the JAN code included in the payment information to organize purchase history by product. When a user searches the purchase history of a specific product or category in the household accounting app, the server retrieves the relevant data from the database and presents it on the device.

[0143] Example: When a user searches for "milk," all of the milk they have ever purchased is displayed.

[0144] Providing discount coupons and store information

[0145] The server analyzes the user's purchase history and generates relevant coupons and store information within the user's area. The generated information is sent to the device and notified to the user within the household account book app.

[0146] Example: A user is offered a 20% discount coupon for a bread they frequently purchase on weekends.

[0147] Asset management setup and transfer

[0148] Users set a monthly budget within the household accounting app and configure asset management settings. At the end of the month, the server manages the budget and actual expenditures, and sends a request to the partner service API to automatically transfer any surplus funds to the asset management organization.

[0149] Example: A user sets a monthly budget for book purchases, and if there is a surplus, the surplus is automatically transferred to a mutual fund.

[0150] Examples of prompt statements

[0151] Please explain the program process for generating and notifying coupons for frequently purchased items.

[0152] ---

[0153] In this way, the present invention manages a variety of electronic payment information in an integrated manner, and realizes the automation of household management and asset management.

[0154] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0155] Automatic household accounting

[0156] Step 1: The user makes a payment at the store using the mobile app's e-wallet.

[0157] Input: Purchase information for goods or services at a store (e.g., 1 loaf of bread, 500 yen).

[0158] What happens: A user completes a payment transaction using an e-wallet app.

[0159] Step 2: The terminal sends the payment information to the server.

[0160] Input: Payment information after payment is completed (payment date and time, amount, store name, JAN code of purchased item, etc.).

[0161] How it works: The terminal sends payment information to the server using the HTTPS protocol.

[0162] Output: The payment information received by the server.

[0163] Step 3: The server receives and records the data.

[0164] Input: Payment information sent from the terminal.

[0165] Operation: The server analyzes the payment information received and extracts the payment date and time, amount, store name, purchased item information, etc.

[0166] Output: The analyzed data is recorded in the household accounting database.

[0167] Linking other payment methods

[0168] Step 1: User enters another payment.

[0169] Input: Cash payment or credit card information (e.g. 500 yen in cash, 1000 yen by credit card).

[0170] What it does: A user manually enters payment information using an in-app form.

[0171] Step 2: The app sends the input information to the server.

[0172] Input: Payment information entered manually.

[0173] How it works: The app sends the input information to the server using the HTTPS protocol.

[0174] Output: Manually entered information received by the server.

[0175] Step 3: The server records the data in a database.

[0176] Input: The user's manually entered payment information.

[0177] Operation: The server parses the received manual entry information and records it in a database.

[0178] Output: The manually entered information is saved in the household accounting database.

[0179] Purchase history management and search function

[0180] Step 1: Manage product history on a product-by-product basis.

[0181] Input: JAN code included in payment information.

[0182] How it works: The server analyzes payment information and organizes the purchase history for each product using the JAN code.

[0183] Output: The organized purchase history for each product is saved in a database.

[0184] Step 2: User searches purchase history.

[0185] Input: The user enters search criteria (e.g., product name or category) into the app.

[0186] What it does: A user searches their purchase history for a specific product or category within an app.

[0187] Output: The server retrieves the relevant purchase history from the database.

[0188] Step 3: The server presents the purchase history to the user.

[0189] Input: Purchase history obtained by the server.

[0190] Operation: The server sends the acquired purchase history to the user's device.

[0191] Output: The app displays the user's purchase history (e.g., details such as purchase date, store name, and price).

[0192] Providing discount coupons and store information

[0193] Step 1: The server generates a proposal.

[0194] Input: User purchase history data.

[0195] How it works: The server analyzes a user's purchase history and generates discount coupons and store information based on specific product categories.

[0196] Output: Generated coupon information and store information.

[0197] Step 2: The server presents the proposal to the user.

[0198] Input: Generated coupon information and store information.

[0199] Operation: The server generates information and sends it to the user's device.

[0200] Output: The app notifies and displays coupon information and store information to the user.

[0201] Asset management setup and transfer

[0202] Step 1: The user sets up asset management.

[0203] Input: Set your monthly budget and asset management (e.g., transfer 5,000 yen per month to your savings account).

[0204] How it works: Users set their monthly budget and asset management within the app.

[0205] Output: The set budget information and asset management information are saved on the server.

[0206] Step 2: The server manages the budget and spending.

[0207] Input: User's budget information and actual spending information.

[0208] How it works: The server manages the user's set budget and actual spending information in conjunction with each other.

[0209] Output: The surplus data is obtained at the end of the month.

[0210] Step 3: The server connects to the asset management API and transfers the funds.

[0211] Input: Surplus cash data and asset management information.

[0212] Operation: The server generates a request to transfer surplus funds to an asset management destination and sends the request through the affiliated asset management service API.

[0213] Output: Surplus funds are automatically transferred to the investment account.

[0214] (Application example 1)

[0215] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0216] While conventional household accounting systems have the ability to automatically record electronic payment information, they lack comprehensive consumer support functions, such as spending management using smartphones or other devices and coupon generation functions. This makes it difficult for users to grasp their spending situation, and efficient support for spending control and asset management is needed. Furthermore, the provision of information on deals based on purchase history is limited, and users are not sufficiently encouraged to engage in beneficial consumption behavior. A comprehensive system is needed to resolve these issues and enable users to manage their household finances efficiently and effectively.

[0217] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0218] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a suggestion means that provides discount coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an expenditure management means that is installed on a smartphone, smart glasses, a head-mounted display, or an automated device; and a coupon generation means that uses an application based on the payment history. This allows users to automatically record expenditures made via electronic payments, comprehensively manage their household finances through their smart devices, and obtain information on advantageous offers based on their purchase history.

[0219] An "electronic payment system" is a system that allows users to pay for goods and services electronically.

[0220] A "household account book recording means" is a device or application that has the function of automatically recording payment information using an electronic payment system.

[0221] "Database Means" means a storage device or system for storing and managing payment information and expenditure information manually entered by a User.

[0222] The "search means" is a device or application that searches the purchase history recorded in the database on a product-by-product basis and presents the results to the user.

[0223] The "proposal means" is a device or system that has the function of generating discount coupons and store information based on the user's purchase history and providing them to the user.

[0224] An "asset management instrument" is a device or system that has the function of automatically transferring surplus funds to asset management within the range of expenditures set by the user.

[0225] "Expense management tool" means an application installed on a smartphone, smart glasses, head-mounted display, or automated device that has the function of managing and monitoring a user's expenses.

[0226] The "coupon generating means" is a device or system that has the function of generating advantageous discount information based on the user's payment history.

[0227] An embodiment of the present invention is realized by using a system that works in conjunction with a specific electronic payment system. This system automatically records a user's spending information, makes suggestions based on their purchase history, and utilizes surplus funds for asset management. Specific embodiments of each function of the present invention and the system's processing are explained in natural language below.

[0228] First, when a user makes a payment using the electronic payment system, the terminal sends the payment information to the server. The server receives this payment information, analyzes data such as the payment date and time, amount, store name, and purchased items, and records it in the household accounting database. Users can also manually enter payment information for cash payments or other electronic payment methods within the app, and this information is also recorded in the database.

[0229] Next, to manage purchase histories on a product-by-product basis, the server organizes past purchase histories using the product identification code included in each payment information. Users can search for purchase history for specific products or categories within the app, and the server retrieves the relevant purchase history and presents it to the user. For example, if a user searches for past purchase history for "milk," the server retrieves all purchase history related to "milk" from the household accounting database and displays details such as purchase date, store name, and price.

[0230] The system also has the ability to analyze a user's purchase history and provide relevant coupons and store information. The server generates coupon information based on purchase patterns and specific product categories, and sends and displays it on the user's device. For example, the system can provide useful information to the user by presenting coupons and new store information for "bread," which the user frequently purchases.

[0231] Regarding asset management settings, users can set a monthly budget within the app and set up the transfer of any surplus funds to their asset management account. Based on the user's settings, the server checks the surplus funds at the end of the month and automatically requests the transfer to the asset management account via the API of the partner asset management service. For example, if a user sets up a monthly transfer of 5,000 yen to a specific investment trust account, the surplus funds for that month will be automatically transferred to the investment trust account.

[0232] These functions are implemented by the following hardware and software:

[0233] Hardware: smartphones, servers, databases

[0234] Software: Python, libraries for API integration (e.g., requests), database system (e.g., SQLite)

[0235] An example of a prompt sentence would be the following text:

[0236] "You are looking to develop an application that automatically records a user's electronic payment information in a household ledger and also supports asset management. In particular, the application should include the following features: automatic recording of payment information, support for manual entry, search for purchase history, provide coupons, and asset management of surplus funds."

[0237] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0238] Step 1:

[0239] The user makes a payment using an electronic payment system.

[0240] What it does: A user pays for goods and services at a store using an electronic payment application on their smartphone.

[0241] Input: Payment information (payment date and time, amount, store name, purchased items, etc.).

[0242] Output: Payment information is captured by the terminal.

[0243] Step 2:

[0244] The terminal sends the payment information to the server.

[0245] Specific operation: After the payment is completed, the smartphone's electronic payment application automatically sends the payment information to the server.

[0246] Input: Payment information.

[0247] Output: Payment information is received by the server.

[0248] Step 3:

[0249] The server records the received payment information in a database.

[0250] Specific operation: The server saves the received payment information in the database and records it in the household accounting database.

[0251] Input: Payment information.

[0252] Output: Payment information recorded in the household accounting database.

[0253] Step 4:

[0254] The user manually enters another payment method within the app.

[0255] What happens: A user manually enters payment information for a cash or other electronic payment method and sends it to a server through an application.

[0256] Input: Manually entered payment information.

[0257] Output: Manually entered payment information is received by the server.

[0258] Step 5:

[0259] The server records the manually entered payment information in a database.

[0260] Specific operation: The server receives manually entered payment information and records it in the household accounting database.

[0261] Input: Manually entered payment information.

[0262] Output: Manual payment information recorded in the household accounting database.

[0263] Step 6:

[0264] The server manages purchase history on a product-by-product basis.

[0265] Specific operation: The server organizes the purchase history using the product identification code included in each payment information.

[0266] Input: Payment information recorded in the household accounting database.

[0267] Output: An organized purchase history.

[0268] Step 7:

[0269] The user searches for their purchase history within the app.

[0270] What happens: A user searches for a product or category in their purchase history within an app. The app sends the query to the server.

[0271] Input: Search query (e.g. product name "Milk").

[0272] Output: A display of the purchase history specified by the user.

[0273] Step 8:

[0274] The server presents the search results to the user.

[0275] Specific operation: The server retrieves the relevant purchase history from the household account book database and sends it to the user's terminal for display.

[0276] Input: Search results from the purchase history database.

[0277] Output: Purchase history displayed on the user's device.

[0278] Step 9:

[0279] The server generates advantageous coupons and store information based on purchase history.

[0280] Specific operation: The server analyzes the user's purchase history and generates relevant discount information and store information.

[0281] Input: Purchase history data.

[0282] Output: Generated coupon information and store information.

[0283] Step 10:

[0284] The server transmits the generated coupon information and store information to the user terminal.

[0285] Specific operation: The server sends the generated coupon information and store information to the user's device and displays it within the app.

[0286] Input: Generated coupon information and store information.

[0287] Output: Coupon information and store information displayed on the user's device.

[0288] Step 11:

[0289] Users set up their asset management settings within the app.

[0290] How it works: Users enter their monthly budget and the amount of surplus money they want to use for asset management within the app.

[0291] Input: Monthly budget and financial settings.

[0292] Output: Budget and investment settings stored on the server.

[0293] Step 12:

[0294] The server checks the surplus at the end of the month and transfers it to asset management.

[0295] Specific operation: The server compares the user's monthly budget with their actual spending, and if there is a surplus, it automatically sends a request to transfer the surplus to the asset management provider via the API of the affiliated asset management service.

[0296] Input: Actual expenditure data, budget data, API information of partner asset management services.

[0297] Output: Surplus transferred to investment destination.

[0298] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0299] In one embodiment of the present invention, the objective is to provide personalized spending management and suggestions based on the user's emotions by linking with a specific electronic payment system and combining an emotion engine with a system that streamlines household management.

[0300] Automatic household accounting

[0301] The terminal makes the payment

[0302] When a user pays for a product or service at a store using an electronic payment system, payment information (date and time, amount, store name, purchased product information, etc.) is generated.

[0303] The server receives and records the data

[0304] After the payment is completed, the terminal sends the payment information to the server, which receives it, analyzes it, and records it in the household account book database.

[0305] Linking other payment methods

[0306] User enters other payments

[0307] If the user manually enters cash payments or other electronic payment methods (credit cards, direct debit, etc.), these entries are also sent to the server.

[0308] The server records the data

[0309] The server receives the manually entered payment information and records it in the household account book database.

[0310] Purchase history management and search function

[0311] History management for each product

[0312] The server analyzes the JAN code included in the payment information and manages the purchase history for each product, allowing users to track in detail when and where they purchased which products.

[0313] User searches purchase history

[0314] When a user searches for a purchase history for a specific product or category, the server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[0315] Providing discount coupons and store information

[0316] The server generates the proposal

[0317] The server generates discount coupons and store information within the user's living area based on the user's purchase history.

[0318] Present suggestions to the user

[0319] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[0320] Asset management setup and transfer

[0321] The user sets up asset management

[0322] Users set a monthly budget within the app and set up their assets to receive any surplus funds.

[0323] Server manages budget and spending

[0324] The server compares the set budget with actual spending and identifies any surplus at the end of the month.

[0325] Linking with asset management API

[0326] The server automatically sends a request to transfer the surplus funds to the asset management destination via the API of the affiliated asset management service.

[0327] Combining Emotion Engines

[0328] emotion recognition

[0329] The device is equipped with an emotion engine that recognizes the user's emotions from their facial expressions, voice, text, etc. When the user uses the app, emotion data is collected using the device's camera and microphone.

[0330] Sending emotional data

[0331] The device transmits emotional data acquired by the emotion engine to the server, including information such as whether the user is relaxed or stressed.

[0332] Emotional Data Analysis

[0333] The server analyzes the emotional data to understand the user's current emotional state, and uses this information to analyze spending patterns and predict future spending.

[0334] Example: A server uses the user's emotional data to provide coupons for relaxation products and services to users who are feeling stressed, and makes investment and savings suggestions to users when they are in a positive emotional state.

[0335] Emotion-based suggestions

[0336] The server customizes the coupons and store information to be provided based on the user's emotions recognized by the emotion engine.

[0337] Example: If the server detects that the user is feeling tired, it will provide coupons for products that promote relaxation or information about the nearest spa. If the user is happy, it will provide information about restaurants and trips with special offers.

[0338] In this way, by combining the emotion engine, personalized suggestions and expenditure management based on the user's emotional state become possible. The present invention is a system that provides comprehensive support for the user's household finances, realizing more efficient and satisfying expenditure management.

[0339] The processing flow will be explained below.

[0340] Step 1:

[0341] A user pays for goods and services at a store using a specific electronic payment system.

[0342] Step 2:

[0343] After the payment is completed, the terminal retrieves payment information, including the payment date and time, amount, store name, and details of the purchased item (including JAN code).

[0344] Step 3:

[0345] The terminal transmits the acquired payment information to the server using the HTTPS protocol.

[0346] Step 4:

[0347] The server receives the payment information from the terminal and checks the data for consistency, including the validity of the amount and date.

[0348] Step 5:

[0349] The server records the payment information, whose integrity has been confirmed, in the household account book database, inserting the payment date and time, amount, store name, and details of the purchased item.

[0350] Step 6:

[0351] A user manually enters a cash payment or other electronic payment (e.g., credit card, direct debit) within the app.

[0352] Step 7:

[0353] The payment information entered by the user is sent from the terminal to the server.

[0354] Step 8:

[0355] The server receives the manually entered payment information and records it in the household account database.

[0356] Step 9:

[0357] The server analyzes the JAN code of the purchased item and updates the database with the product information based on that.

[0358] Step 10:

[0359] The server organizes purchase history by product and allows users to search for purchase history by specific criteria.

[0360] Step 11:

[0361] A user searches their purchase history for a specific product or category within the app.

[0362] Step 12:

[0363] The server retrieves the relevant purchase history from the household account book database and sends the results to the user's terminal.

[0364] Step 13:

[0365] The server analyzes the user's purchase history and generates relevant discount coupons and store information.

[0366] Step 14:

[0367] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[0368] Step 15:

[0369] Users set a monthly budget within the app and set up their surplus funds to be transferred to asset management.

[0370] Step 16:

[0371] The terminal transmits the set budget information to the server.

[0372] Step 17:

[0373] The server compares the set budget with the actual expenditure and checks the surplus at the end of the month.

[0374] Step 18:

[0375] The server makes a request to transfer the surplus funds to the user's asset management account through the API of the asset management service it is affiliated with.

[0376] Step 19:

[0377] The device uses an emotion engine to analyze the user's facial expressions, voice, text, etc. to obtain emotional data, including information such as whether the user is relaxed or stressed.

[0378] Step 20:

[0379] The device transmits the emotion data to the server.

[0380] Step 21:

[0381] The server analyzes the emotional data and understands the user's current emotional state.

[0382] Step 22:

[0383] The server customizes the coupons and store information it provides based on the emotion data. For example, if it detects that the user is tired, it will provide relaxation-related coupons and store information.

[0384] Step 23:

[0385] The server transmits the customized coupons and store information to the user's terminal and presents them to the user.

[0386] These steps allow users to not only automatically record and manage their spending, but also receive personalized suggestions based on their emotional state, and efficiently utilize their surplus funds for asset management.

[0387] Example 2

[0388] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0389] While conventional household management systems provide the ability to automatically record users' spending information and the ability to manually input some payment information, they lack the ability to provide personalized spending management and suggestions that take into account the user's emotional state. This makes it difficult to provide optimal spending management and suggestions based on the user's current psychological state, making it difficult to improve user satisfaction.

[0390] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0391] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a suggestion means that provides advantageous coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an emotion recognition means that recognizes and collects user emotion data; an emotion analysis means that analyzes the user's emotional state based on the collected emotion data; and a suggestion customization means that customizes suggestions based on the emotion analysis results. This enables personalized expenditure management and suggestions according to the user's emotional state, thereby improving user satisfaction and spending efficiency.

[0392] The "household account book recording means" is a function that works in conjunction with a specific electronic payment system and automatically records payment information using the electronic payment system.

[0393] "Database Means" refers to a facility that stores payment information and manually entered expenditure information.

[0394] The "search means" is a function for searching purchase history on a product-by-product basis and displaying the results.

[0395] "Proposal means" is a function that provides advantageous coupons and store information based on purchase history.

[0396] "Asset management tools" are functions that automatically transfer surplus funds to asset management based on a spending plan.

[0397] The "emotion recognition means" is a function that recognizes and collects the user's emotional data.

[0398] The "emotion analysis means" is a function that analyzes the user's emotional state based on the collected emotional data.

[0399] The "suggestion customization means" is a function that makes optimal suggestions to individual users based on the results of emotion analysis.

[0400] The present invention aims to provide personalized spending management and suggestions based on the user's emotions by linking with a specific electronic payment system and combining an emotion engine with a system that streamlines household management.

[0401] Automatic household accounting

[0402] The terminal makes the payment

[0403] Users use their smartphones or tablets to pay for goods and services at stores through an electronic payment app, and payment information (date, time, amount, store name, purchased product information, etc.) is generated on the device.

[0404] The device sends data

[0405] After the payment is completed, the device sends the payment information to the server, typically over Wi-Fi or mobile data.

[0406] The server receives and records the data

[0407] The server analyzes the received payment information and records it in a household account database, which is used to efficiently manage expenditure information.

[0408] Linking other payment methods

[0409] User enters other payments

[0410] Users manually enter cash payments or other electronic payment methods (credit cards, direct debit, etc.) through an app on their device.

[0411] The device sends data

[0412] The terminal sends the manually entered payment information to the server.

[0413] The server records the data

[0414] The server receives the manually entered payment information and records it in the household account database.

[0415] Purchase history management and search function

[0416] The server analyzes the data

[0417] The server analyzes the JAN code included in the payment information and manages the purchase history for each product. This data is used by users to track their past spending.

[0418] User searches purchase history

[0419] Users can use the search function within the app to search for purchase history for a specific product or category. The server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[0420] Providing discount coupons and store information

[0421] The server generates coupons and store information

[0422] The server generates discount coupons and store information within the user's living area based on the user's purchase history.

[0423] The server makes a proposal

[0424] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[0425] Asset management setup and transfer

[0426] The user sets up asset management

[0427] Users set a monthly budget within the app and set up their assets to receive any surplus funds.

[0428] Server manages budget and spending

[0429] The server compares the set budget with the actual spending and checks for any surplus at the end of the month.

[0430] Linking with asset management API

[0431] The server automatically transfers the surplus funds through the affiliated asset management service API.

[0432] Combining Emotion Engines

[0433] The device recognizes emotions

[0434] The device is equipped with an emotion engine that uses a camera and microphone to recognize the user's emotions, analyzing the user's facial expressions and voice to obtain emotional data.

[0435] The device sends data

[0436] The device transmits the emotion data acquired by the emotion engine to the server.

[0437] The server analyzes the emotional data

[0438] The server analyzes the emotional data to understand the user's emotional state, and uses this information to analyze spending patterns and predict future spending.

[0439] The server generates sentiment-based suggestions

[0440] The server customizes the coupons and store information it provides based on the results of emotion analysis. If it detects that the user is feeling tired, it will provide coupons for products that promote relaxation and information on the nearest spa. If the user is happy, it will provide information on restaurants and travel with special offers.

[0441] Specific examples

[0442] For example, when a user goes shopping at a convenience store, the terminal collects payment information and sends it to the server, which stores the information in a household account database. If the user feels stressed, the server can provide coupons for relaxation products or the nearest spa.

[0443] Prompt Sentence Examples

[0444] "Explain the design of a household finance app that uses an emotion engine."

[0445] "Please tell me more about the feature that provides personalized coupons based on user sentiment."

[0446] "Please create a system for setting a monthly budget and transferring any surplus funds to asset management."

[0447] As described above, the present invention is a system that realizes personalized suggestions and expenditure management according to the user's emotional state, and provides comprehensive support for the user's household finance management.

[0448] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0449] Step 1:

[0450] The user makes a payment

[0451] Input: A user makes a payment using an electronic payment system.

[0452] Specific operation: A user uses a smartphone or tablet to pay for a product using an electronic payment app.

[0453] Output: Payment information (date and time, amount, store name, purchased product information, etc.) is generated on the terminal.

[0454] Step 2:

[0455] The terminal sends the payment information

[0456] Input: Payment information is generated on the terminal.

[0457] What happens: Your device uses Wi-Fi or mobile data to send payment information to a server.

[0458] Output: Payment information is sent to the server.

[0459] Step 3:

[0460] The server receives and records the payment information

[0461] Input: Payment information is sent to the server.

[0462] Specific operation: The server analyzes the payment information and records it in the household accounting database. Data analysis includes extracting information such as date, time, amount, store name, and purchased product information.

[0463] Output: Parsed payment information is saved in the household account database.

[0464] Step 4:

[0465] The user manually enters other payment information

[0466] Input: A user makes a payment using cash or other electronic payment methods.

[0467] What happens: A user uses the manual entry feature within the app to enter cash or credit card payment information.

[0468] Output: Manually entered payment information is generated on the terminal.

[0469] Step 5:

[0470] The terminal sends the manually entered payment information

[0471] Input: Manually entered payment information is generated.

[0472] What happens: The device uses Wi-Fi or mobile data to send manually entered payment information to a server.

[0473] Output: Manually entered payment information is sent to the server.

[0474] Step 6:

[0475] The server records manually entered payment information

[0476] Input: Manually entered payment information is sent to the server.

[0477] Specific operation: The server analyzes the manually entered information and records it in the household accounting database. The analyzed information includes detailed information such as payment date and time, amount, and expenditure details.

[0478] Output: Parsed manual payment information is saved in the household finance database.

[0479] Step 7:

[0480] The server analyzes and records purchase history

[0481] Input: Payment information received by the server.

[0482] Specific operation: The server analyzes the JAN code of the payment information, identifies the purchased item, and records the purchase history for each item in the database.

[0483] Output: Purchase history managed by product is saved in the database.

[0484] Step 8:

[0485] User searches purchase history

[0486] Input: A user searches for a specific product or category.

[0487] What happens: A user uses the app's search function to enter a product name or category and perform a search.

[0488] Output: The user's input information is sent to the server.

[0489] Step 9:

[0490] The server searches for and displays the purchase history

[0491] Input: The user's search query.

[0492] Specific operation: The server retrieves the relevant purchase history from the household accounting database and presents the results to the user. The database search is performed using an SQL query.

[0493] Output: The acquired purchase history information is sent to the user's device.

[0494] Step 10:

[0495] The server generates coupons and store information

[0496] Input: User purchase history data.

[0497] Specific operation: The server runs an algorithm that generates discount coupons and store information within the user's living area based on past purchase history.

[0498] Output: The generated coupons and store information are saved on the server.

[0499] Step 11:

[0500] The server presents the coupon and store information

[0501] Input: Generated coupon information and store information.

[0502] Specific operation: The server sends the generated information to the user's device as a push notification or in-app message.

[0503] Output: Coupon information and store information are displayed on the user's device.

[0504] Step 12:

[0505] The user sets up asset management

[0506] Input: User sets monthly budget and asset management settings.

[0507] Specific operation: The user enters their monthly budget in the settings screen within the app and sets up automatic transfer of surplus funds to an investment destination.

[0508] Output: The configuration information is saved to the device.

[0509] Step 13:

[0510] The device sends the configuration information

[0511] Input: Monthly budget and investment settings information.

[0512] Specific operation: The device sends the setting information to the server.

[0513] Output: The configuration information is sent to the server.

[0514] Step 14:

[0515] Server manages budget and spending

[0516] Input: Monthly budget settings and spending information from your household finance database.

[0517] How it works: The server compares the configured monthly budget with the actual spending information and checks for any surplus. An algorithm is used to compare the data.

[0518] Output: The confirmed surplus amount is saved in the database.

[0519] Step 15:

[0520] The server connects to the asset management API

[0521] Input: Confirmed surplus amount and affiliated asset management service API information.

[0522] Specific operation: The server sends a surplus transfer request to the asset management API. The request includes details such as the API key and the surplus amount.

[0523] Output: Surplus funds are transferred to the partner asset management service.

[0524] Step 16:

[0525] The device recognizes emotional data

[0526] Input: Emotional data such as user facial expressions and voice.

[0527] Specific operation: The device uses the camera and microphone to activate the emotion engine, recognize the user's emotions, and collect data.

[0528] Output: The collected emotion data is saved on the device.

[0529] Step 17:

[0530] The device sends emotion data

[0531] Input: Collected emotion data.

[0532] Specific operation: The device sends emotion data to the server.

[0533] Output: Emotion data is sent to the server.

[0534] Step 18:

[0535] The server analyzes the emotional data

[0536] Input: Submitted emotion data.

[0537] How it works: The server uses an emotion analysis algorithm to analyze the user's emotional state, including their stress level and relaxation level.

[0538] Output: The analysis results are saved on the server.

[0539] Step 19:

[0540] The server generates sentiment-based suggestions

[0541] Input: Sentiment analysis results and purchase history data.

[0542] Specific operation: The server executes the proposed algorithm based on the emotional data and generates coupons and store information according to the user's emotional state.

[0543] Output: The sentiment-based suggestion information is generated and stored on the server.

[0544] Step 20:

[0545] The server provides emotion-based suggestions

[0546] Input: Sentiment-based suggestion information.

[0547] Specific operation: The server sends the suggestion information to the user's device and displays it within the app.

[0548] Output: Customized suggestions based on emotions are displayed on the user's device.

[0549] (Application example 2)

[0550] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0551] While modern electronic payment services excel at recording payment information, they are limited in their ability to provide personalized spending management and suggestions that take users' emotions into account. Furthermore, they are unable to provide appropriate suggestions based on users' emotions, such as when they are stressed or relaxed, making it difficult to efficiently manage assets and curb impulsive spending. To address these issues, a system is needed that can grasp users' emotional states in real time and provide personalized spending management and suggestions based on those emotions.

[0552] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a household account book recording means that cooperates with an electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase history by product and presents the results; a suggestion means that provides advantageous coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an emotion recognition means that recognizes emotions from the user's facial expressions, voice, and text and acquires emotion data; and a means that analyzes the emotion data and generates individual expenditure management and suggestions based on the user's emotional state. This enables personalized expenditure management and suggestions based on the user's emotional state.

[0553] "Specific electronic payment system" refers to any system that allows payment for goods or services by electronic means.

[0554] "Household accounting recording means" refers to a means that has the function of automatically collecting and recording the user's payment information.

[0555] "Database Means" means a means for storing and managing payment information and manually entered expenditure information in digital form.

[0556] "Search means" refers to a means that has the function of searching for information in a database based on specific conditions and presenting the results to the user.

[0557] The "proposal means" refers to a means that has the function of generating and providing advantageous coupons and store information based on the user's purchase history and expenditure information.

[0558] "Asset management instrument" refers to an instrument that has the function of automatically transferring surplus funds to asset management based on conditions set by the user.

[0559] "Emotion recognition means" refers to a means that has the function of recognizing emotions from a user's facial expressions, voice, and text, and acquiring that data.

[0560] "Emotion data analysis means" refers to means having the function of analyzing acquired emotion data and grasping the current emotional state of the user.

[0561] "Personalized spending management tool" refers to a tool that has the function of providing individually tailored spending management based on the user's emotional state.

[0562] The system for implementing this invention is a combination of a specific electronic payment system, emotion recognition means, database means, suggestion means, search means, and asset management means. The operation of each means will be explained in order.

[0563] System Program

[0564] This system is constructed using the following hardware and software.

[0565] Hardware: Smartphone (camera, microphone)

[0566] Software: Emotion API (emotion recognition), Firebase (real-time database), payment gateway API (e.g., PayPal's API), asset management service API (e.g., a general asset management service API), Python (Flask, TensorFlow)

[0567] Natural language explanation of program processing

[0568] 1. Acquisition and recording of electronic payment information

[0569] The server uses the payment gateway API to obtain the user's payment information, including the date, time, amount, store information, and purchased product information. The obtained payment information is recorded in the Firebase database.

[0570] 2. Collecting and analyzing emotion data

[0571] The device uses the smartphone's camera and microphone to collect user emotional data via the Emotion API, which is analyzed from facial expressions, voice, and text input and sent to and stored in a Firebase database.

[0572] 3. Manage and search your purchase history

[0573] The server manages purchase history on a product-by-product basis, and when a user performs a search, it retrieves the relevant history information from the Firebase database and presents it to the user.

[0574] 4. Generating personalized suggestions

[0575] The server retrieves emotion data and purchase history from the Firebase database and analyzes it using a generative AI model powered by TensorFlow. Based on the analysis results, it generates personalized suggestions, such as coupons and store information, that match the user's emotional state and purchasing habits, and notifies them to the user.

[0576] 5. Asset management setup and transfer

[0577] Users set a monthly budget through the app and set up their asset management system to transfer any surplus funds. The server checks the surplus funds at the end of the month and automatically transfers them to the asset management system via the asset management API.

[0578] Specific examples

[0579] When a user makes an electronic payment at a restaurant, the information is automatically recorded in the household account book.

[0580] If the app recognizes the user's facial expression as indicating stress, it will provide coupon information for products with a relaxing effect.

[0581] If the user sets up automatic transfer of surplus funds to a specified investment, the amount will be automatically transferred at the end of the month.

[0582] Prompt Sentence Examples

[0583] "What information is recorded in the household ledger after a user pays at a restaurant?"

[0584] "If a user is identified as 'stressed' through the emotion engine, what kind of coupon information will be offered?"

[0585] In this way, the present invention makes users' lives more efficient and enables them to manage their spending in a personalized manner according to their emotions.

[0586] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0587] Step 1:

[0588] The user makes an electronic payment. When the user makes an electronic payment at a store, the terminal obtains payment information (date and time, amount, store name, and purchased product information) through the payment gateway API. The terminal then sends the obtained payment information to the server.

[0589] Step 2:

[0590] The server saves the received payment information in a database. The server connects to Firebase and records the payment information in a database. The input is the payment information and the output is the payment information saved in the database.

[0591] Step 3:

[0592] The device collects the user's emotional data. When the user uses the app, the device's camera and microphone are used to collect facial expressions, voice, text, etc. via the Emotion API. The collected emotional data is then sent from the device to the server.

[0593] Step 4:

[0594] The server saves the emotion data in a database. The server connects to Firebase and records the emotion data in a database. The input is emotion data, and the output is emotion data saved in the database.

[0595] Step 5:

[0596] The user searches for purchase history. The user enters search criteria into the app to search for the purchase history of a specific product. The device sends these criteria to the server.

[0597] Step 6:

[0598] The server retrieves the relevant purchase history from the database and sends the results to the terminal. The server searches the database and retrieves purchase history that matches the conditions. The input is the search conditions, and the output is the purchase history as a search result.

[0599] Step 7:

[0600] The server generates personalized suggestions. The server retrieves emotion data and purchase history from Firebase and analyzes it using a generative AI model using TensorFlow. Through the analysis, it generates suggestions based on the user's emotional state and purchasing tendencies. The input is emotion data and purchase history, and the output is personalized suggestions.

[0601] Step 8:

[0602] The server sends the generated suggestions to the device, which then notifies the user of the suggestions and displays them in the app, allowing the user to receive coupons and store information tailored to their emotional state.

[0603] Step 9:

[0604] The user sets up asset management. The user sets a monthly budget within the app and enters the conditions for transferring surplus funds to asset management. The device sends the setting information to the server.

[0605] Step 10:

[0606] The server checks the surplus at the end of the month and automatically transfers it to the asset management account set through the asset management service API. The input is the user's budget setting and expenditure information, and the output is the transferred surplus.

[0607] This process flow allows users to efficiently manage their spending and receive personalized, emotion-based recommendations.

[0608] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0609] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0610] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0611] [Second embodiment]

[0612] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0613] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0614] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0615] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0616] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0617] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0618] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0619] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0620] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0621] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0622] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0623] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0624] The embodiment of the present invention starts by linking with a specific electronic payment system. Specific embodiments of the functions of the present invention and the processing of the programs are explained below in natural language.

[0625] Automatic household accounting

[0626] The terminal makes the payment

[0627] A user makes a payment using an electronic payment system (e.g., an electronic wallet in a mobile app). This includes paying for goods or services in a store via an electronic payment system.

[0628] The server receives and records the data

[0629] After the payment is completed, the terminal sends the payment information to the server. The server receives this payment information, analyzes it, and records it in the household accounting database. For example, data such as the payment date and time, amount, store name, and purchased item (using JAN code) are recorded.

[0630] Linking other payment methods

[0631] User enters other payments

[0632] Users can manually enter cash payments or other electronic payment methods (e.g., credit card, direct debit) within the app, which then sends these inputs to the server.

[0633] The server records the data in a database

[0634] The server receives the manually entered payment information and records it appropriately in the household accounting database.

[0635] Purchase history management and search function

[0636] History management for each product

[0637] The server organizes purchase history by product using the JAN code included in each payment information, allowing users to record in detail when, where and which products they purchased.

[0638] User searches purchase history

[0639] When a user searches for a specific product or category in the app, the server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[0640] Example: When a user searches for past purchase history of "milk," the server retrieves all purchase history related to "milk" from the household accounting database and displays details such as purchase date, store name, and price.

[0641] Providing discount coupons and store information

[0642] The server generates the proposal

[0643] The server analyzes the user's purchase history and generates relevant coupons and local store information based on past purchasing patterns and specific product categories.

[0644] Present suggestions to the user

[0645] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[0646] Example: For the item "bread" that a user frequently purchases, useful information is provided to the user by presenting discount coupons and information on new bakeries.

[0647] Asset management setup and transfer

[0648] The user sets up asset management

[0649] Users can set a monthly budget within the app and set up settings to transfer any surplus funds to an asset management account, such as automatically transferring 5,000 yen to a savings account every month.

[0650] Server manages budget and spending

[0651] The server manages the user's set budget and actual expenditure information, and checks the surplus at the end of the month.

[0652] Linking with asset management API

[0653] At the end of the month, the server automatically sends a request to transfer any surplus funds to the asset management destination via the API of the affiliated asset management service.

[0654] Example: A user sets a budget for book purchases, and if they have any money left over that month, the surplus is automatically transferred to a mutual fund account.

[0655] With each of the above functions, users can automatically manage their spending and manage their household finances efficiently. Furthermore, by managing detailed purchase histories and providing information on special offers, spending can be optimized, and surplus funds can be utilized for asset management, improving overall household management. In this way, the present invention is a system that aims to automate and streamline household finance management.

[0656] The processing flow will be explained below.

[0657] Step 1:

[0658] A user pays for goods and services at a store using a specific electronic payment system.

[0659] Step 2:

[0660] After the payment is completed, the terminal retrieves the payment information, which includes details such as the payment date and time, amount, store name, and purchased items (using JAN codes).

[0661] Step 3:

[0662] The terminal transmits the acquired payment information to the server using the HTTPS protocol.

[0663] Step 4:

[0664] The server receives the payment information from the terminal and checks the data for consistency, including the validity of the amount and date.

[0665] Step 5:

[0666] The server records the payment information, whose integrity has been confirmed, in the database. The server then inserts the payment date and time, amount, store name, and purchased product information into the household account book database.

[0667] Step 6:

[0668] A user manually enters a cash payment or other electronic payment (such as a credit card or direct debit) within the app.

[0669] Step 7:

[0670] The payment information entered by the user is sent from the terminal to the server.

[0671] Step 8:

[0672] The server receives the manually entered payment information and records it in a database.

[0673] Step 9:

[0674] The server analyzes the JAN code of the purchased item and obtains the product information. This information is then updated in the database.

[0675] Step 10:

[0676] The server organizes purchase history by product and allows users to search for purchase history by specific criteria.

[0677] Step 11:

[0678] A user searches their purchase history for a specific product or category within the app.

[0679] Step 12:

[0680] The server retrieves the relevant purchase history from the household account book database and sends the results to the user's terminal.

[0681] Step 13:

[0682] The server analyzes the user's purchase history and generates relevant discount coupons and store information.

[0683] Step 14:

[0684] The server sends the generated coupons and store information in JSON format to the user's device and presents them to the user.

[0685] Step 15:

[0686] Users set a monthly budget within the app and set up their surplus funds to be transferred to asset management.

[0687] Step 16:

[0688] The terminal transmits the set budget information to the server.

[0689] Step 17:

[0690] The server compares the set budget with actual spending and identifies any surplus at the end of the month.

[0691] Step 18:

[0692] The server makes a request through the API of its partner asset management service to transfer the surplus funds to the user's asset management account.

[0693] By following these steps, users can automatically record and manage their expenses, and also obtain useful information and manage their assets automatically.

[0694] Example 1

[0695] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0696] In recent years, the spread of electronic payment systems has made daily payments easier and faster, but at the same time, it has created the challenge of making spending management more complex. Traditional household accounting is often done manually, requiring time and effort, and is prone to omissions and input errors. There is also a demand for integrated systems with more advanced functions, such as the ability to search purchase history, provide discount coupons, and automate asset management, in addition to managing spending information. However, there is still a problem in that the technology to effectively integrate and automate these functions is insufficient.

[0697] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0698] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a proposal means that provides advantageous discount coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; a proposal generation means that generates coupons and store information based on specific product categories and notifies the user's terminal; and an asset management linking means that manages the user's set budget and actual expenditures at the end of the month and transfers surplus funds to an affiliated asset management service. This automates the user's expenditure management, streamlines daily household management, and provides comprehensive support ranging from advantageous information to asset management.

[0699] A "specific electronic payment system" is a system that, unlike general payment methods, completes transactions using dedicated electronic devices and applications.

[0700] The "household account book recording means" is a device or software that has the function of automatically collecting payment information made by the user and recording it in the form of a household account book.

[0701] "Payment Information" refers to information regarding the date, time, amount, location of a payment, and the item purchased.

[0702] "Manually entered expenditure information" refers to information about expenditures that is manually entered by a user via an application.

[0703] "Database Measures" means the systems and software used to store and manage payment information and manually entered expenditure information.

[0704] "Purchase history by product" refers to the history of past purchases of a specific product, such as the date, time, place, and amount.

[0705] "Search means" refers to a function or device that allows a user to search for specific information.

[0706] A "discount coupon" is a coupon that allows you to receive a discount when purchasing goods or services.

[0707] "Store information" refers to information about stores that users can visit (location, business hours, products sold, etc.).

[0708] The "proposing means" refers to a function or device for providing useful information (discount coupons, store information, etc.) to the user.

[0709] "Surplus" refers to the difference between the budget set by the user and the amount of expenditure that is less than the budget set by the user.

[0710] "Asset management" refers to a series of tasks and activities aimed at increasing assets by managing income or surplus funds.

[0711] The "proposal generating means" refers to a function or device for generating coupons and store information based on a user's purchase history or a specific product category, and notifying the user of the coupons and store information.

[0712] "Asset management linkage means" refers to functions and devices that link with affiliated asset management services and automatically transfer surplus funds to the investment destination.

[0713] The present invention is a household management system that starts by linking with an electronic payment system. To implement this system, specific hardware and software are used to collect, analyze, record, search, propose, and link asset management data.

[0714] Hardware and software used

[0715] 1. Terminal (user's mobile device):

[0716] E-wallet app: Used by users to make payments.

[0717] Household accounting app: An app for manually entering payment information, searching purchase history, and setting up settings.

[0718] 2. Server:

[0719] Data receiving and analysis system: Receives and analyzes payment information and manually entered information sent from the user's device.

[0720] Database System: A system for storing payment information and manually entered information.

[0721] Proposal generation system: A system for generating coupons and store information based on purchase history.

[0722] Asset management collaboration system: Collaborates with affiliated asset management services to automatically transfer surplus funds.

[0723] Explanation of program processing

[0724] Automatic household accounting

[0725] When a user uses an electronic wallet app to purchase goods or services at a store, the device sends payment information (payment date and time, amount, store name, and JAN code of the purchased goods) to the server. The server analyzes the received information and records it in the household account book database.

[0726] Example: A user buys bread for 500 yen at a convenience store at 2 p.m. one day, and the information is automatically recorded in the household account book.

[0727] Linking other payment methods

[0728] Users manually enter cash payments and credit card information using forms within the household accounting app, which is then sent from the device to the server and recorded in a database.

[0729] Example: If a user manually enters "Purchase bread for 500 yen with cash at a convenience store on March 1, 2023," that information will be reflected in the household account book.

[0730] Purchase history management and search function

[0731] The server uses the JAN code included in the payment information to organize purchase history by product. When a user searches the purchase history of a specific product or category in the household accounting app, the server retrieves the relevant data from the database and presents it on the device.

[0732] Example: When a user searches for "milk," all of the milk they have ever purchased is displayed.

[0733] Providing discount coupons and store information

[0734] The server analyzes the user's purchase history and generates relevant coupons and store information within the user's area. The generated information is sent to the device and notified to the user within the household account book app.

[0735] Example: A user is offered a 20% discount coupon for a bread they frequently purchase on weekends.

[0736] Asset management setup and transfer

[0737] Users set a monthly budget within the household accounting app and configure asset management settings. At the end of the month, the server manages the budget and actual expenditures, and sends a request to the partner service API to automatically transfer any surplus funds to the asset management organization.

[0738] Example: A user sets a monthly budget for book purchases, and if there is a surplus, the surplus is automatically transferred to a mutual fund.

[0739] Examples of prompt statements

[0740] Please explain the program process for generating and notifying coupons for frequently purchased items.

[0741] ---

[0742] In this way, the present invention manages a variety of electronic payment information in an integrated manner, and realizes the automation of household management and asset management.

[0743] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0744] Automatic household accounting

[0745] Step 1: The user makes a payment at the store using the mobile app's e-wallet.

[0746] Input: Purchase information for goods or services at a store (e.g., 1 loaf of bread, 500 yen).

[0747] What happens: A user completes a payment transaction using an e-wallet app.

[0748] Step 2: The terminal sends the payment information to the server.

[0749] Input: Payment information after payment is completed (payment date and time, amount, store name, JAN code of purchased item, etc.).

[0750] How it works: The terminal sends payment information to the server using the HTTPS protocol.

[0751] Output: The payment information received by the server.

[0752] Step 3: The server receives and records the data.

[0753] Input: Payment information sent from the terminal.

[0754] Operation: The server analyzes the payment information received and extracts the payment date and time, amount, store name, purchased item information, etc.

[0755] Output: The analyzed data is recorded in the household accounting database.

[0756] Linking other payment methods

[0757] Step 1: User enters another payment.

[0758] Input: Cash payment or credit card information (e.g. 500 yen in cash, 1000 yen by credit card).

[0759] What it does: A user manually enters payment information using an in-app form.

[0760] Step 2: The app sends the input information to the server.

[0761] Input: Payment information entered manually.

[0762] How it works: The app sends the input information to the server using the HTTPS protocol.

[0763] Output: Manually entered information received by the server.

[0764] Step 3: The server records the data in a database.

[0765] Input: The user's manually entered payment information.

[0766] Operation: The server parses the received manual entry information and records it in a database.

[0767] Output: The manually entered information is saved in the household accounting database.

[0768] Purchase history management and search function

[0769] Step 1: Manage product history on a product-by-product basis.

[0770] Input: JAN code included in payment information.

[0771] How it works: The server analyzes payment information and organizes the purchase history for each product using the JAN code.

[0772] Output: The organized purchase history for each product is saved in a database.

[0773] Step 2: User searches purchase history.

[0774] Input: The user enters search criteria (e.g., product name or category) into the app.

[0775] What it does: A user searches their purchase history for a specific product or category within an app.

[0776] Output: The server retrieves the relevant purchase history from the database.

[0777] Step 3: The server presents the purchase history to the user.

[0778] Input: Purchase history obtained by the server.

[0779] Operation: The server sends the acquired purchase history to the user's device.

[0780] Output: The app displays the user's purchase history (e.g., details such as purchase date, store name, and price).

[0781] Providing discount coupons and store information

[0782] Step 1: The server generates a proposal.

[0783] Input: User purchase history data.

[0784] How it works: The server analyzes a user's purchase history and generates discount coupons and store information based on specific product categories.

[0785] Output: Generated coupon information and store information.

[0786] Step 2: The server presents the proposal to the user.

[0787] Input: Generated coupon information and store information.

[0788] Operation: The server generates information and sends it to the user's device.

[0789] Output: The app notifies and displays coupon information and store information to the user.

[0790] Asset management setup and transfer

[0791] Step 1: The user sets up asset management.

[0792] Input: Set your monthly budget and asset management (e.g., transfer 5,000 yen per month to your savings account).

[0793] How it works: Users set their monthly budget and asset management within the app.

[0794] Output: The set budget information and asset management information are saved on the server.

[0795] Step 2: The server manages the budget and spending.

[0796] Input: User's budget information and actual spending information.

[0797] How it works: The server manages the user's set budget and actual spending information in conjunction with each other.

[0798] Output: The surplus data is obtained at the end of the month.

[0799] Step 3: The server connects to the asset management API and transfers the funds.

[0800] Input: Surplus cash data and asset management information.

[0801] Operation: The server generates a request to transfer surplus funds to an asset management destination and sends the request through the affiliated asset management service API.

[0802] Output: Surplus funds are automatically transferred to the investment account.

[0803] (Application example 1)

[0804] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0805] While conventional household accounting systems have the ability to automatically record electronic payment information, they lack comprehensive consumer support functions, such as spending management using smartphones or other devices and coupon generation functions. This makes it difficult for users to grasp their spending situation, and efficient support for spending control and asset management is needed. Furthermore, the provision of information on deals based on purchase history is limited, and users are not sufficiently encouraged to engage in beneficial consumption behavior. A comprehensive system is needed to resolve these issues and enable users to manage their household finances efficiently and effectively.

[0806] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0807] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a suggestion means that provides discount coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an expenditure management means that is installed on a smartphone, smart glasses, a head-mounted display, or an automated device; and a coupon generation means that uses an application based on the payment history. This allows users to automatically record expenditures made via electronic payments, comprehensively manage their household finances through their smart devices, and obtain information on advantageous offers based on their purchase history.

[0808] An "electronic payment system" is a system that allows users to pay for goods and services electronically.

[0809] A "household account book recording means" is a device or application that has the function of automatically recording payment information using an electronic payment system.

[0810] "Database Means" means a storage device or system for storing and managing payment information and expenditure information manually entered by a User.

[0811] The "search means" is a device or application that searches the purchase history recorded in the database on a product-by-product basis and presents the results to the user.

[0812] The "proposal means" is a device or system that has the function of generating discount coupons and store information based on the user's purchase history and providing them to the user.

[0813] An "asset management instrument" is a device or system that has the function of automatically transferring surplus funds to asset management within the range of expenditures set by the user.

[0814] "Expense management tool" means an application installed on a smartphone, smart glasses, head-mounted display, or automated device that has the function of managing and monitoring a user's expenses.

[0815] The "coupon generating means" is a device or system that has the function of generating advantageous discount information based on the user's payment history.

[0816] An embodiment of the present invention is realized by using a system that works in conjunction with a specific electronic payment system. This system automatically records a user's spending information, makes suggestions based on their purchase history, and utilizes surplus funds for asset management. Specific embodiments of each function of the present invention and the system's processing are explained in natural language below.

[0817] First, when a user makes a payment using the electronic payment system, the terminal sends the payment information to the server. The server receives this payment information, analyzes data such as the payment date and time, amount, store name, and purchased items, and records it in the household accounting database. Users can also manually enter payment information for cash payments or other electronic payment methods within the app, and this information is also recorded in the database.

[0818] Next, to manage purchase histories on a product-by-product basis, the server organizes past purchase histories using the product identification code included in each payment information. Users can search for purchase history for specific products or categories within the app, and the server retrieves the relevant purchase history and presents it to the user. For example, if a user searches for past purchase history for "milk," the server retrieves all purchase history related to "milk" from the household accounting database and displays details such as purchase date, store name, and price.

[0819] The system also has the ability to analyze a user's purchase history and provide relevant coupons and store information. The server generates coupon information based on purchase patterns and specific product categories, and sends and displays it on the user's device. For example, the system can provide useful information to the user by presenting coupons and new store information for "bread," which the user frequently purchases.

[0820] Regarding asset management settings, users can set a monthly budget within the app and set up the transfer of any surplus funds to their asset management account. Based on the user's settings, the server checks the surplus funds at the end of the month and automatically requests the transfer to the asset management account via the API of the partner asset management service. For example, if a user sets up a monthly transfer of 5,000 yen to a specific investment trust account, the surplus funds for that month will be automatically transferred to the investment trust account.

[0821] These functions are implemented by the following hardware and software:

[0822] Hardware: smartphones, servers, databases

[0823] Software: Python, libraries for API integration (e.g., requests), database system (e.g., SQLite)

[0824] An example of a prompt sentence would be the following text:

[0825] "You are looking to develop an application that automatically records a user's electronic payment information in a household ledger and also supports asset management. In particular, the application should include the following features: automatic recording of payment information, support for manual entry, search for purchase history, provide coupons, and asset management of surplus funds."

[0826] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0827] Step 1:

[0828] The user makes a payment using an electronic payment system.

[0829] What it does: A user pays for goods and services at a store using an electronic payment application on their smartphone.

[0830] Input: Payment information (payment date and time, amount, store name, purchased items, etc.).

[0831] Output: Payment information is captured by the terminal.

[0832] Step 2:

[0833] The terminal sends the payment information to the server.

[0834] Specific operation: After the payment is completed, the smartphone's electronic payment application automatically sends the payment information to the server.

[0835] Input: Payment information.

[0836] Output: Payment information is received by the server.

[0837] Step 3:

[0838] The server records the received payment information in a database.

[0839] Specific operation: The server saves the received payment information in the database and records it in the household accounting database.

[0840] Input: Payment information.

[0841] Output: Payment information recorded in the household accounting database.

[0842] Step 4:

[0843] The user manually enters another payment method within the app.

[0844] What happens: A user manually enters payment information for a cash or other electronic payment method and sends it to a server through an application.

[0845] Input: Manually entered payment information.

[0846] Output: Manually entered payment information is received by the server.

[0847] Step 5:

[0848] The server records the manually entered payment information in a database.

[0849] Specific operation: The server receives manually entered payment information and records it in the household accounting database.

[0850] Input: Manually entered payment information.

[0851] Output: Manual payment information recorded in the household accounting database.

[0852] Step 6:

[0853] The server manages purchase history on a product-by-product basis.

[0854] Specific operation: The server organizes the purchase history using the product identification code included in each payment information.

[0855] Input: Payment information recorded in the household accounting database.

[0856] Output: An organized purchase history.

[0857] Step 7:

[0858] The user searches for their purchase history within the app.

[0859] What happens: A user searches for a product or category in their purchase history within an app. The app sends the query to the server.

[0860] Input: Search query (e.g. product name "Milk").

[0861] Output: A display of the purchase history specified by the user.

[0862] Step 8:

[0863] The server presents the search results to the user.

[0864] Specific operation: The server retrieves the relevant purchase history from the household account book database and sends it to the user's terminal for display.

[0865] Input: Search results from the purchase history database.

[0866] Output: Purchase history displayed on the user's device.

[0867] Step 9:

[0868] The server generates advantageous coupons and store information based on purchase history.

[0869] Specific operation: The server analyzes the user's purchase history and generates relevant discount information and store information.

[0870] Input: Purchase history data.

[0871] Output: Generated coupon information and store information.

[0872] Step 10:

[0873] The server transmits the generated coupon information and store information to the user terminal.

[0874] Specific operation: The server sends the generated coupon information and store information to the user's device and displays it within the app.

[0875] Input: Generated coupon information and store information.

[0876] Output: Coupon information and store information displayed on the user's device.

[0877] Step 11:

[0878] Users set up their asset management settings within the app.

[0879] How it works: Users enter their monthly budget and the amount of surplus money they want to use for asset management within the app.

[0880] Input: Monthly budget and financial settings.

[0881] Output: Budget and investment settings stored on the server.

[0882] Step 12:

[0883] The server checks the surplus at the end of the month and transfers it to asset management.

[0884] Specific operation: The server compares the user's monthly budget with their actual spending, and if there is a surplus, it automatically sends a request to transfer the surplus to the asset management provider via the API of the affiliated asset management service.

[0885] Input: Actual expenditure data, budget data, API information of partner asset management services.

[0886] Output: Surplus transferred to investment destination.

[0887] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0888] In one embodiment of the present invention, the objective is to provide personalized spending management and suggestions based on the user's emotions by linking with a specific electronic payment system and combining an emotion engine with a system that streamlines household management.

[0889] Automatic household accounting

[0890] The terminal makes the payment

[0891] When a user pays for a product or service at a store using an electronic payment system, payment information (date and time, amount, store name, purchased product information, etc.) is generated.

[0892] The server receives and records the data

[0893] After the payment is completed, the terminal sends the payment information to the server, which receives it, analyzes it, and records it in the household account book database.

[0894] Linking other payment methods

[0895] User enters other payments

[0896] If the user manually enters cash payments or other electronic payment methods (credit cards, direct debit, etc.), these entries are also sent to the server.

[0897] The server records the data

[0898] The server receives the manually entered payment information and records it in the household account book database.

[0899] Purchase history management and search function

[0900] History management for each product

[0901] The server analyzes the JAN code included in the payment information and manages the purchase history for each product, allowing users to track in detail when and where they purchased which products.

[0902] User searches purchase history

[0903] When a user searches for a purchase history for a specific product or category, the server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[0904] Providing discount coupons and store information

[0905] The server generates the proposal

[0906] The server generates discount coupons and store information within the user's living area based on the user's purchase history.

[0907] Present suggestions to the user

[0908] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[0909] Asset management setup and transfer

[0910] The user sets up asset management

[0911] Users set a monthly budget within the app and set up their assets to receive any surplus funds.

[0912] Server manages budget and spending

[0913] The server compares the set budget with actual spending and identifies any surplus at the end of the month.

[0914] Linking with asset management API

[0915] The server automatically sends a request to transfer the surplus funds to the asset management destination via the API of the affiliated asset management service.

[0916] Combining Emotion Engines

[0917] emotion recognition

[0918] The device is equipped with an emotion engine that recognizes the user's emotions from their facial expressions, voice, text, etc. When the user uses the app, emotion data is collected using the device's camera and microphone.

[0919] Sending emotional data

[0920] The device transmits emotional data acquired by the emotion engine to the server, including information such as whether the user is relaxed or stressed.

[0921] Emotional Data Analysis

[0922] The server analyzes the emotional data to understand the user's current emotional state, and uses this information to analyze spending patterns and predict future spending.

[0923] Example: A server uses the user's emotional data to provide coupons for relaxation products and services to users who are feeling stressed, and makes investment and savings suggestions to users when they are in a positive emotional state.

[0924] Emotion-based suggestions

[0925] The server customizes the coupons and store information to be provided based on the user's emotions recognized by the emotion engine.

[0926] Example: If the server detects that the user is feeling tired, it will provide coupons for products that promote relaxation or information about the nearest spa. If the user is happy, it will provide information about restaurants and trips with special offers.

[0927] In this way, by combining the emotion engine, personalized suggestions and expenditure management based on the user's emotional state become possible. The present invention is a system that provides comprehensive support for the user's household finances, realizing more efficient and satisfying expenditure management.

[0928] The processing flow will be explained below.

[0929] Step 1:

[0930] A user pays for goods and services at a store using a specific electronic payment system.

[0931] Step 2:

[0932] After the payment is completed, the terminal retrieves payment information, including the payment date and time, amount, store name, and details of the purchased item (including JAN code).

[0933] Step 3:

[0934] The terminal transmits the acquired payment information to the server using the HTTPS protocol.

[0935] Step 4:

[0936] The server receives the payment information from the terminal and checks the data for consistency, including the validity of the amount and date.

[0937] Step 5:

[0938] The server records the payment information, whose integrity has been confirmed, in the household account book database, inserting the payment date and time, amount, store name, and details of the purchased item.

[0939] Step 6:

[0940] A user manually enters a cash payment or other electronic payment (e.g., credit card, direct debit) within the app.

[0941] Step 7:

[0942] The payment information entered by the user is sent from the terminal to the server.

[0943] Step 8:

[0944] The server receives the manually entered payment information and records it in the household account database.

[0945] Step 9:

[0946] The server analyzes the JAN code of the purchased item and updates the database with the product information based on that.

[0947] Step 10:

[0948] The server organizes purchase history by product and allows users to search for purchase history by specific criteria.

[0949] Step 11:

[0950] A user searches their purchase history for a specific product or category within the app.

[0951] Step 12:

[0952] The server retrieves the relevant purchase history from the household account book database and sends the results to the user's terminal.

[0953] Step 13:

[0954] The server analyzes the user's purchase history and generates relevant discount coupons and store information.

[0955] Step 14:

[0956] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[0957] Step 15:

[0958] Users set a monthly budget within the app and set up their surplus funds to be transferred to asset management.

[0959] Step 16:

[0960] The terminal transmits the set budget information to the server.

[0961] Step 17:

[0962] The server compares the set budget with the actual expenditure and checks the surplus at the end of the month.

[0963] Step 18:

[0964] The server makes a request to transfer the surplus funds to the user's asset management account through the API of the asset management service it is affiliated with.

[0965] Step 19:

[0966] The device uses an emotion engine to analyze the user's facial expressions, voice, text, etc. to obtain emotional data, including information such as whether the user is relaxed or stressed.

[0967] Step 20:

[0968] The device transmits the emotion data to the server.

[0969] Step 21:

[0970] The server analyzes the emotional data and understands the user's current emotional state.

[0971] Step 22:

[0972] The server customizes the coupons and store information it provides based on the emotion data. For example, if it detects that the user is tired, it will provide relaxation-related coupons and store information.

[0973] Step 23:

[0974] The server transmits the customized coupons and store information to the user's terminal and presents them to the user.

[0975] These steps allow users to not only automatically record and manage their spending, but also receive personalized suggestions based on their emotional state, and efficiently utilize their surplus funds for asset management.

[0976] Example 2

[0977] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0978] While conventional household management systems provide the ability to automatically record users' spending information and the ability to manually input some payment information, they lack the ability to provide personalized spending management and suggestions that take into account the user's emotional state. This makes it difficult to provide optimal spending management and suggestions based on the user's current psychological state, making it difficult to improve user satisfaction.

[0979] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0980] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a suggestion means that provides advantageous coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an emotion recognition means that recognizes and collects user emotion data; an emotion analysis means that analyzes the user's emotional state based on the collected emotion data; and a suggestion customization means that customizes suggestions based on the emotion analysis results. This enables personalized expenditure management and suggestions according to the user's emotional state, thereby improving user satisfaction and spending efficiency.

[0981] The "household account book recording means" is a function that works in conjunction with a specific electronic payment system and automatically records payment information using the electronic payment system.

[0982] "Database Means" refers to a facility that stores payment information and manually entered expenditure information.

[0983] The "search means" is a function for searching purchase history on a product-by-product basis and displaying the results.

[0984] "Proposal means" is a function that provides advantageous coupons and store information based on purchase history.

[0985] "Asset management tools" are functions that automatically transfer surplus funds to asset management based on a spending plan.

[0986] The "emotion recognition means" is a function that recognizes and collects the user's emotional data.

[0987] The "emotion analysis means" is a function that analyzes the user's emotional state based on the collected emotional data.

[0988] The "suggestion customization means" is a function that makes optimal suggestions to individual users based on the results of emotion analysis.

[0989] The present invention aims to provide personalized spending management and suggestions based on the user's emotions by linking with a specific electronic payment system and combining an emotion engine with a system that streamlines household management.

[0990] Automatic household accounting

[0991] The terminal makes the payment

[0992] Users use their smartphones or tablets to pay for goods and services at stores through an electronic payment app, and payment information (date, time, amount, store name, purchased product information, etc.) is generated on the device.

[0993] The device sends data

[0994] After the payment is completed, the device sends the payment information to the server, typically over Wi-Fi or mobile data.

[0995] The server receives and records the data

[0996] The server analyzes the received payment information and records it in a household account database, which is used to efficiently manage expenditure information.

[0997] Linking other payment methods

[0998] User enters other payments

[0999] Users manually enter cash payments or other electronic payment methods (credit cards, direct debit, etc.) through an app on their device.

[1000] The device sends data

[1001] The terminal sends the manually entered payment information to the server.

[1002] The server records the data

[1003] The server receives the manually entered payment information and records it in the household account database.

[1004] Purchase history management and search function

[1005] The server analyzes the data

[1006] The server analyzes the JAN code included in the payment information and manages the purchase history for each product. This data is used by users to track their past spending.

[1007] User searches purchase history

[1008] Users can use the search function within the app to search for purchase history for a specific product or category. The server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[1009] Providing discount coupons and store information

[1010] The server generates coupons and store information

[1011] The server generates discount coupons and store information within the user's living area based on the user's purchase history.

[1012] The server makes a proposal

[1013] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[1014] Asset management setup and transfer

[1015] The user sets up asset management

[1016] Users set a monthly budget within the app and set up their assets to receive any surplus funds.

[1017] Server manages budget and spending

[1018] The server compares the set budget with the actual spending and checks for any surplus at the end of the month.

[1019] Linking with asset management API

[1020] The server automatically transfers the surplus funds through the affiliated asset management service API.

[1021] Combining Emotion Engines

[1022] The device recognizes emotions

[1023] The device is equipped with an emotion engine that uses a camera and microphone to recognize the user's emotions, analyzing the user's facial expressions and voice to obtain emotional data.

[1024] The device sends data

[1025] The device transmits the emotion data acquired by the emotion engine to the server.

[1026] The server analyzes the emotional data

[1027] The server analyzes the emotional data to understand the user's emotional state, and uses this information to analyze spending patterns and predict future spending.

[1028] The server generates sentiment-based suggestions

[1029] The server customizes the coupons and store information it provides based on the results of emotion analysis. If it detects that the user is feeling tired, it will provide coupons for products that promote relaxation and information on the nearest spa. If the user is happy, it will provide information on restaurants and travel with special offers.

[1030] Specific examples

[1031] For example, when a user goes shopping at a convenience store, the terminal collects payment information and sends it to the server, which stores the information in a household account database. If the user feels stressed, the server can provide coupons for relaxation products or the nearest spa.

[1032] Prompt Sentence Examples

[1033] "Explain the design of a household finance app that uses an emotion engine."

[1034] "Please tell me more about the feature that provides personalized coupons based on user sentiment."

[1035] "Please create a system for setting a monthly budget and transferring any surplus funds to asset management."

[1036] As described above, the present invention is a system that realizes personalized suggestions and expenditure management according to the user's emotional state, and provides comprehensive support for the user's household finance management.

[1037] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1038] Step 1:

[1039] The user makes a payment

[1040] Input: A user makes a payment using an electronic payment system.

[1041] Specific operation: A user uses a smartphone or tablet to pay for a product using an electronic payment app.

[1042] Output: Payment information (date and time, amount, store name, purchased product information, etc.) is generated on the terminal.

[1043] Step 2:

[1044] The terminal sends the payment information

[1045] Input: Payment information is generated on the terminal.

[1046] What happens: Your device uses Wi-Fi or mobile data to send payment information to a server.

[1047] Output: Payment information is sent to the server.

[1048] Step 3:

[1049] The server receives and records the payment information

[1050] Input: Payment information is sent to the server.

[1051] Specific operation: The server analyzes the payment information and records it in the household accounting database. Data analysis includes extracting information such as date, time, amount, store name, and purchased product information.

[1052] Output: Parsed payment information is saved in the household account database.

[1053] Step 4:

[1054] The user manually enters other payment information

[1055] Input: A user makes a payment using cash or other electronic payment methods.

[1056] What happens: A user uses the manual entry feature within the app to enter cash or credit card payment information.

[1057] Output: Manually entered payment information is generated on the terminal.

[1058] Step 5:

[1059] The terminal sends the manually entered payment information

[1060] Input: Manually entered payment information is generated.

[1061] What happens: The device uses Wi-Fi or mobile data to send manually entered payment information to a server.

[1062] Output: Manually entered payment information is sent to the server.

[1063] Step 6:

[1064] The server records manually entered payment information

[1065] Input: Manually entered payment information is sent to the server.

[1066] Specific operation: The server analyzes the manually entered information and records it in the household accounting database. The analyzed information includes detailed information such as payment date and time, amount, and expenditure details.

[1067] Output: Parsed manual payment information is saved in the household finance database.

[1068] Step 7:

[1069] The server analyzes and records purchase history

[1070] Input: Payment information received by the server.

[1071] Specific operation: The server analyzes the JAN code of the payment information, identifies the purchased item, and records the purchase history for each item in the database.

[1072] Output: Purchase history managed by product is saved in the database.

[1073] Step 8:

[1074] User searches purchase history

[1075] Input: A user searches for a specific product or category.

[1076] What happens: A user uses the app's search function to enter a product name or category and perform a search.

[1077] Output: The user's input information is sent to the server.

[1078] Step 9:

[1079] The server searches for and displays the purchase history

[1080] Input: The user's search query.

[1081] Specific operation: The server retrieves the relevant purchase history from the household accounting database and presents the results to the user. The database search is performed using an SQL query.

[1082] Output: The acquired purchase history information is sent to the user's device.

[1083] Step 10:

[1084] The server generates coupons and store information

[1085] Input: User purchase history data.

[1086] Specific operation: The server runs an algorithm that generates discount coupons and store information within the user's living area based on past purchase history.

[1087] Output: The generated coupons and store information are saved on the server.

[1088] Step 11:

[1089] The server presents the coupon and store information

[1090] Input: Generated coupon information and store information.

[1091] Specific operation: The server sends the generated information to the user's device as a push notification or in-app message.

[1092] Output: Coupon information and store information are displayed on the user's device.

[1093] Step 12:

[1094] The user sets up asset management

[1095] Input: User sets monthly budget and asset management settings.

[1096] Specific operation: The user enters their monthly budget in the settings screen within the app and sets up automatic transfer of surplus funds to an investment destination.

[1097] Output: The configuration information is saved to the device.

[1098] Step 13:

[1099] The device sends the configuration information

[1100] Input: Monthly budget and investment settings information.

[1101] Specific operation: The device sends the setting information to the server.

[1102] Output: The configuration information is sent to the server.

[1103] Step 14:

[1104] Server manages budget and spending

[1105] Input: Monthly budget settings and spending information from your household finance database.

[1106] How it works: The server compares the configured monthly budget with the actual spending information and checks for any surplus. An algorithm is used to compare the data.

[1107] Output: The confirmed surplus amount is saved in the database.

[1108] Step 15:

[1109] The server connects to the asset management API

[1110] Input: Confirmed surplus amount and affiliated asset management service API information.

[1111] Specific operation: The server sends a surplus transfer request to the asset management API. The request includes details such as the API key and the surplus amount.

[1112] Output: Surplus funds are transferred to the partner asset management service.

[1113] Step 16:

[1114] The device recognizes emotional data

[1115] Input: Emotional data such as user facial expressions and voice.

[1116] Specific operation: The device uses the camera and microphone to activate the emotion engine, recognize the user's emotions, and collect data.

[1117] Output: The collected emotion data is saved on the device.

[1118] Step 17:

[1119] The device sends emotion data

[1120] Input: Collected emotion data.

[1121] Specific operation: The device sends emotion data to the server.

[1122] Output: Emotion data is sent to the server.

[1123] Step 18:

[1124] The server analyzes the emotional data

[1125] Input: Submitted emotion data.

[1126] How it works: The server uses an emotion analysis algorithm to analyze the user's emotional state, including their stress level and relaxation level.

[1127] Output: The analysis results are saved on the server.

[1128] Step 19:

[1129] The server generates sentiment-based suggestions

[1130] Input: Sentiment analysis results and purchase history data.

[1131] Specific operation: The server executes the proposed algorithm based on the emotional data and generates coupons and store information according to the user's emotional state.

[1132] Output: The sentiment-based suggestion information is generated and stored on the server.

[1133] Step 20:

[1134] The server provides emotion-based suggestions

[1135] Input: Sentiment-based suggestion information.

[1136] Specific operation: The server sends the suggestion information to the user's device and displays it within the app.

[1137] Output: Customized suggestions based on emotions are displayed on the user's device.

[1138] (Application example 2)

[1139] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1140] While modern electronic payment services excel at recording payment information, they are limited in their ability to provide personalized spending management and suggestions that take users' emotions into account. Furthermore, they are unable to provide appropriate suggestions based on users' emotions, such as when they are stressed or relaxed, making it difficult to efficiently manage assets and curb impulsive spending. To address these issues, a system is needed that can grasp users' emotional states in real time and provide personalized spending management and suggestions based on those emotions.

[1141] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a household account book recording means that cooperates with an electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase history by product and presents the results; a suggestion means that provides advantageous coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an emotion recognition means that recognizes emotions from the user's facial expressions, voice, and text and acquires emotion data; and a means that analyzes the emotion data and generates individual expenditure management and suggestions based on the user's emotional state. This enables personalized expenditure management and suggestions based on the user's emotional state.

[1142] "Specific electronic payment system" refers to any system that allows payment for goods or services by electronic means.

[1143] "Household accounting recording means" refers to a means that has the function of automatically collecting and recording the user's payment information.

[1144] "Database Means" means a means for storing and managing payment information and manually entered expenditure information in digital form.

[1145] "Search means" refers to a means that has the function of searching for information in a database based on specific conditions and presenting the results to the user.

[1146] The "proposal means" refers to a means that has the function of generating and providing advantageous coupons and store information based on the user's purchase history and expenditure information.

[1147] "Asset management instrument" refers to an instrument that has the function of automatically transferring surplus funds to asset management based on conditions set by the user.

[1148] "Emotion recognition means" refers to a means that has the function of recognizing emotions from a user's facial expressions, voice, and text, and acquiring that data.

[1149] "Emotion data analysis means" refers to means having the function of analyzing acquired emotion data and grasping the current emotional state of the user.

[1150] "Personalized spending management tool" refers to a tool that has the function of providing individually tailored spending management based on the user's emotional state.

[1151] The system for implementing this invention is a combination of a specific electronic payment system, emotion recognition means, database means, suggestion means, search means, and asset management means. The operation of each means will be explained in order.

[1152] System Program

[1153] This system is constructed using the following hardware and software.

[1154] Hardware: Smartphone (camera, microphone)

[1155] Software: Emotion API (emotion recognition), Firebase (real-time database), payment gateway API (e.g., PayPal's API), asset management service API (e.g., a general asset management service API), Python (Flask, TensorFlow)

[1156] Natural language explanation of program processing

[1157] 1. Acquisition and recording of electronic payment information

[1158] The server uses the payment gateway API to obtain the user's payment information, including the date, time, amount, store information, and purchased product information. The obtained payment information is recorded in the Firebase database.

[1159] 2. Collecting and analyzing emotion data

[1160] The device uses the smartphone's camera and microphone to collect user emotional data via the Emotion API, which is analyzed from facial expressions, voice, and text input and sent to and stored in a Firebase database.

[1161] 3. Manage and search your purchase history

[1162] The server manages purchase history on a product-by-product basis, and when a user performs a search, it retrieves the relevant history information from the Firebase database and presents it to the user.

[1163] 4. Generating personalized suggestions

[1164] The server retrieves emotion data and purchase history from the Firebase database and analyzes it using a generative AI model powered by TensorFlow. Based on the analysis results, it generates personalized suggestions, such as coupons and store information, that match the user's emotional state and purchasing habits, and notifies them to the user.

[1165] 5. Asset management setup and transfer

[1166] Users set a monthly budget through the app and set up their asset management system to transfer any surplus funds. The server checks the surplus funds at the end of the month and automatically transfers them to the asset management system via the asset management API.

[1167] Specific examples

[1168] When a user makes an electronic payment at a restaurant, the information is automatically recorded in the household account book.

[1169] If the app recognizes the user's facial expression as indicating stress, it will provide coupon information for products with a relaxing effect.

[1170] If the user sets up automatic transfer of surplus funds to a specified investment, the amount will be automatically transferred at the end of the month.

[1171] Prompt Sentence Examples

[1172] "What information is recorded in the household ledger after a user pays at a restaurant?"

[1173] "If a user is identified as 'stressed' through the emotion engine, what kind of coupon information will be offered?"

[1174] In this way, the present invention makes users' lives more efficient and enables them to manage their spending in a personalized manner according to their emotions.

[1175] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1176] Step 1:

[1177] The user makes an electronic payment. When the user makes an electronic payment at a store, the terminal obtains payment information (date and time, amount, store name, and purchased product information) through the payment gateway API. The terminal then sends the obtained payment information to the server.

[1178] Step 2:

[1179] The server saves the received payment information in a database. The server connects to Firebase and records the payment information in a database. The input is the payment information and the output is the payment information saved in the database.

[1180] Step 3:

[1181] The device collects the user's emotional data. When the user uses the app, the device's camera and microphone are used to collect facial expressions, voice, text, etc. via the Emotion API. The collected emotional data is then sent from the device to the server.

[1182] Step 4:

[1183] The server saves the emotion data in a database. The server connects to Firebase and records the emotion data in a database. The input is emotion data, and the output is emotion data saved in the database.

[1184] Step 5:

[1185] The user searches for purchase history. The user enters search criteria into the app to search for the purchase history of a specific product. The device sends these criteria to the server.

[1186] Step 6:

[1187] The server retrieves the relevant purchase history from the database and sends the results to the terminal. The server searches the database and retrieves purchase history that matches the conditions. The input is the search conditions, and the output is the purchase history as a search result.

[1188] Step 7:

[1189] The server generates personalized suggestions. The server retrieves emotion data and purchase history from Firebase and analyzes it using a generative AI model using TensorFlow. Through the analysis, it generates suggestions based on the user's emotional state and purchasing tendencies. The input is emotion data and purchase history, and the output is personalized suggestions.

[1190] Step 8:

[1191] The server sends the generated suggestions to the device, which then notifies the user of the suggestions and displays them in the app, allowing the user to receive coupons and store information tailored to their emotional state.

[1192] Step 9:

[1193] The user sets up asset management. The user sets a monthly budget within the app and enters the conditions for transferring surplus funds to asset management. The device sends the setting information to the server.

[1194] Step 10:

[1195] The server checks the surplus at the end of the month and automatically transfers it to the asset management account set through the asset management service API. The input is the user's budget setting and expenditure information, and the output is the transferred surplus.

[1196] This process flow allows users to efficiently manage their spending and receive personalized, emotion-based recommendations.

[1197] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1198] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1199] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1200] [Third embodiment]

[1201] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1202] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1203] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1204] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1205] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1206] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1207] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1208] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1209] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1210] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1211] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1212] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1213] The embodiment of the present invention starts by linking with a specific electronic payment system. Specific embodiments of the functions of the present invention and the processing of the programs are explained below in natural language.

[1214] Automatic household accounting

[1215] The terminal makes the payment

[1216] A user makes a payment using an electronic payment system (e.g., an electronic wallet in a mobile app). This includes paying for goods or services in a store via an electronic payment system.

[1217] The server receives and records the data

[1218] After the payment is completed, the terminal sends the payment information to the server. The server receives this payment information, analyzes it, and records it in the household accounting database. For example, data such as the payment date and time, amount, store name, and purchased item (using JAN code) are recorded.

[1219] Linking other payment methods

[1220] User enters other payments

[1221] Users can manually enter cash payments or other electronic payment methods (e.g., credit card, direct debit) within the app, which then sends these inputs to the server.

[1222] The server records the data in a database

[1223] The server receives the manually entered payment information and records it appropriately in the household accounting database.

[1224] Purchase history management and search function

[1225] History management for each product

[1226] The server organizes purchase history by product using the JAN code included in each payment information, allowing users to record in detail when, where and which products they purchased.

[1227] User searches purchase history

[1228] When a user searches for a specific product or category in the app, the server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[1229] Example: When a user searches for past purchase history of "milk," the server retrieves all purchase history related to "milk" from the household accounting database and displays details such as purchase date, store name, and price.

[1230] Providing discount coupons and store information

[1231] The server generates the proposal

[1232] The server analyzes the user's purchase history and generates relevant coupons and local store information based on past purchasing patterns and specific product categories.

[1233] Present suggestions to the user

[1234] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[1235] Example: For the item "bread" that a user frequently purchases, useful information is provided to the user by presenting discount coupons and information on new bakeries.

[1236] Asset management setup and transfer

[1237] The user sets up asset management

[1238] Users can set a monthly budget within the app and set up settings to transfer any surplus funds to an asset management account, such as automatically transferring 5,000 yen to a savings account every month.

[1239] Server manages budget and spending

[1240] The server manages the user's set budget and actual expenditure information, and checks the surplus at the end of the month.

[1241] Linking with asset management API

[1242] At the end of the month, the server automatically sends a request to transfer any surplus funds to the asset management destination via the API of the affiliated asset management service.

[1243] Example: A user sets a budget for book purchases, and if they have any money left over that month, the surplus is automatically transferred to a mutual fund account.

[1244] With each of the above functions, users can automatically manage their spending and manage their household finances efficiently. Furthermore, by managing detailed purchase histories and providing information on special offers, spending can be optimized, and surplus funds can be utilized for asset management, improving overall household management. In this way, the present invention is a system that aims to automate and streamline household finance management.

[1245] The processing flow will be explained below.

[1246] Step 1:

[1247] A user pays for goods and services at a store using a specific electronic payment system.

[1248] Step 2:

[1249] After the payment is completed, the terminal retrieves the payment information, which includes details such as the payment date and time, amount, store name, and purchased items (using JAN codes).

[1250] Step 3:

[1251] The terminal transmits the acquired payment information to the server using the HTTPS protocol.

[1252] Step 4:

[1253] The server receives the payment information from the terminal and checks the data for consistency, including the validity of the amount and date.

[1254] Step 5:

[1255] The server records the payment information, whose integrity has been confirmed, in the database. The server then inserts the payment date and time, amount, store name, and purchased product information into the household account book database.

[1256] Step 6:

[1257] A user manually enters a cash payment or other electronic payment (such as a credit card or direct debit) within the app.

[1258] Step 7:

[1259] The payment information entered by the user is sent from the terminal to the server.

[1260] Step 8:

[1261] The server receives the manually entered payment information and records it in a database.

[1262] Step 9:

[1263] The server analyzes the JAN code of the purchased item and obtains the product information. This information is then updated in the database.

[1264] Step 10:

[1265] The server organizes purchase history by product and allows users to search for purchase history by specific criteria.

[1266] Step 11:

[1267] A user searches their purchase history for a specific product or category within the app.

[1268] Step 12:

[1269] The server retrieves the relevant purchase history from the household account book database and sends the results to the user's terminal.

[1270] Step 13:

[1271] The server analyzes the user's purchase history and generates relevant discount coupons and store information.

[1272] Step 14:

[1273] The server sends the generated coupons and store information in JSON format to the user's device and presents them to the user.

[1274] Step 15:

[1275] Users set a monthly budget within the app and set up their surplus funds to be transferred to asset management.

[1276] Step 16:

[1277] The terminal transmits the set budget information to the server.

[1278] Step 17:

[1279] The server compares the set budget with actual spending and identifies any surplus at the end of the month.

[1280] Step 18:

[1281] The server makes a request through the API of its partner asset management service to transfer the surplus funds to the user's asset management account.

[1282] By following these steps, users can automatically record and manage their expenses, and also obtain useful information and manage their assets automatically.

[1283] Example 1

[1284] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1285] In recent years, the spread of electronic payment systems has made daily payments easier and faster, but at the same time, it has created the challenge of making spending management more complex. Traditional household accounting is often done manually, requiring time and effort, and is prone to omissions and input errors. There is also a demand for integrated systems with more advanced functions, such as the ability to search purchase history, provide discount coupons, and automate asset management, in addition to managing spending information. However, there is still a problem in that the technology to effectively integrate and automate these functions is insufficient.

[1286] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1287] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a proposal means that provides advantageous discount coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; a proposal generation means that generates coupons and store information based on specific product categories and notifies the user's terminal; and an asset management linking means that manages the user's set budget and actual expenditures at the end of the month and transfers surplus funds to an affiliated asset management service. This automates the user's expenditure management, streamlines daily household management, and provides comprehensive support ranging from advantageous information to asset management.

[1288] A "specific electronic payment system" is a system that, unlike general payment methods, completes transactions using dedicated electronic devices and applications.

[1289] The "household account book recording means" is a device or software that has the function of automatically collecting payment information made by the user and recording it in the form of a household account book.

[1290] "Payment Information" refers to information regarding the date, time, amount, location of a payment, and the item purchased.

[1291] "Manually entered expenditure information" refers to information about expenditures that is manually entered by a user via an application.

[1292] "Database Measures" means the systems and software used to store and manage payment information and manually entered expenditure information.

[1293] "Purchase history by product" refers to the history of past purchases of a specific product, such as the date, time, place, and amount.

[1294] "Search means" refers to a function or device that allows a user to search for specific information.

[1295] A "discount coupon" is a coupon that allows you to receive a discount when purchasing goods or services.

[1296] "Store information" refers to information about stores that users can visit (location, business hours, products sold, etc.).

[1297] The "proposing means" refers to a function or device for providing useful information (discount coupons, store information, etc.) to the user.

[1298] "Surplus" refers to the difference between the budget set by the user and the amount of expenditure that is less than the budget set by the user.

[1299] "Asset management" refers to a series of tasks and activities aimed at increasing assets by managing income or surplus funds.

[1300] The "proposal generating means" refers to a function or device for generating coupons and store information based on a user's purchase history or a specific product category, and notifying the user of the coupons and store information.

[1301] "Asset management linkage means" refers to functions and devices that link with affiliated asset management services and automatically transfer surplus funds to the investment destination.

[1302] The present invention is a household management system that starts by linking with an electronic payment system. To implement this system, specific hardware and software are used to collect, analyze, record, search, propose, and link asset management data.

[1303] Hardware and software used

[1304] 1. Terminal (user's mobile device):

[1305] E-wallet app: Used by users to make payments.

[1306] Household accounting app: An app for manually entering payment information, searching purchase history, and setting up settings.

[1307] 2. Server:

[1308] Data receiving and analysis system: Receives and analyzes payment information and manually entered information sent from the user's device.

[1309] Database System: A system for storing payment information and manually entered information.

[1310] Proposal generation system: A system for generating coupons and store information based on purchase history.

[1311] Asset management collaboration system: Collaborates with affiliated asset management services to automatically transfer surplus funds.

[1312] Explanation of program processing

[1313] Automatic household accounting

[1314] When a user uses an electronic wallet app to purchase goods or services at a store, the device sends payment information (payment date and time, amount, store name, and JAN code of the purchased goods) to the server. The server analyzes the received information and records it in the household account book database.

[1315] Example: A user buys bread for 500 yen at a convenience store at 2 p.m. one day, and the information is automatically recorded in the household account book.

[1316] Linking other payment methods

[1317] Users manually enter cash payments and credit card information using forms within the household accounting app, which is then sent from the device to the server and recorded in a database.

[1318] Example: If a user manually enters "Purchase bread for 500 yen with cash at a convenience store on March 1, 2023," that information will be reflected in the household account book.

[1319] Purchase history management and search function

[1320] The server uses the JAN code included in the payment information to organize purchase history by product. When a user searches the purchase history of a specific product or category in the household accounting app, the server retrieves the relevant data from the database and presents it on the device.

[1321] Example: When a user searches for "milk," all of the milk they have ever purchased is displayed.

[1322] Providing discount coupons and store information

[1323] The server analyzes the user's purchase history and generates relevant coupons and store information within the user's area. The generated information is sent to the device and notified to the user within the household account book app.

[1324] Example: A user is offered a 20% discount coupon for a bread they frequently purchase on weekends.

[1325] Asset management setup and transfer

[1326] Users set a monthly budget within the household accounting app and configure asset management settings. At the end of the month, the server manages the budget and actual expenditures, and sends a request to the partner service API to automatically transfer any surplus funds to the asset management organization.

[1327] Example: A user sets a monthly budget for book purchases, and if there is a surplus, the surplus is automatically transferred to a mutual fund.

[1328] Examples of prompt statements

[1329] Please explain the program process for generating and notifying coupons for frequently purchased items.

[1330] ---

[1331] In this way, the present invention manages a variety of electronic payment information in an integrated manner, and realizes the automation of household management and asset management.

[1332] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1333] Automatic household accounting

[1334] Step 1: The user makes a payment at the store using the mobile app's e-wallet.

[1335] Input: Purchase information for goods or services at a store (e.g., 1 loaf of bread, 500 yen).

[1336] What happens: A user completes a payment transaction using an e-wallet app.

[1337] Step 2: The terminal sends the payment information to the server.

[1338] Input: Payment information after payment is completed (payment date and time, amount, store name, JAN code of purchased item, etc.).

[1339] How it works: The terminal sends payment information to the server using the HTTPS protocol.

[1340] Output: The payment information received by the server.

[1341] Step 3: The server receives and records the data.

[1342] Input: Payment information sent from the terminal.

[1343] Operation: The server analyzes the payment information received and extracts the payment date and time, amount, store name, purchased item information, etc.

[1344] Output: The analyzed data is recorded in the household accounting database.

[1345] Linking other payment methods

[1346] Step 1: User enters another payment.

[1347] Input: Cash payment or credit card information (e.g. 500 yen in cash, 1000 yen by credit card).

[1348] What it does: A user manually enters payment information using an in-app form.

[1349] Step 2: The app sends the input information to the server.

[1350] Input: Payment information entered manually.

[1351] How it works: The app sends the input information to the server using the HTTPS protocol.

[1352] Output: Manually entered information received by the server.

[1353] Step 3: The server records the data in a database.

[1354] Input: The user's manually entered payment information.

[1355] Operation: The server parses the received manual entry information and records it in a database.

[1356] Output: The manually entered information is saved in the household accounting database.

[1357] Purchase history management and search function

[1358] Step 1: Manage product history on a product-by-product basis.

[1359] Input: JAN code included in payment information.

[1360] How it works: The server analyzes payment information and organizes the purchase history for each product using the JAN code.

[1361] Output: The organized purchase history for each product is saved in a database.

[1362] Step 2: User searches purchase history.

[1363] Input: The user enters search criteria (e.g., product name or category) into the app.

[1364] What it does: A user searches their purchase history for a specific product or category within an app.

[1365] Output: The server retrieves the relevant purchase history from the database.

[1366] Step 3: The server presents the purchase history to the user.

[1367] Input: Purchase history obtained by the server.

[1368] Operation: The server sends the acquired purchase history to the user's device.

[1369] Output: The app displays the user's purchase history (e.g., details such as purchase date, store name, and price).

[1370] Providing discount coupons and store information

[1371] Step 1: The server generates a proposal.

[1372] Input: User purchase history data.

[1373] How it works: The server analyzes a user's purchase history and generates discount coupons and store information based on specific product categories.

[1374] Output: Generated coupon information and store information.

[1375] Step 2: The server presents the proposal to the user.

[1376] Input: Generated coupon information and store information.

[1377] Operation: The server generates information and sends it to the user's device.

[1378] Output: The app notifies and displays coupon information and store information to the user.

[1379] Asset management setup and transfer

[1380] Step 1: The user sets up asset management.

[1381] Input: Set your monthly budget and asset management (e.g., transfer 5,000 yen per month to your savings account).

[1382] How it works: Users set their monthly budget and asset management within the app.

[1383] Output: The set budget information and asset management information are saved on the server.

[1384] Step 2: The server manages the budget and spending.

[1385] Input: User's budget information and actual spending information.

[1386] How it works: The server manages the user's set budget and actual spending information in conjunction with each other.

[1387] Output: The surplus data is obtained at the end of the month.

[1388] Step 3: The server connects to the asset management API and transfers the funds.

[1389] Input: Surplus cash data and asset management information.

[1390] Operation: The server generates a request to transfer surplus funds to an asset management destination and sends the request through the affiliated asset management service API.

[1391] Output: Surplus funds are automatically transferred to the investment account.

[1392] (Application example 1)

[1393] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1394] While conventional household accounting systems have the ability to automatically record electronic payment information, they lack comprehensive consumer support functions, such as spending management using smartphones or other devices and coupon generation functions. This makes it difficult for users to grasp their spending situation, and efficient support for spending control and asset management is needed. Furthermore, the provision of information on deals based on purchase history is limited, and users are not sufficiently encouraged to engage in beneficial consumption behavior. A comprehensive system is needed to resolve these issues and enable users to manage their household finances efficiently and effectively.

[1395] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1396] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a suggestion means that provides discount coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an expenditure management means that is installed on a smartphone, smart glasses, a head-mounted display, or an automated device; and a coupon generation means that uses an application based on the payment history. This allows users to automatically record expenditures made via electronic payments, comprehensively manage their household finances through their smart devices, and obtain information on advantageous offers based on their purchase history.

[1397] An "electronic payment system" is a system that allows users to pay for goods and services electronically.

[1398] A "household account book recording means" is a device or application that has the function of automatically recording payment information using an electronic payment system.

[1399] "Database Means" means a storage device or system for storing and managing payment information and expenditure information manually entered by a User.

[1400] The "search means" is a device or application that searches the purchase history recorded in the database on a product-by-product basis and presents the results to the user.

[1401] The "proposal means" is a device or system that has the function of generating discount coupons and store information based on the user's purchase history and providing them to the user.

[1402] An "asset management instrument" is a device or system that has the function of automatically transferring surplus funds to asset management within the range of expenditures set by the user.

[1403] "Expense management tool" means an application installed on a smartphone, smart glasses, head-mounted display, or automated device that has the function of managing and monitoring a user's expenses.

[1404] The "coupon generating means" is a device or system that has the function of generating advantageous discount information based on the user's payment history.

[1405] An embodiment of the present invention is realized by using a system that works in conjunction with a specific electronic payment system. This system automatically records a user's spending information, makes suggestions based on their purchase history, and utilizes surplus funds for asset management. Specific embodiments of each function of the present invention and the system's processing are explained in natural language below.

[1406] First, when a user makes a payment using the electronic payment system, the terminal sends the payment information to the server. The server receives this payment information, analyzes data such as the payment date and time, amount, store name, and purchased items, and records it in the household accounting database. Users can also manually enter payment information for cash payments or other electronic payment methods within the app, and this information is also recorded in the database.

[1407] Next, to manage purchase histories on a product-by-product basis, the server organizes past purchase histories using the product identification code included in each payment information. Users can search for purchase history for specific products or categories within the app, and the server retrieves the relevant purchase history and presents it to the user. For example, if a user searches for past purchase history for "milk," the server retrieves all purchase history related to "milk" from the household accounting database and displays details such as purchase date, store name, and price.

[1408] The system also has the ability to analyze a user's purchase history and provide relevant coupons and store information. The server generates coupon information based on purchase patterns and specific product categories, and sends and displays it on the user's device. For example, the system can provide useful information to the user by presenting coupons and new store information for "bread," which the user frequently purchases.

[1409] Regarding asset management settings, users can set a monthly budget within the app and set up the transfer of any surplus funds to their asset management account. Based on the user's settings, the server checks the surplus funds at the end of the month and automatically requests the transfer to the asset management account via the API of the partner asset management service. For example, if a user sets up a monthly transfer of 5,000 yen to a specific investment trust account, the surplus funds for that month will be automatically transferred to the investment trust account.

[1410] These functions are implemented by the following hardware and software:

[1411] Hardware: smartphones, servers, databases

[1412] Software: Python, libraries for API integration (e.g., requests), database system (e.g., SQLite)

[1413] An example of a prompt sentence would be the following text:

[1414] "You are looking to develop an application that automatically records a user's electronic payment information in a household ledger and also supports asset management. In particular, the application should include the following features: automatic recording of payment information, support for manual entry, search for purchase history, provide coupons, and asset management of surplus funds."

[1415] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1416] Step 1:

[1417] The user makes a payment using an electronic payment system.

[1418] What it does: A user pays for goods and services at a store using an electronic payment application on their smartphone.

[1419] Input: Payment information (payment date and time, amount, store name, purchased items, etc.).

[1420] Output: Payment information is captured by the terminal.

[1421] Step 2:

[1422] The terminal sends the payment information to the server.

[1423] Specific operation: After the payment is completed, the smartphone's electronic payment application automatically sends the payment information to the server.

[1424] Input: Payment information.

[1425] Output: Payment information is received by the server.

[1426] Step 3:

[1427] The server records the received payment information in a database.

[1428] Specific operation: The server saves the received payment information in the database and records it in the household accounting database.

[1429] Input: Payment information.

[1430] Output: Payment information recorded in the household accounting database.

[1431] Step 4:

[1432] The user manually enters another payment method within the app.

[1433] What happens: A user manually enters payment information for a cash or other electronic payment method and sends it to a server through an application.

[1434] Input: Manually entered payment information.

[1435] Output: Manually entered payment information is received by the server.

[1436] Step 5:

[1437] The server records the manually entered payment information in a database.

[1438] Specific operation: The server receives manually entered payment information and records it in the household accounting database.

[1439] Input: Manually entered payment information.

[1440] Output: Manual payment information recorded in the household accounting database.

[1441] Step 6:

[1442] The server manages purchase history on a product-by-product basis.

[1443] Specific operation: The server organizes the purchase history using the product identification code included in each payment information.

[1444] Input: Payment information recorded in the household accounting database.

[1445] Output: An organized purchase history.

[1446] Step 7:

[1447] The user searches for their purchase history within the app.

[1448] What happens: A user searches for a product or category in their purchase history within an app. The app sends the query to the server.

[1449] Input: Search query (e.g. product name "Milk").

[1450] Output: A display of the purchase history specified by the user.

[1451] Step 8:

[1452] The server presents the search results to the user.

[1453] Specific operation: The server retrieves the relevant purchase history from the household account book database and sends it to the user's terminal for display.

[1454] Input: Search results from the purchase history database.

[1455] Output: Purchase history displayed on the user's device.

[1456] Step 9:

[1457] The server generates advantageous coupons and store information based on purchase history.

[1458] Specific operation: The server analyzes the user's purchase history and generates relevant discount information and store information.

[1459] Input: Purchase history data.

[1460] Output: Generated coupon information and store information.

[1461] Step 10:

[1462] The server transmits the generated coupon information and store information to the user terminal.

[1463] Specific operation: The server sends the generated coupon information and store information to the user's device and displays it within the app.

[1464] Input: Generated coupon information and store information.

[1465] Output: Coupon information and store information displayed on the user's device.

[1466] Step 11:

[1467] Users set up their asset management settings within the app.

[1468] How it works: Users enter their monthly budget and the amount of surplus money they want to use for asset management within the app.

[1469] Input: Monthly budget and financial settings.

[1470] Output: Budget and investment settings stored on the server.

[1471] Step 12:

[1472] The server checks the surplus at the end of the month and transfers it to asset management.

[1473] Specific operation: The server compares the user's monthly budget with their actual spending, and if there is a surplus, it automatically sends a request to transfer the surplus to the asset management provider via the API of the affiliated asset management service.

[1474] Input: Actual expenditure data, budget data, API information of partner asset management services.

[1475] Output: Surplus transferred to investment destination.

[1476] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1477] In one embodiment of the present invention, the objective is to provide personalized spending management and suggestions based on the user's emotions by linking with a specific electronic payment system and combining an emotion engine with a system that streamlines household management.

[1478] Automatic household accounting

[1479] The terminal makes the payment

[1480] When a user pays for a product or service at a store using an electronic payment system, payment information (date and time, amount, store name, purchased product information, etc.) is generated.

[1481] The server receives and records the data

[1482] After the payment is completed, the terminal sends the payment information to the server, which receives it, analyzes it, and records it in the household account book database.

[1483] Linking other payment methods

[1484] User enters other payments

[1485] If the user manually enters cash payments or other electronic payment methods (credit cards, direct debit, etc.), these entries are also sent to the server.

[1486] The server records the data

[1487] The server receives the manually entered payment information and records it in the household account book database.

[1488] Purchase history management and search function

[1489] History management for each product

[1490] The server analyzes the JAN code included in the payment information and manages the purchase history for each product, allowing users to track in detail when and where they purchased which products.

[1491] User searches purchase history

[1492] When a user searches for a purchase history for a specific product or category, the server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[1493] Providing discount coupons and store information

[1494] The server generates the proposal

[1495] The server generates discount coupons and store information within the user's living area based on the user's purchase history.

[1496] Present suggestions to the user

[1497] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[1498] Asset management setup and transfer

[1499] The user sets up asset management

[1500] Users set a monthly budget within the app and set up their assets to receive any surplus funds.

[1501] Server manages budget and spending

[1502] The server compares the set budget with actual spending and identifies any surplus at the end of the month.

[1503] Linking with asset management API

[1504] The server automatically sends a request to transfer the surplus funds to the asset management destination via the API of the affiliated asset management service.

[1505] Combining Emotion Engines

[1506] emotion recognition

[1507] The device is equipped with an emotion engine that recognizes the user's emotions from their facial expressions, voice, text, etc. When the user uses the app, emotion data is collected using the device's camera and microphone.

[1508] Sending emotional data

[1509] The device transmits emotional data acquired by the emotion engine to the server, including information such as whether the user is relaxed or stressed.

[1510] Emotional Data Analysis

[1511] The server analyzes the emotional data to understand the user's current emotional state, and uses this information to analyze spending patterns and predict future spending.

[1512] Example: A server uses the user's emotional data to provide coupons for relaxation products and services to users who are feeling stressed, and makes investment and savings suggestions to users when they are in a positive emotional state.

[1513] Emotion-based suggestions

[1514] The server customizes the coupons and store information to be provided based on the user's emotions recognized by the emotion engine.

[1515] Example: If the server detects that the user is feeling tired, it will provide coupons for products that promote relaxation or information about the nearest spa. If the user is happy, it will provide information about restaurants and trips with special offers.

[1516] In this way, by combining the emotion engine, personalized suggestions and expenditure management based on the user's emotional state become possible. The present invention is a system that provides comprehensive support for the user's household finances, realizing more efficient and satisfying expenditure management.

[1517] The processing flow will be explained below.

[1518] Step 1:

[1519] A user pays for goods and services at a store using a specific electronic payment system.

[1520] Step 2:

[1521] After the payment is completed, the terminal retrieves payment information, including the payment date and time, amount, store name, and details of the purchased item (including JAN code).

[1522] Step 3:

[1523] The terminal transmits the acquired payment information to the server using the HTTPS protocol.

[1524] Step 4:

[1525] The server receives the payment information from the terminal and checks the data for consistency, including the validity of the amount and date.

[1526] Step 5:

[1527] The server records the payment information, whose integrity has been confirmed, in the household account book database, inserting the payment date and time, amount, store name, and details of the purchased item.

[1528] Step 6:

[1529] A user manually enters a cash payment or other electronic payment (e.g., credit card, direct debit) within the app.

[1530] Step 7:

[1531] The payment information entered by the user is sent from the terminal to the server.

[1532] Step 8:

[1533] The server receives the manually entered payment information and records it in the household account database.

[1534] Step 9:

[1535] The server analyzes the JAN code of the purchased item and updates the database with the product information based on that.

[1536] Step 10:

[1537] The server organizes purchase history by product and allows users to search for purchase history by specific criteria.

[1538] Step 11:

[1539] A user searches their purchase history for a specific product or category within the app.

[1540] Step 12:

[1541] The server retrieves the relevant purchase history from the household account book database and sends the results to the user's terminal.

[1542] Step 13:

[1543] The server analyzes the user's purchase history and generates relevant discount coupons and store information.

[1544] Step 14:

[1545] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[1546] Step 15:

[1547] Users set a monthly budget within the app and set up their surplus funds to be transferred to asset management.

[1548] Step 16:

[1549] The terminal transmits the set budget information to the server.

[1550] Step 17:

[1551] The server compares the set budget with the actual expenditure and checks the surplus at the end of the month.

[1552] Step 18:

[1553] The server makes a request to transfer the surplus funds to the user's asset management account through the API of the asset management service it is affiliated with.

[1554] Step 19:

[1555] The device uses an emotion engine to analyze the user's facial expressions, voice, text, etc. to obtain emotional data, including information such as whether the user is relaxed or stressed.

[1556] Step 20:

[1557] The device transmits the emotion data to the server.

[1558] Step 21:

[1559] The server analyzes the emotional data and understands the user's current emotional state.

[1560] Step 22:

[1561] The server customizes the coupons and store information it provides based on the emotion data. For example, if it detects that the user is tired, it will provide relaxation-related coupons and store information.

[1562] Step 23:

[1563] The server transmits the customized coupons and store information to the user's terminal and presents them to the user.

[1564] These steps allow users to not only automatically record and manage their spending, but also receive personalized suggestions based on their emotional state, and efficiently utilize their surplus funds for asset management.

[1565] Example 2

[1566] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1567] While conventional household management systems provide the ability to automatically record users' spending information and the ability to manually input some payment information, they lack the ability to provide personalized spending management and suggestions that take into account the user's emotional state. This makes it difficult to provide optimal spending management and suggestions based on the user's current psychological state, making it difficult to improve user satisfaction.

[1568] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1569] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a suggestion means that provides advantageous coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an emotion recognition means that recognizes and collects user emotion data; an emotion analysis means that analyzes the user's emotional state based on the collected emotion data; and a suggestion customization means that customizes suggestions based on the emotion analysis results. This enables personalized expenditure management and suggestions according to the user's emotional state, thereby improving user satisfaction and spending efficiency.

[1570] The "household account book recording means" is a function that works in conjunction with a specific electronic payment system and automatically records payment information using the electronic payment system.

[1571] "Database Means" refers to a facility that stores payment information and manually entered expenditure information.

[1572] The "search means" is a function for searching purchase history on a product-by-product basis and displaying the results.

[1573] "Proposal means" is a function that provides advantageous coupons and store information based on purchase history.

[1574] "Asset management tools" are functions that automatically transfer surplus funds to asset management based on a spending plan.

[1575] The "emotion recognition means" is a function that recognizes and collects the user's emotional data.

[1576] The "emotion analysis means" is a function that analyzes the user's emotional state based on the collected emotional data.

[1577] The "suggestion customization means" is a function that makes optimal suggestions to individual users based on the results of emotion analysis.

[1578] The present invention aims to provide personalized spending management and suggestions based on the user's emotions by linking with a specific electronic payment system and combining an emotion engine with a system that streamlines household management.

[1579] Automatic household accounting

[1580] The terminal makes the payment

[1581] Users use their smartphones or tablets to pay for goods and services at stores through an electronic payment app, and payment information (date, time, amount, store name, purchased product information, etc.) is generated on the device.

[1582] The device sends data

[1583] After the payment is completed, the device sends the payment information to the server, typically over Wi-Fi or mobile data.

[1584] The server receives and records the data

[1585] The server analyzes the received payment information and records it in a household account database, which is used to efficiently manage expenditure information.

[1586] Linking other payment methods

[1587] User enters other payments

[1588] Users manually enter cash payments or other electronic payment methods (credit cards, direct debit, etc.) through an app on their device.

[1589] The device sends data

[1590] The terminal sends the manually entered payment information to the server.

[1591] The server records the data

[1592] The server receives the manually entered payment information and records it in the household account database.

[1593] Purchase history management and search function

[1594] The server analyzes the data

[1595] The server analyzes the JAN code included in the payment information and manages the purchase history for each product. This data is used by users to track their past spending.

[1596] User searches purchase history

[1597] Users can use the search function within the app to search for purchase history for a specific product or category. The server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[1598] Providing discount coupons and store information

[1599] The server generates coupons and store information

[1600] The server generates discount coupons and store information within the user's living area based on the user's purchase history.

[1601] The server makes a proposal

[1602] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[1603] Asset management setup and transfer

[1604] The user sets up asset management

[1605] Users set a monthly budget within the app and set up their assets to receive any surplus funds.

[1606] Server manages budget and spending

[1607] The server compares the set budget with the actual spending and checks for any surplus at the end of the month.

[1608] Linking with asset management API

[1609] The server automatically transfers the surplus funds through the affiliated asset management service API.

[1610] Combining Emotion Engines

[1611] The device recognizes emotions

[1612] The device is equipped with an emotion engine that uses a camera and microphone to recognize the user's emotions, analyzing the user's facial expressions and voice to obtain emotional data.

[1613] The device sends data

[1614] The device transmits the emotion data acquired by the emotion engine to the server.

[1615] The server analyzes the emotional data

[1616] The server analyzes the emotional data to understand the user's emotional state, and uses this information to analyze spending patterns and predict future spending.

[1617] The server generates sentiment-based suggestions

[1618] The server customizes the coupons and store information it provides based on the results of emotion analysis. If it detects that the user is feeling tired, it will provide coupons for products that promote relaxation and information on the nearest spa. If the user is happy, it will provide information on restaurants and travel with special offers.

[1619] Specific examples

[1620] For example, when a user goes shopping at a convenience store, the terminal collects payment information and sends it to the server, which stores the information in a household account database. If the user feels stressed, the server can provide coupons for relaxation products or the nearest spa.

[1621] Prompt Sentence Examples

[1622] "Explain the design of a household finance app that uses an emotion engine."

[1623] "Please tell me more about the feature that provides personalized coupons based on user sentiment."

[1624] "Please create a system for setting a monthly budget and transferring any surplus funds to asset management."

[1625] As described above, the present invention is a system that realizes personalized suggestions and expenditure management according to the user's emotional state, and provides comprehensive support for the user's household finance management.

[1626] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1627] Step 1:

[1628] The user makes a payment

[1629] Input: A user makes a payment using an electronic payment system.

[1630] Specific operation: A user uses a smartphone or tablet to pay for a product using an electronic payment app.

[1631] Output: Payment information (date and time, amount, store name, purchased product information, etc.) is generated on the terminal.

[1632] Step 2:

[1633] The terminal sends the payment information

[1634] Input: Payment information is generated on the terminal.

[1635] What happens: Your device uses Wi-Fi or mobile data to send payment information to a server.

[1636] Output: Payment information is sent to the server.

[1637] Step 3:

[1638] The server receives and records the payment information

[1639] Input: Payment information is sent to the server.

[1640] Specific operation: The server analyzes the payment information and records it in the household accounting database. Data analysis includes extracting information such as date, time, amount, store name, and purchased product information.

[1641] Output: Parsed payment information is saved in the household account database.

[1642] Step 4:

[1643] The user manually enters other payment information

[1644] Input: A user makes a payment using cash or other electronic payment methods.

[1645] What happens: A user uses the manual entry feature within the app to enter cash or credit card payment information.

[1646] Output: Manually entered payment information is generated on the terminal.

[1647] Step 5:

[1648] The terminal sends the manually entered payment information

[1649] Input: Manually entered payment information is generated.

[1650] What happens: The device uses Wi-Fi or mobile data to send manually entered payment information to a server.

[1651] Output: Manually entered payment information is sent to the server.

[1652] Step 6:

[1653] The server records manually entered payment information

[1654] Input: Manually entered payment information is sent to the server.

[1655] Specific operation: The server analyzes the manually entered information and records it in the household accounting database. The analyzed information includes detailed information such as payment date and time, amount, and expenditure details.

[1656] Output: Parsed manual payment information is saved in the household finance database.

[1657] Step 7:

[1658] The server analyzes and records purchase history

[1659] Input: Payment information received by the server.

[1660] Specific operation: The server analyzes the JAN code of the payment information, identifies the purchased item, and records the purchase history for each item in the database.

[1661] Output: Purchase history managed by product is saved in the database.

[1662] Step 8:

[1663] User searches purchase history

[1664] Input: A user searches for a specific product or category.

[1665] What happens: A user uses the app's search function to enter a product name or category and perform a search.

[1666] Output: The user's input information is sent to the server.

[1667] Step 9:

[1668] The server searches for and displays the purchase history

[1669] Input: The user's search query.

[1670] Specific operation: The server retrieves the relevant purchase history from the household accounting database and presents the results to the user. The database search is performed using an SQL query.

[1671] Output: The acquired purchase history information is sent to the user's device.

[1672] Step 10:

[1673] The server generates coupons and store information

[1674] Input: User purchase history data.

[1675] Specific operation: The server runs an algorithm that generates discount coupons and store information within the user's living area based on past purchase history.

[1676] Output: The generated coupons and store information are saved on the server.

[1677] Step 11:

[1678] The server presents the coupon and store information

[1679] Input: Generated coupon information and store information.

[1680] Specific operation: The server sends the generated information to the user's device as a push notification or in-app message.

[1681] Output: Coupon information and store information are displayed on the user's device.

[1682] Step 12:

[1683] The user sets up asset management

[1684] Input: User sets monthly budget and asset management settings.

[1685] Specific operation: The user enters their monthly budget in the settings screen within the app and sets up automatic transfer of surplus funds to an investment destination.

[1686] Output: The configuration information is saved to the device.

[1687] Step 13:

[1688] The device sends the configuration information

[1689] Input: Monthly budget and investment settings information.

[1690] Specific operation: The device sends the setting information to the server.

[1691] Output: The configuration information is sent to the server.

[1692] Step 14:

[1693] Server manages budget and spending

[1694] Input: Monthly budget settings and spending information from your household finance database.

[1695] How it works: The server compares the configured monthly budget with the actual spending information and checks for any surplus. An algorithm is used to compare the data.

[1696] Output: The confirmed surplus amount is saved in the database.

[1697] Step 15:

[1698] The server connects to the asset management API

[1699] Input: Confirmed surplus amount and affiliated asset management service API information.

[1700] Specific operation: The server sends a surplus transfer request to the asset management API. The request includes details such as the API key and the surplus amount.

[1701] Output: Surplus funds are transferred to the partner asset management service.

[1702] Step 16:

[1703] The device recognizes emotional data

[1704] Input: Emotional data such as user facial expressions and voice.

[1705] Specific operation: The device uses the camera and microphone to activate the emotion engine, recognize the user's emotions, and collect data.

[1706] Output: The collected emotion data is saved on the device.

[1707] Step 17:

[1708] The device sends emotion data

[1709] Input: Collected emotion data.

[1710] Specific operation: The device sends emotion data to the server.

[1711] Output: Emotion data is sent to the server.

[1712] Step 18:

[1713] The server analyzes the emotional data

[1714] Input: Submitted emotion data.

[1715] How it works: The server uses an emotion analysis algorithm to analyze the user's emotional state, including their stress level and relaxation level.

[1716] Output: The analysis results are saved on the server.

[1717] Step 19:

[1718] The server generates sentiment-based suggestions

[1719] Input: Sentiment analysis results and purchase history data.

[1720] Specific operation: The server executes the proposed algorithm based on the emotional data and generates coupons and store information according to the user's emotional state.

[1721] Output: The sentiment-based suggestion information is generated and stored on the server.

[1722] Step 20:

[1723] The server provides emotion-based suggestions

[1724] Input: Sentiment-based suggestion information.

[1725] Specific operation: The server sends the suggestion information to the user's device and displays it within the app.

[1726] Output: Customized suggestions based on emotions are displayed on the user's device.

[1727] (Application example 2)

[1728] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1729] While modern electronic payment services excel at recording payment information, they are limited in their ability to provide personalized spending management and suggestions that take users' emotions into account. Furthermore, they are unable to provide appropriate suggestions based on users' emotions, such as when they are stressed or relaxed, making it difficult to efficiently manage assets and curb impulsive spending. To address these issues, a system is needed that can grasp users' emotional states in real time and provide personalized spending management and suggestions based on those emotions.

[1730] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a household account book recording means that cooperates with an electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase history by product and presents the results; a suggestion means that provides advantageous coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an emotion recognition means that recognizes emotions from the user's facial expressions, voice, and text and acquires emotion data; and a means that analyzes the emotion data and generates individual expenditure management and suggestions based on the user's emotional state. This enables personalized expenditure management and suggestions based on the user's emotional state.

[1731] "Specific electronic payment system" refers to any system that allows payment for goods or services by electronic means.

[1732] "Household accounting recording means" refers to a means that has the function of automatically collecting and recording the user's payment information.

[1733] "Database Means" means a means for storing and managing payment information and manually entered expenditure information in digital form.

[1734] "Search means" refers to a means that has the function of searching for information in a database based on specific conditions and presenting the results to the user.

[1735] The "proposal means" refers to a means that has the function of generating and providing advantageous coupons and store information based on the user's purchase history and expenditure information.

[1736] "Asset management instrument" refers to an instrument that has the function of automatically transferring surplus funds to asset management based on conditions set by the user.

[1737] "Emotion recognition means" refers to a means that has the function of recognizing emotions from a user's facial expressions, voice, and text, and acquiring that data.

[1738] "Emotion data analysis means" refers to means having the function of analyzing acquired emotion data and grasping the current emotional state of the user.

[1739] "Personalized spending management tool" refers to a tool that has the function of providing individually tailored spending management based on the user's emotional state.

[1740] The system for implementing this invention is a combination of a specific electronic payment system, emotion recognition means, database means, suggestion means, search means, and asset management means. The operation of each means will be explained in order.

[1741] System Program

[1742] This system is constructed using the following hardware and software.

[1743] Hardware: Smartphone (camera, microphone)

[1744] Software: Emotion API (emotion recognition), Firebase (real-time database), payment gateway API (e.g., PayPal's API), asset management service API (e.g., a general asset management service API), Python (Flask, TensorFlow)

[1745] Natural language explanation of program processing

[1746] 1. Acquisition and recording of electronic payment information

[1747] The server uses the payment gateway API to obtain the user's payment information, including the date, time, amount, store information, and purchased product information. The obtained payment information is recorded in the Firebase database.

[1748] 2. Collecting and analyzing emotion data

[1749] The device uses the smartphone's camera and microphone to collect user emotional data via the Emotion API, which is analyzed from facial expressions, voice, and text input and sent to and stored in a Firebase database.

[1750] 3. Manage and search your purchase history

[1751] The server manages purchase history on a product-by-product basis, and when a user performs a search, it retrieves the relevant history information from the Firebase database and presents it to the user.

[1752] 4. Generating personalized suggestions

[1753] The server retrieves emotion data and purchase history from the Firebase database and analyzes it using a generative AI model powered by TensorFlow. Based on the analysis results, it generates personalized suggestions, such as coupons and store information, that match the user's emotional state and purchasing habits, and notifies them to the user.

[1754] 5. Asset management setup and transfer

[1755] Users set a monthly budget through the app and set up their asset management system to transfer any surplus funds. The server checks the surplus funds at the end of the month and automatically transfers them to the asset management system via the asset management API.

[1756] Specific examples

[1757] When a user makes an electronic payment at a restaurant, the information is automatically recorded in the household account book.

[1758] If the app recognizes the user's facial expression as indicating stress, it will provide coupon information for products with a relaxing effect.

[1759] If the user sets up automatic transfer of surplus funds to a specified investment, the amount will be automatically transferred at the end of the month.

[1760] Prompt Sentence Examples

[1761] "What information is recorded in the household ledger after a user pays at a restaurant?"

[1762] "If a user is identified as 'stressed' through the emotion engine, what kind of coupon information will be offered?"

[1763] In this way, the present invention makes users' lives more efficient and enables them to manage their spending in a personalized manner according to their emotions.

[1764] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1765] Step 1:

[1766] The user makes an electronic payment. When the user makes an electronic payment at a store, the terminal obtains payment information (date and time, amount, store name, and purchased product information) through the payment gateway API. The terminal then sends the obtained payment information to the server.

[1767] Step 2:

[1768] The server saves the received payment information in a database. The server connects to Firebase and records the payment information in a database. The input is the payment information and the output is the payment information saved in the database.

[1769] Step 3:

[1770] The device collects the user's emotional data. When the user uses the app, the device's camera and microphone are used to collect facial expressions, voice, text, etc. via the Emotion API. The collected emotional data is then sent from the device to the server.

[1771] Step 4:

[1772] The server saves the emotion data in a database. The server connects to Firebase and records the emotion data in a database. The input is emotion data, and the output is emotion data saved in the database.

[1773] Step 5:

[1774] The user searches for purchase history. The user enters search criteria into the app to search for the purchase history of a specific product. The device sends these criteria to the server.

[1775] Step 6:

[1776] The server retrieves the relevant purchase history from the database and sends the results to the terminal. The server searches the database and retrieves purchase history that matches the conditions. The input is the search conditions, and the output is the purchase history as a search result.

[1777] Step 7:

[1778] The server generates personalized suggestions. The server retrieves emotion data and purchase history from Firebase and analyzes it using a generative AI model using TensorFlow. Through the analysis, it generates suggestions based on the user's emotional state and purchasing tendencies. The input is emotion data and purchase history, and the output is personalized suggestions.

[1779] Step 8:

[1780] The server sends the generated suggestions to the device, which then notifies the user of the suggestions and displays them in the app, allowing the user to receive coupons and store information tailored to their emotional state.

[1781] Step 9:

[1782] The user sets up asset management. The user sets a monthly budget within the app and enters the conditions for transferring surplus funds to asset management. The device sends the setting information to the server.

[1783] Step 10:

[1784] The server checks the surplus at the end of the month and automatically transfers it to the asset management account set through the asset management service API. The input is the user's budget setting and expenditure information, and the output is the transferred surplus.

[1785] This process flow allows users to efficiently manage their spending and receive personalized, emotion-based recommendations.

[1786] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1787] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1788] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1789] [Fourth embodiment]

[1790] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1791] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1792] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1793] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1794] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1795] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1796] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1797] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1798] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1799] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1800] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1801] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1802] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1803] The embodiment of the present invention starts by linking with a specific electronic payment system. Specific embodiments of the functions of the present invention and the processing of the programs are explained below in natural language.

[1804] Automatic household accounting

[1805] The terminal makes the payment

[1806] A user makes a payment using an electronic payment system (e.g., an electronic wallet in a mobile app). This includes paying for goods or services in a store via an electronic payment system.

[1807] The server receives and records the data

[1808] After the payment is completed, the terminal sends the payment information to the server. The server receives this payment information, analyzes it, and records it in the household accounting database. For example, data such as the payment date and time, amount, store name, and purchased item (using JAN code) are recorded.

[1809] Linking other payment methods

[1810] User enters other payments

[1811] Users can manually enter cash payments or other electronic payment methods (e.g., credit card, direct debit) within the app, which then sends these inputs to the server.

[1812] The server records the data in a database

[1813] The server receives the manually entered payment information and records it appropriately in the household accounting database.

[1814] Purchase history management and search function

[1815] History management for each product

[1816] The server organizes purchase history by product using the JAN code included in each payment information, allowing users to record in detail when, where and which products they purchased.

[1817] User searches purchase history

[1818] When a user searches for a specific product or category in the app, the server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[1819] Example: When a user searches for past purchase history of "milk," the server retrieves all purchase history related to "milk" from the household accounting database and displays details such as purchase date, store name, and price.

[1820] Providing discount coupons and store information

[1821] The server generates the proposal

[1822] The server analyzes the user's purchase history and generates relevant coupons and local store information based on past purchasing patterns and specific product categories.

[1823] Present suggestions to the user

[1824] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[1825] Example: For the item "bread" that a user frequently purchases, useful information is provided to the user by presenting discount coupons and information on new bakeries.

[1826] Asset management setup and transfer

[1827] The user sets up asset management

[1828] Users can set a monthly budget within the app and set up settings to transfer any surplus funds to an asset management account, such as automatically transferring 5,000 yen to a savings account every month.

[1829] Server manages budget and spending

[1830] The server manages the user's set budget and actual expenditure information, and checks the surplus at the end of the month.

[1831] Linking with asset management API

[1832] At the end of the month, the server automatically sends a request to transfer any surplus funds to the asset management destination via the API of the affiliated asset management service.

[1833] Example: A user sets a budget for book purchases, and if they have any money left over that month, the surplus is automatically transferred to a mutual fund account.

[1834] With each of the above functions, users can automatically manage their spending and manage their household finances efficiently. Furthermore, by managing detailed purchase histories and providing information on special offers, spending can be optimized, and surplus funds can be utilized for asset management, improving overall household management. In this way, the present invention is a system that aims to automate and streamline household finance management.

[1835] The processing flow will be explained below.

[1836] Step 1:

[1837] A user pays for goods and services at a store using a specific electronic payment system.

[1838] Step 2:

[1839] After the payment is completed, the terminal retrieves the payment information, which includes details such as the payment date and time, amount, store name, and purchased items (using JAN codes).

[1840] Step 3:

[1841] The terminal transmits the acquired payment information to the server using the HTTPS protocol.

[1842] Step 4:

[1843] The server receives the payment information from the terminal and checks the data for consistency, including the validity of the amount and date.

[1844] Step 5:

[1845] The server records the payment information, whose integrity has been confirmed, in the database. The server then inserts the payment date and time, amount, store name, and purchased product information into the household account book database.

[1846] Step 6:

[1847] A user manually enters a cash payment or other electronic payment (such as a credit card or direct debit) within the app.

[1848] Step 7:

[1849] The payment information entered by the user is sent from the terminal to the server.

[1850] Step 8:

[1851] The server receives the manually entered payment information and records it in a database.

[1852] Step 9:

[1853] The server analyzes the JAN code of the purchased item and obtains the product information. This information is then updated in the database.

[1854] Step 10:

[1855] The server organizes purchase history by product and allows users to search for purchase history by specific criteria.

[1856] Step 11:

[1857] A user searches their purchase history for a specific product or category within the app.

[1858] Step 12:

[1859] The server retrieves the relevant purchase history from the household account book database and sends the results to the user's terminal.

[1860] Step 13:

[1861] The server analyzes the user's purchase history and generates relevant discount coupons and store information.

[1862] Step 14:

[1863] The server sends the generated coupons and store information in JSON format to the user's device and presents them to the user.

[1864] Step 15:

[1865] Users set a monthly budget within the app and set up their surplus funds to be transferred to asset management.

[1866] Step 16:

[1867] The terminal transmits the set budget information to the server.

[1868] Step 17:

[1869] The server compares the set budget with actual spending and identifies any surplus at the end of the month.

[1870] Step 18:

[1871] The server makes a request through the API of its partner asset management service to transfer the surplus funds to the user's asset management account.

[1872] By following these steps, users can automatically record and manage their expenses, and also obtain useful information and manage their assets automatically.

[1873] Example 1

[1874] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1875] In recent years, the spread of electronic payment systems has made daily payments easier and faster, but at the same time, it has created the challenge of making spending management more complex. Traditional household accounting is often done manually, requiring time and effort, and is prone to omissions and input errors. There is also a demand for integrated systems with more advanced functions, such as the ability to search purchase history, provide discount coupons, and automate asset management, in addition to managing spending information. However, there is still a problem in that the technology to effectively integrate and automate these functions is insufficient.

[1876] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1877] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a proposal means that provides advantageous discount coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; a proposal generation means that generates coupons and store information based on specific product categories and notifies the user's terminal; and an asset management linking means that manages the user's set budget and actual expenditures at the end of the month and transfers surplus funds to an affiliated asset management service. This automates the user's expenditure management, streamlines daily household management, and provides comprehensive support ranging from advantageous information to asset management.

[1878] A "specific electronic payment system" is a system that, unlike general payment methods, completes transactions using dedicated electronic devices and applications.

[1879] The "household account book recording means" is a device or software that has the function of automatically collecting payment information made by the user and recording it in the form of a household account book.

[1880] "Payment Information" refers to information regarding the date, time, amount, location of a payment, and the item purchased.

[1881] "Manually entered expenditure information" refers to information about expenditures that is manually entered by a user via an application.

[1882] "Database Measures" means the systems and software used to store and manage payment information and manually entered expenditure information.

[1883] "Purchase history by product" refers to the history of past purchases of a specific product, such as the date, time, place, and amount.

[1884] "Search means" refers to a function or device that allows a user to search for specific information.

[1885] A "discount coupon" is a coupon that allows you to receive a discount when purchasing goods or services.

[1886] "Store information" refers to information about stores that users can visit (location, business hours, products sold, etc.).

[1887] The "proposing means" refers to a function or device for providing useful information (discount coupons, store information, etc.) to the user.

[1888] "Surplus" refers to the difference between the budget set by the user and the amount of expenditure that is less than the budget set by the user.

[1889] "Asset management" refers to a series of tasks and activities aimed at increasing assets by managing income or surplus funds.

[1890] The "proposal generating means" refers to a function or device for generating coupons and store information based on a user's purchase history or a specific product category, and notifying the user of the coupons and store information.

[1891] "Asset management linkage means" refers to functions and devices that link with affiliated asset management services and automatically transfer surplus funds to the investment destination.

[1892] The present invention is a household management system that starts by linking with an electronic payment system. To implement this system, specific hardware and software are used to collect, analyze, record, search, propose, and link asset management data.

[1893] Hardware and software used

[1894] 1. Terminal (user's mobile device):

[1895] E-wallet app: Used by users to make payments.

[1896] Household accounting app: An app for manually entering payment information, searching purchase history, and setting up settings.

[1897] 2. Server:

[1898] Data receiving and analysis system: Receives and analyzes payment information and manually entered information sent from the user's device.

[1899] Database System: A system for storing payment information and manually entered information.

[1900] Proposal generation system: A system for generating coupons and store information based on purchase history.

[1901] Asset management collaboration system: Collaborates with affiliated asset management services to automatically transfer surplus funds.

[1902] Explanation of program processing

[1903] Automatic household accounting

[1904] When a user uses an electronic wallet app to purchase goods or services at a store, the device sends payment information (payment date and time, amount, store name, and JAN code of the purchased goods) to the server. The server analyzes the received information and records it in the household account book database.

[1905] Example: A user buys bread for 500 yen at a convenience store at 2 p.m. one day, and the information is automatically recorded in the household account book.

[1906] Linking other payment methods

[1907] Users manually enter cash payments and credit card information using forms within the household accounting app, which is then sent from the device to the server and recorded in a database.

[1908] Example: If a user manually enters "Purchase bread for 500 yen with cash at a convenience store on March 1, 2023," that information will be reflected in the household account book.

[1909] Purchase history management and search function

[1910] The server uses the JAN code included in the payment information to organize purchase history by product. When a user searches the purchase history of a specific product or category in the household accounting app, the server retrieves the relevant data from the database and presents it on the device.

[1911] Example: When a user searches for "milk," all of the milk they have ever purchased is displayed.

[1912] Providing discount coupons and store information

[1913] The server analyzes the user's purchase history and generates relevant coupons and store information within the user's area. The generated information is sent to the device and notified to the user within the household account book app.

[1914] Example: A user is offered a 20% discount coupon for a bread they frequently purchase on weekends.

[1915] Asset management setup and transfer

[1916] Users set a monthly budget within the household accounting app and configure asset management settings. At the end of the month, the server manages the budget and actual expenditures, and sends a request to the partner service API to automatically transfer any surplus funds to the asset management organization.

[1917] Example: A user sets a monthly budget for book purchases, and if there is a surplus, the surplus is automatically transferred to a mutual fund.

[1918] Examples of prompt statements

[1919] Please explain the program process for generating and notifying coupons for frequently purchased items.

[1920] ---

[1921] In this way, the present invention manages a variety of electronic payment information in an integrated manner, and realizes the automation of household management and asset management.

[1922] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1923] Automatic household accounting

[1924] Step 1: The user makes a payment at the store using the mobile app's e-wallet.

[1925] Input: Purchase information for goods or services at a store (e.g., 1 loaf of bread, 500 yen).

[1926] What happens: A user completes a payment transaction using an e-wallet app.

[1927] Step 2: The terminal sends the payment information to the server.

[1928] Input: Payment information after payment is completed (payment date and time, amount, store name, JAN code of purchased item, etc.).

[1929] How it works: The terminal sends payment information to the server using the HTTPS protocol.

[1930] Output: The payment information received by the server.

[1931] Step 3: The server receives and records the data.

[1932] Input: Payment information sent from the terminal.

[1933] Operation: The server analyzes the payment information received and extracts the payment date and time, amount, store name, purchased item information, etc.

[1934] Output: The analyzed data is recorded in the household accounting database.

[1935] Linking other payment methods

[1936] Step 1: User enters another payment.

[1937] Input: Cash payment or credit card information (e.g. 500 yen in cash, 1000 yen by credit card).

[1938] What it does: A user manually enters payment information using an in-app form.

[1939] Step 2: The app sends the input information to the server.

[1940] Input: Payment information entered manually.

[1941] How it works: The app sends the input information to the server using the HTTPS protocol.

[1942] Output: Manually entered information received by the server.

[1943] Step 3: The server records the data in a database.

[1944] Input: The user's manually entered payment information.

[1945] Operation: The server parses the received manual entry information and records it in a database.

[1946] Output: The manually entered information is saved in the household accounting database.

[1947] Purchase history management and search function

[1948] Step 1: Manage product history on a product-by-product basis.

[1949] Input: JAN code included in payment information.

[1950] How it works: The server analyzes payment information and organizes the purchase history for each product using the JAN code.

[1951] Output: The organized purchase history for each product is saved in a database.

[1952] Step 2: User searches purchase history.

[1953] Input: The user enters search criteria (e.g., product name or category) into the app.

[1954] What it does: A user searches their purchase history for a specific product or category within an app.

[1955] Output: The server retrieves the relevant purchase history from the database.

[1956] Step 3: The server presents the purchase history to the user.

[1957] Input: Purchase history obtained by the server.

[1958] Operation: The server sends the acquired purchase history to the user's device.

[1959] Output: The app displays the user's purchase history (e.g., details such as purchase date, store name, and price).

[1960] Providing discount coupons and store information

[1961] Step 1: The server generates a proposal.

[1962] Input: User purchase history data.

[1963] How it works: The server analyzes a user's purchase history and generates discount coupons and store information based on specific product categories.

[1964] Output: Generated coupon information and store information.

[1965] Step 2: The server presents the proposal to the user.

[1966] Input: Generated coupon information and store information.

[1967] Operation: The server generates information and sends it to the user's device.

[1968] Output: The app notifies and displays coupon information and store information to the user.

[1969] Asset management setup and transfer

[1970] Step 1: The user sets up asset management.

[1971] Input: Set your monthly budget and asset management (e.g., transfer 5,000 yen per month to your savings account).

[1972] How it works: Users set their monthly budget and asset management within the app.

[1973] Output: The set budget information and asset management information are saved on the server.

[1974] Step 2: The server manages the budget and spending.

[1975] Input: User's budget information and actual spending information.

[1976] How it works: The server manages the user's set budget and actual spending information in conjunction with each other.

[1977] Output: The surplus data is obtained at the end of the month.

[1978] Step 3: The server connects to the asset management API and transfers the funds.

[1979] Input: Surplus cash data and asset management information.

[1980] Operation: The server generates a request to transfer surplus funds to an asset management destination and sends the request through the affiliated asset management service API.

[1981] Output: Surplus funds are automatically transferred to the investment account.

[1982] (Application example 1)

[1983] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1984] While conventional household accounting systems have the ability to automatically record electronic payment information, they lack comprehensive consumer support functions, such as spending management using smartphones or other devices and coupon generation functions. This makes it difficult for users to grasp their spending situation, and efficient support for spending control and asset management is needed. Furthermore, the provision of information on deals based on purchase history is limited, and users are not sufficiently encouraged to engage in beneficial consumption behavior. A comprehensive system is needed to resolve these issues and enable users to manage their household finances efficiently and effectively.

[1985] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1986] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a suggestion means that provides discount coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an expenditure management means that is installed on a smartphone, smart glasses, a head-mounted display, or an automated device; and a coupon generation means that uses an application based on the payment history. This allows users to automatically record expenditures made via electronic payments, comprehensively manage their household finances through their smart devices, and obtain information on advantageous offers based on their purchase history.

[1987] An "electronic payment system" is a system that allows users to pay for goods and services electronically.

[1988] A "household account book recording means" is a device or application that has the function of automatically recording payment information using an electronic payment system.

[1989] "Database Means" means a storage device or system for storing and managing payment information and expenditure information manually entered by a User.

[1990] The "search means" is a device or application that searches the purchase history recorded in the database on a product-by-product basis and presents the results to the user.

[1991] The "proposal means" is a device or system that has the function of generating discount coupons and store information based on the user's purchase history and providing them to the user.

[1992] An "asset management instrument" is a device or system that has the function of automatically transferring surplus funds to asset management within the range of expenditures set by the user.

[1993] "Expense management tool" means an application installed on a smartphone, smart glasses, head-mounted display, or automated device that has the function of managing and monitoring a user's expenses.

[1994] The "coupon generating means" is a device or system that has the function of generating advantageous discount information based on the user's payment history.

[1995] An embodiment of the present invention is realized by using a system that works in conjunction with a specific electronic payment system. This system automatically records a user's spending information, makes suggestions based on their purchase history, and utilizes surplus funds for asset management. Specific embodiments of each function of the present invention and the system's processing are explained in natural language below.

[1996] First, when a user makes a payment using the electronic payment system, the terminal sends the payment information to the server. The server receives this payment information, analyzes data such as the payment date and time, amount, store name, and purchased items, and records it in the household accounting database. Users can also manually enter payment information for cash payments or other electronic payment methods within the app, and this information is also recorded in the database.

[1997] Next, to manage purchase histories on a product-by-product basis, the server organizes past purchase histories using the product identification code included in each payment information. Users can search for purchase history for specific products or categories within the app, and the server retrieves the relevant purchase history and presents it to the user. For example, if a user searches for past purchase history for "milk," the server retrieves all purchase history related to "milk" from the household accounting database and displays details such as purchase date, store name, and price.

[1998] The system also has the ability to analyze a user's purchase history and provide relevant coupons and store information. The server generates coupon information based on purchase patterns and specific product categories, and sends and displays it on the user's device. For example, the system can provide useful information to the user by presenting coupons and new store information for "bread," which the user frequently purchases.

[1999] Regarding asset management settings, users can set a monthly budget within the app and set up the transfer of any surplus funds to their asset management account. Based on the user's settings, the server checks the surplus funds at the end of the month and automatically requests the transfer to the asset management account via the API of the partner asset management service. For example, if a user sets up a monthly transfer of 5,000 yen to a specific investment trust account, the surplus funds for that month will be automatically transferred to the investment trust account.

[2000] These functions are implemented by the following hardware and software:

[2001] Hardware: smartphones, servers, databases

[2002] Software: Python, libraries for API integration (e.g., requests), database system (e.g., SQLite)

[2003] An example of a prompt sentence would be the following text:

[2004] "You are looking to develop an application that automatically records a user's electronic payment information in a household ledger and also supports asset management. In particular, the application should include the following features: automatic recording of payment information, support for manual entry, search for purchase history, provide coupons, and asset management of surplus funds."

[2005] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2006] Step 1:

[2007] The user makes a payment using an electronic payment system.

[2008] What it does: A user pays for goods and services at a store using an electronic payment application on their smartphone.

[2009] Input: Payment information (payment date and time, amount, store name, purchased items, etc.).

[2010] Output: Payment information is captured by the terminal.

[2011] Step 2:

[2012] The terminal sends the payment information to the server.

[2013] Specific operation: After the payment is completed, the smartphone's electronic payment application automatically sends the payment information to the server.

[2014] Input: Payment information.

[2015] Output: Payment information is received by the server.

[2016] Step 3:

[2017] The server records the received payment information in a database.

[2018] Specific operation: The server saves the received payment information in the database and records it in the household accounting database.

[2019] Input: Payment information.

[2020] Output: Payment information recorded in the household accounting database.

[2021] Step 4:

[2022] The user manually enters another payment method within the app.

[2023] What happens: A user manually enters payment information for a cash or other electronic payment method and sends it to a server through an application.

[2024] Input: Manually entered payment information.

[2025] Output: Manually entered payment information is received by the server.

[2026] Step 5:

[2027] The server records the manually entered payment information in a database.

[2028] Specific operation: The server receives manually entered payment information and records it in the household accounting database.

[2029] Input: Manually entered payment information.

[2030] Output: Manual payment information recorded in the household accounting database.

[2031] Step 6:

[2032] The server manages purchase history on a product-by-product basis.

[2033] Specific operation: The server organizes the purchase history using the product identification code included in each payment information.

[2034] Input: Payment information recorded in the household accounting database.

[2035] Output: An organized purchase history.

[2036] Step 7:

[2037] The user searches for their purchase history within the app.

[2038] What happens: A user searches for a product or category in their purchase history within an app. The app sends the query to the server.

[2039] Input: Search query (e.g. product name "Milk").

[2040] Output: A display of the purchase history specified by the user.

[2041] Step 8:

[2042] The server presents the search results to the user.

[2043] Specific operation: The server retrieves the relevant purchase history from the household account book database and sends it to the user's terminal for display.

[2044] Input: Search results from the purchase history database.

[2045] Output: Purchase history displayed on the user's device.

[2046] Step 9:

[2047] The server generates advantageous coupons and store information based on purchase history.

[2048] Specific operation: The server analyzes the user's purchase history and generates relevant discount information and store information.

[2049] Input: Purchase history data.

[2050] Output: Generated coupon information and store information.

[2051] Step 10:

[2052] The server transmits the generated coupon information and store information to the user terminal.

[2053] Specific operation: The server sends the generated coupon information and store information to the user's device and displays it within the app.

[2054] Input: Generated coupon information and store information.

[2055] Output: Coupon information and store information displayed on the user's device.

[2056] Step 11:

[2057] Users set up their asset management settings within the app.

[2058] How it works: Users enter their monthly budget and the amount of surplus money they want to use for asset management within the app.

[2059] Input: Monthly budget and financial settings.

[2060] Output: Budget and investment settings stored on the server.

[2061] Step 12:

[2062] The server checks the surplus at the end of the month and transfers it to asset management.

[2063] Specific operation: The server compares the user's monthly budget with their actual spending, and if there is a surplus, it automatically sends a request to transfer the surplus to the asset management provider via the API of the affiliated asset management service.

[2064] Input: Actual expenditure data, budget data, API information of partner asset management services.

[2065] Output: Surplus transferred to investment destination.

[2066] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2067] In one embodiment of the present invention, the objective is to provide personalized spending management and suggestions based on the user's emotions by linking with a specific electronic payment system and combining an emotion engine with a system that streamlines household management.

[2068] Automatic household accounting

[2069] The terminal makes the payment

[2070] When a user pays for a product or service at a store using an electronic payment system, payment information (date and time, amount, store name, purchased product information, etc.) is generated.

[2071] The server receives and records the data

[2072] After the payment is completed, the terminal sends the payment information to the server, which receives it, analyzes it, and records it in the household account book database.

[2073] Linking other payment methods

[2074] User enters other payments

[2075] If the user manually enters cash payments or other electronic payment methods (credit cards, direct debit, etc.), these entries are also sent to the server.

[2076] The server records the data

[2077] The server receives the manually entered payment information and records it in the household account book database.

[2078] Purchase history management and search function

[2079] History management for each product

[2080] The server analyzes the JAN code included in the payment information and manages the purchase history for each product, allowing users to track in detail when and where they purchased which products.

[2081] User searches purchase history

[2082] When a user searches for a purchase history for a specific product or category, the server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[2083] Providing discount coupons and store information

[2084] The server generates the proposal

[2085] The server generates discount coupons and store information within the user's living area based on the user's purchase history.

[2086] Present suggestions to the user

[2087] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[2088] Asset management setup and transfer

[2089] The user sets up asset management

[2090] Users set a monthly budget within the app and set up their assets to receive any surplus funds.

[2091] Server manages budget and spending

[2092] The server compares the set budget with actual spending and identifies any surplus at the end of the month.

[2093] Linking with asset management API

[2094] The server automatically sends a request to transfer the surplus funds to the asset management destination via the API of the affiliated asset management service.

[2095] Combining Emotion Engines

[2096] emotion recognition

[2097] The device is equipped with an emotion engine that recognizes the user's emotions from their facial expressions, voice, text, etc. When the user uses the app, emotion data is collected using the device's camera and microphone.

[2098] Sending emotional data

[2099] The device transmits emotional data acquired by the emotion engine to the server, including information such as whether the user is relaxed or stressed.

[2100] Emotional Data Analysis

[2101] The server analyzes the emotional data to understand the user's current emotional state, and uses this information to analyze spending patterns and predict future spending.

[2102] Example: A server uses the user's emotional data to provide coupons for relaxation products and services to users who are feeling stressed, and makes investment and savings suggestions to users when they are in a positive emotional state.

[2103] Emotion-based suggestions

[2104] The server customizes the coupons and store information to be provided based on the user's emotions recognized by the emotion engine.

[2105] Example: If the server detects that the user is feeling tired, it will provide coupons for products that promote relaxation or information about the nearest spa. If the user is happy, it will provide information about restaurants and trips with special offers.

[2106] In this way, by combining the emotion engine, personalized suggestions and expenditure management based on the user's emotional state become possible. The present invention is a system that provides comprehensive support for the user's household finances, realizing more efficient and satisfying expenditure management.

[2107] The processing flow will be explained below.

[2108] Step 1:

[2109] A user pays for goods and services at a store using a specific electronic payment system.

[2110] Step 2:

[2111] After the payment is completed, the terminal retrieves payment information, including the payment date and time, amount, store name, and details of the purchased item (including JAN code).

[2112] Step 3:

[2113] The terminal transmits the acquired payment information to the server using the HTTPS protocol.

[2114] Step 4:

[2115] The server receives the payment information from the terminal and checks the data for consistency, including the validity of the amount and date.

[2116] Step 5:

[2117] The server records the payment information, whose integrity has been confirmed, in the household account book database, inserting the payment date and time, amount, store name, and details of the purchased item.

[2118] Step 6:

[2119] A user manually enters a cash payment or other electronic payment (e.g., credit card, direct debit) within the app.

[2120] Step 7:

[2121] The payment information entered by the user is sent from the terminal to the server.

[2122] Step 8:

[2123] The server receives the manually entered payment information and records it in the household account database.

[2124] Step 9:

[2125] The server analyzes the JAN code of the purchased item and updates the database with the product information based on that.

[2126] Step 10:

[2127] The server organizes purchase history by product and allows users to search for purchase history by specific criteria.

[2128] Step 11:

[2129] A user searches their purchase history for a specific product or category within the app.

[2130] Step 12:

[2131] The server retrieves the relevant purchase history from the household account book database and sends the results to the user's terminal.

[2132] Step 13:

[2133] The server analyzes the user's purchase history and generates relevant discount coupons and store information.

[2134] Step 14:

[2135] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[2136] Step 15:

[2137] Users set a monthly budget within the app and set up their surplus funds to be transferred to asset management.

[2138] Step 16:

[2139] The terminal transmits the set budget information to the server.

[2140] Step 17:

[2141] The server compares the set budget with the actual expenditure and checks the surplus at the end of the month.

[2142] Step 18:

[2143] The server makes a request to transfer the surplus funds to the user's asset management account through the API of the asset management service it is affiliated with.

[2144] Step 19:

[2145] The device uses an emotion engine to analyze the user's facial expressions, voice, text, etc. to obtain emotional data, including information such as whether the user is relaxed or stressed.

[2146] Step 20:

[2147] The device transmits the emotion data to the server.

[2148] Step 21:

[2149] The server analyzes the emotional data and understands the user's current emotional state.

[2150] Step 22:

[2151] The server customizes the coupons and store information it provides based on the emotion data. For example, if it detects that the user is tired, it will provide relaxation-related coupons and store information.

[2152] Step 23:

[2153] The server transmits the customized coupons and store information to the user's terminal and presents them to the user.

[2154] These steps allow users to not only automatically record and manage their spending, but also receive personalized suggestions based on their emotional state, and efficiently utilize their surplus funds for asset management.

[2155] Example 2

[2156] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2157] While conventional household management systems provide the ability to automatically record users' spending information and the ability to manually input some payment information, they lack the ability to provide personalized spending management and suggestions that take into account the user's emotional state. This makes it difficult to provide optimal spending management and suggestions based on the user's current psychological state, making it difficult to improve user satisfaction.

[2158] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2159] In this invention, the server includes: a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase histories by product and presents the results; a suggestion means that provides advantageous coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an emotion recognition means that recognizes and collects user emotion data; an emotion analysis means that analyzes the user's emotional state based on the collected emotion data; and a suggestion customization means that customizes suggestions based on the emotion analysis results. This enables personalized expenditure management and suggestions according to the user's emotional state, thereby improving user satisfaction and spending efficiency.

[2160] The "household account book recording means" is a function that works in conjunction with a specific electronic payment system and automatically records payment information using the electronic payment system.

[2161] "Database Means" refers to a facility that stores payment information and manually entered expenditure information.

[2162] The "search means" is a function for searching purchase history on a product-by-product basis and displaying the results.

[2163] "Proposal means" is a function that provides advantageous coupons and store information based on purchase history.

[2164] "Asset management tools" are functions that automatically transfer surplus funds to asset management based on a spending plan.

[2165] The "emotion recognition means" is a function that recognizes and collects the user's emotional data.

[2166] The "emotion analysis means" is a function that analyzes the user's emotional state based on the collected emotional data.

[2167] The "suggestion customization means" is a function that makes optimal suggestions to individual users based on the results of emotion analysis.

[2168] The present invention aims to provide personalized spending management and suggestions based on the user's emotions by linking with a specific electronic payment system and combining an emotion engine with a system that streamlines household management.

[2169] Automatic household accounting

[2170] The terminal makes the payment

[2171] Users use their smartphones or tablets to pay for goods and services at stores through an electronic payment app, and payment information (date, time, amount, store name, purchased product information, etc.) is generated on the device.

[2172] The device sends data

[2173] After the payment is completed, the device sends the payment information to the server, typically over Wi-Fi or mobile data.

[2174] The server receives and records the data

[2175] The server analyzes the received payment information and records it in a household account database, which is used to efficiently manage expenditure information.

[2176] Linking other payment methods

[2177] User enters other payments

[2178] Users manually enter cash payments or other electronic payment methods (credit cards, direct debit, etc.) through an app on their device.

[2179] The device sends data

[2180] The terminal sends the manually entered payment information to the server.

[2181] The server records the data

[2182] The server receives the manually entered payment information and records it in the household account database.

[2183] Purchase history management and search function

[2184] The server analyzes the data

[2185] The server analyzes the JAN code included in the payment information and manages the purchase history for each product. This data is used by users to track their past spending.

[2186] User searches purchase history

[2187] Users can use the search function within the app to search for purchase history for a specific product or category. The server retrieves the relevant purchase history from the household accounting database and presents it to the user.

[2188] Providing discount coupons and store information

[2189] The server generates coupons and store information

[2190] The server generates discount coupons and store information within the user's living area based on the user's purchase history.

[2191] The server makes a proposal

[2192] The server sends the generated coupon information and store information to the user's device and displays it within the app.

[2193] Asset management setup and transfer

[2194] The user sets up asset management

[2195] Users set a monthly budget within the app and set up their assets to receive any surplus funds.

[2196] Server manages budget and spending

[2197] The server compares the set budget with the actual spending and checks for any surplus at the end of the month.

[2198] Linking with asset management API

[2199] The server automatically transfers the surplus funds through the affiliated asset management service API.

[2200] Combining Emotion Engines

[2201] The device recognizes emotions

[2202] The device is equipped with an emotion engine that uses a camera and microphone to recognize the user's emotions, analyzing the user's facial expressions and voice to obtain emotional data.

[2203] The device sends data

[2204] The device transmits the emotion data acquired by the emotion engine to the server.

[2205] The server analyzes the emotional data

[2206] The server analyzes the emotional data to understand the user's emotional state, and uses this information to analyze spending patterns and predict future spending.

[2207] The server generates sentiment-based suggestions

[2208] The server customizes the coupons and store information it provides based on the results of emotion analysis. If it detects that the user is feeling tired, it will provide coupons for products that promote relaxation and information on the nearest spa. If the user is happy, it will provide information on restaurants and travel with special offers.

[2209] Specific examples

[2210] For example, when a user goes shopping at a convenience store, the terminal collects payment information and sends it to the server, which stores the information in a household account database. If the user feels stressed, the server can provide coupons for relaxation products or the nearest spa.

[2211] Prompt Sentence Examples

[2212] "Explain the design of a household finance app that uses an emotion engine."

[2213] "Please tell me more about the feature that provides personalized coupons based on user sentiment."

[2214] "Please create a system for setting a monthly budget and transferring any surplus funds to asset management."

[2215] As described above, the present invention is a system that realizes personalized suggestions and expenditure management according to the user's emotional state, and provides comprehensive support for the user's household finance management.

[2216] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2217] Step 1:

[2218] The user makes a payment

[2219] Input: A user makes a payment using an electronic payment system.

[2220] Specific operation: A user uses a smartphone or tablet to pay for a product using an electronic payment app.

[2221] Output: Payment information (date and time, amount, store name, purchased product information, etc.) is generated on the terminal.

[2222] Step 2:

[2223] The terminal sends the payment information

[2224] Input: Payment information is generated on the terminal.

[2225] What happens: Your device uses Wi-Fi or mobile data to send payment information to a server.

[2226] Output: Payment information is sent to the server.

[2227] Step 3:

[2228] The server receives and records the payment information

[2229] Input: Payment information is sent to the server.

[2230] Specific operation: The server analyzes the payment information and records it in the household accounting database. Data analysis includes extracting information such as date, time, amount, store name, and purchased product information.

[2231] Output: Parsed payment information is saved in the household account database.

[2232] Step 4:

[2233] The user manually enters other payment information

[2234] Input: A user makes a payment using cash or other electronic payment methods.

[2235] What happens: A user uses the manual entry feature within the app to enter cash or credit card payment information.

[2236] Output: Manually entered payment information is generated on the terminal.

[2237] Step 5:

[2238] The terminal sends the manually entered payment information

[2239] Input: Manually entered payment information is generated.

[2240] What happens: The device uses Wi-Fi or mobile data to send manually entered payment information to a server.

[2241] Output: Manually entered payment information is sent to the server.

[2242] Step 6:

[2243] The server records manually entered payment information

[2244] Input: Manually entered payment information is sent to the server.

[2245] Specific operation: The server analyzes the manually entered information and records it in the household accounting database. The analyzed information includes detailed information such as payment date and time, amount, and expenditure details.

[2246] Output: Parsed manual payment information is saved in the household finance database.

[2247] Step 7:

[2248] The server analyzes and records purchase history

[2249] Input: Payment information received by the server.

[2250] Specific operation: The server analyzes the JAN code of the payment information, identifies the purchased item, and records the purchase history for each item in the database.

[2251] Output: Purchase history managed by product is saved in the database.

[2252] Step 8:

[2253] User searches purchase history

[2254] Input: A user searches for a specific product or category.

[2255] What happens: A user uses the app's search function to enter a product name or category and perform a search.

[2256] Output: The user's input information is sent to the server.

[2257] Step 9:

[2258] The server searches for and displays the purchase history

[2259] Input: The user's search query.

[2260] Specific operation: The server retrieves the relevant purchase history from the household accounting database and presents the results to the user. The database search is performed using an SQL query.

[2261] Output: The acquired purchase history information is sent to the user's device.

[2262] Step 10:

[2263] The server generates coupons and store information

[2264] Input: User purchase history data.

[2265] Specific operation: The server runs an algorithm that generates discount coupons and store information within the user's living area based on past purchase history.

[2266] Output: The generated coupons and store information are saved on the server.

[2267] Step 11:

[2268] The server presents the coupon and store information

[2269] Input: Generated coupon information and store information.

[2270] Specific operation: The server sends the generated information to the user's device as a push notification or in-app message.

[2271] Output: Coupon information and store information are displayed on the user's device.

[2272] Step 12:

[2273] The user sets up asset management

[2274] Input: User sets monthly budget and asset management settings.

[2275] Specific operation: The user enters their monthly budget in the settings screen within the app and sets up automatic transfer of surplus funds to an investment destination.

[2276] Output: The configuration information is saved to the device.

[2277] Step 13:

[2278] The device sends the configuration information

[2279] Input: Monthly budget and investment settings information.

[2280] Specific operation: The device sends the setting information to the server.

[2281] Output: The configuration information is sent to the server.

[2282] Step 14:

[2283] Server manages budget and spending

[2284] Input: Monthly budget settings and spending information from your household finance database.

[2285] How it works: The server compares the configured monthly budget with the actual spending information and checks for any surplus. An algorithm is used to compare the data.

[2286] Output: The confirmed surplus amount is saved in the database.

[2287] Step 15:

[2288] The server connects to the asset management API

[2289] Input: Confirmed surplus amount and affiliated asset management service API information.

[2290] Specific operation: The server sends a surplus transfer request to the asset management API. The request includes details such as the API key and the surplus amount.

[2291] Output: Surplus funds are transferred to the partner asset management service.

[2292] Step 16:

[2293] The device recognizes emotional data

[2294] Input: Emotional data such as user facial expressions and voice.

[2295] Specific operation: The device uses the camera and microphone to activate the emotion engine, recognize the user's emotions, and collect data.

[2296] Output: The collected emotion data is saved on the device.

[2297] Step 17:

[2298] The device sends emotion data

[2299] Input: Collected emotion data.

[2300] Specific operation: The device sends emotion data to the server.

[2301] Output: Emotion data is sent to the server.

[2302] Step 18:

[2303] The server analyzes the emotional data

[2304] Input: Submitted emotion data.

[2305] How it works: The server uses an emotion analysis algorithm to analyze the user's emotional state, including their stress level and relaxation level.

[2306] Output: The analysis results are saved on the server.

[2307] Step 19:

[2308] The server generates sentiment-based suggestions

[2309] Input: Sentiment analysis results and purchase history data.

[2310] Specific operation: The server executes the proposed algorithm based on the emotional data and generates coupons and store information according to the user's emotional state.

[2311] Output: The sentiment-based suggestion information is generated and stored on the server.

[2312] Step 20:

[2313] The server provides emotion-based suggestions

[2314] Input: Sentiment-based suggestion information.

[2315] Specific operation: The server sends the suggestion information to the user's device and displays it within the app.

[2316] Output: Customized suggestions based on emotions are displayed on the user's device.

[2317] (Application example 2)

[2318] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2319] While modern electronic payment services excel at recording payment information, they are limited in their ability to provide personalized spending management and suggestions that take users' emotions into account. Furthermore, they are unable to provide appropriate suggestions based on users' emotions, such as when they are stressed or relaxed, making it difficult to efficiently manage assets and curb impulsive spending. To address these issues, a system is needed that can grasp users' emotional states in real time and provide personalized spending management and suggestions based on those emotions.

[2320] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a household account book recording means that cooperates with an electronic payment system and automatically records payment information using the electronic payment system; a database means that stores payment information and manually entered expenditure information; a search means that searches purchase history by product and presents the results; a suggestion means that provides advantageous coupons and store information based on the purchase history; a means that automatically transfers surplus funds to asset management based on expenditure settings; an emotion recognition means that recognizes emotions from the user's facial expressions, voice, and text and acquires emotion data; and a means that analyzes the emotion data and generates indi...

Claims

1. a household account book recording means that cooperates with a specific electronic payment system and automatically records payment information using the electronic payment system; database means for storing payment information and manually entered expenditure information; A search method that searches purchase history by product and displays the results; a suggestion means for providing advantageous coupons and store information based on the purchase history; A means to automatically transfer surplus funds into investments based on spending preferences; A system including:

2. 2. The system according to claim 1, further comprising a linking means for recording payment information by credit card or account transfer in the database means.

3. 2. The system according to claim 1, further comprising means for acquiring product information using a JAN code and recording the acquired information in the database means.

Images