system

Abstract

Provide a system. [Solution] A smart wallet equipped with a sensor that detects cash deposits and withdrawals, a communication means for transmitting the deposit and withdrawal information detected by the smart wallet to a user terminal via Bluetooth; a data transfer means for transmitting the deposit / withdrawal information received by the user terminal to a central server; a means for aggregating transaction data via APIs of multiple electronic money services and financial institutions in the central server; A means for analyzing the integrated data and classifying it into categories, the means comprising a generating AI; A means for feeding back the data classified by category by the generating AI to a user terminal; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The challenge is that it is difficult to manage cash expenditures and consolidate electronic money usage history. Conventional household accounting apps require manual input, making it difficult to manage cash and electronic money simultaneously. As a result, it is difficult to accurately grasp the overall picture of the household finances, making it difficult to achieve efficient financial management. [Means for solving the problem]

[0005] This invention provides a smart wallet equipped with a sensor that detects cash deposits and withdrawals, and a communication means for transmitting cash deposit and withdrawal information from the smart wallet via Bluetooth to a user terminal. It also includes a data transfer means for transmitting the deposit and withdrawal information received by the user terminal to a central server. The central server integrates transaction data via APIs from multiple electronic money services and financial institutions, analyzes the data using a generation AI, and classifies it by category. Finally, it provides a means for feeding back the categorized data classified by the generation AI to the user terminal. This enables centralized management of cash and electronic money spending information, supporting comprehensive and efficient household management for users.

[0006] A "smart wallet" is a wallet that is equipped with a sensor that detects cash deposits and withdrawals, a means of acquiring location information, and the ability to transmit data via Bluetooth.

[0007] A "sensor" is a device that physically detects cash deposits and withdrawals and processes that information as digital data.

[0008] "Bluetooth" is a technology standard for wirelessly transmitting data over short distances.

[0009] A "user terminal" is a device, such as a smartphone or tablet, that has communication capabilities and is capable of receiving and sending data.

[0010] "Communication means" means the technology or equipment for transmitting and receiving data.

[0011] A "data transfer means" is a mechanism by which data received by a user terminal is transmitted to a central server.

[0012] A "central server" is a high-performance computer on a network that centrally manages and processes various data.

[0013] "API" stands for Application Programming Interface, an interface that allows software to communicate with each other.

[0014] "Generative AI" is an artificial intelligence technology that analyzes collected data and generates information for specific purposes.

[0015] "Categorization" is the act of classifying data based on specific criteria.

[0016] The "feedback means" is a function for notifying the user terminal of the analysis results and classified data. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The present invention provides a system for managing expenditures of both cash and electronic money in an integrated manner, thereby enabling efficient household management when a user uses both cash and electronic money at the same time. Hereinafter, a detailed description will be given of an embodiment of the present invention.

[0039] System configuration

[0040] The system consists of the following main components:

[0041] 1. Smart Wallet

[0042] Sensor: Detects cash deposits and withdrawals.

[0043] Location information acquisition method: Location information is acquired using GPS.

[0044] Communication method: Send data to the user terminal via Bluetooth.

[0045] 2. User Device

[0046] Data receiving means: Receives deposit and withdrawal information and location information from the smart wallet.

[0047] Data transfer means: Sends received data to a central server.

[0048] API integration method: Obtain transaction data through APIs of electronic money and financial institutions.

[0049] 3. Central Server

[0050] Data integration method: Integrates all data obtained from user devices and APIs.

[0051] Generative AI: Analyzes the combined data and classifies it into categories.

[0052] 4. Feedback methods

[0053] User terminal notification: Notify the user of the classification and analysis results.

[0054] Program processing and specific examples

[0055] Data collection

[0056] The terminal (smart wallet) detects cash deposits and withdrawals and records them as digital data. At the same time, location information is obtained via GPS. For example, if a user deposits 500 yen into their wallet, the sensor detects this and generates the data "Deposit: 500 yen," along with the location information being recorded.

[0057] Data transmission

[0058] The terminal (smart wallet) uses Bluetooth to transmit the deposit data and location information to the user terminal, which receives it and transmits it to the central server using a data transfer means.

[0059] Acquiring electronic money data

[0060] The user device periodically obtains transaction data using APIs of electronic money and financial institutions. For example, if a user pays 200 yen with electronic money, the data "Expenses: 200 yen" is obtained through the API.

[0061] Data Integration

[0062] The server integrates the cash deposit and withdrawal data sent from the user terminal with the electronic money data obtained through the API, thereby generating an integrated data set.

[0063] Data analysis and categorization

[0064] The server's generation AI analyzes the integrated data and classifies each transaction into the appropriate category. For example, a "Deposit: 500 yen (cash)" and "Expense: 200 yen (electronic money)" may be classified as food expenses.

[0065] User Feedback

[0066] The app (user device) notifies and displays the analysis results to the user. For example, it may display information such as, "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[0067] In this way, the present invention provides a household management system that can efficiently manage both cash and electronic money. Furthermore, by using location-based prediction functions and automatic categorization using AI generation, the burden of input by the user is minimized, enabling accurate household management.

[0068] The processing flow will be explained below.

[0069] Step 1:

[0070] The user uses cash or electronic money. For example, the user pays 500 yen in cash at a supermarket and then pays 200 yen in electronic money at another store.

[0071] Step 2:

[0072] The device (smart wallet) uses sensors to detect cash deposits and withdrawals, and records the data while acquiring location information. For example, if 500 yen is withdrawn in cash, it will record "withdrawal of 500 yen" and the location information.

[0073] Step 3:

[0074] The terminal (smart wallet) uses Bluetooth to send the collected cash deposit and withdrawal information and location information to the user's terminal. For example, the information "withdrawal of 500 yen" and location information are sent to the user's smartphone.

[0075] Step 4:

[0076] The user terminal checks the data received from the smart wallet and sends it to the central server using a data transfer method. For example, "Withdraw 500 yen" and location information are sent to the central server.

[0077] Step 5:

[0078] The user device obtains transaction data through the API of electronic money or financial institutions. For example, data on a payment of 200 yen with electronic money, such as "Expense 200 yen," is received from the API.

[0079] Step 6:

[0080] The server receives the cash and electronic money data sent from the user terminal and integrates them. For example, "withdrawal of 500 yen (cash)" and "expense of 200 yen (electronic money)" are integrated.

[0081] Step 7:

[0082] The server's AI analyzes the integrated data and categorizes it. For example, a withdrawal of 500 yen might be classified as "food" based on location information, and an expenditure of 200 yen might be classified as "daily necessities."

[0083] Step 8:

[0084] The server then sends the analyzed and classified results to the user's device. For example, data such as "food expenses 500 yen, daily necessities 200 yen" is sent to the user's smartphone.

[0085] Step 9:

[0086] The user device displays the analysis results sent from the server to the user. For example, the app screen displays "Today's expenses: food 500 yen, daily necessities 200 yen."

[0087] The above is an explanation of each processing step and its specific operation.

[0088] Example 1

[0089] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0090] When cash and electronic money expenditure information is used in parallel, users must manage each expenditure information separately, which is cumbersome for users and makes it difficult to manage their household finances efficiently. Furthermore, since cash expenditures are recorded manually, there is a risk of input errors or omissions. Furthermore, the task of categorizing each transaction is a heavy burden, making accurate household finances difficult to manage.

[0091] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0092] In this invention, the server comprises a smart storage device equipped with a sensor that detects cash deposits and withdrawals,

[0093] a communication means for transmitting the deposit and withdrawal information detected by the smart storage device to a user terminal via wireless communication;

[0094] a data transfer means for transmitting the deposit / withdrawal information received by the user terminal to the centralized processing unit;

[0095] means for aggregating transaction data via application interfaces of a plurality of electronic payment services and financial institutions in the centralized processing unit;

[0096] means for analyzing the integrated data and organizing it into categories; and

[0097] A means for feeding back the data classified by the generating artificial intelligence to a user terminal;

[0098] This will enable centralized management of cash and electronic money expenditure information, enabling efficient household management.

[0099] A "smart storage device" is an electronic device equipped with a sensor that detects cash deposits and withdrawals.

[0100] "Communication means" refers to a mechanism for transmitting data to other electronic devices using wireless communication.

[0101] A "user terminal" refers to an electronic device such as a computer or smartphone used by a user.

[0102] "Data transfer means" refers to a mechanism that has the function of transmitting data from one electronic device to another.

[0103] A "centralized processing device" is a server or mainframe computer used to centrally manage and analyze multiple data sets.

[0104] "Electronic payment services" are services for making payments online, including credit cards and digital wallets.

[0105] An "application interface" provides a connection through which different software systems can communicate with each other.

[0106] "Transaction Data" means data that includes information regarding expenses and income.

[0107] "Generative AI" refers to software and systems that use machine learning and artificial intelligence techniques to analyze large amounts of data and recognize patterns.

[0108] "Feedback means" refers to a mechanism for providing analysis results and notifications to users.

[0109] The present invention is a system that allows users who use both cash and electronic money to centrally manage their expenditure information and achieve efficient household management. This system uses the following main hardware and software:

[0110] Smart storage equipment

[0111] The smart storage device is equipped with a sensor to detect cash deposits and withdrawals. It also has a built-in GPS as a means of acquiring location information. Each time it detects a cash deposit or withdrawal, it records that information and the location information. For example, if a user deposits 500 yen into their wallet, the sensor will detect "Deposit: 500 yen" and record the location information (longitude and latitude) acquired by the GPS.

[0112] communication means

[0113] The smart storage device transmits recorded deposit and withdrawal information and location information to the user's terminal using wireless communication, such as Bluetooth, eliminating the need for the user to manually enter information and automatically synchronizing the data.

[0114] User terminal

[0115] The user terminal is equipped with a data transfer means that temporarily stores the received deposit and withdrawal information and location information in an internal database and periodically transmits it to the centralized processing unit. The user terminal also periodically obtains electronic money transaction data through the application programming interfaces (APIs) of multiple electronic payment services and financial institutions. For example, if a user pays 200 yen with electronic money, the transaction data "Expenses: 200 yen" is obtained through the API.

[0116] Centralized Processing Unit

[0117] The centralized processing unit has the function of integrating cash deposit and withdrawal data sent from user terminals with electronic money data obtained through APIs, which allows all transaction data to be managed centrally and analyzed efficiently.

[0118] Generative Artificial Intelligence

[0119] The centralized processing unit is equipped with a generative artificial intelligence (generative AI) that analyzes the integrated data and organizes it by category. This generative AI analyzes each transaction data and classifies it into the appropriate category. For example, "Deposit: 500 yen (cash)" may be classified as "food expenses," and "Expenses: 200 yen (electronic money)" may be classified as "daily necessities."

[0120] Feedback Methods

[0121] The user terminal is equipped with a feedback means for receiving the analysis results and notifying the user. For example, the user terminal may notify the user of the analysis results, such as "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[0122] By combining these elements, the present invention allows for centralized management of both cash and electronic money, thereby improving the efficiency of a user's household finances.

[0123] Specific examples

[0124] For example, if a user pays 200 yen using electronic money at a convenience store on May 1st and then deposits 500 yen in cash into their wallet on the same day, the smart storage device will record the location information as "Deposit: 500 yen" and send this to the user's device. The user's device will obtain the electronic money transaction data from the API and send it to the centralized processing device. The centralized processing device's artificial intelligence will classify this data as "food expenses" and provide feedback to the user's device.

[0125] Prompt Sentence Examples

[0126] Prompt: "Generate spending data for a user who spends 200 yen at a convenience store on May 1st and also puts 500 yen in cash into their wallet on the same day."

[0127] The above is an embodiment of the present invention. This system allows users to efficiently manage their cash and electronic money expenditure information, enabling them to manage their household finances in detail.

[0128] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0129] Step 1:

[0130] The terminal (smart storage device) uses a sensor to detect cash deposits and withdrawals. The input is the user's action of putting cash into or taking out cash from the smart storage device. For example, if a user puts 500 yen into the smart storage device, the sensor detects this and generates the data "Deposit: 500 yen." At the same time, the GPS module is used to obtain location information (longitude and latitude). The output is the data "Deposit: 500 yen" and "Location information: longitude X, latitude Y."

[0131] Step 2:

[0132] The terminal (smart storage device) uses Bluetooth to send the generated deposit data and location information to the user's terminal. The input is the aforementioned "Deposit: 500 yen" and "Location information: longitude X, latitude Y." The data is sent via Bluetooth communication and received by the user's terminal. As an output, the received data is temporarily saved in the internal database of the user's terminal.

[0133] Step 3:

[0134] The user terminal periodically calls the APIs of electronic payment services and financial institutions to obtain transaction data. The input is the authentication information and parameters required to make the API call. For example, if a user pays 200 yen with electronic money, the data "Expense: 200 yen" is obtained from the API. The output is the transaction data "Expense: 200 yen" and "Payment method: electronic money."

[0135] Step 4:

[0136] The user terminal transmits the received cash deposit and withdrawal data and electronic money transaction data to the centralized processing unit. The inputs are "Deposit: 500 yen," "Location information: longitude X, latitude Y," "Expense: 200 yen," and "Payment method: electronic money," all stored in the internal database. These data are transmitted to the centralized processing unit. The output is a unified data set received by the centralized processing unit.

[0137] Step 5:

[0138] The server (central processing device) uses a generation AI to analyze the integrated data and classify each transaction into the appropriate category. The input is integrated data such as "Deposit: 500 yen," "Expenses: 200 yen," and "Location information: longitude X, latitude Y." The generation AI analyzes this data and classifies it into categories such as "Deposit: 500 yen (food)" and "Expenses: 200 yen (daily necessities)." The output is data classified by category.

[0139] Step 6:

[0140] The user terminal receives the analysis results and notifies the user using a feedback means. The input is categorized data sent from the server. For example, data such as "Deposit: 500 yen (food)" and "Expenses: 200 yen (daily necessities)" arrives at the user terminal. The user terminal visually displays this data and notifies the user. The output is feedback to the user of specific categorized expenditure information, such as "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[0141] The above is the specific processing flow of the program for this system. At each step, the input data is utilized and appropriate data processing and calculations are performed, ultimately providing the user with information that is useful for managing their household finances.

[0142] (Application example 1)

[0143] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0144] Users who use both cash and electronic money face the challenge of managing their spending information in a unified manner and achieving efficient and accurate household management. Cash spending, in particular, is particularly cumbersome to manage manually, making it easy for records to be overlooked. Categorizing spending by category is also time-consuming, making accurate household management difficult.

[0145] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0146] In this invention, the server includes a smart wallet equipped with a sensor that detects cash deposits and withdrawals, communication means for transmitting deposit and withdrawal information detected by the smart wallet to a user terminal via Bluetooth, data transfer means for transmitting the deposit and withdrawal information received by the user terminal to a central server, means for integrating transaction data in the central server via APIs of multiple electronic money services and financial institutions, means for analyzing the integrated data and classifying it by category, a generation AI for analyzing and classifying the categorized data by the generation AI, means for feeding back the categorized data classified by the generation AI to the user terminal, and means for generating a monthly report based on the analysis and notifying the user. This not only enables centralized management of cash and electronic money spending information, but also enables efficient and accurate household management by classifying and generating monthly reports by category.

[0147] - A "cash deposit / withdrawal detection sensor" is a device that physically detects a user's cash deposit / withdrawal and records that information as digital data.

[0148] A "smart wallet" is a multi-functional wallet device equipped with sensors that detect cash deposits and withdrawals, communication means, location information acquisition means, etc.

[0149] "Communication means" is a function that transmits information acquired by the smart wallet to the user terminal using wireless communication technology such as Bluetooth.

[0150] A "user terminal" is a portable information terminal that receives data sent from the smart wallet and exchanges data with the central server.

[0151] The "data transfer means" is a function for transmitting data received by the user terminal to the central server.

[0152] The "central server" is a server system that integrates and analyzes data sent from multiple user terminals and provides feedback on the results to the users.

[0153] "APIs of multiple electronic money services and financial institutions" are application programming interfaces for obtaining information on electronic money transactions and financial transactions.

[0154] "Generative AI" is an artificial intelligence algorithm that analyzes the aggregated data and classifies it into categories.

[0155] "Classifying by category" means dividing expenditure data into categories such as food, transportation, and daily necessities.

[0156] "Feedback to the user terminal" means notifying or displaying the analysis results on the user terminal.

[0157] The "location information acquisition means" is a function that acquires the user's current location information using a GPS or the like.

[0158] A "monthly report" is a report that compiles expenditure data over a certain period (usually one month) and organizes it by category.

[0159] The specific details required to implement the present invention are described below. This invention is a system that streamlines household management for users who use both cash and electronic money and centrally manages expenditure information. This system is composed of a smart wallet, a user terminal, and a central server.

[0160] Smart Wallet

[0161] Smart wallets are equipped with sensors that detect cash deposits and withdrawals. The sensors identify physical cash deposits and withdrawals and record the amounts deposited and withdrawn as digital data. They also have built-in GPS as a means of acquiring location information, and obtain GPS data on the location where cash deposits and withdrawals were made. Bluetooth is used as a means of communication, and this data is sent to the user's device.

[0162] User terminal

[0163] The user terminal receives cash deposit and withdrawal information and location information from the smart wallet and transmits it to the central server using a data transfer means. The user terminal also has the function of periodically obtaining transaction data through the APIs of electronic money services and financial institutions. This transaction data is also transmitted to the central server.

[0164] Central Server

[0165] The central server integrates cash deposit and withdrawal data and electronic money data sent from user devices. The integrated data is analyzed using generative AI and classified by category. For example, automatic classification can divide data into categories such as food expenses, transportation expenses, and daily necessities. The classified data is managed centrally, and the analysis results are fed back to the user device.

[0166] Feedback and monthly reports

[0167] The central server generates a monthly report based on the data analysis results and notifies the user. This report details the total amount spent by category and monthly spending trends, allowing users to manage their household finances more efficiently.

[0168] Hardware and software used

[0169] Hardware: Smart wallet (sensor, GPS module, Bluetooth module), smartphone, central server

[0170] Software: Bluetooth protocol for communication, Python requests library for data transfer and API calls, Python data analysis libraries (e.g., pandas, scikit-learn) for data analysis including generative AI.

[0171] Specific examples

[0172] As a specific example, consider the case where a user puts 5,000 yen into their wallet and pays 2,000 yen with electronic money. At this time, the smart wallet generates data for "Deposit: 5,000 yen" and sends it to the smartphone via Bluetooth. The smartphone then calls the API to obtain data for "Expenses: 2,000 yen" and sends both data to the central server. The central server's generation AI analyzes the data and generates a monthly report stating "Total expenditures for May: 7,000 yen (cash: 5,000 yen, electronic money: 2,000 yen), food expenses: 3,000 yen, transportation expenses: 2,000 yen, other: 2,000 yen," and notifies the user.

[0173] Example prompts for generative AI models

[0174] Combine cash spending data from your smart wallet with transaction data from your e-money API and generate a monthly report that breaks down each spending data by category. Here's an example:

[0175] Cash expenditure: 5,000 yen, electronic money expenditure: 2,000 yen

[0176] Expected categories: Food, transportation, other

[0177] conclusion

[0178] This system allows for centralized management of cash and electronic money expenditure information, enabling efficient and accurate household management. Automatic classification and monthly report generation using generation AI reduces the burden on users and makes it easier to visualize expenditures.

[0179] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0180] Step 1:

[0181] A sensor installed in the smart wallet detects the user's cash deposits and withdrawals. The input is the user's cash deposit and withdrawal actions, which the sensor detects and generates digital data such as "Deposit: 5,000 yen" or "Withdrawal: 2,000 yen." The output is cash transaction data.

[0182] Step 2:

[0183] The location information acquisition means of the smart wallet uses GPS to acquire the location where cash deposits and withdrawals are made. The input is the user's location information, which is acquired by the GPS module. The output is location information data.

[0184] Step 3:

[0185] The smart wallet transmits cash transaction data and location information data to the user terminal via Bluetooth communication means. The input is the cash transaction data and location information data, which the Bluetooth communication module transmits to the user terminal. The output is the data received by the user terminal.

[0186] Step 4:

[0187] The user terminal transmits the cash transaction data and location information data received from the smart wallet to the central server. The input is the received data, which is transmitted to the central server by the data transmission means. The output is the data transmitted to the central server.

[0188] Step 5:

[0189] The user terminal periodically obtains transaction data using the APIs of electronic money services and financial institutions. The input is an API call, which the user terminal executes to obtain electronic money transaction data. The output is electronic money data.

[0190] Step 6:

[0191] The electronic money data acquired by the user terminal is transmitted to the central server. The input is the electronic money data, which is transmitted to the central server by the data transmission means. The output is the electronic money data transmitted to the central server.

[0192] Step 7:

[0193] The central server integrates the cash transaction data, location information data, and electronic money data sent from the user terminals. These data are input, and the data integration means performs the integration process. The output is an integrated transaction data set.

[0194] Step 8:

[0195] The generation AI on the central server analyzes the integrated dataset and classifies it into categories. The input is the integrated dataset, which the generation AI analyzes. The output is data classified into categories.

[0196] Step 9:

[0197] The central server generates a monthly report based on the analysis results and feeds it back to the user terminal. The input is categorized data, which the report generation means uses to create the monthly report. The output is the monthly report notified to the user terminal.

[0198] Step 10:

[0199] The user terminal receives the monthly report and notifies the user of the analysis results. The input is the monthly report, which is displayed by the user notification means. The output is a report display that can be viewed by the user.

[0200] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0201] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies the user's emotions in combination, enabling efficient household finance management and providing feedback and advice according to the user's emotional state.

[0202] System configuration

[0203] The system consists of the following main components:

[0204] 1. Smart Wallet

[0205] Sensor: Detects cash deposits and withdrawals.

[0206] Location information acquisition method: Location information is acquired using GPS.

[0207] Communication method: Send data to the user terminal via Bluetooth.

[0208] 2. User Device

[0209] Data receiving means: Receives deposit / withdrawal information and location information from the smart wallet.

[0210] Data transfer means: Sends received data to a central server.

[0211] API integration method: Obtain transaction data through APIs of electronic money and financial institutions.

[0212] 3. Emotion Engine

[0213] Emotional data collection methods: Emotional data is collected using the user's voice input, facial expression analysis, and pulse sensor.

[0214] Emotion analysis means: Analyzes the collected emotion data and determines the user's emotional state.

[0215] 4. Central Server

[0216] Data integration method: Integrates all data obtained from user devices and APIs.

[0217] Generative AI: Analyzes and categorizes integrated transactional and sentiment data.

[0218] 5. Feedback channels

[0219] User device notification: Notifies the user of the classification and analysis results and provides advice based on their emotional state.

[0220] Program processing and specific examples

[0221] Data collection

[0222] The terminal (smart wallet) detects cash deposits and withdrawals, records them as digital data, and also acquires location information via GPS. For example, when a user withdraws 500 yen, the sensor records "Withdrawal 500 yen" and the location information.

[0223] Data transmission

[0224] The terminal (smart wallet) uses Bluetooth to send the collected cash withdrawal information and location information to the user terminal. For example, "Withdrawal of 500 yen" and location information data are sent to the user terminal.

[0225] Acquiring electronic money data

[0226] The user device periodically obtains transaction data via APIs of electronic money and financial institutions. For example, if a user pays 200 yen with electronic money, the data "Expense of 200 yen" is obtained from the API.

[0227] Collecting Emotional Data

[0228] The emotion engine (user device) collects emotion data using the user's voice input, facial expression analysis, and pulse sensor. For example, if the user is feeling stressed, it obtains "stress state" data from facial expression analysis and pulse rate fluctuations.

[0229] Data Integration

[0230] The server receives cash and electronic money data and emotion data sent from the user's device and integrates them. For example, data such as "withdrawal of 500 yen (cash)," "expense of 200 yen (electronic money)," and "stress state" are integrated.

[0231] Data analysis and categorization

[0232] The server's AI analyzes the integrated data and categorizes it. It also customizes the analysis results based on emotional data. For example, a withdrawal of 500 yen would be classified as "food," an expenditure of 200 yen as "daily necessities," and the emotional state as "stress."

[0233] User Feedback

[0234] The app (user device) displays the analyzed and classified results to the user and also provides advice based on their emotional state. For example, it might display feedback such as, "Today's expenses: food 500 yen, daily necessities 200 yen. You are under high stress, so we recommend taking time to relax."

[0235] In this way, the present invention centrally manages cash and electronic money expenditure information, and further provides feedback and advice that takes emotional state into consideration, thereby supporting users in managing their household finances more accurately and efficiently.

[0236] The processing flow will be explained below.

[0237] Step 1:

[0238] The user uses cash or electronic money. For example, the user pays 500 yen in cash at a supermarket, and then pays 200 yen at a cafe with electronic money.

[0239] Step 2:

[0240] The terminal (smart wallet) uses a sensor to detect cash deposits and withdrawals and records the data. For example, if a user withdraws 500 yen in cash, the sensor will generate the data as "withdrawal of 500 yen."

[0241] Step 3:

[0242] The device (smart wallet) acquires location information using the GPS function. For example, it records the location where the user paid 500 yen at the supermarket.

[0243] Step 4:

[0244] The terminal (smart wallet) uses Bluetooth to send cash withdrawal information and location information to the user terminal. For example, "withdrawal of 500 yen" and the location information are sent to the user's smartphone.

[0245] Step 5:

[0246] The user terminal checks the data received from the smart wallet and sends it to the central server using the data transfer means. For example, the user terminal sends "Withdraw 500 yen" and its location information to the central server.

[0247] Step 6:

[0248] The user device periodically obtains transaction data via the API of electronic money or financial institutions. For example, if a user makes a payment of 200 yen using electronic money, that data is obtained from the API.

[0249] Step 7:

[0250] The emotion engine (user device) collects emotional data using the user's voice input, facial expression analysis, and pulse sensor. For example, if a user is relaxing in a cafe, data on their "relaxed state" can be obtained from their voice input and pulse rate.

[0251] Step 8:

[0252] The server receives cash and electronic money data and emotion data sent from the user terminal and integrates them. For example, it integrates data such as "withdrawal of 500 yen (cash)," "expense of 200 yen (electronic money)," and "relaxed state."

[0253] Step 9:

[0254] The server's AI analyzes the integrated data and categorizes it. It also customizes the analysis results based on emotional data. For example, a withdrawal of 500 yen would be classified as "food," an expenditure of 200 yen as "luxury items," and the emotional state as "relaxation."

[0255] Step 10:

[0256] The server then sends the analyzed and classified results to the user's device. For example, data such as "food expenses 500 yen," "luxury items 200 yen," and "relaxed state" is sent to the user's device.

[0257] Step 11:

[0258] The user's device displays the analysis results sent from the server to the user. For example, feedback such as "Today's expenses: food 500 yen, luxury items 200 yen. As you are mostly in a relaxed state, we recommend moderate exercise" is displayed.

[0259] The above is an explanation of each processing step and its specific operation.

[0260] Example 2

[0261] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0262] There is a demand for systems that can centrally manage cash and electronic money deposit and withdrawal information while providing feedback and advice based on the user's emotional state, thereby achieving more accurate expenditure management and mental health care than conventional household management systems. Existing systems have problems in that it is difficult to integrate cash and electronic money expenditure information, and they are unable to provide customized feedback based on the user's emotional state.

[0263] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0264] In this invention, the server includes a smart wallet equipped with a sensor for detecting cash deposits and withdrawals, communication means for transmitting the deposit and withdrawal information detected by the smart wallet to an electronic device via Bluetooth, data transfer means for transmitting the deposit and withdrawal information received by the electronic device to a central processing unit, means for integrating transaction data via application programming interfaces of multiple digital payment services and financial institutions, means for analyzing and categorizing the integrated data, means for providing feedback on the categorized data classified by the generation AI to the electronic device, emotion data collection means for collecting emotion data using voice input, facial expression analysis, and a pulse sensor, emotion analysis means for analyzing the emotion data and determining the user's emotional state, and means for integrating the user's emotion data and transaction data and customizing the analysis results based on the user's emotional state. This allows for centralized management of cash and electronic money spending information while providing personalized feedback and advice based on the user's emotional state.

[0265] A "smart wallet" is a device equipped with a sensor that detects cash deposits and withdrawals and has communication means to transmit that data to an electronic device.

[0266] "Electronic device" means an electronic device capable of receiving deposit and withdrawal information and emotional data from the smart wallet and transmitting it to the central processing unit.

[0267] "Central Processing Unit" refers to a server system that receives data from electronic devices and integrates and analyzes the data through application programming interfaces of multiple digital payment services and financial institutions.

[0268] "Digital payment services" are online services that provide transactions using electronic money.

[0269] An "application programming interface" is an interface that allows data to be exchanged between different software programs.

[0270] "Generative AI" is artificial intelligence that analyzes integrated data and classifies it into categories.

[0271] "Communication means" refers to a means for transmitting and receiving data between devices via wireless or wired communication.

[0272] A "data transfer means" is a method for transmitting data from an electronic device to a central processing unit.

[0273] The "emotion data collection means" is a means for collecting user emotion data using voice input, facial expression analysis, and a pulse sensor.

[0274] The "emotion analysis means" is a means for analyzing collected emotion data and determining the user's emotional state.

[0275] "Feedback means" refers to a method of notifying an electronic device of data analyzed and classified by the generative AI and providing feedback to the user.

[0276] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies the user's emotions in combination, enabling efficient household finance management and providing feedback and advice according to the user's emotional state.

[0277] System Configuration

[0278] Hardware

[0279] 1. Smart Wallet

[0280] Sensor: Detects cash deposits and withdrawals.

[0281] GPS module: Obtains location information.

[0282] Bluetooth module: Used as a communication means to transmit data to the user terminal.

[0283] 2. Electronic Devices (User Terminals)

[0284] Data receiving module: Receives data from the smart wallet.

[0285] Data transfer module: transmits the received data to the central processing unit.

[0286] API integration module: Obtains transaction data through APIs of digital payment services and financial institutions.

[0287] Emotion data collection module: Collects emotion data using the user's voice input, facial expression analysis, and pulse sensor.

[0288] 3. Central Processing Unit (Server)

[0289] Data integration module: Integrates data obtained from user devices and APIs.

[0290] Generative AI module: Analyzes data and classifies it into categories.

[0291] 4. Feedback System

[0292] Notification module: Notifies the user of the classification and analysis results and provides feedback.

[0293] software

[0294] 1. Generative AI Models

[0295] The integrated data is analyzed and classified into categories.

[0296] Customize analysis results based on emotional data.

[0297] 2. Prompt generation

[0298] For example, to generate a prompt like this:

[0299] Data Used:

[0300] 1. Cash expenditure: 500 yen (food)

[0301] 2. Electronic money expenditure: 200 yen (daily necessities)

[0302] 3. Emotional data: High stress

[0303] Provide feedback:

[0304] Provide users with advice based on today's spending category and emotional state.

[0305] Specific examples

[0306] For example, suppose a user pays 500 yen in cash at a cafe, and then later spends 200 yen using electronic money at a convenience store. The smart wallet records the cash withdrawal information and location information and sends them to the electronic device. The electronic device then obtains the electronic money spending data, and the emotion data collection module detects the user's stress level. This data is sent to the central processing unit and analyzed and classified by the generative AI model. Finally, the user's device receives feedback such as, "Today's spending: 500 yen for food, 200 yen for daily necessities. You are under high stress, so we recommend you relax."

[0307] In this way, the system of the present invention centrally manages cash and electronic money expenditure information, and further provides feedback and advice that takes emotional state into account, thereby supporting users in managing their household finances more accurately and efficiently.

[0308] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0309] Step 1:

[0310] Cash deposit and withdrawal detection

[0311] The terminal (smart wallet) detects cash deposits and withdrawals. A sensor is used to detect cash deposits and withdrawals in real time and record them as digital data. For example, when a user pays 500 yen, the sensor recognizes this as "withdrawal of 500 yen" and records it. The input is the user's cash deposit and withdrawal action, and the output is the digital data "withdrawal of 500 yen."

[0312] Step 2:

[0313] Obtaining location information

[0314] The terminal (smart wallet) acquires location information using a built-in GPS module. The location information corresponding to the cash deposit and withdrawal detected in the previous step is acquired and linked to digital data. For example, the location information (latitude and longitude) of the cafe where the payment was made is added to "Withdrawal of 500 yen." The input is location information from the GPS, and the output is composite data including "Withdrawal of 500 yen" and location information.

[0315] Step 3:

[0316] Data Transfer

[0317] The terminal (smart wallet) transmits the collected data on deposits and withdrawals and location information to an electronic device (user terminal) via Bluetooth. For example, data including "withdrawal of 500 yen, latitude and longitude" is transmitted to the user's smartphone. The input is the data recorded in the smart wallet, and the output is the data transmitted to the user terminal.

[0318] Step 4:

[0319] Acquisition of electronic money transaction data

[0320] The user's device periodically calls the APIs of the digital payment service and financial institution to obtain transaction data. For example, if a user spends 200 yen at a convenience store using electronic money, the transaction data is obtained from the API. The input is the APIs of the digital payment service and financial institution, and the output is the obtained transaction data.

[0321] Step 5:

[0322] Collecting Emotional Data

[0323] An emotion data collection module installed in the user's device collects emotion data using voice input, facial expression analysis, and a pulse sensor. For example, if a user feels stressed during their commute, their facial expression and pulse rate fluctuations will indicate that they are in a "stressed state." The input is the user's biometric data and voice data, and the output is data indicating their emotional state.

[0324] Step 6:

[0325] Data integration

[0326] The server receives cash deposit and withdrawal data, electronic money transaction data, and emotion data sent from the user terminal and integrates them. For example, it integrates data such as "withdrawal of 500 yen (cash), expenditure of 200 yen (electronic money), stress state." The inputs are cash data, electronic money data, and emotion data, and the output is an integrated dataset.

[0327] Step 7:

[0328] Data analysis and categorization

[0329] The server's generation AI module analyzes the integrated data and classifies it into categories. For example, a withdrawal of 500 yen is classified as "food expenses," an expenditure of 200 yen as "daily necessities," and an emotional state as "stress." The input is the integrated dataset, and the output is data classified by category.

[0330] Step 8:

[0331] User Feedback

[0332] The server sends the analysis and classification results to the user's device, and feedback is displayed on the user's device. For example, a notification such as "Today's expenses: food 500 yen, daily necessities 200 yen. Stress is high, so we recommend you relax" is displayed. The input is data classified by category, and the output is a feedback message to the user.

[0333] (Application example 2)

[0334] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0335] There is a demand for a household management system that not only centrally manages cash and electronic money deposit and withdrawal information, but also takes into account the user's emotional state. Conventional household management systems simply collect and classify expenditure data, but are unable to provide feedback that reflects the user's emotional and psychological state. As a result, they lack advice that takes into account the user's mental health, making it difficult to improve long-term household management.

[0336] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for transmitting deposit / withdrawal information from a smart wallet equipped with a sensor that detects cash deposits and withdrawals via Bluetooth to a user terminal; means for transmitting the deposit / withdrawal information received by the user terminal to a central server; means for integrating transaction data via APIs of multiple electronic money services and financial institutions; means for collecting emotional data using the user's voice input, facial expression analysis, and pulse sensor; means for including a generation AI that analyzes the integrated data and emotional data and classifies them by category; and means for providing the user terminal with feedback according to the categorized data and emotional state classified by the generation AI. This makes it possible to centrally manage cash and electronic money transaction information and provide feedback that takes into account the user's emotional state.

[0337] A "smart wallet" is an electronic device equipped with a sensor that detects cash deposits and withdrawals and has the ability to transmit data to a user terminal via Bluetooth.

[0338] "Communication means" refers to the technical means for transmitting deposit and withdrawal information from the smart wallet to the user terminal via Bluetooth.

[0339] "Data transfer means" refers to the technical means by which the user terminal transmits the deposit and withdrawal information received to the central server.

[0340] The "central server" is a central system that aggregates data sent from multiple user terminals and analyzes transaction data and emotional data.

[0341] "API" is an application programming interface for obtaining transaction data from electronic money services and financial institutions.

[0342] "Emotion data collection means" refers to technical means for collecting emotion data using the user's voice input, facial expression analysis, and pulse sensor.

[0343] "Generative AI" is an artificial intelligence technology that analyzes collected data and classifies it into categories.

[0344] "Feedback means" refers to a technical means for providing feedback to a user terminal according to the data and emotional state classified by the generating AI.

[0345] "Location information acquisition means" refers to a technical means for acquiring user location information using a GPS or the like.

[0346] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies user emotions. This system consists of the following main components:

[0347] Smart Wallet

[0348] The smart wallet is equipped with a sensor that detects cash deposits and withdrawals, and has a communication means that transmits data to a user terminal via Bluetooth. For example, when a user withdraws cash, this smart wallet detects "withdrawal" information in real time and transmits it to the user terminal.

[0349] User terminal

[0350] The user terminal is equipped with a data transfer means for receiving deposit and withdrawal information from the smart wallet and transmitting this information to a central server. It also has a function for periodically acquiring transaction data via APIs of electronic money services and financial institutions. Furthermore, the user terminal is equipped with an emotion data collection means for collecting emotion data using voice input, facial expression analysis, and a pulse sensor.

[0351] Central Server

[0352] The central server has the function of integrating cash and electronic money data and emotional data sent from user devices. This allows all transaction data and emotional data to be managed centrally. The central server is equipped with a generative AI that analyzes the integrated data and classifies it into categories. The results of this analysis serve as the basis for users to receive feedback based on their emotional data.

[0353] Data collection and analysis

[0354] For example, if a user pays 500 yen, the smart wallet detects the corresponding cash withdrawal data, and then makes a further electronic payment of 200 yen, these data are centrally imported into the user's terminal. The emotional data collection means then collects the user's emotional state (e.g., stress level) and sends it to a central server. The data is then integrated and analyzed by the AI ​​generator, which categorizes the spending information and generates feedback according to the user's emotional state.

[0355] Feedback Methods

[0356] Based on the analyzed expenditure data and emotion data, the user device will provide appropriate feedback to the user. For example, a notification such as "Today's expenditure: Food 500 yen, daily necessities 200 yen. Stress is high, so we recommend taking time to relax" will be displayed on the user device.

[0357] Examples and prompts

[0358] As a concrete example, if the cash withdrawal data from the smart wallet shows "500 yen" and the electronic money expenditure of "200 yen", and the user's emotional state is judged to be "stressed", the following user feedback will be displayed:

[0359] Analyze the given expenditure data (cash and electronic money) and emotional data, and classify them into expenditure categories (food, daily necessities, etc.) and emotional states (stress, relaxation, etc.). Example: Withdrawal of 500 yen (cash), expenditure of 200 yen (electronic money), emotional state (stress).

[0360] This system not only allows users to centrally manage their cash and electronic money transaction information, but also provides feedback based on their emotional state, enabling healthier and more efficient household management, thereby improving the quality of life for users compared to conventional household management systems.

[0361] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0362] Step 1:

[0363] The smart wallet uses sensors to detect cash deposits and withdrawals and records the information as digital data. This data includes information such as "withdrawal of 500 yen" and "deposit of 1000 yen." At the same time, GPS data is also acquired using location information acquisition means. This allows the location of the withdrawal or deposit to be recorded. The input is the physical movement of cash, and the output is cash deposit and withdrawal data and location information.

[0364] Step 2:

[0365] The smart wallet transmits the acquired deposit and withdrawal data and location information to the user's device via Bluetooth. The user's device receives this data using Bluetooth communication and temporarily stores it internally. The input is data sent from the smart wallet, and the output is digital data stored in the user's device.

[0366] Step 3:

[0367] The user terminal periodically obtains transaction data through the APIs of electronic money services and financial institutions. This also allows for the acquisition of electronic money expenditure information. This acquisition process requires an internet connection and corresponding API authentication. The input is authentication information and transaction data requests from each API, and the output is the transaction data acquisition results.

[0368] Step 4:

[0369] The user terminal uses emotion data collection means to collect data from the user's voice input, facial expression analysis, and pulse sensor. For example, the user's face is photographed with a camera and facial expression analysis software is used to detect emotional states such as "stress" and "relaxation." The user's emotions are also analyzed from voice input. The input is the user's facial expression, voice, and pulse data, and the output is the result of the emotion analysis.

[0370] Step 5:

[0371] The user terminal transmits the cash deposit and withdrawal data, electronic money transaction data, and emotion data acquired to the central server, which then aggregates all data. The input is all data stored on the user terminal, and the output is the digital data transmitted to the central server.

[0372] Step 6:

[0373] The central server uses a data integration means to integrate the received cash and electronic money data and emotion data. This integrated data is managed centrally and serves as the basis for analysis. The input is multiple data sources sent from user terminals, and the output is the integrated data.

[0374] Step 7:

[0375] The generation AI on the central server analyzes the integrated data and classifies it into categories. During this analysis, emotional data is also taken into consideration. For example, of a 500 yen withdrawal, 400 yen may be classified as "food expenses" and 100 yen as "miscellaneous expenses," with the emotional state corresponding to "stress." A machine learning model is used in this process. The input is the integrated data, and the output is the analysis results and category classification.

[0376] Step 8:

[0377] The central server feeds back the analysis results of the generative AI to the user's device. The user's device receives this and displays specific feedback to the user. For example, a notification may be displayed saying, "Today's expenses: 500 yen for food, 200 yen for daily necessities. Stress is high, so we recommend taking time to relax." The input is the analysis results of the generative AI, and the output is feedback information to the user.

[0378] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0379] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0380] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0381] [Second embodiment]

[0382] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0383] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0384] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0385] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0386] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0387] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0388] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0389] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0390] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0391] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0392] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0393] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0394] The present invention provides a system for managing expenditures of both cash and electronic money in an integrated manner, thereby enabling efficient household management when a user uses both cash and electronic money at the same time. Hereinafter, a detailed description will be given of an embodiment of the present invention.

[0395] System configuration

[0396] The system consists of the following main components:

[0397] 1. Smart Wallet

[0398] Sensor: Detects cash deposits and withdrawals.

[0399] Location information acquisition method: Location information is acquired using GPS.

[0400] Communication method: Send data to the user terminal via Bluetooth.

[0401] 2. User Device

[0402] Data receiving means: Receives deposit and withdrawal information and location information from the smart wallet.

[0403] Data transfer means: Sends received data to a central server.

[0404] API integration method: Obtain transaction data through APIs of electronic money and financial institutions.

[0405] 3. Central Server

[0406] Data integration method: Integrates all data obtained from user devices and APIs.

[0407] Generative AI: Analyzes the combined data and classifies it into categories.

[0408] 4. Feedback methods

[0409] User terminal notification: Notify the user of the classification and analysis results.

[0410] Program processing and specific examples

[0411] Data collection

[0412] The terminal (smart wallet) detects cash deposits and withdrawals and records them as digital data. At the same time, location information is obtained via GPS. For example, if a user deposits 500 yen into their wallet, the sensor detects this and generates the data "Deposit: 500 yen," along with the location information being recorded.

[0413] Data transmission

[0414] The terminal (smart wallet) uses Bluetooth to transmit the deposit data and location information to the user terminal, which receives it and transmits it to the central server using a data transfer means.

[0415] Acquiring electronic money data

[0416] The user device periodically obtains transaction data using APIs of electronic money and financial institutions. For example, if a user pays 200 yen with electronic money, the data "Expenses: 200 yen" is obtained through the API.

[0417] Data Integration

[0418] The server integrates the cash deposit and withdrawal data sent from the user terminal with the electronic money data obtained through the API, thereby generating an integrated data set.

[0419] Data analysis and categorization

[0420] The server's generation AI analyzes the integrated data and classifies each transaction into the appropriate category. For example, a "Deposit: 500 yen (cash)" and "Expense: 200 yen (electronic money)" may be classified as food expenses.

[0421] User Feedback

[0422] The app (user device) notifies and displays the analysis results to the user. For example, it may display information such as, "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[0423] In this way, the present invention provides a household management system that can efficiently manage both cash and electronic money. Furthermore, by using location-based prediction functions and automatic categorization using AI generation, the burden of input by the user is minimized, enabling accurate household management.

[0424] The processing flow will be explained below.

[0425] Step 1:

[0426] The user uses cash or electronic money. For example, the user pays 500 yen in cash at a supermarket and then pays 200 yen in electronic money at another store.

[0427] Step 2:

[0428] The device (smart wallet) uses sensors to detect cash deposits and withdrawals, and records the data while acquiring location information. For example, if 500 yen is withdrawn in cash, it will record "withdrawal of 500 yen" and the location information.

[0429] Step 3:

[0430] The terminal (smart wallet) uses Bluetooth to send the collected cash deposit and withdrawal information and location information to the user's terminal. For example, the information "withdrawal of 500 yen" and location information are sent to the user's smartphone.

[0431] Step 4:

[0432] The user terminal checks the data received from the smart wallet and sends it to the central server using a data transfer method. For example, "Withdraw 500 yen" and location information are sent to the central server.

[0433] Step 5:

[0434] The user device obtains transaction data through the API of electronic money or financial institutions. For example, data on a payment of 200 yen with electronic money, such as "Expense 200 yen," is received from the API.

[0435] Step 6:

[0436] The server receives the cash and electronic money data sent from the user terminal and integrates them. For example, "withdrawal of 500 yen (cash)" and "expense of 200 yen (electronic money)" are integrated.

[0437] Step 7:

[0438] The server's AI analyzes the integrated data and categorizes it. For example, a withdrawal of 500 yen might be classified as "food" based on location information, and an expenditure of 200 yen might be classified as "daily necessities."

[0439] Step 8:

[0440] The server then sends the analyzed and classified results to the user's device. For example, data such as "food expenses 500 yen, daily necessities 200 yen" is sent to the user's smartphone.

[0441] Step 9:

[0442] The user device displays the analysis results sent from the server to the user. For example, the app screen displays "Today's expenses: food 500 yen, daily necessities 200 yen."

[0443] The above is an explanation of each processing step and its specific operation.

[0444] Example 1

[0445] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0446] When cash and electronic money expenditure information is used in parallel, users must manage each expenditure information separately, which is cumbersome for users and makes it difficult to manage their household finances efficiently. Furthermore, since cash expenditures are recorded manually, there is a risk of input errors or omissions. Furthermore, the task of categorizing each transaction is a heavy burden, making accurate household finances difficult to manage.

[0447] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0448] In this invention, the server comprises a smart storage device equipped with a sensor that detects cash deposits and withdrawals,

[0449] a communication means for transmitting the deposit and withdrawal information detected by the smart storage device to a user terminal via wireless communication;

[0450] a data transfer means for transmitting the deposit / withdrawal information received by the user terminal to the centralized processing unit;

[0451] means for aggregating transaction data via application interfaces of a plurality of electronic payment services and financial institutions in the centralized processing unit;

[0452] means for analyzing the integrated data and organizing it into categories; and

[0453] A means for feeding back the data classified by the generating artificial intelligence to a user terminal;

[0454] This will enable centralized management of cash and electronic money expenditure information, enabling efficient household management.

[0455] A "smart storage device" is an electronic device equipped with a sensor that detects cash deposits and withdrawals.

[0456] "Communication means" refers to a mechanism for transmitting data to other electronic devices using wireless communication.

[0457] A "user terminal" refers to an electronic device such as a computer or smartphone used by a user.

[0458] "Data transfer means" refers to a mechanism that has the function of transmitting data from one electronic device to another.

[0459] A "centralized processing device" is a server or mainframe computer used to centrally manage and analyze multiple data sets.

[0460] "Electronic payment services" are services for making payments online, including credit cards and digital wallets.

[0461] An "application interface" provides a connection through which different software systems can communicate with each other.

[0462] "Transaction Data" means data that includes information regarding expenses and income.

[0463] "Generative AI" refers to software and systems that use machine learning and artificial intelligence techniques to analyze large amounts of data and recognize patterns.

[0464] "Feedback means" refers to a mechanism for providing analysis results and notifications to users.

[0465] The present invention is a system that allows users who use both cash and electronic money to centrally manage their expenditure information and achieve efficient household management. This system uses the following main hardware and software:

[0466] Smart storage equipment

[0467] The smart storage device is equipped with a sensor to detect cash deposits and withdrawals. It also has a built-in GPS as a means of acquiring location information. Each time it detects a cash deposit or withdrawal, it records that information and the location information. For example, if a user deposits 500 yen into their wallet, the sensor will detect "Deposit: 500 yen" and record the location information (longitude and latitude) acquired by the GPS.

[0468] communication means

[0469] The smart storage device transmits recorded deposit and withdrawal information and location information to the user's terminal using wireless communication, such as Bluetooth, eliminating the need for the user to manually enter information and automatically synchronizing the data.

[0470] User terminal

[0471] The user terminal is equipped with a data transfer means that temporarily stores the received deposit and withdrawal information and location information in an internal database and periodically transmits it to the centralized processing unit. The user terminal also periodically obtains electronic money transaction data through the application programming interfaces (APIs) of multiple electronic payment services and financial institutions. For example, if a user pays 200 yen with electronic money, the transaction data "Expenses: 200 yen" is obtained through the API.

[0472] Centralized Processing Unit

[0473] The centralized processing unit has the function of integrating cash deposit and withdrawal data sent from user terminals with electronic money data obtained through APIs, which allows all transaction data to be managed centrally and analyzed efficiently.

[0474] Generative Artificial Intelligence

[0475] The centralized processing unit is equipped with a generative artificial intelligence (generative AI) that analyzes the integrated data and organizes it by category. This generative AI analyzes each transaction data and classifies it into the appropriate category. For example, "Deposit: 500 yen (cash)" may be classified as "food expenses," and "Expenses: 200 yen (electronic money)" may be classified as "daily necessities."

[0476] Feedback Methods

[0477] The user terminal is equipped with a feedback means for receiving the analysis results and notifying the user. For example, the user terminal may notify the user of the analysis results, such as "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[0478] By combining these elements, the present invention allows for centralized management of both cash and electronic money, thereby improving the efficiency of a user's household finances.

[0479] Specific examples

[0480] For example, if a user pays 200 yen using electronic money at a convenience store on May 1st and then deposits 500 yen in cash into their wallet on the same day, the smart storage device will record the location information as "Deposit: 500 yen" and send this to the user's device. The user's device will obtain the electronic money transaction data from the API and send it to the centralized processing device. The centralized processing device's artificial intelligence will classify this data as "food expenses" and provide feedback to the user's device.

[0481] Prompt Sentence Examples

[0482] Prompt: "Generate spending data for a user who spends 200 yen at a convenience store on May 1st and also puts 500 yen in cash into their wallet on the same day."

[0483] The above is an embodiment of the present invention. This system allows users to efficiently manage their cash and electronic money expenditure information, enabling them to manage their household finances in detail.

[0484] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0485] Step 1:

[0486] The terminal (smart storage device) uses a sensor to detect cash deposits and withdrawals. The input is the user's action of putting cash into or taking out cash from the smart storage device. For example, if a user puts 500 yen into the smart storage device, the sensor detects this and generates the data "Deposit: 500 yen." At the same time, the GPS module is used to obtain location information (longitude and latitude). The output is the data "Deposit: 500 yen" and "Location information: longitude X, latitude Y."

[0487] Step 2:

[0488] The terminal (smart storage device) uses Bluetooth to send the generated deposit data and location information to the user's terminal. The input is the aforementioned "Deposit: 500 yen" and "Location information: longitude X, latitude Y." The data is sent via Bluetooth communication and received by the user's terminal. As an output, the received data is temporarily saved in the internal database of the user's terminal.

[0489] Step 3:

[0490] The user terminal periodically calls the APIs of electronic payment services and financial institutions to obtain transaction data. The input is the authentication information and parameters required to make the API call. For example, if a user pays 200 yen with electronic money, the data "Expense: 200 yen" is obtained from the API. The output is the transaction data "Expense: 200 yen" and "Payment method: electronic money."

[0491] Step 4:

[0492] The user terminal transmits the received cash deposit and withdrawal data and electronic money transaction data to the centralized processing unit. The inputs are "Deposit: 500 yen," "Location information: longitude X, latitude Y," "Expense: 200 yen," and "Payment method: electronic money," all stored in the internal database. These data are transmitted to the centralized processing unit. The output is a unified data set received by the centralized processing unit.

[0493] Step 5:

[0494] The server (central processing device) uses a generation AI to analyze the integrated data and classify each transaction into the appropriate category. The input is integrated data such as "Deposit: 500 yen," "Expenses: 200 yen," and "Location information: longitude X, latitude Y." The generation AI analyzes this data and classifies it into categories such as "Deposit: 500 yen (food)" and "Expenses: 200 yen (daily necessities)." The output is data classified by category.

[0495] Step 6:

[0496] The user terminal receives the analysis results and notifies the user using a feedback means. The input is categorized data sent from the server. For example, data such as "Deposit: 500 yen (food)" and "Expenses: 200 yen (daily necessities)" arrives at the user terminal. The user terminal visually displays this data and notifies the user. The output is feedback to the user of specific categorized expenditure information, such as "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[0497] The above is the specific processing flow of the program for this system. At each step, the input data is utilized and appropriate data processing and calculations are performed, ultimately providing the user with information that is useful for managing their household finances.

[0498] (Application example 1)

[0499] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0500] Users who use both cash and electronic money face the challenge of managing their spending information in a unified manner and achieving efficient and accurate household management. Cash spending, in particular, is particularly cumbersome to manage manually, making it easy for records to be overlooked. Categorizing spending by category is also time-consuming, making accurate household management difficult.

[0501] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0502] In this invention, the server includes a smart wallet equipped with a sensor that detects cash deposits and withdrawals, communication means for transmitting deposit and withdrawal information detected by the smart wallet to a user terminal via Bluetooth, data transfer means for transmitting the deposit and withdrawal information received by the user terminal to a central server, means for integrating transaction data in the central server via APIs of multiple electronic money services and financial institutions, means for analyzing the integrated data and classifying it by category, a generation AI for analyzing and classifying the categorized data by the generation AI, means for feeding back the categorized data classified by the generation AI to the user terminal, and means for generating a monthly report based on the analysis and notifying the user. This not only enables centralized management of cash and electronic money spending information, but also enables efficient and accurate household management by classifying and generating monthly reports by category.

[0503] - A "cash deposit / withdrawal detection sensor" is a device that physically detects a user's cash deposit / withdrawal and records that information as digital data.

[0504] A "smart wallet" is a multi-functional wallet device equipped with sensors that detect cash deposits and withdrawals, communication means, location information acquisition means, etc.

[0505] "Communication means" is a function that transmits information acquired by the smart wallet to the user terminal using wireless communication technology such as Bluetooth.

[0506] A "user terminal" is a portable information terminal that receives data sent from the smart wallet and exchanges data with the central server.

[0507] The "data transfer means" is a function for transmitting data received by the user terminal to the central server.

[0508] The "central server" is a server system that integrates and analyzes data sent from multiple user terminals and provides feedback on the results to the users.

[0509] "APIs of multiple electronic money services and financial institutions" are application programming interfaces for obtaining information on electronic money transactions and financial transactions.

[0510] "Generative AI" is an artificial intelligence algorithm that analyzes the aggregated data and classifies it into categories.

[0511] "Classifying by category" means dividing expenditure data into categories such as food, transportation, and daily necessities.

[0512] "Feedback to the user terminal" means notifying or displaying the analysis results on the user terminal.

[0513] The "location information acquisition means" is a function that acquires the user's current location information using a GPS or the like.

[0514] A "monthly report" is a report that compiles expenditure data over a certain period (usually one month) and organizes it by category.

[0515] The specific details required to implement the present invention are described below. This invention is a system that streamlines household management for users who use both cash and electronic money and centrally manages expenditure information. This system is composed of a smart wallet, a user terminal, and a central server.

[0516] Smart Wallet

[0517] Smart wallets are equipped with sensors that detect cash deposits and withdrawals. The sensors identify physical cash deposits and withdrawals and record the amounts deposited and withdrawn as digital data. They also have built-in GPS as a means of acquiring location information, and obtain GPS data on the location where cash deposits and withdrawals were made. Bluetooth is used as a means of communication, and this data is sent to the user's device.

[0518] User terminal

[0519] The user terminal receives cash deposit and withdrawal information and location information from the smart wallet and transmits it to the central server using a data transfer means. The user terminal also has the function of periodically obtaining transaction data through the APIs of electronic money services and financial institutions. This transaction data is also transmitted to the central server.

[0520] Central Server

[0521] The central server integrates cash deposit and withdrawal data and electronic money data sent from user devices. The integrated data is analyzed using generative AI and classified by category. For example, automatic classification can divide data into categories such as food expenses, transportation expenses, and daily necessities. The classified data is managed centrally, and the analysis results are fed back to the user device.

[0522] Feedback and monthly reports

[0523] The central server generates a monthly report based on the data analysis results and notifies the user. This report details the total amount spent by category and monthly spending trends, allowing users to manage their household finances more efficiently.

[0524] Hardware and software used

[0525] Hardware: Smart wallet (sensor, GPS module, Bluetooth module), smartphone, central server

[0526] Software: Bluetooth protocol for communication, Python requests library for data transfer and API calls, Python data analysis libraries (e.g., pandas, scikit-learn) for data analysis including generative AI.

[0527] Specific examples

[0528] As a specific example, consider the case where a user puts 5,000 yen into their wallet and pays 2,000 yen with electronic money. At this time, the smart wallet generates data for "Deposit: 5,000 yen" and sends it to the smartphone via Bluetooth. The smartphone then calls the API to obtain data for "Expenses: 2,000 yen" and sends both data to the central server. The central server's generation AI analyzes the data and generates a monthly report stating "Total expenditures for May: 7,000 yen (cash: 5,000 yen, electronic money: 2,000 yen), food expenses: 3,000 yen, transportation expenses: 2,000 yen, other: 2,000 yen," and notifies the user.

[0529] Example prompts for generative AI models

[0530] Combine cash spending data from your smart wallet with transaction data from your e-money API and generate a monthly report that breaks down each spending data by category. Here's an example:

[0531] Cash expenditure: 5,000 yen, electronic money expenditure: 2,000 yen

[0532] Expected categories: Food, transportation, other

[0533] conclusion

[0534] This system allows for centralized management of cash and electronic money expenditure information, enabling efficient and accurate household management. Automatic classification and monthly report generation using generation AI reduces the burden on users and makes it easier to visualize expenditures.

[0535] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0536] Step 1:

[0537] A sensor installed in the smart wallet detects the user's cash deposits and withdrawals. The input is the user's cash deposit and withdrawal actions, which the sensor detects and generates digital data such as "Deposit: 5,000 yen" or "Withdrawal: 2,000 yen." The output is cash transaction data.

[0538] Step 2:

[0539] The location information acquisition means of the smart wallet uses GPS to acquire the location where cash deposits and withdrawals are made. The input is the user's location information, which is acquired by the GPS module. The output is location information data.

[0540] Step 3:

[0541] The smart wallet transmits cash transaction data and location information data to the user terminal via Bluetooth communication means. The input is the cash transaction data and location information data, which the Bluetooth communication module transmits to the user terminal. The output is the data received by the user terminal.

[0542] Step 4:

[0543] The user terminal transmits the cash transaction data and location information data received from the smart wallet to the central server. The input is the received data, which is transmitted to the central server by the data transmission means. The output is the data transmitted to the central server.

[0544] Step 5:

[0545] The user terminal periodically obtains transaction data using the APIs of electronic money services and financial institutions. The input is an API call, which the user terminal executes to obtain electronic money transaction data. The output is electronic money data.

[0546] Step 6:

[0547] The electronic money data acquired by the user terminal is transmitted to the central server. The input is the electronic money data, which is transmitted to the central server by the data transmission means. The output is the electronic money data transmitted to the central server.

[0548] Step 7:

[0549] The central server integrates the cash transaction data, location information data, and electronic money data sent from the user terminals. These data are input, and the data integration means performs the integration process. The output is an integrated transaction data set.

[0550] Step 8:

[0551] The generation AI on the central server analyzes the integrated dataset and classifies it into categories. The input is the integrated dataset, which the generation AI analyzes. The output is data classified into categories.

[0552] Step 9:

[0553] The central server generates a monthly report based on the analysis results and feeds it back to the user terminal. The input is categorized data, which the report generation means uses to create the monthly report. The output is the monthly report notified to the user terminal.

[0554] Step 10:

[0555] The user terminal receives the monthly report and notifies the user of the analysis results. The input is the monthly report, which is displayed by the user notification means. The output is a report display that can be viewed by the user.

[0556] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0557] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies the user's emotions in combination, enabling efficient household finance management and providing feedback and advice according to the user's emotional state.

[0558] System configuration

[0559] The system consists of the following main components:

[0560] 1. Smart Wallet

[0561] Sensor: Detects cash deposits and withdrawals.

[0562] Location information acquisition method: Location information is acquired using GPS.

[0563] Communication method: Send data to the user terminal via Bluetooth.

[0564] 2. User Device

[0565] Data receiving means: Receives deposit / withdrawal information and location information from the smart wallet.

[0566] Data transfer means: Sends received data to a central server.

[0567] API integration method: Obtain transaction data through APIs of electronic money and financial institutions.

[0568] 3. Emotion Engine

[0569] Emotional data collection methods: Emotional data is collected using the user's voice input, facial expression analysis, and pulse sensor.

[0570] Emotion analysis means: Analyzes the collected emotion data and determines the user's emotional state.

[0571] 4. Central Server

[0572] Data integration method: Integrates all data obtained from user devices and APIs.

[0573] Generative AI: Analyzes and categorizes integrated transactional and sentiment data.

[0574] 5. Feedback channels

[0575] User device notification: Notifies the user of the classification and analysis results and provides advice based on their emotional state.

[0576] Program processing and specific examples

[0577] Data collection

[0578] The terminal (smart wallet) detects cash deposits and withdrawals, records them as digital data, and also acquires location information via GPS. For example, when a user withdraws 500 yen, the sensor records "Withdrawal 500 yen" and the location information.

[0579] Data transmission

[0580] The terminal (smart wallet) uses Bluetooth to send the collected cash withdrawal information and location information to the user terminal. For example, "Withdrawal of 500 yen" and location information data are sent to the user terminal.

[0581] Acquiring electronic money data

[0582] The user device periodically obtains transaction data via APIs of electronic money and financial institutions. For example, if a user pays 200 yen with electronic money, the data "Expense of 200 yen" is obtained from the API.

[0583] Collecting Emotional Data

[0584] The emotion engine (user device) collects emotion data using the user's voice input, facial expression analysis, and pulse sensor. For example, if the user is feeling stressed, it obtains "stress state" data from facial expression analysis and pulse rate fluctuations.

[0585] Data Integration

[0586] The server receives cash and electronic money data and emotion data sent from the user's device and integrates them. For example, data such as "withdrawal of 500 yen (cash)," "expense of 200 yen (electronic money)," and "stress state" are integrated.

[0587] Data analysis and categorization

[0588] The server's AI analyzes the integrated data and categorizes it. It also customizes the analysis results based on emotional data. For example, a withdrawal of 500 yen would be classified as "food," an expenditure of 200 yen as "daily necessities," and the emotional state as "stress."

[0589] User Feedback

[0590] The app (user device) displays the analyzed and classified results to the user and also provides advice based on their emotional state. For example, it might display feedback such as, "Today's expenses: food 500 yen, daily necessities 200 yen. You are under high stress, so we recommend taking time to relax."

[0591] In this way, the present invention centrally manages cash and electronic money expenditure information, and further provides feedback and advice that takes emotional state into consideration, thereby supporting users in managing their household finances more accurately and efficiently.

[0592] The processing flow will be explained below.

[0593] Step 1:

[0594] The user uses cash or electronic money. For example, the user pays 500 yen in cash at a supermarket, and then pays 200 yen at a cafe with electronic money.

[0595] Step 2:

[0596] The terminal (smart wallet) uses a sensor to detect cash deposits and withdrawals and records the data. For example, if a user withdraws 500 yen in cash, the sensor will generate the data as "withdrawal of 500 yen."

[0597] Step 3:

[0598] The device (smart wallet) acquires location information using the GPS function. For example, it records the location where the user paid 500 yen at the supermarket.

[0599] Step 4:

[0600] The terminal (smart wallet) uses Bluetooth to send cash withdrawal information and location information to the user terminal. For example, "withdrawal of 500 yen" and the location information are sent to the user's smartphone.

[0601] Step 5:

[0602] The user terminal checks the data received from the smart wallet and sends it to the central server using the data transfer means. For example, the user terminal sends "Withdraw 500 yen" and its location information to the central server.

[0603] Step 6:

[0604] The user device periodically obtains transaction data via the API of electronic money or financial institutions. For example, if a user makes a payment of 200 yen using electronic money, that data is obtained from the API.

[0605] Step 7:

[0606] The emotion engine (user device) collects emotional data using the user's voice input, facial expression analysis, and pulse sensor. For example, if a user is relaxing in a cafe, data on their "relaxed state" can be obtained from their voice input and pulse rate.

[0607] Step 8:

[0608] The server receives cash and electronic money data and emotion data sent from the user terminal and integrates them. For example, it integrates data such as "withdrawal of 500 yen (cash)," "expense of 200 yen (electronic money)," and "relaxed state."

[0609] Step 9:

[0610] The server's AI analyzes the integrated data and categorizes it. It also customizes the analysis results based on emotional data. For example, a withdrawal of 500 yen would be classified as "food," an expenditure of 200 yen as "luxury items," and the emotional state as "relaxation."

[0611] Step 10:

[0612] The server then sends the analyzed and classified results to the user's device. For example, data such as "food expenses 500 yen," "luxury items 200 yen," and "relaxed state" is sent to the user's device.

[0613] Step 11:

[0614] The user's device displays the analysis results sent from the server to the user. For example, feedback such as "Today's expenses: food 500 yen, luxury items 200 yen. As you are mostly in a relaxed state, we recommend moderate exercise" is displayed.

[0615] The above is an explanation of each processing step and its specific operation.

[0616] Example 2

[0617] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0618] There is a demand for systems that can centrally manage cash and electronic money deposit and withdrawal information while providing feedback and advice based on the user's emotional state, thereby achieving more accurate expenditure management and mental health care than conventional household management systems. Existing systems have problems in that it is difficult to integrate cash and electronic money expenditure information, and they are unable to provide customized feedback based on the user's emotional state.

[0619] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0620] In this invention, the server includes a smart wallet equipped with a sensor for detecting cash deposits and withdrawals, communication means for transmitting the deposit and withdrawal information detected by the smart wallet to an electronic device via Bluetooth, data transfer means for transmitting the deposit and withdrawal information received by the electronic device to a central processing unit, means for integrating transaction data via application programming interfaces of multiple digital payment services and financial institutions, means for analyzing and categorizing the integrated data, means for providing feedback on the categorized data classified by the generation AI to the electronic device, emotion data collection means for collecting emotion data using voice input, facial expression analysis, and a pulse sensor, emotion analysis means for analyzing the emotion data and determining the user's emotional state, and means for integrating the user's emotion data and transaction data and customizing the analysis results based on the user's emotional state. This allows for centralized management of cash and electronic money spending information while providing personalized feedback and advice based on the user's emotional state.

[0621] A "smart wallet" is a device equipped with a sensor that detects cash deposits and withdrawals and has communication means to transmit that data to an electronic device.

[0622] "Electronic device" means an electronic device capable of receiving deposit and withdrawal information and emotional data from the smart wallet and transmitting it to the central processing unit.

[0623] "Central Processing Unit" refers to a server system that receives data from electronic devices and integrates and analyzes the data through application programming interfaces of multiple digital payment services and financial institutions.

[0624] "Digital payment services" are online services that provide transactions using electronic money.

[0625] An "application programming interface" is an interface that allows data to be exchanged between different software programs.

[0626] "Generative AI" is artificial intelligence that analyzes integrated data and classifies it into categories.

[0627] "Communication means" refers to a means for transmitting and receiving data between devices via wireless or wired communication.

[0628] A "data transfer means" is a method for transmitting data from an electronic device to a central processing unit.

[0629] The "emotion data collection means" is a means for collecting user emotion data using voice input, facial expression analysis, and a pulse sensor.

[0630] The "emotion analysis means" is a means for analyzing collected emotion data and determining the user's emotional state.

[0631] "Feedback means" refers to a method of notifying an electronic device of data analyzed and classified by the generative AI and providing feedback to the user.

[0632] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies the user's emotions in combination, enabling efficient household finance management and providing feedback and advice according to the user's emotional state.

[0633] System Configuration

[0634] Hardware

[0635] 1. Smart Wallet

[0636] Sensor: Detects cash deposits and withdrawals.

[0637] GPS module: Obtains location information.

[0638] Bluetooth module: Used as a communication means to transmit data to the user terminal.

[0639] 2. Electronic Devices (User Terminals)

[0640] Data receiving module: Receives data from the smart wallet.

[0641] Data transfer module: transmits the received data to the central processing unit.

[0642] API integration module: Obtains transaction data through APIs of digital payment services and financial institutions.

[0643] Emotion data collection module: Collects emotion data using the user's voice input, facial expression analysis, and pulse sensor.

[0644] 3. Central Processing Unit (Server)

[0645] Data integration module: Integrates data obtained from user devices and APIs.

[0646] Generative AI module: Analyzes data and classifies it into categories.

[0647] 4. Feedback System

[0648] Notification module: Notifies the user of the classification and analysis results and provides feedback.

[0649] software

[0650] 1. Generative AI Models

[0651] The integrated data is analyzed and classified into categories.

[0652] Customize analysis results based on emotional data.

[0653] 2. Prompt generation

[0654] For example, to generate a prompt like this:

[0655] Data Used:

[0656] 1. Cash expenditure: 500 yen (food)

[0657] 2. Electronic money expenditure: 200 yen (daily necessities)

[0658] 3. Emotional data: High stress

[0659] Provide feedback:

[0660] Provide users with advice based on today's spending category and emotional state.

[0661] Specific examples

[0662] For example, suppose a user pays 500 yen in cash at a cafe, and then later spends 200 yen using electronic money at a convenience store. The smart wallet records the cash withdrawal information and location information and sends them to the electronic device. The electronic device then obtains the electronic money spending data, and the emotion data collection module detects the user's stress level. This data is sent to the central processing unit and analyzed and classified by the generative AI model. Finally, the user's device receives feedback such as, "Today's spending: 500 yen for food, 200 yen for daily necessities. You are under high stress, so we recommend you relax."

[0663] In this way, the system of the present invention centrally manages cash and electronic money expenditure information, and further provides feedback and advice that takes emotional state into account, thereby supporting users in managing their household finances more accurately and efficiently.

[0664] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0665] Step 1:

[0666] Cash deposit and withdrawal detection

[0667] The terminal (smart wallet) detects cash deposits and withdrawals. A sensor is used to detect cash deposits and withdrawals in real time and record them as digital data. For example, when a user pays 500 yen, the sensor recognizes this as "withdrawal of 500 yen" and records it. The input is the user's cash deposit and withdrawal action, and the output is the digital data "withdrawal of 500 yen."

[0668] Step 2:

[0669] Obtaining location information

[0670] The terminal (smart wallet) acquires location information using a built-in GPS module. The location information corresponding to the cash deposit and withdrawal detected in the previous step is acquired and linked to digital data. For example, the location information (latitude and longitude) of the cafe where the payment was made is added to "Withdrawal of 500 yen." The input is location information from the GPS, and the output is composite data including "Withdrawal of 500 yen" and location information.

[0671] Step 3:

[0672] Data Transfer

[0673] The terminal (smart wallet) transmits the collected data on deposits and withdrawals and location information to an electronic device (user terminal) via Bluetooth. For example, data including "withdrawal of 500 yen, latitude and longitude" is transmitted to the user's smartphone. The input is the data recorded in the smart wallet, and the output is the data transmitted to the user terminal.

[0674] Step 4:

[0675] Acquisition of electronic money transaction data

[0676] The user's device periodically calls the APIs of the digital payment service and financial institution to obtain transaction data. For example, if a user spends 200 yen at a convenience store using electronic money, the transaction data is obtained from the API. The input is the APIs of the digital payment service and financial institution, and the output is the obtained transaction data.

[0677] Step 5:

[0678] Collecting Emotional Data

[0679] An emotion data collection module installed in the user's device collects emotion data using voice input, facial expression analysis, and a pulse sensor. For example, if a user feels stressed during their commute, their facial expression and pulse rate fluctuations will indicate that they are in a "stressed state." The input is the user's biometric data and voice data, and the output is data indicating their emotional state.

[0680] Step 6:

[0681] Data integration

[0682] The server receives cash deposit and withdrawal data, electronic money transaction data, and emotion data sent from the user terminal and integrates them. For example, it integrates data such as "withdrawal of 500 yen (cash), expenditure of 200 yen (electronic money), stress state." The inputs are cash data, electronic money data, and emotion data, and the output is an integrated dataset.

[0683] Step 7:

[0684] Data analysis and categorization

[0685] The server's generation AI module analyzes the integrated data and classifies it into categories. For example, a withdrawal of 500 yen is classified as "food expenses," an expenditure of 200 yen as "daily necessities," and an emotional state as "stress." The input is the integrated dataset, and the output is data classified by category.

[0686] Step 8:

[0687] User Feedback

[0688] The server sends the analysis and classification results to the user's device, and feedback is displayed on the user's device. For example, a notification such as "Today's expenses: food 500 yen, daily necessities 200 yen. Stress is high, so we recommend you relax" is displayed. The input is data classified by category, and the output is a feedback message to the user.

[0689] (Application example 2)

[0690] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0691] There is a demand for a household management system that not only centrally manages cash and electronic money deposit and withdrawal information, but also takes into account the user's emotional state. Conventional household management systems simply collect and classify expenditure data, but are unable to provide feedback that reflects the user's emotional and psychological state. As a result, they lack advice that takes into account the user's mental health, making it difficult to improve long-term household management.

[0692] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for transmitting deposit / withdrawal information from a smart wallet equipped with a sensor that detects cash deposits and withdrawals via Bluetooth to a user terminal; means for transmitting the deposit / withdrawal information received by the user terminal to a central server; means for integrating transaction data via APIs of multiple electronic money services and financial institutions; means for collecting emotional data using the user's voice input, facial expression analysis, and pulse sensor; means for including a generation AI that analyzes the integrated data and emotional data and classifies them by category; and means for providing the user terminal with feedback according to the categorized data and emotional state classified by the generation AI. This makes it possible to centrally manage cash and electronic money transaction information and provide feedback that takes into account the user's emotional state.

[0693] A "smart wallet" is an electronic device equipped with a sensor that detects cash deposits and withdrawals and has the ability to transmit data to a user terminal via Bluetooth.

[0694] "Communication means" refers to the technical means for transmitting deposit and withdrawal information from the smart wallet to the user terminal via Bluetooth.

[0695] "Data transfer means" refers to the technical means by which the user terminal transmits the deposit and withdrawal information received to the central server.

[0696] The "central server" is a central system that aggregates data sent from multiple user terminals and analyzes transaction data and emotional data.

[0697] "API" is an application programming interface for obtaining transaction data from electronic money services and financial institutions.

[0698] "Emotion data collection means" refers to technical means for collecting emotion data using the user's voice input, facial expression analysis, and pulse sensor.

[0699] "Generative AI" is an artificial intelligence technology that analyzes collected data and classifies it into categories.

[0700] "Feedback means" refers to a technical means for providing feedback to a user terminal according to the data and emotional state classified by the generating AI.

[0701] "Location information acquisition means" refers to a technical means for acquiring user location information using a GPS or the like.

[0702] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies user emotions. This system consists of the following main components:

[0703] Smart Wallet

[0704] The smart wallet is equipped with a sensor that detects cash deposits and withdrawals, and has a communication means that transmits data to a user terminal via Bluetooth. For example, when a user withdraws cash, this smart wallet detects "withdrawal" information in real time and transmits it to the user terminal.

[0705] User terminal

[0706] The user terminal is equipped with a data transfer means for receiving deposit and withdrawal information from the smart wallet and transmitting this information to a central server. It also has a function for periodically acquiring transaction data via APIs of electronic money services and financial institutions. Furthermore, the user terminal is equipped with an emotion data collection means for collecting emotion data using voice input, facial expression analysis, and a pulse sensor.

[0707] Central Server

[0708] The central server has the function of integrating cash and electronic money data and emotional data sent from user devices. This allows all transaction data and emotional data to be managed centrally. The central server is equipped with a generative AI that analyzes the integrated data and classifies it into categories. The results of this analysis serve as the basis for users to receive feedback based on their emotional data.

[0709] Data collection and analysis

[0710] For example, if a user pays 500 yen, the smart wallet detects the corresponding cash withdrawal data, and then makes a further electronic payment of 200 yen, these data are centrally imported into the user's terminal. The emotional data collection means then collects the user's emotional state (e.g., stress level) and sends it to a central server. The data is then integrated and analyzed by the AI ​​generator, which categorizes the spending information and generates feedback according to the user's emotional state.

[0711] Feedback Methods

[0712] Based on the analyzed expenditure data and emotion data, the user device will provide appropriate feedback to the user. For example, a notification such as "Today's expenditure: Food 500 yen, daily necessities 200 yen. Stress is high, so we recommend taking time to relax" will be displayed on the user device.

[0713] Examples and prompts

[0714] As a concrete example, if the cash withdrawal data from the smart wallet shows "500 yen" and the electronic money expenditure of "200 yen", and the user's emotional state is judged to be "stressed", the following user feedback will be displayed:

[0715] Analyze the given expenditure data (cash and electronic money) and emotional data, and classify them into expenditure categories (food, daily necessities, etc.) and emotional states (stress, relaxation, etc.). Example: Withdrawal of 500 yen (cash), expenditure of 200 yen (electronic money), emotional state (stress).

[0716] This system not only allows users to centrally manage their cash and electronic money transaction information, but also provides feedback based on their emotional state, enabling healthier and more efficient household management, thereby improving the quality of life for users compared to conventional household management systems.

[0717] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0718] Step 1:

[0719] The smart wallet uses sensors to detect cash deposits and withdrawals and records the information as digital data. This data includes information such as "withdrawal of 500 yen" and "deposit of 1000 yen." At the same time, GPS data is also acquired using location information acquisition means. This allows the location of the withdrawal or deposit to be recorded. The input is the physical movement of cash, and the output is cash deposit and withdrawal data and location information.

[0720] Step 2:

[0721] The smart wallet transmits the acquired deposit and withdrawal data and location information to the user's device via Bluetooth. The user's device receives this data using Bluetooth communication and temporarily stores it internally. The input is data sent from the smart wallet, and the output is digital data stored in the user's device.

[0722] Step 3:

[0723] The user terminal periodically obtains transaction data through the APIs of electronic money services and financial institutions. This also allows for the acquisition of electronic money expenditure information. This acquisition process requires an internet connection and corresponding API authentication. The input is authentication information and transaction data requests from each API, and the output is the transaction data acquisition results.

[0724] Step 4:

[0725] The user terminal uses emotion data collection means to collect data from the user's voice input, facial expression analysis, and pulse sensor. For example, the user's face is photographed with a camera and facial expression analysis software is used to detect emotional states such as "stress" and "relaxation." The user's emotions are also analyzed from voice input. The input is the user's facial expression, voice, and pulse data, and the output is the result of the emotion analysis.

[0726] Step 5:

[0727] The user terminal transmits the cash deposit and withdrawal data, electronic money transaction data, and emotion data acquired to the central server, which then aggregates all data. The input is all data stored on the user terminal, and the output is the digital data transmitted to the central server.

[0728] Step 6:

[0729] The central server uses a data integration means to integrate the received cash and electronic money data and emotion data. This integrated data is managed centrally and serves as the basis for analysis. The input is multiple data sources sent from user terminals, and the output is the integrated data.

[0730] Step 7:

[0731] The generation AI on the central server analyzes the integrated data and classifies it into categories. During this analysis, emotional data is also taken into consideration. For example, of a 500 yen withdrawal, 400 yen may be classified as "food expenses" and 100 yen as "miscellaneous expenses," with the emotional state corresponding to "stress." A machine learning model is used in this process. The input is the integrated data, and the output is the analysis results and category classification.

[0732] Step 8:

[0733] The central server feeds back the analysis results of the generative AI to the user's device. The user's device receives this and displays specific feedback to the user. For example, a notification may be displayed saying, "Today's expenses: 500 yen for food, 200 yen for daily necessities. Stress is high, so we recommend taking time to relax." The input is the analysis results of the generative AI, and the output is feedback information to the user.

[0734] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0735] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0736] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0737] [Third embodiment]

[0738] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0739] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0740] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0741] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0742] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0743] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0744] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0745] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0746] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0747] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0748] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0749] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0750] The present invention provides a system for managing expenditures of both cash and electronic money in an integrated manner, thereby enabling efficient household management when a user uses both cash and electronic money at the same time. Hereinafter, a detailed description will be given of an embodiment of the present invention.

[0751] System configuration

[0752] The system consists of the following main components:

[0753] 1. Smart Wallet

[0754] Sensor: Detects cash deposits and withdrawals.

[0755] Location information acquisition method: Location information is acquired using GPS.

[0756] Communication method: Send data to the user terminal via Bluetooth.

[0757] 2. User Device

[0758] Data receiving means: Receives deposit and withdrawal information and location information from the smart wallet.

[0759] Data transfer means: Sends received data to a central server.

[0760] API integration method: Obtain transaction data through APIs of electronic money and financial institutions.

[0761] 3. Central Server

[0762] Data integration method: Integrates all data obtained from user devices and APIs.

[0763] Generative AI: Analyzes the combined data and classifies it into categories.

[0764] 4. Feedback methods

[0765] User terminal notification: Notify the user of the classification and analysis results.

[0766] Program processing and specific examples

[0767] Data collection

[0768] The terminal (smart wallet) detects cash deposits and withdrawals and records them as digital data. At the same time, location information is obtained via GPS. For example, if a user deposits 500 yen into their wallet, the sensor detects this and generates the data "Deposit: 500 yen," along with the location information being recorded.

[0769] Data transmission

[0770] The terminal (smart wallet) uses Bluetooth to transmit the deposit data and location information to the user terminal, which receives it and transmits it to the central server using a data transfer means.

[0771] Acquiring electronic money data

[0772] The user device periodically obtains transaction data using APIs of electronic money and financial institutions. For example, if a user pays 200 yen with electronic money, the data "Expenses: 200 yen" is obtained through the API.

[0773] Data Integration

[0774] The server integrates the cash deposit and withdrawal data sent from the user terminal with the electronic money data obtained through the API, thereby generating an integrated data set.

[0775] Data analysis and categorization

[0776] The server's generation AI analyzes the integrated data and classifies each transaction into the appropriate category. For example, a "Deposit: 500 yen (cash)" and "Expense: 200 yen (electronic money)" may be classified as food expenses.

[0777] User Feedback

[0778] The app (user device) notifies and displays the analysis results to the user. For example, it may display information such as, "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[0779] In this way, the present invention provides a household management system that can efficiently manage both cash and electronic money. Furthermore, by using location-based prediction functions and automatic categorization using AI generation, the burden of input by the user is minimized, enabling accurate household management.

[0780] The processing flow will be explained below.

[0781] Step 1:

[0782] The user uses cash or electronic money. For example, the user pays 500 yen in cash at a supermarket and then pays 200 yen in electronic money at another store.

[0783] Step 2:

[0784] The device (smart wallet) uses sensors to detect cash deposits and withdrawals, and records the data while acquiring location information. For example, if 500 yen is withdrawn in cash, it will record "withdrawal of 500 yen" and the location information.

[0785] Step 3:

[0786] The terminal (smart wallet) uses Bluetooth to send the collected cash deposit and withdrawal information and location information to the user's terminal. For example, the information "withdrawal of 500 yen" and location information are sent to the user's smartphone.

[0787] Step 4:

[0788] The user terminal checks the data received from the smart wallet and sends it to the central server using a data transfer method. For example, "Withdraw 500 yen" and location information are sent to the central server.

[0789] Step 5:

[0790] The user device obtains transaction data through the API of electronic money or financial institutions. For example, data on a payment of 200 yen with electronic money, such as "Expense 200 yen," is received from the API.

[0791] Step 6:

[0792] The server receives the cash and electronic money data sent from the user terminal and integrates them. For example, "withdrawal of 500 yen (cash)" and "expense of 200 yen (electronic money)" are integrated.

[0793] Step 7:

[0794] The server's AI analyzes the integrated data and categorizes it. For example, a withdrawal of 500 yen might be classified as "food" based on location information, and an expenditure of 200 yen might be classified as "daily necessities."

[0795] Step 8:

[0796] The server then sends the analyzed and classified results to the user's device. For example, data such as "food expenses 500 yen, daily necessities 200 yen" is sent to the user's smartphone.

[0797] Step 9:

[0798] The user device displays the analysis results sent from the server to the user. For example, the app screen displays "Today's expenses: food 500 yen, daily necessities 200 yen."

[0799] The above is an explanation of each processing step and its specific operation.

[0800] Example 1

[0801] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0802] When cash and electronic money expenditure information is used in parallel, users must manage each expenditure information separately, which is cumbersome for users and makes it difficult to manage their household finances efficiently. Furthermore, since cash expenditures are recorded manually, there is a risk of input errors or omissions. Furthermore, the task of categorizing each transaction is a heavy burden, making accurate household finances difficult to manage.

[0803] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0804] In this invention, the server comprises a smart storage device equipped with a sensor that detects cash deposits and withdrawals,

[0805] a communication means for transmitting the deposit and withdrawal information detected by the smart storage device to a user terminal via wireless communication;

[0806] a data transfer means for transmitting the deposit / withdrawal information received by the user terminal to the centralized processing unit;

[0807] means for aggregating transaction data via application interfaces of a plurality of electronic payment services and financial institutions in the centralized processing unit;

[0808] means for analyzing the integrated data and organizing it into categories; and

[0809] A means for feeding back the data classified by the generating artificial intelligence to a user terminal;

[0810] This will enable centralized management of cash and electronic money expenditure information, enabling efficient household management.

[0811] A "smart storage device" is an electronic device equipped with a sensor that detects cash deposits and withdrawals.

[0812] "Communication means" refers to a mechanism for transmitting data to other electronic devices using wireless communication.

[0813] A "user terminal" refers to an electronic device such as a computer or smartphone used by a user.

[0814] "Data transfer means" refers to a mechanism that has the function of transmitting data from one electronic device to another.

[0815] A "centralized processing device" is a server or mainframe computer used to centrally manage and analyze multiple data sets.

[0816] "Electronic payment services" are services for making payments online, including credit cards and digital wallets.

[0817] An "application interface" provides a connection through which different software systems can communicate with each other.

[0818] "Transaction Data" means data that includes information regarding expenses and income.

[0819] "Generative AI" refers to software and systems that use machine learning and artificial intelligence techniques to analyze large amounts of data and recognize patterns.

[0820] "Feedback means" refers to a mechanism for providing analysis results and notifications to users.

[0821] The present invention is a system that allows users who use both cash and electronic money to centrally manage their expenditure information and achieve efficient household management. This system uses the following main hardware and software:

[0822] Smart storage equipment

[0823] The smart storage device is equipped with a sensor to detect cash deposits and withdrawals. It also has a built-in GPS as a means of acquiring location information. Each time it detects a cash deposit or withdrawal, it records that information and the location information. For example, if a user deposits 500 yen into their wallet, the sensor will detect "Deposit: 500 yen" and record the location information (longitude and latitude) acquired by the GPS.

[0824] communication means

[0825] The smart storage device transmits recorded deposit and withdrawal information and location information to the user's terminal using wireless communication, such as Bluetooth, eliminating the need for the user to manually enter information and automatically synchronizing the data.

[0826] User terminal

[0827] The user terminal is equipped with a data transfer means that temporarily stores the received deposit and withdrawal information and location information in an internal database and periodically transmits it to the centralized processing unit. The user terminal also periodically obtains electronic money transaction data through the application programming interfaces (APIs) of multiple electronic payment services and financial institutions. For example, if a user pays 200 yen with electronic money, the transaction data "Expenses: 200 yen" is obtained through the API.

[0828] Centralized Processing Unit

[0829] The centralized processing unit has the function of integrating cash deposit and withdrawal data sent from user terminals with electronic money data obtained through APIs, which allows all transaction data to be managed centrally and analyzed efficiently.

[0830] Generative Artificial Intelligence

[0831] The centralized processing unit is equipped with a generative artificial intelligence (generative AI) that analyzes the integrated data and organizes it by category. This generative AI analyzes each transaction data and classifies it into the appropriate category. For example, "Deposit: 500 yen (cash)" may be classified as "food expenses," and "Expenses: 200 yen (electronic money)" may be classified as "daily necessities."

[0832] Feedback Methods

[0833] The user terminal is equipped with a feedback means for receiving the analysis results and notifying the user. For example, the user terminal may notify the user of the analysis results, such as "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[0834] By combining these elements, the present invention allows for centralized management of both cash and electronic money, thereby improving the efficiency of a user's household finances.

[0835] Specific examples

[0836] For example, if a user pays 200 yen using electronic money at a convenience store on May 1st and then deposits 500 yen in cash into their wallet on the same day, the smart storage device will record the location information as "Deposit: 500 yen" and send this to the user's device. The user's device will obtain the electronic money transaction data from the API and send it to the centralized processing device. The centralized processing device's artificial intelligence will classify this data as "food expenses" and provide feedback to the user's device.

[0837] Prompt Sentence Examples

[0838] Prompt: "Generate spending data for a user who spends 200 yen at a convenience store on May 1st and also puts 500 yen in cash into their wallet on the same day."

[0839] The above is an embodiment of the present invention. This system allows users to efficiently manage their cash and electronic money expenditure information, enabling them to manage their household finances in detail.

[0840] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0841] Step 1:

[0842] The terminal (smart storage device) uses a sensor to detect cash deposits and withdrawals. The input is the user's action of putting cash into or taking out cash from the smart storage device. For example, if a user puts 500 yen into the smart storage device, the sensor detects this and generates the data "Deposit: 500 yen." At the same time, the GPS module is used to obtain location information (longitude and latitude). The output is the data "Deposit: 500 yen" and "Location information: longitude X, latitude Y."

[0843] Step 2:

[0844] The terminal (smart storage device) uses Bluetooth to send the generated deposit data and location information to the user's terminal. The input is the aforementioned "Deposit: 500 yen" and "Location information: longitude X, latitude Y." The data is sent via Bluetooth communication and received by the user's terminal. As an output, the received data is temporarily saved in the internal database of the user's terminal.

[0845] Step 3:

[0846] The user terminal periodically calls the APIs of electronic payment services and financial institutions to obtain transaction data. The input is the authentication information and parameters required to make the API call. For example, if a user pays 200 yen with electronic money, the data "Expense: 200 yen" is obtained from the API. The output is the transaction data "Expense: 200 yen" and "Payment method: electronic money."

[0847] Step 4:

[0848] The user terminal transmits the received cash deposit and withdrawal data and electronic money transaction data to the centralized processing unit. The inputs are "Deposit: 500 yen," "Location information: longitude X, latitude Y," "Expense: 200 yen," and "Payment method: electronic money," all stored in the internal database. These data are transmitted to the centralized processing unit. The output is a unified data set received by the centralized processing unit.

[0849] Step 5:

[0850] The server (central processing device) uses a generation AI to analyze the integrated data and classify each transaction into the appropriate category. The input is integrated data such as "Deposit: 500 yen," "Expenses: 200 yen," and "Location information: longitude X, latitude Y." The generation AI analyzes this data and classifies it into categories such as "Deposit: 500 yen (food)" and "Expenses: 200 yen (daily necessities)." The output is data classified by category.

[0851] Step 6:

[0852] The user terminal receives the analysis results and notifies the user using a feedback means. The input is categorized data sent from the server. For example, data such as "Deposit: 500 yen (food)" and "Expenses: 200 yen (daily necessities)" arrives at the user terminal. The user terminal visually displays this data and notifies the user. The output is feedback to the user of specific categorized expenditure information, such as "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[0853] The above is the specific processing flow of the program for this system. At each step, the input data is utilized and appropriate data processing and calculations are performed, ultimately providing the user with information that is useful for managing their household finances.

[0854] (Application example 1)

[0855] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0856] Users who use both cash and electronic money face the challenge of managing their spending information in a unified manner and achieving efficient and accurate household management. Cash spending, in particular, is particularly cumbersome to manage manually, making it easy for records to be overlooked. Categorizing spending by category is also time-consuming, making accurate household management difficult.

[0857] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0858] In this invention, the server includes a smart wallet equipped with a sensor that detects cash deposits and withdrawals, communication means for transmitting deposit and withdrawal information detected by the smart wallet to a user terminal via Bluetooth, data transfer means for transmitting the deposit and withdrawal information received by the user terminal to a central server, means for integrating transaction data in the central server via APIs of multiple electronic money services and financial institutions, means for analyzing the integrated data and classifying it by category, a generation AI for analyzing and classifying the categorized data by the generation AI, means for feeding back the categorized data classified by the generation AI to the user terminal, and means for generating a monthly report based on the analysis and notifying the user. This not only enables centralized management of cash and electronic money spending information, but also enables efficient and accurate household management by classifying and generating monthly reports by category.

[0859] - A "cash deposit / withdrawal detection sensor" is a device that physically detects a user's cash deposit / withdrawal and records that information as digital data.

[0860] A "smart wallet" is a multi-functional wallet device equipped with sensors that detect cash deposits and withdrawals, communication means, location information acquisition means, etc.

[0861] "Communication means" is a function that transmits information acquired by the smart wallet to the user terminal using wireless communication technology such as Bluetooth.

[0862] A "user terminal" is a portable information terminal that receives data sent from the smart wallet and exchanges data with the central server.

[0863] The "data transfer means" is a function for transmitting data received by the user terminal to the central server.

[0864] The "central server" is a server system that integrates and analyzes data sent from multiple user terminals and provides feedback on the results to the users.

[0865] "APIs of multiple electronic money services and financial institutions" are application programming interfaces for obtaining information on electronic money transactions and financial transactions.

[0866] "Generative AI" is an artificial intelligence algorithm that analyzes the aggregated data and classifies it into categories.

[0867] "Classifying by category" means dividing expenditure data into categories such as food, transportation, and daily necessities.

[0868] "Feedback to the user terminal" means notifying or displaying the analysis results on the user terminal.

[0869] The "location information acquisition means" is a function that acquires the user's current location information using a GPS or the like.

[0870] A "monthly report" is a report that compiles expenditure data over a certain period (usually one month) and organizes it by category.

[0871] The specific details required to implement the present invention are described below. This invention is a system that streamlines household management for users who use both cash and electronic money and centrally manages expenditure information. This system is composed of a smart wallet, a user terminal, and a central server.

[0872] Smart Wallet

[0873] Smart wallets are equipped with sensors that detect cash deposits and withdrawals. The sensors identify physical cash deposits and withdrawals and record the amounts deposited and withdrawn as digital data. They also have built-in GPS as a means of acquiring location information, and obtain GPS data on the location where cash deposits and withdrawals were made. Bluetooth is used as a means of communication, and this data is sent to the user's device.

[0874] User terminal

[0875] The user terminal receives cash deposit and withdrawal information and location information from the smart wallet and transmits it to the central server using a data transfer means. The user terminal also has the function of periodically obtaining transaction data through the APIs of electronic money services and financial institutions. This transaction data is also transmitted to the central server.

[0876] Central Server

[0877] The central server integrates cash deposit and withdrawal data and electronic money data sent from user devices. The integrated data is analyzed using generative AI and classified by category. For example, automatic classification can divide data into categories such as food expenses, transportation expenses, and daily necessities. The classified data is managed centrally, and the analysis results are fed back to the user device.

[0878] Feedback and monthly reports

[0879] The central server generates a monthly report based on the data analysis results and notifies the user. This report details the total amount spent by category and monthly spending trends, allowing users to manage their household finances more efficiently.

[0880] Hardware and software used

[0881] Hardware: Smart wallet (sensor, GPS module, Bluetooth module), smartphone, central server

[0882] Software: Bluetooth protocol for communication, Python requests library for data transfer and API calls, Python data analysis libraries (e.g., pandas, scikit-learn) for data analysis including generative AI.

[0883] Specific examples

[0884] As a specific example, consider the case where a user puts 5,000 yen into their wallet and pays 2,000 yen with electronic money. At this time, the smart wallet generates data for "Deposit: 5,000 yen" and sends it to the smartphone via Bluetooth. The smartphone then calls the API to obtain data for "Expenses: 2,000 yen" and sends both data to the central server. The central server's generation AI analyzes the data and generates a monthly report stating "Total expenditures for May: 7,000 yen (cash: 5,000 yen, electronic money: 2,000 yen), food expenses: 3,000 yen, transportation expenses: 2,000 yen, other: 2,000 yen," and notifies the user.

[0885] Example prompts for generative AI models

[0886] Combine cash spending data from your smart wallet with transaction data from your e-money API and generate a monthly report that breaks down each spending data by category. Here's an example:

[0887] Cash expenditure: 5,000 yen, electronic money expenditure: 2,000 yen

[0888] Expected categories: Food, transportation, other

[0889] conclusion

[0890] This system allows for centralized management of cash and electronic money expenditure information, enabling efficient and accurate household management. Automatic classification and monthly report generation using generation AI reduces the burden on users and makes it easier to visualize expenditures.

[0891] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0892] Step 1:

[0893] A sensor installed in the smart wallet detects the user's cash deposits and withdrawals. The input is the user's cash deposit and withdrawal actions, which the sensor detects and generates digital data such as "Deposit: 5,000 yen" or "Withdrawal: 2,000 yen." The output is cash transaction data.

[0894] Step 2:

[0895] The location information acquisition means of the smart wallet uses GPS to acquire the location where cash deposits and withdrawals are made. The input is the user's location information, which is acquired by the GPS module. The output is location information data.

[0896] Step 3:

[0897] The smart wallet transmits cash transaction data and location information data to the user terminal via Bluetooth communication means. The input is the cash transaction data and location information data, which the Bluetooth communication module transmits to the user terminal. The output is the data received by the user terminal.

[0898] Step 4:

[0899] The user terminal transmits the cash transaction data and location information data received from the smart wallet to the central server. The input is the received data, which is transmitted to the central server by the data transmission means. The output is the data transmitted to the central server.

[0900] Step 5:

[0901] The user terminal periodically obtains transaction data using the APIs of electronic money services and financial institutions. The input is an API call, which the user terminal executes to obtain electronic money transaction data. The output is electronic money data.

[0902] Step 6:

[0903] The electronic money data acquired by the user terminal is transmitted to the central server. The input is the electronic money data, which is transmitted to the central server by the data transmission means. The output is the electronic money data transmitted to the central server.

[0904] Step 7:

[0905] The central server integrates the cash transaction data, location information data, and electronic money data sent from the user terminals. These data are input, and the data integration means performs the integration process. The output is an integrated transaction data set.

[0906] Step 8:

[0907] The generation AI on the central server analyzes the integrated dataset and classifies it into categories. The input is the integrated dataset, which the generation AI analyzes. The output is data classified into categories.

[0908] Step 9:

[0909] The central server generates a monthly report based on the analysis results and feeds it back to the user terminal. The input is categorized data, which the report generation means uses to create the monthly report. The output is the monthly report notified to the user terminal.

[0910] Step 10:

[0911] The user terminal receives the monthly report and notifies the user of the analysis results. The input is the monthly report, which is displayed by the user notification means. The output is a report display that can be viewed by the user.

[0912] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0913] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies the user's emotions in combination, enabling efficient household finance management and providing feedback and advice according to the user's emotional state.

[0914] System configuration

[0915] The system consists of the following main components:

[0916] 1. Smart Wallet

[0917] Sensor: Detects cash deposits and withdrawals.

[0918] Location information acquisition method: Location information is acquired using GPS.

[0919] Communication method: Send data to the user terminal via Bluetooth.

[0920] 2. User Device

[0921] Data receiving means: Receives deposit / withdrawal information and location information from the smart wallet.

[0922] Data transfer means: Sends received data to a central server.

[0923] API integration method: Obtain transaction data through APIs of electronic money and financial institutions.

[0924] 3. Emotion Engine

[0925] Emotional data collection methods: Emotional data is collected using the user's voice input, facial expression analysis, and pulse sensor.

[0926] Emotion analysis means: Analyzes the collected emotion data and determines the user's emotional state.

[0927] 4. Central Server

[0928] Data integration method: Integrates all data obtained from user devices and APIs.

[0929] Generative AI: Analyzes and categorizes integrated transactional and sentiment data.

[0930] 5. Feedback channels

[0931] User device notification: Notifies the user of the classification and analysis results and provides advice based on their emotional state.

[0932] Program processing and specific examples

[0933] Data collection

[0934] The terminal (smart wallet) detects cash deposits and withdrawals, records them as digital data, and also acquires location information via GPS. For example, when a user withdraws 500 yen, the sensor records "Withdrawal 500 yen" and the location information.

[0935] Data transmission

[0936] The terminal (smart wallet) uses Bluetooth to send the collected cash withdrawal information and location information to the user terminal. For example, "Withdrawal of 500 yen" and location information data are sent to the user terminal.

[0937] Acquiring electronic money data

[0938] The user device periodically obtains transaction data via APIs of electronic money and financial institutions. For example, if a user pays 200 yen with electronic money, the data "Expense of 200 yen" is obtained from the API.

[0939] Collecting Emotional Data

[0940] The emotion engine (user device) collects emotion data using the user's voice input, facial expression analysis, and pulse sensor. For example, if the user is feeling stressed, it obtains "stress state" data from facial expression analysis and pulse rate fluctuations.

[0941] Data Integration

[0942] The server receives cash and electronic money data and emotion data sent from the user's device and integrates them. For example, data such as "withdrawal of 500 yen (cash)," "expense of 200 yen (electronic money)," and "stress state" are integrated.

[0943] Data analysis and categorization

[0944] The server's AI analyzes the integrated data and categorizes it. It also customizes the analysis results based on emotional data. For example, a withdrawal of 500 yen would be classified as "food," an expenditure of 200 yen as "daily necessities," and the emotional state as "stress."

[0945] User Feedback

[0946] The app (user device) displays the analyzed and classified results to the user and also provides advice based on their emotional state. For example, it might display feedback such as, "Today's expenses: food 500 yen, daily necessities 200 yen. You are under high stress, so we recommend taking time to relax."

[0947] In this way, the present invention centrally manages cash and electronic money expenditure information, and further provides feedback and advice that takes emotional state into consideration, thereby supporting users in managing their household finances more accurately and efficiently.

[0948] The processing flow will be explained below.

[0949] Step 1:

[0950] The user uses cash or electronic money. For example, the user pays 500 yen in cash at a supermarket, and then pays 200 yen at a cafe with electronic money.

[0951] Step 2:

[0952] The terminal (smart wallet) uses a sensor to detect cash deposits and withdrawals and records the data. For example, if a user withdraws 500 yen in cash, the sensor will generate the data as "withdrawal of 500 yen."

[0953] Step 3:

[0954] The device (smart wallet) acquires location information using the GPS function. For example, it records the location where the user paid 500 yen at the supermarket.

[0955] Step 4:

[0956] The terminal (smart wallet) uses Bluetooth to send cash withdrawal information and location information to the user terminal. For example, "withdrawal of 500 yen" and the location information are sent to the user's smartphone.

[0957] Step 5:

[0958] The user terminal checks the data received from the smart wallet and sends it to the central server using the data transfer means. For example, the user terminal sends "Withdraw 500 yen" and its location information to the central server.

[0959] Step 6:

[0960] The user device periodically obtains transaction data via the API of electronic money or financial institutions. For example, if a user makes a payment of 200 yen using electronic money, that data is obtained from the API.

[0961] Step 7:

[0962] The emotion engine (user device) collects emotional data using the user's voice input, facial expression analysis, and pulse sensor. For example, if a user is relaxing in a cafe, data on their "relaxed state" can be obtained from their voice input and pulse rate.

[0963] Step 8:

[0964] The server receives cash and electronic money data and emotion data sent from the user terminal and integrates them. For example, it integrates data such as "withdrawal of 500 yen (cash)," "expense of 200 yen (electronic money)," and "relaxed state."

[0965] Step 9:

[0966] The server's AI analyzes the integrated data and categorizes it. It also customizes the analysis results based on emotional data. For example, a withdrawal of 500 yen would be classified as "food," an expenditure of 200 yen as "luxury items," and the emotional state as "relaxation."

[0967] Step 10:

[0968] The server then sends the analyzed and classified results to the user's device. For example, data such as "food expenses 500 yen," "luxury items 200 yen," and "relaxed state" is sent to the user's device.

[0969] Step 11:

[0970] The user's device displays the analysis results sent from the server to the user. For example, feedback such as "Today's expenses: food 500 yen, luxury items 200 yen. As you are mostly in a relaxed state, we recommend moderate exercise" is displayed.

[0971] The above is an explanation of each processing step and its specific operation.

[0972] Example 2

[0973] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0974] There is a demand for systems that can centrally manage cash and electronic money deposit and withdrawal information while providing feedback and advice based on the user's emotional state, thereby achieving more accurate expenditure management and mental health care than conventional household management systems. Existing systems have problems in that it is difficult to integrate cash and electronic money expenditure information, and they are unable to provide customized feedback based on the user's emotional state.

[0975] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0976] In this invention, the server includes a smart wallet equipped with a sensor for detecting cash deposits and withdrawals, communication means for transmitting the deposit and withdrawal information detected by the smart wallet to an electronic device via Bluetooth, data transfer means for transmitting the deposit and withdrawal information received by the electronic device to a central processing unit, means for integrating transaction data via application programming interfaces of multiple digital payment services and financial institutions, means for analyzing and categorizing the integrated data, means for providing feedback on the categorized data classified by the generation AI to the electronic device, emotion data collection means for collecting emotion data using voice input, facial expression analysis, and a pulse sensor, emotion analysis means for analyzing the emotion data and determining the user's emotional state, and means for integrating the user's emotion data and transaction data and customizing the analysis results based on the user's emotional state. This allows for centralized management of cash and electronic money spending information while providing personalized feedback and advice based on the user's emotional state.

[0977] A "smart wallet" is a device equipped with a sensor that detects cash deposits and withdrawals and has communication means to transmit that data to an electronic device.

[0978] "Electronic device" means an electronic device capable of receiving deposit and withdrawal information and emotional data from the smart wallet and transmitting it to the central processing unit.

[0979] "Central Processing Unit" refers to a server system that receives data from electronic devices and integrates and analyzes the data through application programming interfaces of multiple digital payment services and financial institutions.

[0980] "Digital payment services" are online services that provide transactions using electronic money.

[0981] An "application programming interface" is an interface that allows data to be exchanged between different software programs.

[0982] "Generative AI" is artificial intelligence that analyzes integrated data and classifies it into categories.

[0983] "Communication means" refers to a means for transmitting and receiving data between devices via wireless or wired communication.

[0984] A "data transfer means" is a method for transmitting data from an electronic device to a central processing unit.

[0985] The "emotion data collection means" is a means for collecting user emotion data using voice input, facial expression analysis, and a pulse sensor.

[0986] The "emotion analysis means" is a means for analyzing collected emotion data and determining the user's emotional state.

[0987] "Feedback means" refers to a method of notifying an electronic device of data analyzed and classified by the generative AI and providing feedback to the user.

[0988] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies the user's emotions in combination, enabling efficient household finance management and providing feedback and advice according to the user's emotional state.

[0989] System Configuration

[0990] Hardware

[0991] 1. Smart Wallet

[0992] Sensor: Detects cash deposits and withdrawals.

[0993] GPS module: Obtains location information.

[0994] Bluetooth module: Used as a communication means to transmit data to the user terminal.

[0995] 2. Electronic Devices (User Terminals)

[0996] Data receiving module: Receives data from the smart wallet.

[0997] Data transfer module: transmits the received data to the central processing unit.

[0998] API integration module: Obtains transaction data through APIs of digital payment services and financial institutions.

[0999] Emotion data collection module: Collects emotion data using the user's voice input, facial expression analysis, and pulse sensor.

[1000] 3. Central Processing Unit (Server)

[1001] Data integration module: Integrates data obtained from user devices and APIs.

[1002] Generative AI module: Analyzes data and classifies it into categories.

[1003] 4. Feedback System

[1004] Notification module: Notifies the user of the classification and analysis results and provides feedback.

[1005] software

[1006] 1. Generative AI Models

[1007] The integrated data is analyzed and classified into categories.

[1008] Customize analysis results based on emotional data.

[1009] 2. Prompt generation

[1010] For example, to generate a prompt like this:

[1011] Data Used:

[1012] 1. Cash expenditure: 500 yen (food)

[1013] 2. Electronic money expenditure: 200 yen (daily necessities)

[1014] 3. Emotional data: High stress

[1015] Provide feedback:

[1016] Provide users with advice based on today's spending category and emotional state.

[1017] Specific examples

[1018] For example, suppose a user pays 500 yen in cash at a cafe, and then later spends 200 yen using electronic money at a convenience store. The smart wallet records the cash withdrawal information and location information and sends them to the electronic device. The electronic device then obtains the electronic money spending data, and the emotion data collection module detects the user's stress level. This data is sent to the central processing unit and analyzed and classified by the generative AI model. Finally, the user's device receives feedback such as, "Today's spending: 500 yen for food, 200 yen for daily necessities. You are under high stress, so we recommend you relax."

[1019] In this way, the system of the present invention centrally manages cash and electronic money expenditure information, and further provides feedback and advice that takes emotional state into account, thereby supporting users in managing their household finances more accurately and efficiently.

[1020] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1021] Step 1:

[1022] Cash deposit and withdrawal detection

[1023] The terminal (smart wallet) detects cash deposits and withdrawals. A sensor is used to detect cash deposits and withdrawals in real time and record them as digital data. For example, when a user pays 500 yen, the sensor recognizes this as "withdrawal of 500 yen" and records it. The input is the user's cash deposit and withdrawal action, and the output is the digital data "withdrawal of 500 yen."

[1024] Step 2:

[1025] Obtaining location information

[1026] The terminal (smart wallet) acquires location information using a built-in GPS module. The location information corresponding to the cash deposit and withdrawal detected in the previous step is acquired and linked to digital data. For example, the location information (latitude and longitude) of the cafe where the payment was made is added to "Withdrawal of 500 yen." The input is location information from the GPS, and the output is composite data including "Withdrawal of 500 yen" and location information.

[1027] Step 3:

[1028] Data Transfer

[1029] The terminal (smart wallet) transmits the collected data on deposits and withdrawals and location information to an electronic device (user terminal) via Bluetooth. For example, data including "withdrawal of 500 yen, latitude and longitude" is transmitted to the user's smartphone. The input is the data recorded in the smart wallet, and the output is the data transmitted to the user terminal.

[1030] Step 4:

[1031] Acquisition of electronic money transaction data

[1032] The user's device periodically calls the APIs of the digital payment service and financial institution to obtain transaction data. For example, if a user spends 200 yen at a convenience store using electronic money, the transaction data is obtained from the API. The input is the APIs of the digital payment service and financial institution, and the output is the obtained transaction data.

[1033] Step 5:

[1034] Collecting Emotional Data

[1035] An emotion data collection module installed in the user's device collects emotion data using voice input, facial expression analysis, and a pulse sensor. For example, if a user feels stressed during their commute, their facial expression and pulse rate fluctuations will indicate that they are in a "stressed state." The input is the user's biometric data and voice data, and the output is data indicating their emotional state.

[1036] Step 6:

[1037] Data integration

[1038] The server receives cash deposit and withdrawal data, electronic money transaction data, and emotion data sent from the user terminal and integrates them. For example, it integrates data such as "withdrawal of 500 yen (cash), expenditure of 200 yen (electronic money), stress state." The inputs are cash data, electronic money data, and emotion data, and the output is an integrated dataset.

[1039] Step 7:

[1040] Data analysis and categorization

[1041] The server's generation AI module analyzes the integrated data and classifies it into categories. For example, a withdrawal of 500 yen is classified as "food expenses," an expenditure of 200 yen as "daily necessities," and an emotional state as "stress." The input is the integrated dataset, and the output is data classified by category.

[1042] Step 8:

[1043] User Feedback

[1044] The server sends the analysis and classification results to the user's device, and feedback is displayed on the user's device. For example, a notification such as "Today's expenses: food 500 yen, daily necessities 200 yen. Stress is high, so we recommend you relax" is displayed. The input is data classified by category, and the output is a feedback message to the user.

[1045] (Application example 2)

[1046] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1047] There is a demand for a household management system that not only centrally manages cash and electronic money deposit and withdrawal information, but also takes into account the user's emotional state. Conventional household management systems simply collect and classify expenditure data, but are unable to provide feedback that reflects the user's emotional and psychological state. As a result, they lack advice that takes into account the user's mental health, making it difficult to improve long-term household management.

[1048] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for transmitting deposit / withdrawal information from a smart wallet equipped with a sensor that detects cash deposits and withdrawals via Bluetooth to a user terminal; means for transmitting the deposit / withdrawal information received by the user terminal to a central server; means for integrating transaction data via APIs of multiple electronic money services and financial institutions; means for collecting emotional data using the user's voice input, facial expression analysis, and pulse sensor; means for including a generation AI that analyzes the integrated data and emotional data and classifies them by category; and means for providing the user terminal with feedback according to the categorized data and emotional state classified by the generation AI. This makes it possible to centrally manage cash and electronic money transaction information and provide feedback that takes into account the user's emotional state.

[1049] A "smart wallet" is an electronic device equipped with a sensor that detects cash deposits and withdrawals and has the ability to transmit data to a user terminal via Bluetooth.

[1050] "Communication means" refers to the technical means for transmitting deposit and withdrawal information from the smart wallet to the user terminal via Bluetooth.

[1051] "Data transfer means" refers to the technical means by which the user terminal transmits the deposit and withdrawal information received to the central server.

[1052] The "central server" is a central system that aggregates data sent from multiple user terminals and analyzes transaction data and emotional data.

[1053] "API" is an application programming interface for obtaining transaction data from electronic money services and financial institutions.

[1054] "Emotion data collection means" refers to technical means for collecting emotion data using the user's voice input, facial expression analysis, and pulse sensor.

[1055] "Generative AI" is an artificial intelligence technology that analyzes collected data and classifies it into categories.

[1056] "Feedback means" refers to a technical means for providing feedback to a user terminal according to the data and emotional state classified by the generating AI.

[1057] "Location information acquisition means" refers to a technical means for acquiring user location information using a GPS or the like.

[1058] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies user emotions. This system consists of the following main components:

[1059] Smart Wallet

[1060] The smart wallet is equipped with a sensor that detects cash deposits and withdrawals, and has a communication means that transmits data to a user terminal via Bluetooth. For example, when a user withdraws cash, this smart wallet detects "withdrawal" information in real time and transmits it to the user terminal.

[1061] User terminal

[1062] The user terminal is equipped with a data transfer means for receiving deposit and withdrawal information from the smart wallet and transmitting this information to a central server. It also has a function for periodically acquiring transaction data via APIs of electronic money services and financial institutions. Furthermore, the user terminal is equipped with an emotion data collection means for collecting emotion data using voice input, facial expression analysis, and a pulse sensor.

[1063] Central Server

[1064] The central server has the function of integrating cash and electronic money data and emotional data sent from user devices. This allows all transaction data and emotional data to be managed centrally. The central server is equipped with a generative AI that analyzes the integrated data and classifies it into categories. The results of this analysis serve as the basis for users to receive feedback based on their emotional data.

[1065] Data collection and analysis

[1066] For example, if a user pays 500 yen, the smart wallet detects the corresponding cash withdrawal data, and then makes a further electronic payment of 200 yen, these data are centrally imported into the user's terminal. The emotional data collection means then collects the user's emotional state (e.g., stress level) and sends it to a central server. The data is then integrated and analyzed by the AI ​​generator, which categorizes the spending information and generates feedback according to the user's emotional state.

[1067] Feedback Methods

[1068] Based on the analyzed expenditure data and emotion data, the user device will provide appropriate feedback to the user. For example, a notification such as "Today's expenditure: Food 500 yen, daily necessities 200 yen. Stress is high, so we recommend taking time to relax" will be displayed on the user device.

[1069] Examples and prompts

[1070] As a concrete example, if the cash withdrawal data from the smart wallet shows "500 yen" and the electronic money expenditure of "200 yen", and the user's emotional state is judged to be "stressed", the following user feedback will be displayed:

[1071] Analyze the given expenditure data (cash and electronic money) and emotional data, and classify them into expenditure categories (food, daily necessities, etc.) and emotional states (stress, relaxation, etc.). Example: Withdrawal of 500 yen (cash), expenditure of 200 yen (electronic money), emotional state (stress).

[1072] This system not only allows users to centrally manage their cash and electronic money transaction information, but also provides feedback based on their emotional state, enabling healthier and more efficient household management, thereby improving the quality of life for users compared to conventional household management systems.

[1073] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1074] Step 1:

[1075] The smart wallet uses sensors to detect cash deposits and withdrawals and records the information as digital data. This data includes information such as "withdrawal of 500 yen" and "deposit of 1000 yen." At the same time, GPS data is also acquired using location information acquisition means. This allows the location of the withdrawal or deposit to be recorded. The input is the physical movement of cash, and the output is cash deposit and withdrawal data and location information.

[1076] Step 2:

[1077] The smart wallet transmits the acquired deposit and withdrawal data and location information to the user's device via Bluetooth. The user's device receives this data using Bluetooth communication and temporarily stores it internally. The input is data sent from the smart wallet, and the output is digital data stored in the user's device.

[1078] Step 3:

[1079] The user terminal periodically obtains transaction data through the APIs of electronic money services and financial institutions. This also allows for the acquisition of electronic money expenditure information. This acquisition process requires an internet connection and corresponding API authentication. The input is authentication information and transaction data requests from each API, and the output is the transaction data acquisition results.

[1080] Step 4:

[1081] The user terminal uses emotion data collection means to collect data from the user's voice input, facial expression analysis, and pulse sensor. For example, the user's face is photographed with a camera and facial expression analysis software is used to detect emotional states such as "stress" and "relaxation." The user's emotions are also analyzed from voice input. The input is the user's facial expression, voice, and pulse data, and the output is the result of the emotion analysis.

[1082] Step 5:

[1083] The user terminal transmits the cash deposit and withdrawal data, electronic money transaction data, and emotion data acquired to the central server, which then aggregates all data. The input is all data stored on the user terminal, and the output is the digital data transmitted to the central server.

[1084] Step 6:

[1085] The central server uses a data integration means to integrate the received cash and electronic money data and emotion data. This integrated data is managed centrally and serves as the basis for analysis. The input is multiple data sources sent from user terminals, and the output is the integrated data.

[1086] Step 7:

[1087] The generation AI on the central server analyzes the integrated data and classifies it into categories. During this analysis, emotional data is also taken into consideration. For example, of a 500 yen withdrawal, 400 yen may be classified as "food expenses" and 100 yen as "miscellaneous expenses," with the emotional state corresponding to "stress." A machine learning model is used in this process. The input is the integrated data, and the output is the analysis results and category classification.

[1088] Step 8:

[1089] The central server feeds back the analysis results of the generative AI to the user's device. The user's device receives this and displays specific feedback to the user. For example, a notification may be displayed saying, "Today's expenses: 500 yen for food, 200 yen for daily necessities. Stress is high, so we recommend taking time to relax." The input is the analysis results of the generative AI, and the output is feedback information to the user.

[1090] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1091] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1092] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1093] [Fourth embodiment]

[1094] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1095] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1096] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1097] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1098] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1099] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1100] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1101] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1102] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1103] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1104] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1105] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1106] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1107] The present invention provides a system for managing expenditures of both cash and electronic money in an integrated manner, thereby enabling efficient household management when a user uses both cash and electronic money at the same time. Hereinafter, a detailed description will be given of an embodiment of the present invention.

[1108] System configuration

[1109] The system consists of the following main components:

[1110] 1. Smart Wallet

[1111] Sensor: Detects cash deposits and withdrawals.

[1112] Location information acquisition method: Location information is acquired using GPS.

[1113] Communication method: Send data to the user terminal via Bluetooth.

[1114] 2. User Device

[1115] Data receiving means: Receives deposit and withdrawal information and location information from the smart wallet.

[1116] Data transfer means: Sends received data to a central server.

[1117] API integration method: Obtain transaction data through APIs of electronic money and financial institutions.

[1118] 3. Central Server

[1119] Data integration method: Integrates all data obtained from user devices and APIs.

[1120] Generative AI: Analyzes the combined data and classifies it into categories.

[1121] 4. Feedback methods

[1122] User terminal notification: Notify the user of the classification and analysis results.

[1123] Program processing and specific examples

[1124] Data collection

[1125] The terminal (smart wallet) detects cash deposits and withdrawals and records them as digital data. At the same time, location information is obtained via GPS. For example, if a user deposits 500 yen into their wallet, the sensor detects this and generates the data "Deposit: 500 yen," along with the location information being recorded.

[1126] Data transmission

[1127] The terminal (smart wallet) uses Bluetooth to transmit the deposit data and location information to the user terminal, which receives it and transmits it to the central server using a data transfer means.

[1128] Acquiring electronic money data

[1129] The user device periodically obtains transaction data using APIs of electronic money and financial institutions. For example, if a user pays 200 yen with electronic money, the data "Expenses: 200 yen" is obtained through the API.

[1130] Data Integration

[1131] The server integrates the cash deposit and withdrawal data sent from the user terminal with the electronic money data obtained through the API, thereby generating an integrated data set.

[1132] Data analysis and categorization

[1133] The server's generation AI analyzes the integrated data and classifies each transaction into the appropriate category. For example, a "Deposit: 500 yen (cash)" and "Expense: 200 yen (electronic money)" may be classified as food expenses.

[1134] User Feedback

[1135] The app (user device) notifies and displays the analysis results to the user. For example, it may display information such as, "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[1136] In this way, the present invention provides a household management system that can efficiently manage both cash and electronic money. Furthermore, by using location-based prediction functions and automatic categorization using AI generation, the burden of input by the user is minimized, enabling accurate household management.

[1137] The processing flow will be explained below.

[1138] Step 1:

[1139] The user uses cash or electronic money. For example, the user pays 500 yen in cash at a supermarket and then pays 200 yen in electronic money at another store.

[1140] Step 2:

[1141] The device (smart wallet) uses sensors to detect cash deposits and withdrawals, and records the data while acquiring location information. For example, if 500 yen is withdrawn in cash, it will record "withdrawal of 500 yen" and the location information.

[1142] Step 3:

[1143] The terminal (smart wallet) uses Bluetooth to send the collected cash deposit and withdrawal information and location information to the user's terminal. For example, the information "withdrawal of 500 yen" and location information are sent to the user's smartphone.

[1144] Step 4:

[1145] The user terminal checks the data received from the smart wallet and sends it to the central server using a data transfer method. For example, "Withdraw 500 yen" and location information are sent to the central server.

[1146] Step 5:

[1147] The user device obtains transaction data through the API of electronic money or financial institutions. For example, data on a payment of 200 yen with electronic money, such as "Expense 200 yen," is received from the API.

[1148] Step 6:

[1149] The server receives the cash and electronic money data sent from the user terminal and integrates them. For example, "withdrawal of 500 yen (cash)" and "expense of 200 yen (electronic money)" are integrated.

[1150] Step 7:

[1151] The server's AI analyzes the integrated data and categorizes it. For example, a withdrawal of 500 yen might be classified as "food" based on location information, and an expenditure of 200 yen might be classified as "daily necessities."

[1152] Step 8:

[1153] The server then sends the analyzed and classified results to the user's device. For example, data such as "food expenses 500 yen, daily necessities 200 yen" is sent to the user's smartphone.

[1154] Step 9:

[1155] The user device displays the analysis results sent from the server to the user. For example, the app screen displays "Today's expenses: food 500 yen, daily necessities 200 yen."

[1156] The above is an explanation of each processing step and its specific operation.

[1157] Example 1

[1158] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1159] When cash and electronic money expenditure information is used in parallel, users must manage each expenditure information separately, which is cumbersome for users and makes it difficult to manage their household finances efficiently. Furthermore, since cash expenditures are recorded manually, there is a risk of input errors or omissions. Furthermore, the task of categorizing each transaction is a heavy burden, making accurate household finances difficult to manage.

[1160] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1161] In this invention, the server comprises a smart storage device equipped with a sensor that detects cash deposits and withdrawals,

[1162] a communication means for transmitting the deposit and withdrawal information detected by the smart storage device to a user terminal via wireless communication;

[1163] a data transfer means for transmitting the deposit / withdrawal information received by the user terminal to the centralized processing unit;

[1164] means for aggregating transaction data via application interfaces of a plurality of electronic payment services and financial institutions in the centralized processing unit;

[1165] means for analyzing the integrated data and organizing it into categories; and

[1166] A means for feeding back the data classified by the generating artificial intelligence to a user terminal;

[1167] This will enable centralized management of cash and electronic money expenditure information, enabling efficient household management.

[1168] A "smart storage device" is an electronic device equipped with a sensor that detects cash deposits and withdrawals.

[1169] "Communication means" refers to a mechanism for transmitting data to other electronic devices using wireless communication.

[1170] A "user terminal" refers to an electronic device such as a computer or smartphone used by a user.

[1171] "Data transfer means" refers to a mechanism that has the function of transmitting data from one electronic device to another.

[1172] A "centralized processing device" is a server or mainframe computer used to centrally manage and analyze multiple data sets.

[1173] "Electronic payment services" are services for making payments online, including credit cards and digital wallets.

[1174] An "application interface" provides a connection through which different software systems can communicate with each other.

[1175] "Transaction Data" means data that includes information regarding expenses and income.

[1176] "Generative AI" refers to software and systems that use machine learning and artificial intelligence techniques to analyze large amounts of data and recognize patterns.

[1177] "Feedback means" refers to a mechanism for providing analysis results and notifications to users.

[1178] The present invention is a system that allows users who use both cash and electronic money to centrally manage their expenditure information and achieve efficient household management. This system uses the following main hardware and software:

[1179] Smart storage equipment

[1180] The smart storage device is equipped with a sensor to detect cash deposits and withdrawals. It also has a built-in GPS as a means of acquiring location information. Each time it detects a cash deposit or withdrawal, it records that information and the location information. For example, if a user deposits 500 yen into their wallet, the sensor will detect "Deposit: 500 yen" and record the location information (longitude and latitude) acquired by the GPS.

[1181] communication means

[1182] The smart storage device transmits recorded deposit and withdrawal information and location information to the user's terminal using wireless communication, such as Bluetooth, eliminating the need for the user to manually enter information and automatically synchronizing the data.

[1183] User terminal

[1184] The user terminal is equipped with a data transfer means that temporarily stores the received deposit and withdrawal information and location information in an internal database and periodically transmits it to the centralized processing unit. The user terminal also periodically obtains electronic money transaction data through the application programming interfaces (APIs) of multiple electronic payment services and financial institutions. For example, if a user pays 200 yen with electronic money, the transaction data "Expenses: 200 yen" is obtained through the API.

[1185] Centralized Processing Unit

[1186] The centralized processing unit has the function of integrating cash deposit and withdrawal data sent from user terminals with electronic money data obtained through APIs, which allows all transaction data to be managed centrally and analyzed efficiently.

[1187] Generative Artificial Intelligence

[1188] The centralized processing unit is equipped with a generative artificial intelligence (generative AI) that analyzes the integrated data and organizes it by category. This generative AI analyzes each transaction data and classifies it into the appropriate category. For example, "Deposit: 500 yen (cash)" may be classified as "food expenses," and "Expenses: 200 yen (electronic money)" may be classified as "daily necessities."

[1189] Feedback Methods

[1190] The user terminal is equipped with a feedback means for receiving the analysis results and notifying the user. For example, the user terminal may notify the user of the analysis results, such as "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[1191] By combining these elements, the present invention allows for centralized management of both cash and electronic money, thereby improving the efficiency of a user's household finances.

[1192] Specific examples

[1193] For example, if a user pays 200 yen using electronic money at a convenience store on May 1st and then deposits 500 yen in cash into their wallet on the same day, the smart storage device will record the location information as "Deposit: 500 yen" and send this to the user's device. The user's device will obtain the electronic money transaction data from the API and send it to the centralized processing device. The centralized processing device's artificial intelligence will classify this data as "food expenses" and provide feedback to the user's device.

[1194] Prompt Sentence Examples

[1195] Prompt: "Generate spending data for a user who spends 200 yen at a convenience store on May 1st and also puts 500 yen in cash into their wallet on the same day."

[1196] The above is an embodiment of the present invention. This system allows users to efficiently manage their cash and electronic money expenditure information, enabling them to manage their household finances in detail.

[1197] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1198] Step 1:

[1199] The terminal (smart storage device) uses a sensor to detect cash deposits and withdrawals. The input is the user's action of putting cash into or taking out cash from the smart storage device. For example, if a user puts 500 yen into the smart storage device, the sensor detects this and generates the data "Deposit: 500 yen." At the same time, the GPS module is used to obtain location information (longitude and latitude). The output is the data "Deposit: 500 yen" and "Location information: longitude X, latitude Y."

[1200] Step 2:

[1201] The terminal (smart storage device) uses Bluetooth to send the generated deposit data and location information to the user's terminal. The input is the aforementioned "Deposit: 500 yen" and "Location information: longitude X, latitude Y." The data is sent via Bluetooth communication and received by the user's terminal. As an output, the received data is temporarily saved in the internal database of the user's terminal.

[1202] Step 3:

[1203] The user terminal periodically calls the APIs of electronic payment services and financial institutions to obtain transaction data. The input is the authentication information and parameters required to make the API call. For example, if a user pays 200 yen with electronic money, the data "Expense: 200 yen" is obtained from the API. The output is the transaction data "Expense: 200 yen" and "Payment method: electronic money."

[1204] Step 4:

[1205] The user terminal transmits the received cash deposit and withdrawal data and electronic money transaction data to the centralized processing unit. The inputs are "Deposit: 500 yen," "Location information: longitude X, latitude Y," "Expense: 200 yen," and "Payment method: electronic money," all stored in the internal database. These data are transmitted to the centralized processing unit. The output is a unified data set received by the centralized processing unit.

[1206] Step 5:

[1207] The server (central processing device) uses a generation AI to analyze the integrated data and classify each transaction into the appropriate category. The input is integrated data such as "Deposit: 500 yen," "Expenses: 200 yen," and "Location information: longitude X, latitude Y." The generation AI analyzes this data and classifies it into categories such as "Deposit: 500 yen (food)" and "Expenses: 200 yen (daily necessities)." The output is data classified by category.

[1208] Step 6:

[1209] The user terminal receives the analysis results and notifies the user using a feedback means. The input is categorized data sent from the server. For example, data such as "Deposit: 500 yen (food)" and "Expenses: 200 yen (daily necessities)" arrives at the user terminal. The user terminal visually displays this data and notifies the user. The output is feedback to the user of specific categorized expenditure information, such as "Today's expenses are 500 yen for food and 200 yen for daily necessities."

[1210] The above is the specific processing flow of the program for this system. At each step, the input data is utilized and appropriate data processing and calculations are performed, ultimately providing the user with information that is useful for managing their household finances.

[1211] (Application example 1)

[1212] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1213] Users who use both cash and electronic money face the challenge of managing their spending information in a unified manner and achieving efficient and accurate household management. Cash spending, in particular, is particularly cumbersome to manage manually, making it easy for records to be overlooked. Categorizing spending by category is also time-consuming, making accurate household management difficult.

[1214] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1215] In this invention, the server includes a smart wallet equipped with a sensor that detects cash deposits and withdrawals, communication means for transmitting deposit and withdrawal information detected by the smart wallet to a user terminal via Bluetooth, data transfer means for transmitting the deposit and withdrawal information received by the user terminal to a central server, means for integrating transaction data in the central server via APIs of multiple electronic money services and financial institutions, means for analyzing the integrated data and classifying it by category, a generation AI for analyzing and classifying the categorized data by the generation AI, means for feeding back the categorized data classified by the generation AI to the user terminal, and means for generating a monthly report based on the analysis and notifying the user. This not only enables centralized management of cash and electronic money spending information, but also enables efficient and accurate household management by classifying and generating monthly reports by category.

[1216] - A "cash deposit / withdrawal detection sensor" is a device that physically detects a user's cash deposit / withdrawal and records that information as digital data.

[1217] A "smart wallet" is a multi-functional wallet device equipped with sensors that detect cash deposits and withdrawals, communication means, location information acquisition means, etc.

[1218] "Communication means" is a function that transmits information acquired by the smart wallet to the user terminal using wireless communication technology such as Bluetooth.

[1219] A "user terminal" is a portable information terminal that receives data sent from the smart wallet and exchanges data with the central server.

[1220] The "data transfer means" is a function for transmitting data received by the user terminal to the central server.

[1221] The "central server" is a server system that integrates and analyzes data sent from multiple user terminals and provides feedback on the results to the users.

[1222] "APIs of multiple electronic money services and financial institutions" are application programming interfaces for obtaining information on electronic money transactions and financial transactions.

[1223] "Generative AI" is an artificial intelligence algorithm that analyzes the aggregated data and classifies it into categories.

[1224] "Classifying by category" means dividing expenditure data into categories such as food, transportation, and daily necessities.

[1225] "Feedback to the user terminal" means notifying or displaying the analysis results on the user terminal.

[1226] The "location information acquisition means" is a function that acquires the user's current location information using a GPS or the like.

[1227] A "monthly report" is a report that compiles expenditure data over a certain period (usually one month) and organizes it by category.

[1228] The specific details required to implement the present invention are described below. This invention is a system that streamlines household management for users who use both cash and electronic money and centrally manages expenditure information. This system is composed of a smart wallet, a user terminal, and a central server.

[1229] Smart Wallet

[1230] Smart wallets are equipped with sensors that detect cash deposits and withdrawals. The sensors identify physical cash deposits and withdrawals and record the amounts deposited and withdrawn as digital data. They also have built-in GPS as a means of acquiring location information, and obtain GPS data on the location where cash deposits and withdrawals were made. Bluetooth is used as a means of communication, and this data is sent to the user's device.

[1231] User terminal

[1232] The user terminal receives cash deposit and withdrawal information and location information from the smart wallet and transmits it to the central server using a data transfer means. The user terminal also has the function of periodically obtaining transaction data through the APIs of electronic money services and financial institutions. This transaction data is also transmitted to the central server.

[1233] Central Server

[1234] The central server integrates cash deposit and withdrawal data and electronic money data sent from user devices. The integrated data is analyzed using generative AI and classified by category. For example, automatic classification can divide data into categories such as food expenses, transportation expenses, and daily necessities. The classified data is managed centrally, and the analysis results are fed back to the user device.

[1235] Feedback and monthly reports

[1236] The central server generates a monthly report based on the data analysis results and notifies the user. This report details the total amount spent by category and monthly spending trends, allowing users to manage their household finances more efficiently.

[1237] Hardware and software used

[1238] Hardware: Smart wallet (sensor, GPS module, Bluetooth module), smartphone, central server

[1239] Software: Bluetooth protocol for communication, Python requests library for data transfer and API calls, Python data analysis libraries (e.g., pandas, scikit-learn) for data analysis including generative AI.

[1240] Specific examples

[1241] As a specific example, consider the case where a user puts 5,000 yen into their wallet and pays 2,000 yen with electronic money. At this time, the smart wallet generates data for "Deposit: 5,000 yen" and sends it to the smartphone via Bluetooth. The smartphone then calls the API to obtain data for "Expenses: 2,000 yen" and sends both data to the central server. The central server's generation AI analyzes the data and generates a monthly report stating "Total expenditures for May: 7,000 yen (cash: 5,000 yen, electronic money: 2,000 yen), food expenses: 3,000 yen, transportation expenses: 2,000 yen, other: 2,000 yen," and notifies the user.

[1242] Example prompts for generative AI models

[1243] Combine cash spending data from your smart wallet with transaction data from your e-money API and generate a monthly report that breaks down each spending data by category. Here's an example:

[1244] Cash expenditure: 5,000 yen, electronic money expenditure: 2,000 yen

[1245] Expected categories: Food, transportation, other

[1246] conclusion

[1247] This system allows for centralized management of cash and electronic money expenditure information, enabling efficient and accurate household management. Automatic classification and monthly report generation using generation AI reduces the burden on users and makes it easier to visualize expenditures.

[1248] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1249] Step 1:

[1250] A sensor installed in the smart wallet detects the user's cash deposits and withdrawals. The input is the user's cash deposit and withdrawal actions, which the sensor detects and generates digital data such as "Deposit: 5,000 yen" or "Withdrawal: 2,000 yen." The output is cash transaction data.

[1251] Step 2:

[1252] The location information acquisition means of the smart wallet uses GPS to acquire the location where cash deposits and withdrawals are made. The input is the user's location information, which is acquired by the GPS module. The output is location information data.

[1253] Step 3:

[1254] The smart wallet transmits cash transaction data and location information data to the user terminal via Bluetooth communication means. The input is the cash transaction data and location information data, which the Bluetooth communication module transmits to the user terminal. The output is the data received by the user terminal.

[1255] Step 4:

[1256] The user terminal transmits the cash transaction data and location information data received from the smart wallet to the central server. The input is the received data, which is transmitted to the central server by the data transmission means. The output is the data transmitted to the central server.

[1257] Step 5:

[1258] The user terminal periodically obtains transaction data using the APIs of electronic money services and financial institutions. The input is an API call, which the user terminal executes to obtain electronic money transaction data. The output is electronic money data.

[1259] Step 6:

[1260] The electronic money data acquired by the user terminal is transmitted to the central server. The input is the electronic money data, which is transmitted to the central server by the data transmission means. The output is the electronic money data transmitted to the central server.

[1261] Step 7:

[1262] The central server integrates the cash transaction data, location information data, and electronic money data sent from the user terminals. These data are input, and the data integration means performs the integration process. The output is an integrated transaction data set.

[1263] Step 8:

[1264] The generation AI on the central server analyzes the integrated dataset and classifies it into categories. The input is the integrated dataset, which the generation AI analyzes. The output is data classified into categories.

[1265] Step 9:

[1266] The central server generates a monthly report based on the analysis results and feeds it back to the user terminal. The input is categorized data, which the report generation means uses to create the monthly report. The output is the monthly report notified to the user terminal.

[1267] Step 10:

[1268] The user terminal receives the monthly report and notifies the user of the analysis results. The input is the monthly report, which is displayed by the user notification means. The output is a report display that can be viewed by the user.

[1269] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1270] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies the user's emotions in combination, enabling efficient household finance management and providing feedback and advice according to the user's emotional state.

[1271] System configuration

[1272] The system consists of the following main components:

[1273] 1. Smart Wallet

[1274] Sensor: Detects cash deposits and withdrawals.

[1275] Location information acquisition method: Location information is acquired using GPS.

[1276] Communication method: Send data to the user terminal via Bluetooth.

[1277] 2. User Device

[1278] Data receiving means: Receives deposit / withdrawal information and location information from the smart wallet.

[1279] Data transfer means: Sends received data to a central server.

[1280] API integration method: Obtain transaction data through APIs of electronic money and financial institutions.

[1281] 3. Emotion Engine

[1282] Emotional data collection methods: Emotional data is collected using the user's voice input, facial expression analysis, and pulse sensor.

[1283] Emotion analysis means: Analyzes the collected emotion data and determines the user's emotional state.

[1284] 4. Central Server

[1285] Data integration method: Integrates all data obtained from user devices and APIs.

[1286] Generative AI: Analyzes and categorizes integrated transactional and sentiment data.

[1287] 5. Feedback channels

[1288] User device notification: Notifies the user of the classification and analysis results and provides advice based on their emotional state.

[1289] Program processing and specific examples

[1290] Data collection

[1291] The terminal (smart wallet) detects cash deposits and withdrawals, records them as digital data, and also acquires location information via GPS. For example, when a user withdraws 500 yen, the sensor records "Withdrawal 500 yen" and the location information.

[1292] Data transmission

[1293] The terminal (smart wallet) uses Bluetooth to send the collected cash withdrawal information and location information to the user terminal. For example, "Withdrawal of 500 yen" and location information data are sent to the user terminal.

[1294] Acquiring electronic money data

[1295] The user device periodically obtains transaction data via APIs of electronic money and financial institutions. For example, if a user pays 200 yen with electronic money, the data "Expense of 200 yen" is obtained from the API.

[1296] Collecting Emotional Data

[1297] The emotion engine (user device) collects emotion data using the user's voice input, facial expression analysis, and pulse sensor. For example, if the user is feeling stressed, it obtains "stress state" data from facial expression analysis and pulse rate fluctuations.

[1298] Data Integration

[1299] The server receives cash and electronic money data and emotion data sent from the user's device and integrates them. For example, data such as "withdrawal of 500 yen (cash)," "expense of 200 yen (electronic money)," and "stress state" are integrated.

[1300] Data analysis and categorization

[1301] The server's AI analyzes the integrated data and categorizes it. It also customizes the analysis results based on emotional data. For example, a withdrawal of 500 yen would be classified as "food," an expenditure of 200 yen as "daily necessities," and the emotional state as "stress."

[1302] User Feedback

[1303] The app (user device) displays the analyzed and classified results to the user and also provides advice based on their emotional state. For example, it might display feedback such as, "Today's expenses: food 500 yen, daily necessities 200 yen. You are under high stress, so we recommend taking time to relax."

[1304] In this way, the present invention centrally manages cash and electronic money expenditure information, and further provides feedback and advice that takes emotional state into consideration, thereby supporting users in managing their household finances more accurately and efficiently.

[1305] The processing flow will be explained below.

[1306] Step 1:

[1307] The user uses cash or electronic money. For example, the user pays 500 yen in cash at a supermarket, and then pays 200 yen at a cafe with electronic money.

[1308] Step 2:

[1309] The terminal (smart wallet) uses a sensor to detect cash deposits and withdrawals and records the data. For example, if a user withdraws 500 yen in cash, the sensor will generate the data as "withdrawal of 500 yen."

[1310] Step 3:

[1311] The device (smart wallet) acquires location information using the GPS function. For example, it records the location where the user paid 500 yen at the supermarket.

[1312] Step 4:

[1313] The terminal (smart wallet) uses Bluetooth to send cash withdrawal information and location information to the user terminal. For example, "withdrawal of 500 yen" and the location information are sent to the user's smartphone.

[1314] Step 5:

[1315] The user terminal checks the data received from the smart wallet and sends it to the central server using the data transfer means. For example, the user terminal sends "Withdraw 500 yen" and its location information to the central server.

[1316] Step 6:

[1317] The user device periodically obtains transaction data via the API of electronic money or financial institutions. For example, if a user makes a payment of 200 yen using electronic money, that data is obtained from the API.

[1318] Step 7:

[1319] The emotion engine (user device) collects emotional data using the user's voice input, facial expression analysis, and pulse sensor. For example, if a user is relaxing in a cafe, data on their "relaxed state" can be obtained from their voice input and pulse rate.

[1320] Step 8:

[1321] The server receives cash and electronic money data and emotion data sent from the user terminal and integrates them. For example, it integrates data such as "withdrawal of 500 yen (cash)," "expense of 200 yen (electronic money)," and "relaxed state."

[1322] Step 9:

[1323] The server's AI analyzes the integrated data and categorizes it. It also customizes the analysis results based on emotional data. For example, a withdrawal of 500 yen would be classified as "food," an expenditure of 200 yen as "luxury items," and the emotional state as "relaxation."

[1324] Step 10:

[1325] The server then sends the analyzed and classified results to the user's device. For example, data such as "food expenses 500 yen," "luxury items 200 yen," and "relaxed state" is sent to the user's device.

[1326] Step 11:

[1327] The user's device displays the analysis results sent from the server to the user. For example, feedback such as "Today's expenses: food 500 yen, luxury items 200 yen. As you are mostly in a relaxed state, we recommend moderate exercise" is displayed.

[1328] The above is an explanation of each processing step and its specific operation.

[1329] Example 2

[1330] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1331] There is a demand for systems that can centrally manage cash and electronic money deposit and withdrawal information while providing feedback and advice based on the user's emotional state, thereby achieving more accurate expenditure management and mental health care than conventional household management systems. Existing systems have problems in that it is difficult to integrate cash and electronic money expenditure information, and they are unable to provide customized feedback based on the user's emotional state.

[1332] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1333] In this invention, the server includes a smart wallet equipped with a sensor for detecting cash deposits and withdrawals, communication means for transmitting the deposit and withdrawal information detected by the smart wallet to an electronic device via Bluetooth, data transfer means for transmitting the deposit and withdrawal information received by the electronic device to a central processing unit, means for integrating transaction data via application programming interfaces of multiple digital payment services and financial institutions, means for analyzing and categorizing the integrated data, means for providing feedback on the categorized data classified by the generation AI to the electronic device, emotion data collection means for collecting emotion data using voice input, facial expression analysis, and a pulse sensor, emotion analysis means for analyzing the emotion data and determining the user's emotional state, and means for integrating the user's emotion data and transaction data and customizing the analysis results based on the user's emotional state. This allows for centralized management of cash and electronic money spending information while providing personalized feedback and advice based on the user's emotional state.

[1334] A "smart wallet" is a device equipped with a sensor that detects cash deposits and withdrawals and has communication means to transmit that data to an electronic device.

[1335] "Electronic device" means an electronic device capable of receiving deposit and withdrawal information and emotional data from the smart wallet and transmitting it to the central processing unit.

[1336] "Central Processing Unit" refers to a server system that receives data from electronic devices and integrates and analyzes the data through application programming interfaces of multiple digital payment services and financial institutions.

[1337] "Digital payment services" are online services that provide transactions using electronic money.

[1338] An "application programming interface" is an interface that allows data to be exchanged between different software programs.

[1339] "Generative AI" is artificial intelligence that analyzes integrated data and classifies it into categories.

[1340] "Communication means" refers to a means for transmitting and receiving data between devices via wireless or wired communication.

[1341] A "data transfer means" is a method for transmitting data from an electronic device to a central processing unit.

[1342] The "emotion data collection means" is a means for collecting user emotion data using voice input, facial expression analysis, and a pulse sensor.

[1343] The "emotion analysis means" is a means for analyzing collected emotion data and determining the user's emotional state.

[1344] "Feedback means" refers to a method of notifying an electronic device of data analyzed and classified by the generative AI and providing feedback to the user.

[1345] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies the user's emotions in combination, enabling efficient household finance management and providing feedback and advice according to the user's emotional state.

[1346] System Configuration

[1347] Hardware

[1348] 1. Smart Wallet

[1349] Sensor: Detects cash deposits and withdrawals.

[1350] GPS module: Obtains location information.

[1351] Bluetooth module: Used as a communication means to transmit data to the user terminal.

[1352] 2. Electronic Devices (User Terminals)

[1353] Data receiving module: Receives data from the smart wallet.

[1354] Data transfer module: transmits the received data to the central processing unit.

[1355] API integration module: Obtains transaction data through APIs of digital payment services and financial institutions.

[1356] Emotion data collection module: Collects emotion data using the user's voice input, facial expression analysis, and pulse sensor.

[1357] 3. Central Processing Unit (Server)

[1358] Data integration module: Integrates data obtained from user devices and APIs.

[1359] Generative AI module: Analyzes data and classifies it into categories.

[1360] 4. Feedback System

[1361] Notification module: Notifies the user of the classification and analysis results and provides feedback.

[1362] software

[1363] 1. Generative AI Models

[1364] The integrated data is analyzed and classified into categories.

[1365] Customize analysis results based on emotional data.

[1366] 2. Prompt generation

[1367] For example, to generate a prompt like this:

[1368] Data Used:

[1369] 1. Cash expenditure: 500 yen (food)

[1370] 2. Electronic money expenditure: 200 yen (daily necessities)

[1371] 3. Emotional data: High stress

[1372] Provide feedback:

[1373] Provide users with advice based on today's spending category and emotional state.

[1374] Specific examples

[1375] For example, suppose a user pays 500 yen in cash at a cafe, and then later spends 200 yen using electronic money at a convenience store. The smart wallet records the cash withdrawal information and location information and sends them to the electronic device. The electronic device then obtains the electronic money spending data, and the emotion data collection module detects the user's stress level. This data is sent to the central processing unit and analyzed and classified by the generative AI model. Finally, the user's device receives feedback such as, "Today's spending: 500 yen for food, 200 yen for daily necessities. You are under high stress, so we recommend you relax."

[1376] In this way, the system of the present invention centrally manages cash and electronic money expenditure information, and further provides feedback and advice that takes emotional state into account, thereby supporting users in managing their household finances more accurately and efficiently.

[1377] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1378] Step 1:

[1379] Cash deposit and withdrawal detection

[1380] The terminal (smart wallet) detects cash deposits and withdrawals. A sensor is used to detect cash deposits and withdrawals in real time and record them as digital data. For example, when a user pays 500 yen, the sensor recognizes this as "withdrawal of 500 yen" and records it. The input is the user's cash deposit and withdrawal action, and the output is the digital data "withdrawal of 500 yen."

[1381] Step 2:

[1382] Obtaining location information

[1383] The terminal (smart wallet) acquires location information using a built-in GPS module. The location information corresponding to the cash deposit and withdrawal detected in the previous step is acquired and linked to digital data. For example, the location information (latitude and longitude) of the cafe where the payment was made is added to "Withdrawal of 500 yen." The input is location information from the GPS, and the output is composite data including "Withdrawal of 500 yen" and location information.

[1384] Step 3:

[1385] Data Transfer

[1386] The terminal (smart wallet) transmits the collected data on deposits and withdrawals and location information to an electronic device (user terminal) via Bluetooth. For example, data including "withdrawal of 500 yen, latitude and longitude" is transmitted to the user's smartphone. The input is the data recorded in the smart wallet, and the output is the data transmitted to the user terminal.

[1387] Step 4:

[1388] Acquisition of electronic money transaction data

[1389] The user's device periodically calls the APIs of the digital payment service and financial institution to obtain transaction data. For example, if a user spends 200 yen at a convenience store using electronic money, the transaction data is obtained from the API. The input is the APIs of the digital payment service and financial institution, and the output is the obtained transaction data.

[1390] Step 5:

[1391] Collecting Emotional Data

[1392] An emotion data collection module installed in the user's device collects emotion data using voice input, facial expression analysis, and a pulse sensor. For example, if a user feels stressed during their commute, their facial expression and pulse rate fluctuations will indicate that they are in a "stressed state." The input is the user's biometric data and voice data, and the output is data indicating their emotional state.

[1393] Step 6:

[1394] Data integration

[1395] The server receives cash deposit and withdrawal data, electronic money transaction data, and emotion data sent from the user terminal and integrates them. For example, it integrates data such as "withdrawal of 500 yen (cash), expenditure of 200 yen (electronic money), stress state." The inputs are cash data, electronic money data, and emotion data, and the output is an integrated dataset.

[1396] Step 7:

[1397] Data analysis and categorization

[1398] The server's generation AI module analyzes the integrated data and classifies it into categories. For example, a withdrawal of 500 yen is classified as "food expenses," an expenditure of 200 yen as "daily necessities," and an emotional state as "stress." The input is the integrated dataset, and the output is data classified by category.

[1399] Step 8:

[1400] User Feedback

[1401] The server sends the analysis and classification results to the user's device, and feedback is displayed on the user's device. For example, a notification such as "Today's expenses: food 500 yen, daily necessities 200 yen. Stress is high, so we recommend you relax" is displayed. The input is data classified by category, and the output is a feedback message to the user.

[1402] (Application example 2)

[1403] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1404] There is a demand for a household management system that not only centrally manages cash and electronic money deposit and withdrawal information, but also takes into account the user's emotional state. Conventional household management systems simply collect and classify expenditure data, but are unable to provide feedback that reflects the user's emotional and psychological state. As a result, they lack advice that takes into account the user's mental health, making it difficult to improve long-term household management.

[1405] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for transmitting deposit / withdrawal information from a smart wallet equipped with a sensor that detects cash deposits and withdrawals via Bluetooth to a user terminal; means for transmitting the deposit / withdrawal information received by the user terminal to a central server; means for integrating transaction data via APIs of multiple electronic money services and financial institutions; means for collecting emotional data using the user's voice input, facial expression analysis, and pulse sensor; means for including a generation AI that analyzes the integrated data and emotional data and classifies them by category; and means for providing the user terminal with feedback according to the categorized data and emotional state classified by the generation AI. This makes it possible to centrally manage cash and electronic money transaction information and provide feedback that takes into account the user's emotional state.

[1406] A "smart wallet" is an electronic device equipped with a sensor that detects cash deposits and withdrawals and has the ability to transmit data to a user terminal via Bluetooth.

[1407] "Communication means" refers to the technical means for transmitting deposit and withdrawal information from the smart wallet to the user terminal via Bluetooth.

[1408] "Data transfer means" refers to the technical means by which the user terminal transmits the deposit and withdrawal information received to the central server.

[1409] The "central server" is a central system that aggregates data sent from multiple user terminals and analyzes transaction data and emotional data.

[1410] "API" is an application programming interface for obtaining transaction data from electronic money services and financial institutions.

[1411] "Emotion data collection means" refers to technical means for collecting emotion data using the user's voice input, facial expression analysis, and pulse sensor.

[1412] "Generative AI" is an artificial intelligence technology that analyzes collected data and classifies it into categories.

[1413] "Feedback means" refers to a technical means for providing feedback to a user terminal according to the data and emotional state classified by the generating AI.

[1414] "Location information acquisition means" refers to a technical means for acquiring user location information using a GPS or the like.

[1415] This invention is a system that centrally manages cash and electronic money deposit and withdrawal information, and also analyzes and classifies user emotions. This system consists of the following main components:

[1416] Smart Wallet

[1417] The smart wallet is equipped with a sensor that detects cash deposits and withdrawals, and has a communication means that transmits data to a user terminal via Bluetooth. For example, when a user withdraws cash, this smart wallet detects "withdrawal" information in real time and transmits it to the user terminal.

[1418] User terminal

[1419] The user terminal is equipped with a data transfer means for receiving deposit and withdrawal information from the smart wallet and transmitting this information to a central server. It also has a function for periodically acquiring transaction data via APIs of electronic money services and financial institutions. Furthermore, the user terminal is equipped with an emotion data collection means for collecting emotion data using voice input, facial expression analysis, and a pulse sensor.

[1420] Central Server

[1421] The central server has the function of integrating cash and electronic money data and emotional data sent from user devices. This allows all transaction data and emotional data to be managed centrally. The central server is equipped with a generative AI that analyzes the integrated data and classifies it into categories. The results of this analysis serve as the basis for users to receive feedback based on their emotional data.

[1422] Data collection and analysis

[1423] For example, if a user pays 500 yen, the smart wallet detects the corresponding cash withdrawal data, and then makes a further electronic payment of 200 yen, these data are centrally imported into the user's terminal. The emotional data collection means then collects the user's emotional state (e.g., stress level) and sends it to a central server. The data is then integrated and analyzed by the AI ​​generator, which categorizes the spending information and generates feedback according to the user's emotional state.

[1424] Feedback Methods

[1425] Based on the analyzed expenditure data and emotion data, the user device will provide appropriate feedback to the user. For example, a notification such as "Today's expenditure: Food 500 yen, daily necessities 200 yen. Stress is high, so we recommend taking time to relax" will be displayed on the user device.

[1426] Examples and prompts

[1427] As a concrete example, if the cash withdrawal data from the smart wallet shows "500 yen" and the electronic money expenditure of "200 yen", and the user's emotional state is judged to be "stressed", the following user feedback will be displayed:

[1428] Analyze the given expenditure data (cash and electronic money) and emotional data, and classify them into expenditure categories (food, daily necessities, etc.) and emotional states (stress, relaxation, etc.). Example: Withdrawal of 500 yen (cash), expenditure of 200 yen (electronic money), emotional state (stress).

[1429] This system not only allows users to centrally manage their cash and electronic money transaction information, but also provides feedback based on their emotional state, enabling healthier and more efficient household management, thereby improving the quality of life for users compared to conventional household management systems.

[1430] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1431] Step 1:

[1432] The smart wallet uses sensors to detect cash deposits and withdrawals and records the information as digital data. This data includes information such as "withdrawal of 500 yen" and "deposit of 1000 yen." At the same time, GPS data is also acquired using location information acquisition means. This allows the location of the withdrawal or deposit to be recorded. The input is the physical movement of cash, and the output is cash deposit and withdrawal data and location information.

[1433] Step 2:

[1434] The smart wallet transmits the acquired deposit and withdrawal data and location information to the user's device via Bluetooth. The user's device receives this data using Bluetooth communication and temporarily stores it internally. The input is data sent from the smart wallet, and the output is digital data stored in the user's device.

[1435] Step 3:

[1436] The user terminal periodically obtains transaction data through the APIs of electronic money services and financial institutions. This also allows for the acquisition of electronic money expenditure information. This acquisition process requires an internet connection and corresponding API authentication. The input is authentication information and transaction data requests from each API, and the output is the transaction data acquisition results.

[1437] Step 4:

[1438] The user terminal uses emotion data collection means to collect data from the user's voice input, facial expression analysis, and pulse sensor. For example, the user's face is photographed with a camera and facial expression analysis software is used to detect emotional states such as "stress" and "relaxation." The user's emotions are also analyzed from voice input. The input is the user's facial expression, voice, and pulse data, and the output is the result of the emotion analysis.

[1439] Step 5:

[1440] The user terminal transmits the cash deposit and withdrawal data, electronic money transaction data, and emotion data acquired to the central server, which then aggregates all data. The input is all data stored on the user terminal, and the output is the digital data transmitted to the central server.

[1441] Step 6:

[1442] The central server uses a data integration means to integrate the received cash and electronic money data and emotion data. This integrated data is managed centrally and serves as the basis for analysis. The input is multiple data sources sent from user terminals, and the output is the integrated data.

[1443] Step 7:

[1444] The generation AI on the central server analyzes the integrated data and classifies it into categories. During this analysis, emotional data is also taken into consideration. For example, of a 500 yen withdrawal, 400 yen may be classified as "food expenses" and 100 yen as "miscellaneous expenses," with the emotional state corresponding to "stress." A machine learning model is used in this process. The input is the integrated data, and the output is the analysis results and category classification.

[1445] Step 8:

[1446] The central server feeds back the analysis results of the generative AI to the user's device. The user's device receives this and displays specific feedback to the user. For example, a notification may be displayed saying, "Today's expenses: 500 yen for food, 200 yen for daily necessities. Stress is high, so we recommend taking time to relax." The input is the analysis results of the generative AI, and the output is feedback information to the user.

[1447] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1448] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1449] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1450] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1451] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1452] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1453] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1454] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1455] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1456] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1457] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1458] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1459] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1460] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1461] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1462] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1463] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1464] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1465] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1466] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1467] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1468] The following is further disclosed regarding the above embodiment.

[1469] (Claim 1)

[1470] A smart wallet equipped with a sensor that detects cash deposits and withdrawals,

[1471] a communication means for transmitting the deposit and withdrawal information detected by the smart wallet to a user terminal via Bluetooth;

[1472] a data transfer means for transmitting the deposit / withdrawal information received by the user terminal to a central server;

[1473] a means for aggregating transaction data via APIs of multiple electronic money services and financial institutions in the central server;

[1474] A means for analyzing the integrated data and classifying it into categories, the means comprising a generating AI;

[1475] A means for feeding back the data classified by category by the generating AI to a user terminal;

[1476] A system including:

[1477] (Claim 2)

[1478] Further comprising location information acquisition means for acquiring location information together with cash deposit and withdrawal information,

[1479] Based on the location information, the AI ​​will guess and classify the category.

[1480] 10. The system of claim 1.

[1481] (Claim 3)

[1482] means for recording cash deposit and withdrawal information detected by the smart wallet;

[1483] a means for periodically transmitting cash deposit / withdrawal information to the user terminal by the data transfer means;

[1484] The user terminal further comprises means for periodically acquiring transaction data from APIs of electronic money services and financial institutions.

[1485] 10. The system of claim 1.

[1486] "Example 1"

[1487] (Claim 1)

[1488] A smart storage device equipped with a sensor that detects cash deposits and withdrawals,

[1489] a communication means for transmitting the deposit and withdrawal information detected by the smart storage device to a user terminal via wireless communication;

[1490] a data transfer means for transmitting the deposit / withdrawal information received by the user terminal to the centralized processing unit;

[1491] means for aggregating transaction data via application interfaces of a plurality of electronic payment services and financial institutions in the centralized processing unit;

[1492] means for analyzing the integrated data and organizing it into categories; and

[1493] A means for feeding back the data classified by the generating artificial intelligence to a user terminal;

[1494] A system including:

[1495] (Claim 2)

[1496] Further comprising location information acquisition means for acquiring location information together with cash deposit and withdrawal information,

[1497] Based on the location information, the AI ​​will guess and classify the category.

[1498] 10. The system of claim 1.

[1499] (Claim 3)

[1500] A means for recording cash deposit and withdrawal information detected by the smart storage device;

[1501] means for transmitting cash deposit and withdrawal information to the user terminal periodically by the data transfer means;

[1502] The user terminal further comprises means for periodically acquiring transaction data from application interfaces of the electronic payment service and the financial institution;

[1503] 10. The system of claim 1.

[1504] "Application Example 1"

[1505] (Claim 1)

[1506] A smart wallet equipped with a sensor that detects cash deposits and withdrawals,

[1507] a communication means for transmitting the deposit and withdrawal information detected by the smart wallet to a user terminal via Bluetooth;

[1508] a data transfer means for transmitting the deposit / withdrawal information received by the user terminal to a central server;

[1509] a means for aggregating transaction data via APIs of multiple electronic money services and financial institutions in the central server;

[1510] A means for analyzing the integrated data and classifying it into categories, the means comprising a generating AI;

[1511] A means for feeding back the data classified by category by the generating AI to a user terminal;

[1512] means for generating a monthly report based on said analysis and notifying the user;

[1513] A system including:

[1514] (Claim 2)

[1515] Further comprising location information acquisition means for acquiring location information together with cash deposit and withdrawal information,

[1516] Based on the location information, the AI ​​will guess and classify the category, which will be reflected in the monthly report.

[1517] 10. The system of claim 1.

[1518] (Claim 3)

[1519] means for recording cash deposit and withdrawal information detected by the smart wallet;

[1520] a means for periodically transmitting cash deposit / withdrawal information to the user terminal by the data transfer means;

[1521] a means for periodically acquiring transaction data from APIs of electronic money services and financial institutions in the user terminal;

[1522] The generating AI further comprises a means for analyzing each expense item based on the integrated data and notifying the user of an integrated monthly report.

[1523] 10. The system of claim 1.

[1524] "Example 2: Combining Emotion Engines"

[1525] (Claim 1)

[1526] A smart wallet equipped with a sensor that detects cash deposits and withdrawals,

[1527] a communication means for transmitting the deposit and withdrawal information detected by the smart wallet to an electronic device via Bluetooth;

[1528] a data transfer means for transmitting the deposit / withdrawal information received by the electronic device to a central processing unit;

[1529] means for aggregating transaction data via application programming interfaces of a plurality of digital payment services and financial institutions in the central processing unit;

[1530] A means for analyzing the integrated data and classifying it into categories, the means comprising a generating AI;

[1531] A means for feeding back the categorized data classified by the generating AI to an electronic device;

[1532] an emotion data collection means for collecting emotion data using voice input, facial expression analysis, and a pulse sensor;

[1533] emotion analysis means for analyzing the emotion data and determining the user's emotional state;

[1534] means for integrating user emotional data with transaction data and customizing analysis results based on the user's emotional state;

[1535] A system including:

[1536] (Claim 2)

[1537] Further comprising location information acquisition means for acquiring location information together with cash deposit and withdrawal information,

[1538] Based on the location information, the AI ​​will guess and classify the category.

[1539] 10. The system of claim 1.

[1540] (Claim 3)

[1541] means for recording cash deposit and withdrawal information detected by the smart wallet;

[1542] a means for transmitting cash deposit / withdrawal information to the electronic device periodically by the data transfer means;

[1543] and means for periodically obtaining transaction data from application programming interfaces of the digital payment service and the financial institution in the electronic device.

[1544] 10. The system of claim 1.

[1545] "Application example 2 when combining emotion engines"

[1546] (Claim 1)

[1547] A smart wallet equipped with a sensor that detects cash deposits and withdrawals,

[1548] a communication means for transmitting the deposit and withdrawal information detected by the smart wallet to a user terminal via Bluetooth;

[1549] a data transfer means for transmitting the deposit / withdrawal information received by the user terminal to a central server;

[1550] a means for aggregating transaction data via APIs of multiple electronic money services and financial institutions in the central server;

[1551] means for collecting emotion data using a user's voice input, facial expression analysis, and pulse sensor;

[1552] A generating AI means for analyzing the integrated data and emotion data and classifying them into categories;

[1553] A means for providing a user terminal with feedback according to the data classified by category and the emotional state by the generating AI;

[1554] A system including:

[1555] (Claim 2)

[1556] further comprising a location information acquisition means and an emotion data collection means for acquiring location information and emotion data together with cash deposit and withdrawal information,

[1557] Based on the location information and emotion data, the generation AI infers and classifies the category.

[1558] 10. The system of claim 1.

[1559] (Claim 3)

[1560] means for recording cash deposit and withdrawal information detected by the smart wallet;

[1561] a means for periodically transmitting cash deposit / withdrawal information to the user terminal by the data transfer means;

[1562] The user terminal further comprises means for periodically acquiring transaction data and emotion data from APIs of electronic money services and financial institutions.

[1563] 10. The system of claim 1. [Explanation of symbols]

[1564] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A smart wallet equipped with a sensor that detects cash deposits and withdrawals, a communication means for transmitting the deposit and withdrawal information detected by the smart wallet to a user terminal via Bluetooth; a data transfer means for transmitting the deposit / withdrawal information received by the user terminal to a central server; a means for aggregating transaction data via APIs of multiple electronic money services and financial institutions in the central server; A means for analyzing the integrated data and classifying it into categories, the means comprising a generating AI; A means for feeding back the data classified by category by the generating AI to a user terminal; A system including:

2. Further comprising location information acquisition means for acquiring location information together with cash deposit and withdrawal information, Based on the location information, the AI ​​will guess and classify the category. The system of claim 1 .

3. means for recording cash deposit and withdrawal information detected by the smart wallet; a means for periodically transmitting cash deposit / withdrawal information to the user terminal by the data transfer means; The user terminal further comprises means for periodically acquiring transaction data from APIs of electronic money services and financial institutions. The system of claim 1 .

Images