System

Abstract

A system is provided.SOLUTION: This system includes a means for making a user input an annual income, a family structure and financial account information, a means for storing the input information in a database, a means for performing AI by an analysis engine on the basis of the stored information, and a means for providing the user with an optimum tax payment method and campaign information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Previously, individuals and sole proprietors found it difficult to obtain sufficient information when choosing the optimal tax payment method, resulting in inefficient tax payments and missing out on advantageous campaigns. Furthermore, manual tax procedures required time and effort, and were prone to errors and delays. There was a need to streamline these issues and provide the optimal tax payment method for each user. [Means for solving the problem]

[0005] The present invention provides a system that includes a means for having a user input information such as annual income, family composition, and financial account information, a means for saving the input information in a database, a means for performing analysis using an AI engine based on the saved information, and a means for providing the user with optimal tax payment methods and campaign information. The present invention also includes a means for transmitting information selected by the user based on the provided tax payment methods and campaign information to a server, thereby automating the procedure. The present invention also provides a system that includes a means for scanning or uploading an image of a receipt, a means for analyzing the scanned or uploaded image and obtaining necessary information, and a means for reevaluating the optimal tax payment method based on the obtained information and notifying the user of an updated proposal.

[0006] The "user information input means" is a means for allowing the user to input information such as annual income, family structure, and financial account information.

[0007] The "database storage means" is a means for storing input user information.

[0008] The "AI engine" is an artificial intelligence that analyzes stored user information and generates optimal tax payment methods and campaign information.

[0009] "Information provision means" refers to the means for providing users with optimal tax payment methods and campaign information generated by the AI ​​engine.

[0010] The "selected information transmitting means" is a means for transmitting information selected by the user from the tax payment method and campaign information provided to the server.

[0011] The "procedure automation means" is a means for automating tax payment procedures based on the selection information sent to the server.

[0012] A "receipt scanning means" is a means by which a user can scan or upload an image of a receipt.

[0013] The "image analysis means" is a means for analyzing scanned or uploaded receipt images and obtaining necessary information.

[0014] The "reevaluation means" is a means for reevaluating the optimal tax payment method based on the acquired receipt information and generating an updated proposal.

[0015] The "notification means" is a means for notifying the user of the updated proposals generated based on the re-evaluation. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] This invention is a system that uses AI to propose the best tax payment method for individuals and sole proprietors. This system includes the following methods to help users pay their taxes efficiently and optimally.

[0038] Program processing

[0039] Enter and save user information

[0040] The user uses the device to input their annual income, family composition, and financial account information (online banking, credit card, QR code payment account, etc.). The device temporarily stores the input information and sends it to the server. The server then stores the received user information in a database.

[0041] Data analysis

[0042] The server retrieves the saved user information and requests an analysis from the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and advantageous campaign information based on the user's annual income, family composition, and financial services used. The AI ​​engine generates the analysis results and sends them to the server.

[0043] Information provision

[0044] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. The server sends a request to the device to display the suggestions on the dedicated page. The device receives the request from the server and provides a link to access the user's dedicated page. The user accesses the dedicated page from their device and checks the suggestions (optimal tax payment methods and advantageous campaign information).

[0045] Tax payment procedure support

[0046] The user selects their desired option from the payment method and campaign information presented on the device. The device sends the user's selection information to the server. Based on the information received, the server begins supporting the appropriate payment procedures. The server provides the user with information to assist with the procedures, such as providing a link to the hometown tax payment website and automatically generating the necessary documents. The user then completes the payment procedures using the information provided on the device.

[0047] Receipt organization (for sole proprietors)

[0048] The user scans or uploads an image of a receipt using their device. The device sends the scanned or uploaded receipt image to the server. The server sends the received receipt image to the AI ​​engine. The AI ​​engine analyzes the necessary information from the image (date, amount, expenditure details, etc.) and stores the information in a database. The AI ​​engine reevaluates the tax payment method based on the newly acquired receipt information and generates an updated proposal. The server reflects the updated proposal on the user's dedicated page and notifies the user.

[0049] Specific examples

[0050] Example 1: Part-time individual user

[0051] The user uses a device to enter information such as an annual income of 2 million yen and being single. The server stores this information in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with tax payment procedures.

[0052] Example 2: Freelance sole proprietor

[0053] The user uses a terminal to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code account information. The server stores this information in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[0054] Summary

[0055] This system provides users with the most suitable tax payment method and information on special campaigns based on the information they input, enabling them to carry out tax payment procedures efficiently. For self-employed individuals, it also aims to further improve tax payment efficiency by organizing and reevaluating receipts.

[0056] The processing flow will be explained below.

[0057] Step 1:

[0058] The user uses the terminal to enter information such as their annual income, family composition, online banking account, credit card information, and QR code payment account information.

[0059] Step 2:

[0060] The terminal temporarily stores the entered user information, and when all the information is collected, it prepares to send it to the server.

[0061] Step 3:

[0062] The terminal makes a request to send user information to the server, which receives the request and stores the user information in a database.

[0063] Step 4:

[0064] The server retrieves the stored user information from the database and sends an analysis request to the AI ​​engine.

[0065] Step 5:

[0066] Based on the user information received by the AI ​​engine, it analyzes the optimal tax payment method and campaign information based on annual income, family composition, and the financial services used.

[0067] Step 6:

[0068] The AI ​​engine generates analysis results, compiles optimal tax payment methods and campaign information, and sends the results to the server.

[0069] Step 7:

[0070] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page.

[0071] Step 8:

[0072] The server sends a request to the user terminal to display the proposal along with a link to access a dedicated page.

[0073] Step 9:

[0074] The device receives the request from the server and displays a link to access a dedicated page for the user. When the user clicks the link, a dedicated page is displayed where the user can check the proposed content.

[0075] Step 10:

[0076] The user uses the terminal to select the desired option from the tax payment method and campaign information presented.

[0077] Step 11:

[0078] The terminal sends the information selected by the user to the server, which then begins supporting the appropriate tax payment procedures based on the received information.

[0079] Step 12:

[0080] The server provides links to hometown tax payment sites, automatically generates necessary documents, and provides information to assist users with tax payment procedures.

[0081] Step 13:

[0082] The user uses the terminal to complete the tax payment procedure based on the information provided.

[0083] Step 14:

[0084] The user uses the device to scan or upload an image of the receipt.

[0085] Step 15:

[0086] The device sends the scanned or uploaded receipt image to the server, which receives the image and sends an analysis request to the AI ​​engine.

[0087] Step 16:

[0088] The AI ​​engine analyzes the necessary information (date, amount, expenditure details, etc.) from the receipt image and stores it in a database.

[0089] Step 17:

[0090] The AI ​​engine reevaluates the user's tax payment information based on receipt analysis data and generates optimized proposals.

[0091] Step 18:

[0092] The server reflects the re-evaluated proposals on the user's personal page and notifies the user of the changes.

[0093] Step 19:

[0094] The user uses the terminal to check the proposal based on the reevaluation and follow up on the necessary procedures.

[0095] Example 1

[0096] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0097] Tax payment procedures are complex and burdensome for individuals and sole proprietors, making it difficult to find optimal tax payment methods and effective campaign information. Furthermore, for sole proprietors, organizing receipts and reevaluating tax payment methods based on them is also an important issue. Thus, the lack of support for users to pay taxes efficiently and optimally is an issue.

[0098] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0099] In this invention, the server includes means for having the user input income information, household information, and financial information, means for saving the input information in a storage device, means for analyzing the saved information using an artificial intelligence engine, and means for providing the user with optimal tax payment methods and promotional information. This enables users to pay taxes efficiently and optimally, and also enables self-employed individuals to further improve tax payment efficiency by organizing receipts and reevaluating tax payment methods.

[0100] "Income Information" means information relating to a User's annual income or other income.

[0101] "Household information" refers to information about the user's household, such as family structure and support status.

[0102] "Financial information" refers to information regarding financial services used by users (online banking, credit cards, QR code payments, etc.).

[0103] "Storage" refers to a storage device or database for saving data entered by a user.

[0104] An "artificial intelligence engine" refers to a system equipped with an artificial intelligence algorithm that analyzes input data and provides optimal tax payment methods and campaign information.

[0105] "Tax Method" means the method by which the User pays or calculates the Taxes payable by the User.

[0106] "Promotion information" refers to campaigns and discount information available to users.

[0107] "Receipt" refers to a receipt or invoice issued when making a purchase or using a service.

[0108] "Digitalization" refers to scanning and converting paper-based information into electronic form.

[0109] "Extraction" refers to extracting necessary information from image or text data.

[0110] The present invention is a system that proposes optimal tax payment methods for individuals and sole proprietors, and is characterized by performing analysis using an artificial intelligence engine, utilizing a variety of user information such as annual income, family structure, and financial information. This system is implemented primarily using the following hardware and software:

[0111] Hardware and software used

[0112] 1. Terminal (user side): This refers to a device such as a smartphone, tablet, or PC that the user uses to input information. The terminal provides an input interface, temporarily stores information from the user, encrypts it, and sends it to the server.

[0113] 2. Server: Refers to a cloud server or on-premise server that receives, stores, and analyzes information. The server is connected to a database where data is stored. The server is also equipped with an AI engine and has the ability to analyze user data.

[0114] 3. Artificial Intelligence Engine (AI Engine): Analyzes user information using machine learning algorithms and generates optimal tax payment methods and campaign information. For example, a model using Python and TensorFlow is implemented.

[0115] Natural language processing explanation

[0116] Entering and saving user information

[0117] The user enters the necessary information (annual income, family composition, financial information) through the terminal. The terminal temporarily stores the entered information in memory and sends it in encrypted form to the server. The server stores the received information in a database.

[0118] Analyzing the data

[0119] The server retrieves the saved user information and requests an analysis from the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and campaign information based on annual income, family composition, and financial services used, and sends the results to the server.

[0120] Proposal content provided

[0121] The server prepares the analysis results received from the AI ​​engine to be reflected on the user's dedicated page. The server then sends a request to the device to display the suggestions on the dedicated page. The device receives the request and provides a link to access the user's dedicated page. The user accesses the dedicated page from their device and checks the suggestions.

[0122] Tax payment assistance

[0123] The user selects the desired option from the tax payment method and campaign information presented on a dedicated page. The device sends the user's selection information to the server, and the server supports the appropriate tax payment procedures based on the received information. This includes providing a link to the hometown tax payment website and automatically generating the necessary documents. The user then completes the tax payment procedures using the device.

[0124] Organizing receipts (for self-employed individuals)

[0125] The user scans or uploads an image of the receipt. The device sends it to the server, which then sends the image to the AI ​​engine. The AI ​​engine uses image recognition technology (OCR) to analyze the necessary information and stores it in a database. The AI ​​engine reevaluates the tax payment method based on the newly acquired information and sends an updated proposal to the server. The server then updates the user's personal page with the new proposal and notifies them.

[0126] Specific examples

[0127] Example 1: Part-time individual user

[0128] The user uses a device to enter information such as an annual income of 2 million yen and being single. The server stores this information in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with tax payment procedures.

[0129] Example 2: Freelance sole proprietor

[0130] The user uses a terminal to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code account information. The server stores this information in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[0131] In this way, the system of the present invention uses an AI engine to analyze user information and provide optimal tax payment methods and promotional information, enabling users to pay taxes efficiently and optimally. Furthermore, for sole proprietors, it provides a receipt organization function, further improving tax payment efficiency.

[0132] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0133] Step 1: The user enters information using the terminal.

[0134] Input and Output: The user enters income, household, and financial information and sends it to the device.

[0135] Specific behavior:

[0136] The user accesses the system's input form using a smartphone or PC. Here, they enter information such as annual income, family composition, online banking, credit card, and QR code payment account. The device temporarily stores the entered information in its memory. When the user presses the "Send" button, the device encrypts this information and sends it to the server.

[0137] Step 2: The device sends the entered information to the server

[0138] Input and Output: Receives encrypted user information from the terminal and sends it to the server.

[0139] Specific behavior:

[0140] The device packages the encrypted user information into packets and sends them to the server using an HTTP request, which the server receives and decrypts.

[0141] Step 3: The server saves the user information to a database

[0142] Input and Output: The server receives the encrypted information and stores it in a database.

[0143] Specific behavior:

[0144] The server decrypts the received data and generates a SQL query to store in the database, which the server executes and stores the user information securely.

[0145] Step 4: The server sends the data to the AI ​​engine

[0146] Input and Output: User information is retrieved from the database and sent to the AI ​​engine.

[0147] Specific behavior:

[0148] The server retrieves user information from the database and generates a request to send to the AI ​​engine. The server converts the user information into JSON format and sends it to the AI ​​engine.

[0149] Step 5: The AI ​​engine analyzes the data

[0150] Input and output: Analyzes user information received from the server and generates optimal tax payment methods and campaign information.

[0151] Specific behavior:

[0152] The AI ​​engine analyzes the received user information and uses machine learning algorithms to derive optimal tax payment methods and campaign information. For example, it analyzes prompts generated by the AI ​​model and determines that a particular campaign will have a high tax savings effect. The analysis results are sent to the server in JSON format.

[0153] Step 6: The server prepares to reflect the analysis results on the user's personal page

[0154] Input and output: Prepares the analysis results received from the AI ​​engine to be reflected on the user's dedicated page.

[0155] Specific behavior:

[0156] The server stores the analysis results received from the AI ​​engine in a database and generates HTML and JavaScript files to display on a user-specific page.

[0157] Step 7: The server sends a request to the device to display the proposal on a dedicated page.

[0158] Input and Output: The server generates a link for the user and sends a request containing that link to the device.

[0159] Specific behavior:

[0160] The server generates a link to a user-specific page and sends a notification request including this link to the terminal, which receives and displays the request.

[0161] Step 8: The user visits the dedicated page and checks the proposal.

[0162] Input and Output: The user clicks on a link on the device and accesses a dedicated page.

[0163] Specific behavior:

[0164] Users click on the link provided on their device to access a dedicated page, which displays information on the best tax payment methods and campaigns.

[0165] Step 9: User selects desired option from suggestions

[0166] Input and output: The user selects the best offer on a dedicated page and sends the information to the device.

[0167] Specific behavior:

[0168] The user selects the desired option from the options displayed on the dedicated page (hometown tax donation site, campaign, etc.) and presses the "Select" button. The device then sends this selection information to the server.

[0169] Step 10: The server receives the selection information and assists with the tax payment process.

[0170] Input and Output: Generates information to assist with tax procedures based on received information and provides it to the user.

[0171] Specific behavior:

[0172] Based on the user's selection, the server automatically generates and provides the user with related links (for example, hometown tax payment websites) and necessary documents, allowing the user to complete the tax payment procedure using their device.

[0173] Step 11: User scans or uploads image of receipt (for sole proprietors)

[0174] Input and Output: User scans an image of a receipt, saves it on the device, and sends it to the server.

[0175] Specific behavior:

[0176] The user scans the receipt using the smartphone camera and saves the image on the device. Then, the user logs in to the system and uploads the image. The device sends the image to the server.

[0177] Step 12: The server sends the received image to the AI ​​engine

[0178] Input and output: The server sends the received image data to the AI ​​engine for analysis.

[0179] Specific behavior:

[0180] The server sends the received image data to the AI ​​engine, which uses image recognition technology (OCR) to extract the necessary information from the receipt.

[0181] Step 13: The AI ​​engine analyzes the image and stores the information in a database

[0182] Input and Output: Analyze the received receipt image and store the extracted information in a database.

[0183] Specific behavior:

[0184] The AI ​​engine analyzes the received image and uses OCR technology to extract the date, amount, expenditure details, etc. The extracted data is sent to the server, which then stores it in a database.

[0185] Step 14: The AI ​​engine reevaluates the proposal based on the newly acquired information

[0186] Inputs and Outputs: Re-evaluate tax payment methods based on extracted information and generate updated proposals.

[0187] Specific behavior:

[0188] Based on the newly acquired information, the AI ​​engine reevaluates and optimizes existing tax payment methods and promotional information, generates new proposals, and sends them to the server in JSON format.

[0189] Step 15: The server updates the user's page with the updated proposal and notifies them.

[0190] Input and Output: The updated proposal is reflected on the user's personal page and a notification is sent to the user.

[0191] Specific behavior:

[0192] The server receives new suggestions from the AI ​​engine, saves them in a database, and prepares them for display on the user's personal page. The server generates a notification and sends it to the device. The device receives the notification and notifies the user.

[0193] Through the above processing steps, the system of the present invention provides users with the most suitable tax payment method and campaign information, and supports the tax payment procedure. It also provides self-employed individuals with a receipt organization function, further improving the efficiency of tax payment.

[0194] (Application example 1)

[0195] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0196] The current diversification of e-commerce and payment methods makes it difficult for users to choose the optimal payment method from the numerous payment options and campaign information available. In particular, selecting the optimal payment method or campaign requires time and effort, which can degrade the user experience.

[0197] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0198] In this invention, the server includes means for having the user input annual income, family composition, and financial account information, means for saving the input information in a database, means for analyzing the saved information using an AI engine, and means for providing the user with optimal payment methods and campaign information. This allows the user to automatically select the optimal payment options and campaigns from multiple options and campaigns, eliminating the need for selection and enabling efficient purchasing activities.

[0199] "Annual income" is information indicating the total annual income of the user.

[0200] "Family composition" is information indicating the composition of members in the user's household, specifically the number of spouses and children and their relationships.

[0201] "Financial account information" refers to financial account information such as bank accounts, credit cards, and electronic money used by the user.

[0202] "Payment history" is a record of a user's past financial transactions and purchases.

[0203] "Credit card information" refers to information related to a credit card, such as the account number, issuing institution, and usage history.

[0204] "Electronic money information" refers to account information and usage history related to the electronic money service used by the user.

[0205] The "AI engine" is a system that uses artificial intelligence technology to analyze data and generate optimal payment methods and campaign information.

[0206] "Campaign information" is information about benefits such as discounts and cash backs offered by financial institutions and service providers that are beneficial to users.

[0207] This invention is a system that allows users to efficiently select electronic commerce and payment methods. This system consists of a server and user terminals, collects and analyzes user information, and provides optimal payment methods and campaign information.

[0208] Hardware and software used

[0209] Hardware: User devices (smartphones, tablets, PCs, etc.), servers

[0210] Software: Web server (Flask, etc.), database (SQLite, etc.), AI engine

[0211] System Program

[0212] 1. Enter and save user information

[0213] The server provides an interface for allowing the user to input information on annual income, family structure, and financial accounts.

[0214] The user terminal inputs this information, temporarily stores it, and then transmits it to the server.

[0215] The server stores the received information in a database.

[0216] 2. Data analysis

[0217] The server sends the stored information to the AI ​​engine.

[0218] The AI ​​engine analyzes the information and generates the most suitable payment methods and campaign information for the user.

[0219] The generated information is sent back to the server and reflected on the user's personal page.

[0220] 3. Information provision

[0221] The server notifies the user of the most suitable payment method and campaign information.

[0222] The user device provides this information to the user using alerts and notification functions.

[0223] Specific examples

[0224] Example 1: Individual user with an annual income of 5 million yen

[0225] The user enters information about their annual income of 5 million yen, their family composition (husband and wife and two children), various credit cards, and electronic money into the terminal.

[0226] The server stores this information in a database, and the AI ​​engine analyzes it.

[0227] The AI ​​engine generates the optimal credit card cashback campaign, and the server displays it on a user-specific page.

[0228] The user checks the dedicated page on the device and selects the presented cashback campaign.

[0229] Prompt Sentence Examples

[0230] "User ID 1, annual income: 5 million yen, family composition: couple and two children, financial account information: credit card X, electronic money Y"

[0231] This system allows users to easily obtain optimal payment methods and campaign information, enabling them to make purchases efficiently.

[0232] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0233] Step 1:

[0234] The user uses a terminal to input annual income, family composition, and financial account information. This information is temporarily stored on the terminal. The input data is as follows: "Annual income: 5 million yen, Family composition: Couple with two children, Financial account information: Credit card X, Electronic money Y."

[0235] Step 2:

[0236] The terminal sends the entered user information to the server. The server receives the information and stores it in a database. The input information sent to the server is "annual income, family composition, and financial account information," and the output is the user information stored in the database.

[0237] Step 3:

[0238] The server sends the saved user information to the AI ​​engine. The AI ​​engine performs data analysis to generate optimal payment methods and campaign information based on the user's annual income, family structure, and financial account information. User information is sent as input to the AI ​​engine, and the output is "optimal payment methods and campaign information."

[0239] Step 4:

[0240] The AI ​​engine performs the analysis and generates optimal payment methods and campaign information. For example, the AI ​​engine outputs the analysis result, such as "Credit card X's 5% cash back campaign is applicable."

[0241] Step 5:

[0242] The server receives the analysis results from the AI ​​engine and prepares them to generate a user-specific page. The output is a combination of the user-specific page template and the analysis results.

[0243] Step 6:

[0244] The server sends an access link to the dedicated page to the user's terminal. The terminal receives the link sent from the server and notifies the user. This prepares the user to access the dedicated page. The output is a link that the user can click.

[0245] Step 7:

[0246] The user accesses a dedicated page from their device and checks the most suitable payment method and campaign information. Specifically, they can select from the displayed payment methods and campaign information. The output is the user's selection.

[0247] Step 8:

[0248] The terminal sends the payment method and campaign information selected by the user to the server. The server automatically proceeds with the procedure based on the received selection information and applies the optimal payment method and campaign. The output shows the procedure completed.

[0249] Through the above processing steps, the user can efficiently obtain the most suitable payment method and campaign information and carry out purchasing activities.

[0250] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0251] This invention is a system that uses AI and an emotion engine to propose the best tax payment method for individuals and sole proprietors. This system includes the following means to help users pay their taxes efficiently and optimally.

[0252] Program processing

[0253] Enter and save user information

[0254] The user uses the device to input their annual income, family composition, and financial account information (online banking, credit card, QR code payment account, etc.). The emotion engine then recognizes emotions from the user's facial expressions and voice and acquires emotional data. The device temporarily stores the input information and emotional data and sends it to the server. The server then stores the received information and emotional data in a database.

[0255] Data analysis and sentiment reflection

[0256] The server retrieves stored user information and emotional data from the database and sends an analysis request to the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and campaign information based on the user's annual income, family composition, financial services used, and emotional data. By taking emotional data into consideration, the proposals are optimized to reduce the user's stress. The AI ​​engine generates the analysis results and sends them to the server.

[0257] Information provision

[0258] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. The server sends a request to the user's device to display the suggestions along with a link to access the dedicated page. The device receives the request from the server and displays a link to access the user's dedicated page. When the user accesses the link, the dedicated page is displayed and the suggestions can be viewed.

[0259] Tax payment procedure support

[0260] The user selects the desired option from the tax payment method and campaign information presented on the device. The device sends the user's selection information to the server. Based on the information received, the server begins supporting the appropriate tax payment procedures. The server provides information to support the user's tax payment procedures, such as providing a link to the hometown tax payment site and automatically generating the necessary documents. The user completes the tax payment procedures using the information provided on the device.

[0261] Receipt organization (for sole proprietors)

[0262] The user scans or uploads an image of a receipt using their device. The device sends the scanned or uploaded receipt image to the server. The server receives the image and sends an analysis request to the AI ​​engine. The AI ​​engine analyzes the necessary information from the receipt image (date, amount, expenditure details, etc.) and stores it in a database. The AI ​​engine reevaluates the tax payment information based on the newly acquired receipt information and generates an updated proposal. The server reflects the reevaluated proposal on the user's personal page and notifies the user of the changes.

[0263] Specific examples

[0264] Example 1: Part-time individual user

[0265] The user uses a device to input information such as an annual income of 2 million yen and being single, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. Based on the emotional data, an installment plan that reduces the user's stress is proposed. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with the tax payment procedure.

[0266] Example 2: Freelance sole proprietor

[0267] The user uses a device to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code information, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. Taking the emotional data into consideration, the least stressful option for the user is suggested. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[0268] Summary

[0269] This system provides optimal tax payment methods and information on advantageous campaigns based on the user's input information and emotional data, enabling efficient tax payment procedures. It also aims to further improve tax payment efficiency for self-employed individuals by organizing and reevaluating receipts. By combining it with an emotional engine, the system reduces user stress and provides a more comfortable tax payment experience.

[0270] The processing flow will be explained below.

[0271] Step 1:

[0272] The user uses the terminal to enter information such as their annual income, family composition, online banking account, credit card information, and QR code payment account information.

[0273] Step 2:

[0274] When a user enters information, the emotion engine recognizes the user's current emotion through facial detection, voice analysis, etc., and obtains emotion data.

[0275] Step 3:

[0276] The terminal temporarily stores the input user information and acquired emotion data and transmits them to the server.

[0277] Step 4:

[0278] The server receives the user information and emotion data and stores them in a database.

[0279] Step 5:

[0280] The server retrieves the stored user information and emotional data from the database and sends an analysis request to the AI ​​engine.

[0281] Step 6:

[0282] The AI ​​engine analyzes various tax payment methods and campaign information based on the user's annual income, family composition, financial service usage, and emotional data.

[0283] Step 7:

[0284] Taking into account emotional data, the AI ​​engine generates optimal suggestions to reduce the user's stress. The AI ​​engine generates the analysis results and sends them to the server.

[0285] Step 8:

[0286] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page.

[0287] Step 9:

[0288] The server sends a request to the user terminal to display the proposal along with a link to access a dedicated page.

[0289] Step 10:

[0290] The device receives the request from the server and displays a link to access a dedicated page for the user. When the user clicks the link, a dedicated page is displayed where the user can check the proposed content.

[0291] Step 11:

[0292] The user selects the desired option from the tax payment method and campaign information presented on the device. The emotion engine also retrieves the emotion at the time of selection.

[0293] Step 12:

[0294] The device sends the user's selection information and emotion data to the server, which then begins supporting the appropriate tax payment procedures based on the received information.

[0295] Step 13:

[0296] The server provides links to hometown tax payment sites, automatically generates necessary documents, and provides information to assist users with tax payment procedures.

[0297] Step 14:

[0298] The user completes the tax payment procedure using the information provided using the terminal.

[0299] Step 15:

[0300] The user uses the device to scan or upload an image of the receipt, and the emotion engine captures the user's emotions during this process.

[0301] Step 16:

[0302] The device sends the scanned or uploaded receipt image and emotion data to the server, which receives the image and emotion data and sends an analysis request to the AI ​​engine.

[0303] Step 17:

[0304] The AI ​​engine analyzes the necessary information (date, amount, expenditure details, etc.) from the receipt image and stores it in a database.

[0305] Step 18:

[0306] The AI ​​engine reevaluates the payment based on the emotional data and generates the optimal tax payment method. The reevaluated proposal is then sent to the server.

[0307] Step 19:

[0308] The server reflects the re-evaluated proposal on the user's personal page and notifies the user.

[0309] Step 20:

[0310] The user uses the terminal to check the proposal based on the reevaluation and carry out the necessary procedures.

[0311] Example 2

[0312] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0313] Conventional tax payment support systems often provide uniform information without considering the user's emotional state. This makes it difficult to provide optimal tax payment methods and campaign information for users. Furthermore, systems have not adequately improved the efficiency of receipt organization and expense accounting for sole proprietors. This has led to problems such as stress and complication when users go through the tax payment process.

[0314] The specification processing by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for having the user input annual income, family composition, and financial account information, means for acquiring the user's emotion data using an emotion engine, means for temporarily saving the input information and emotion data, means for transmitting the saved information and emotion data to the server, means for saving the received information and emotion data in a database, means for analyzing the saved information and emotion data using an AI engine, means for sending a request to reflect the analysis results in a user-dedicated page, means for displaying a link to the dedicated page on the user terminal, and means for providing the user with optimal tax payment methods and campaign information. This makes it possible to provide the user with optimal tax payment methods and advantageous campaign information based on the user's input information and emotion data, thereby improving the efficiency of tax payment procedures and reducing stress for the user.

[0315] "User" refers to an individual or sole proprietor who uses the system.

[0316] "Annual income" refers to the total amount of income a user receives in a year.

[0317] "Family composition" refers to information about the members of a user's household and their relationships.

[0318] "Financial account information" refers to information related to user financial transactions such as online banking, credit cards, and QR code payment accounts.

[0319] An "emotion engine" refers to a program or device that recognizes and acquires emotional data from a user's facial expressions and voice.

[0320] "Emotion data" refers to information about the user's emotions obtained by the emotion engine.

[0321] "Server" refers to a central processing unit that receives, stores, analyzes, and provides information sent by users.

[0322] A "database" refers to a system for systematically storing information and data.

[0323] An "AI engine" refers to a program or device that uses artificial intelligence to analyze data and generate optimal suggestions.

[0324] "User-specific page" refers to a web page that is customized for a particular user.

[0325] "Tax payment procedures" refers to the series of steps required to pay taxes.

[0326] "Hometown tax donation site" refers to a website through which users can make hometown tax donations.

[0327] "Automatic generation of required documents" refers to the process of automatically generating documents required for a user to complete tax procedures.

[0328] "Receipt" means a document issued as evidence of a transaction or payment.

[0329] "OCR technology" refers to optical character recognition technology, which extracts text data from images.

[0330] "Reassessment" refers to the process of reexamining and updating existing information.

[0331] "Notification" refers to an action to inform a user of specific information.

[0332] The present invention relates to a system that provides optimal tax payment methods and campaign information based on a user's annual income, family structure, financial account information, and emotional data. Specific embodiments of the system are described below.

[0333] System Configuration

[0334] This system consists of a user terminal, emotion engine, server, database, and AI engine. By properly linking these components, it helps users to complete tax procedures efficiently and comfortably.

[0335] Enter and save user information

[0336] Using a device such as a smartphone or PC, a user accesses a dedicated application or web page and enters information such as annual income, family composition, and financial account information. The entered information is temporarily stored on the device. At the same time, an emotion engine (e.g., a facial expression analysis camera or a voice recognition microphone) installed on the device acquires emotional data from the user's facial expressions and voice. This emotional data is also temporarily stored on the device. The device then encrypts this information and sends it to a server.

[0337] Data storage and analysis

[0338] The server stores the received user information and emotional data in a database. The server periodically retrieves new user information and emotional data from the database and sends an analysis request to the AI ​​engine. The AI ​​engine (e.g., generative AI model) analyzes the optimal tax payment method and campaign information based on the user's annual income, family composition, financial services used, and emotional data.

[0339] Viewing Proposals

[0340] The analysis results generated by the AI ​​engine are sent to the server. Based on these results, the server prepares to generate a personalized page for the user. The server then sends a request to the user's device to display the suggestions along with a link to the personalized page, and the device displays the link to the user. When the user clicks the link, they can access the personalized page and check the suggestions.

[0341] Tax payment assistance

[0342] When a user selects their desired payment method from the tax payment method and campaign information presented on the dedicated page, the selected information is sent from the device to the server. Based on the received information, the server starts a process to assist with the appropriate tax payment procedures. Specifically, it provides a link to the hometown tax payment website and automatically generates the necessary documents, which are then provided to the user. The user then uses the device to complete the tax payment procedures based on this information.

[0343] Receipt organization (for sole proprietors)

[0344] As a feature for self-employed individuals, users can scan or upload images of receipts using their device. The device then sends the image data to a server, which then requests an AI engine to analyze it. The AI ​​engine uses OCR technology to extract necessary information from the receipt (date, amount, expenditure details, etc.) and stores it in a database. Based on the newly acquired receipt data, the AI ​​engine reevaluates the tax payment information, generates updated proposals, and the server notifies the user of the changes, which are then reflected on the user's personal page.

[0345] Specific examples

[0346] Example 1: Part-time individual user

[0347] The user uses a device to input information such as an annual income of 2 million yen and being single, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. Based on the emotional data, an installment plan that reduces the user's stress is proposed. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with the tax payment procedure.

[0348] Example 2: Freelance sole proprietor

[0349] The user uses a device to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code information, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. Taking the emotional data into consideration, the least stressful option for the user is suggested. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[0350] Example prompts to input to the generative AI model

[0351] "Generate analysis results to suggest the optimal tax payment method for a single user with an annual income of 2 million yen. Take into account the user's emotional data and suggest the optimal installment plan and campaign information."

[0352] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0353] Step 1: Enter and save user information

[0354] The user uses the device to input information such as annual income, family composition, and financial account information. Once the input is complete, the emotion engine is activated and acquires emotional data from the user's facial expressions and voice. Based on this, the device temporarily stores the input information and emotional data. This information is then encrypted and sent to the server. The server stores the received information and emotional data in a database.

[0355] Input: Annual income, family structure, financial account information, emotional data

[0356] Output: Temporarily saved input information and emotion data, sent to the server and saved in the database

[0357] Step 2: Data analysis and sentiment analysis

[0358] The server retrieves stored user information and emotional data from the database. The retrieved data is sent to an AI engine (generative AI model) and requested to analyze the optimal tax payment method and campaign information. The AI ​​engine calculates the data based on annual income, family composition, financial services used, and emotional data to generate optimal proposals. The analysis results are sent to the server.

[0359] Input: User information, emotion data

[0360] Output: Analysis results by the AI ​​engine

[0361] Step 3: View the proposal

[0362] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. It generates HTML data for the dedicated page and sends a request to the user's device to display the suggestions along with a link to access the dedicated page. The device receives the request and notifies the user of the link.

[0363] Input: Analysis results by AI engine

[0364] Output: Link and suggestions for display on the user's device

[0365] Step 4: Tax Preparation Assistance

[0366] The user checks the proposed payment method and campaign information and selects the desired option. The selected information is sent from the device to the server. Based on the information received by the server, support for the appropriate payment procedure begins, automatically generating a link to the hometown tax payment site and necessary documents. The user then completes the payment procedure based on this information.

[0367] Input: User selection information

[0368] Output: Hometown tax payment site link, required documents, and completion of tax payment procedures

[0369] Step 5: Organizing receipts (for self-employed individuals)

[0370] Self-employed users scan or upload images of receipts using their devices. These image data are sent to a server, which then sends an analysis request to an AI engine. The AI ​​engine uses OCR technology to extract the necessary information from the receipt image and stores it in a database. It then reevaluates the tax payment information based on the new receipt information and generates an updated proposal. The server reflects the reevaluated proposal on the user's personal page and notifies the user of the changes.

[0371] Input: Receipt image

[0372] Output: Parsed receipt data, notification of re-evaluated proposals

[0373] (Application example 2)

[0374] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0375] The main function of conventional tax payment support systems is to provide optimal tax payment methods and campaign information based on the information entered by the user, but because they do not take into account the user's emotions or real-time behavioral data, the optimal suggestions do not necessarily meet the user's needs.In addition, the organization of receipts and updating information for expense accounting must be done manually, which is a burden for users.

[0376] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for prompting the user to input annual income, family composition, and financial account information; means for saving the input information in a database; means for identifying emotional data from the user's facial expression and acquiring the emotional data; means for performing analysis using an AI engine based on the saved information and emotional data; means for providing the user with optimal tax payment methods and campaign information; means for the user to check their purchase history and payment information at a specific location in real time; means for scanning images of receipts for the user's expense reporting; means for analyzing the scanned images and acquiring necessary information; means for reevaluating the optimal tax payment method based on the acquired information; and means for notifying the user of the reevaluated proposal. This makes it possible to propose the optimal tax payment method taking into account the user's emotions and real-time behavior, thereby reducing the user's burden and improving the efficiency of tax payment procedures.

[0377] "User" means an individual or sole proprietor who uses the system.

[0378] "Annual income" refers to the total income earned by a user in a year.

[0379] "Family composition" refers to the composition of members in the user's household, and specifically includes information on spouse, children, and the like.

[0380] "Financial account information" refers to information about the accounts of financial services used by users, such as online banking, credit cards, and QR code payment accounts.

[0381] A "database" is an information accumulation device for storing information and emotional data obtained from users.

[0382] "Emotion data" is data based on emotions recognized from the user's facial expressions, and is information indicating the user's mental state.

[0383] The "AI engine" is an artificial intelligence program that analyzes stored information and emotional data to generate optimal tax payment methods and campaign information.

[0384] The "optimal tax payment method" refers to the most efficient tax payment method that satisfies legal requirements while minimizing the burden on users.

[0385] "Campaign information" is information about various campaigns and special offers related to tax payments, which provide advantageous conditions for the user when paying taxes.

[0386] A "specific location" refers to a place where purchasing activities are mainly carried out, such as a place or store that a user visits in daily life.

[0387] "Purchase history" is a record of past purchases made by a user, including information on what was purchased, where it was purchased, and how much it cost.

[0388] "Payment Information" refers to the payment method and payment details used by the User to pay for the Product.

[0389] "Expense accounting" refers to the process of accurately calculating expenses incurred in running a business and reflecting them in tax returns.

[0390] "Receipt Image" refers to image data of a receipt captured using smart glasses or a device to provide proof of payment for a purchased item by a user.

[0391] "Scanning" refers to the process of optically reading physical documents or receipts and storing them as digital data.

[0392] "Analysis" is the process of extracting information contained in scanned image data and identifying necessary items.

[0393] "Reevaluation" refers to the process of reconsidering and optimizing existing tax payment methods and proposals based on new information obtained.

[0394] The following describes an embodiment of the present invention. This system provides the optimal tax payment method based on the user's input of annual income, family structure, financial account information, and emotion data acquired from facial expressions. Furthermore, the system also has a function that allows the user to check purchase history and payment information in real time at a specific location.

[0395] As a specific example, a case where smart glasses are used will be described. A user wears the smart glasses and inputs their annual income, family composition, and financial account information through the smart glasses' interface. At this time, a camera built into the smart glasses captures the user's facial expressions, and emotion data is obtained through an emotion recognition model (e.g., a model using TensorFlow or Keras).

[0396] The server acquires the information and emotional data entered by the user and stores it in a database. It also uses an AI engine to analyze the stored information. Specifically, it suggests optimal tax payment methods and campaign information based on the user's annual income, family composition, financial services used, and emotional data.

[0397] Through the smart glasses, users can check campaign information and tax-saving methods in real time at specific locations. This allows them to find the best tax payment plan and campaign information while shopping. When users scan a receipt with the smart glasses' camera, the image is sent to the server for analysis. Based on the analysis results, the tax payment information is reevaluated and updated suggestions are notified to the user.

[0398] The specific hardware used includes smart glasses, a camera, and a microphone, while the software includes an emotion recognition model, a data transmission and reception server, and an AI engine.

[0399] For example, when a user is shopping at a supermarket, they can receive information about a 5% cashback campaign through the smart glasses and see in real time how it will affect their household finances, helping them choose the best tax payment method and efficiently complete the tax payment process.

[0400] Examples of specific prompts include:

[0401] "Please explain in detail your approach to capture emotional data through the camera in smart glasses while users are shopping at a supermarket, and display tax campaign information provided in real time. Also, please describe in detail how this system optimizes the user's tax payment plan."

[0402] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0403] Step 1:

[0404] The user inputs annual income, family composition, and financial account information through the interface of the smart glasses. Input data: annual income, family composition, and financial account information. Output data: user information.

[0405] Step 2:

[0406] The camera in the smart glasses captures the user's facial expressions and runs the emotion recognition model to obtain emotion data. Input data: user's facial expressions. Output data: emotion data.

[0407] Step 3:

[0408] The device temporarily stores user information and emotion data in a database and sends it to the server. Input data: User information, emotion data. Output data: Data sent to the server.

[0409] Step 4:

[0410] The server stores the received user information and emotion data in a database. Input data: Data sent to the server. Output data: Data stored in the database.

[0411] Step 5:

[0412] The server sends an analysis request to the AI ​​engine based on the stored user information and emotion data. Input data: Data stored in the database. Output data: Data sent to the AI ​​engine.

[0413] Step 6:

[0414] The AI ​​engine generates optimal tax payment methods and campaign information based on user information and emotional data. Input data: user information, emotional data. Output data: tax payment methods, campaign information.

[0415] Step 7:

[0416] The server prepares the analysis results (tax payment methods, campaign information) received from the AI ​​engine and prepares them to be reflected on the user's dedicated page. Input data: Data received from the AI ​​engine. Output data: Data on the user's dedicated page.

[0417] Step 8:

[0418] The server sends a request to the user's device to display the proposal along with a link to access the dedicated page. Input data: Data on the user's dedicated page. Output data: The request sent to the device.

[0419] Step 9:

[0420] The terminal receives the request from the server and displays a link to access the user's private page. Input data: Request from the server. Output data: Terminal screen with the link displayed.

[0421] Step 10:

[0422] Users use smart glasses to shop at specific locations and check campaign information and tax-saving methods in real time. Input data: User's location information, shopping data. Output data: Campaign information displayed in real time.

[0423] Step 11:

[0424] The user scans the receipt using the camera on the smart glasses and uploads the image to the device. Input data: Image of the receipt. Output data: Image data stored on the device.

[0425] Step 12:

[0426] The device sends the scanned receipt image to the server, where it is analyzed by the AI ​​engine. Input data: Image data stored on the device. Output data: Analyzed receipt information.

[0427] Step 13:

[0428] The AI ​​engine reevaluates the tax payment information based on the receipt information obtained and generates an updated tax payment proposal. Input data: Parsed receipt information. Output data: Updated tax payment proposal.

[0429] Step 14:

[0430] The server updates the re-evaluated proposal on the user's personal page and notifies the user of the changes. Input data: Updated tax proposal. Output data: Changes notified to the user.

[0431] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0432] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0433] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0434] [Second embodiment]

[0435] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0436] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0437] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0438] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0439] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0440] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0441] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0442] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0443] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0444] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0445] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0446] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0447] This invention is a system that uses AI to propose the best tax payment method for individuals and sole proprietors. This system includes the following methods to help users pay their taxes efficiently and optimally.

[0448] Program processing

[0449] Enter and save user information

[0450] The user uses the device to input their annual income, family composition, and financial account information (online banking, credit card, QR code payment account, etc.). The device temporarily stores the input information and sends it to the server. The server then stores the received user information in a database.

[0451] Data analysis

[0452] The server retrieves the saved user information and requests an analysis from the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and advantageous campaign information based on the user's annual income, family composition, and financial services used. The AI ​​engine generates the analysis results and sends them to the server.

[0453] Information provision

[0454] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. The server sends a request to the device to display the suggestions on the dedicated page. The device receives the request from the server and provides a link to access the user's dedicated page. The user accesses the dedicated page from their device and checks the suggestions (optimal tax payment methods and advantageous campaign information).

[0455] Tax payment procedure support

[0456] The user selects their desired option from the payment method and campaign information presented on the device. The device sends the user's selection information to the server. Based on the information received, the server begins supporting the appropriate payment procedures. The server provides the user with information to assist with the procedures, such as providing a link to the hometown tax payment website and automatically generating the necessary documents. The user then completes the payment procedures using the information provided on the device.

[0457] Receipt organization (for sole proprietors)

[0458] The user scans or uploads an image of a receipt using their device. The device sends the scanned or uploaded receipt image to the server. The server sends the received receipt image to the AI ​​engine. The AI ​​engine analyzes the necessary information from the image (date, amount, expenditure details, etc.) and stores the information in a database. The AI ​​engine reevaluates the tax payment method based on the newly acquired receipt information and generates an updated proposal. The server reflects the updated proposal on the user's dedicated page and notifies the user.

[0459] Specific examples

[0460] Example 1: Part-time individual user

[0461] The user uses a device to enter information such as an annual income of 2 million yen and being single. The server stores this information in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with tax payment procedures.

[0462] Example 2: Freelance sole proprietor

[0463] The user uses a terminal to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code account information. The server stores this information in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[0464] Summary

[0465] This system provides users with the most suitable tax payment method and information on special campaigns based on the information they input, enabling them to carry out tax payment procedures efficiently. For self-employed individuals, it also aims to further improve tax payment efficiency by organizing and reevaluating receipts.

[0466] The processing flow will be explained below.

[0467] Step 1:

[0468] The user uses the terminal to enter information such as their annual income, family composition, online banking account, credit card information, and QR code payment account information.

[0469] Step 2:

[0470] The terminal temporarily stores the entered user information, and when all the information is collected, it prepares to send it to the server.

[0471] Step 3:

[0472] The terminal makes a request to send user information to the server, which receives the request and stores the user information in a database.

[0473] Step 4:

[0474] The server retrieves the stored user information from the database and sends an analysis request to the AI ​​engine.

[0475] Step 5:

[0476] Based on the user information received by the AI ​​engine, it analyzes the optimal tax payment method and campaign information based on annual income, family composition, and the financial services used.

[0477] Step 6:

[0478] The AI ​​engine generates analysis results, compiles optimal tax payment methods and campaign information, and sends the results to the server.

[0479] Step 7:

[0480] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page.

[0481] Step 8:

[0482] The server sends a request to the user terminal to display the proposal along with a link to access a dedicated page.

[0483] Step 9:

[0484] The device receives the request from the server and displays a link to access a dedicated page for the user. When the user clicks the link, a dedicated page is displayed where the user can check the proposed content.

[0485] Step 10:

[0486] The user uses the terminal to select the desired option from the tax payment method and campaign information presented.

[0487] Step 11:

[0488] The terminal sends the information selected by the user to the server, which then begins supporting the appropriate tax payment procedures based on the received information.

[0489] Step 12:

[0490] The server provides links to hometown tax payment sites, automatically generates necessary documents, and provides information to assist users with tax payment procedures.

[0491] Step 13:

[0492] The user uses the terminal to complete the tax payment procedure based on the information provided.

[0493] Step 14:

[0494] The user uses the device to scan or upload an image of the receipt.

[0495] Step 15:

[0496] The device sends the scanned or uploaded receipt image to the server, which receives the image and sends an analysis request to the AI ​​engine.

[0497] Step 16:

[0498] The AI ​​engine analyzes the necessary information (date, amount, expenditure details, etc.) from the receipt image and stores it in a database.

[0499] Step 17:

[0500] The AI ​​engine reevaluates the user's tax payment information based on receipt analysis data and generates optimized proposals.

[0501] Step 18:

[0502] The server reflects the re-evaluated proposals on the user's personal page and notifies the user of the changes.

[0503] Step 19:

[0504] The user uses the terminal to check the proposal based on the reevaluation and follow up on the necessary procedures.

[0505] Example 1

[0506] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0507] Tax payment procedures are complex and burdensome for individuals and sole proprietors, making it difficult to find optimal tax payment methods and effective campaign information. Furthermore, for sole proprietors, organizing receipts and reevaluating tax payment methods based on them is also an important issue. Thus, the lack of support for users to pay taxes efficiently and optimally is an issue.

[0508] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0509] In this invention, the server includes means for having the user input income information, household information, and financial information, means for saving the input information in a storage device, means for analyzing the saved information using an artificial intelligence engine, and means for providing the user with optimal tax payment methods and promotional information. This enables users to pay taxes efficiently and optimally, and also enables self-employed individuals to further improve tax payment efficiency by organizing receipts and reevaluating tax payment methods.

[0510] "Income Information" means information relating to a User's annual income or other income.

[0511] "Household information" refers to information about the user's household, such as family structure and support status.

[0512] "Financial information" refers to information regarding financial services used by users (online banking, credit cards, QR code payments, etc.).

[0513] "Storage" refers to a storage device or database for saving data entered by a user.

[0514] An "artificial intelligence engine" refers to a system equipped with an artificial intelligence algorithm that analyzes input data and provides optimal tax payment methods and campaign information.

[0515] "Tax Method" means the method by which the User pays or calculates the Taxes payable by the User.

[0516] "Promotion information" refers to campaigns and discount information available to users.

[0517] "Receipt" refers to a receipt or invoice issued when making a purchase or using a service.

[0518] "Digitalization" refers to scanning and converting paper-based information into electronic form.

[0519] "Extraction" refers to extracting necessary information from image or text data.

[0520] The present invention is a system that proposes optimal tax payment methods for individuals and sole proprietors, and is characterized by performing analysis using an artificial intelligence engine, utilizing a variety of user information such as annual income, family structure, and financial information. This system is implemented primarily using the following hardware and software:

[0521] Hardware and software used

[0522] 1. Terminal (user side): This refers to a device such as a smartphone, tablet, or PC that the user uses to input information. The terminal provides an input interface, temporarily stores information from the user, encrypts it, and sends it to the server.

[0523] 2. Server: Refers to a cloud server or on-premise server that receives, stores, and analyzes information. The server is connected to a database where data is stored. The server is also equipped with an AI engine and has the ability to analyze user data.

[0524] 3. Artificial Intelligence Engine (AI Engine): Analyzes user information using machine learning algorithms and generates optimal tax payment methods and campaign information. For example, a model using Python and TensorFlow is implemented.

[0525] Natural language processing explanation

[0526] Entering and saving user information

[0527] The user enters the necessary information (annual income, family composition, financial information) through the terminal. The terminal temporarily stores the entered information in memory and sends it in encrypted form to the server. The server stores the received information in a database.

[0528] Analyzing the data

[0529] The server retrieves the saved user information and requests an analysis from the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and campaign information based on annual income, family composition, and financial services used, and sends the results to the server.

[0530] Proposal content provided

[0531] The server prepares the analysis results received from the AI ​​engine to be reflected on the user's dedicated page. The server then sends a request to the device to display the suggestions on the dedicated page. The device receives the request and provides a link to access the user's dedicated page. The user accesses the dedicated page from their device and checks the suggestions.

[0532] Tax payment assistance

[0533] The user selects the desired option from the tax payment method and campaign information presented on a dedicated page. The device sends the user's selection information to the server, and the server supports the appropriate tax payment procedures based on the received information. This includes providing a link to the hometown tax payment website and automatically generating the necessary documents. The user then completes the tax payment procedures using the device.

[0534] Organizing receipts (for self-employed individuals)

[0535] The user scans or uploads an image of the receipt. The device sends it to the server, which then sends the image to the AI ​​engine. The AI ​​engine uses image recognition technology (OCR) to analyze the necessary information and stores it in a database. The AI ​​engine reevaluates the tax payment method based on the newly acquired information and sends an updated proposal to the server. The server then updates the user's personal page with the new proposal and notifies them.

[0536] Specific examples

[0537] Example 1: Part-time individual user

[0538] The user uses a device to enter information such as an annual income of 2 million yen and being single. The server stores this information in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with tax payment procedures.

[0539] Example 2: Freelance sole proprietor

[0540] The user uses a terminal to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code account information. The server stores this information in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[0541] In this way, the system of the present invention uses an AI engine to analyze user information and provide optimal tax payment methods and promotional information, enabling users to pay taxes efficiently and optimally. Furthermore, for sole proprietors, it provides a receipt organization function, further improving tax payment efficiency.

[0542] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0543] Step 1: The user enters information using the terminal.

[0544] Input and Output: The user enters income, household, and financial information and sends it to the device.

[0545] Specific behavior:

[0546] The user accesses the system's input form using a smartphone or PC. Here, they enter information such as annual income, family composition, online banking, credit card, and QR code payment account. The device temporarily stores the entered information in its memory. When the user presses the "Send" button, the device encrypts this information and sends it to the server.

[0547] Step 2: The device sends the entered information to the server

[0548] Input and Output: Receives encrypted user information from the terminal and sends it to the server.

[0549] Specific behavior:

[0550] The device packages the encrypted user information into packets and sends them to the server using an HTTP request, which the server receives and decrypts.

[0551] Step 3: The server saves the user information to a database

[0552] Input and Output: The server receives the encrypted information and stores it in a database.

[0553] Specific behavior:

[0554] The server decrypts the received data and generates a SQL query to store in the database, which the server executes and stores the user information securely.

[0555] Step 4: The server sends the data to the AI ​​engine

[0556] Input and Output: User information is retrieved from the database and sent to the AI ​​engine.

[0557] Specific behavior:

[0558] The server retrieves user information from the database and generates a request to send to the AI ​​engine. The server converts the user information into JSON format and sends it to the AI ​​engine.

[0559] Step 5: The AI ​​engine analyzes the data

[0560] Input and output: Analyzes user information received from the server and generates optimal tax payment methods and campaign information.

[0561] Specific behavior:

[0562] The AI ​​engine analyzes the received user information and uses machine learning algorithms to derive optimal tax payment methods and campaign information. For example, it analyzes prompts generated by the AI ​​model and determines that a particular campaign will have a high tax savings effect. The analysis results are sent to the server in JSON format.

[0563] Step 6: The server prepares to reflect the analysis results on the user's personal page

[0564] Input and output: Prepares the analysis results received from the AI ​​engine to be reflected on the user's dedicated page.

[0565] Specific behavior:

[0566] The server stores the analysis results received from the AI ​​engine in a database and generates HTML and JavaScript files to display on a user-specific page.

[0567] Step 7: The server sends a request to the device to display the proposal on a dedicated page.

[0568] Input and Output: The server generates a link for the user and sends a request containing that link to the device.

[0569] Specific behavior:

[0570] The server generates a link to a user-specific page and sends a notification request including this link to the terminal, which receives and displays the request.

[0571] Step 8: The user visits the dedicated page and checks the proposal.

[0572] Input and Output: The user clicks on a link on the device and accesses a dedicated page.

[0573] Specific behavior:

[0574] Users click on the link provided on their device to access a dedicated page, which displays information on the best tax payment methods and campaigns.

[0575] Step 9: User selects desired option from suggestions

[0576] Input and output: The user selects the best offer on a dedicated page and sends the information to the device.

[0577] Specific behavior:

[0578] The user selects the desired option from the options displayed on the dedicated page (hometown tax donation site, campaign, etc.) and presses the "Select" button. The device then sends this selection information to the server.

[0579] Step 10: The server receives the selection information and assists with the tax payment process.

[0580] Input and Output: Generates information to assist with tax procedures based on received information and provides it to the user.

[0581] Specific behavior:

[0582] Based on the user's selection, the server automatically generates and provides the user with related links (for example, hometown tax payment websites) and necessary documents, allowing the user to complete the tax payment procedure using their device.

[0583] Step 11: User scans or uploads image of receipt (for sole proprietors)

[0584] Input and Output: User scans an image of a receipt, saves it on the device, and sends it to the server.

[0585] Specific behavior:

[0586] The user scans the receipt using the smartphone camera and saves the image on the device. Then, the user logs in to the system and uploads the image. The device sends the image to the server.

[0587] Step 12: The server sends the received image to the AI ​​engine

[0588] Input and output: The server sends the received image data to the AI ​​engine for analysis.

[0589] Specific behavior:

[0590] The server sends the received image data to the AI ​​engine, which uses image recognition technology (OCR) to extract the necessary information from the receipt.

[0591] Step 13: The AI ​​engine analyzes the image and stores the information in a database

[0592] Input and Output: Analyze the received receipt image and store the extracted information in a database.

[0593] Specific behavior:

[0594] The AI ​​engine analyzes the received image and uses OCR technology to extract the date, amount, expenditure details, etc. The extracted data is sent to the server, which then stores it in a database.

[0595] Step 14: The AI ​​engine reevaluates the proposal based on the newly acquired information

[0596] Inputs and Outputs: Re-evaluate tax payment methods based on extracted information and generate updated proposals.

[0597] Specific behavior:

[0598] Based on the newly acquired information, the AI ​​engine reevaluates and optimizes existing tax payment methods and promotional information, generates new proposals, and sends them to the server in JSON format.

[0599] Step 15: The server updates the user's page with the updated proposal and notifies them.

[0600] Input and Output: The updated proposal is reflected on the user's personal page and a notification is sent to the user.

[0601] Specific behavior:

[0602] The server receives new suggestions from the AI ​​engine, saves them in a database, and prepares them for display on the user's personal page. The server generates a notification and sends it to the device. The device receives the notification and notifies the user.

[0603] Through the above processing steps, the system of the present invention provides users with the most suitable tax payment method and campaign information, and supports the tax payment procedure. It also provides self-employed individuals with a receipt organization function, further improving the efficiency of tax payment.

[0604] (Application example 1)

[0605] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0606] The current diversification of e-commerce and payment methods makes it difficult for users to choose the optimal payment method from the numerous payment options and campaign information available. In particular, selecting the optimal payment method or campaign requires time and effort, which can degrade the user experience.

[0607] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0608] In this invention, the server includes means for having the user input annual income, family composition, and financial account information, means for saving the input information in a database, means for analyzing the saved information using an AI engine, and means for providing the user with optimal payment methods and campaign information. This allows the user to automatically select the optimal payment options and campaigns from multiple options and campaigns, eliminating the need for selection and enabling efficient purchasing activities.

[0609] "Annual income" is information indicating the total annual income of the user.

[0610] "Family composition" is information indicating the composition of members in the user's household, specifically the number of spouses and children and their relationships.

[0611] "Financial account information" refers to financial account information such as bank accounts, credit cards, and electronic money used by the user.

[0612] "Payment history" is a record of a user's past financial transactions and purchases.

[0613] "Credit card information" refers to information related to a credit card, such as the account number, issuing institution, and usage history.

[0614] "Electronic money information" refers to account information and usage history related to the electronic money service used by the user.

[0615] The "AI engine" is a system that uses artificial intelligence technology to analyze data and generate optimal payment methods and campaign information.

[0616] "Campaign information" is information about benefits such as discounts and cash backs offered by financial institutions and service providers that are beneficial to users.

[0617] This invention is a system that allows users to efficiently select electronic commerce and payment methods. This system consists of a server and user terminals, collects and analyzes user information, and provides optimal payment methods and campaign information.

[0618] Hardware and software used

[0619] Hardware: User devices (smartphones, tablets, PCs, etc.), servers

[0620] Software: Web server (Flask, etc.), database (SQLite, etc.), AI engine

[0621] System Program

[0622] 1. Enter and save user information

[0623] The server provides an interface for allowing the user to input information on annual income, family structure, and financial accounts.

[0624] The user terminal inputs this information, temporarily stores it, and then transmits it to the server.

[0625] The server stores the received information in a database.

[0626] 2. Data analysis

[0627] The server sends the stored information to the AI ​​engine.

[0628] The AI ​​engine analyzes the information and generates the most suitable payment methods and campaign information for the user.

[0629] The generated information is sent back to the server and reflected on the user's personal page.

[0630] 3. Information provision

[0631] The server notifies the user of the most suitable payment method and campaign information.

[0632] The user device provides this information to the user using alerts and notification functions.

[0633] Specific examples

[0634] Example 1: Individual user with an annual income of 5 million yen

[0635] The user enters information about their annual income of 5 million yen, their family composition (husband and wife and two children), various credit cards, and electronic money into the terminal.

[0636] The server stores this information in a database, and the AI ​​engine analyzes it.

[0637] The AI ​​engine generates the optimal credit card cashback campaign, and the server displays it on a user-specific page.

[0638] The user checks the dedicated page on the device and selects the presented cashback campaign.

[0639] Prompt Sentence Examples

[0640] "User ID 1, annual income: 5 million yen, family composition: couple and two children, financial account information: credit card X, electronic money Y"

[0641] This system allows users to easily obtain optimal payment methods and campaign information, enabling them to make purchases efficiently.

[0642] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0643] Step 1:

[0644] The user uses a terminal to input annual income, family composition, and financial account information. This information is temporarily stored on the terminal. The input data is as follows: "Annual income: 5 million yen, Family composition: Couple with two children, Financial account information: Credit card X, Electronic money Y."

[0645] Step 2:

[0646] The terminal sends the entered user information to the server. The server receives the information and stores it in a database. The input information sent to the server is "annual income, family composition, and financial account information," and the output is the user information stored in the database.

[0647] Step 3:

[0648] The server sends the saved user information to the AI ​​engine. The AI ​​engine performs data analysis to generate optimal payment methods and campaign information based on the user's annual income, family structure, and financial account information. User information is sent as input to the AI ​​engine, and the output is "optimal payment methods and campaign information."

[0649] Step 4:

[0650] The AI ​​engine performs the analysis and generates optimal payment methods and campaign information. For example, the AI ​​engine outputs the analysis result, such as "Credit card X's 5% cash back campaign is applicable."

[0651] Step 5:

[0652] The server receives the analysis results from the AI ​​engine and prepares them to generate a user-specific page. The output is a combination of the user-specific page template and the analysis results.

[0653] Step 6:

[0654] The server sends an access link to the dedicated page to the user's terminal. The terminal receives the link sent from the server and notifies the user. This prepares the user to access the dedicated page. The output is a link that the user can click.

[0655] Step 7:

[0656] The user accesses a dedicated page from their device and checks the most suitable payment method and campaign information. Specifically, they can select from the displayed payment methods and campaign information. The output is the user's selection.

[0657] Step 8:

[0658] The terminal sends the payment method and campaign information selected by the user to the server. The server automatically proceeds with the procedure based on the received selection information and applies the optimal payment method and campaign. The output shows the procedure completed.

[0659] Through the above processing steps, the user can efficiently obtain the most suitable payment method and campaign information and carry out purchasing activities.

[0660] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0661] This invention is a system that uses AI and an emotion engine to propose the best tax payment method for individuals and sole proprietors. This system includes the following means to help users pay their taxes efficiently and optimally.

[0662] Program processing

[0663] Enter and save user information

[0664] The user uses the device to input their annual income, family composition, and financial account information (online banking, credit card, QR code payment account, etc.). The emotion engine then recognizes emotions from the user's facial expressions and voice and acquires emotional data. The device temporarily stores the input information and emotional data and sends it to the server. The server then stores the received information and emotional data in a database.

[0665] Data analysis and sentiment reflection

[0666] The server retrieves stored user information and emotional data from the database and sends an analysis request to the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and campaign information based on the user's annual income, family composition, financial services used, and emotional data. By taking emotional data into consideration, the proposals are optimized to reduce the user's stress. The AI ​​engine generates the analysis results and sends them to the server.

[0667] Information provision

[0668] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. The server sends a request to the user's device to display the suggestions along with a link to access the dedicated page. The device receives the request from the server and displays a link to access the user's dedicated page. When the user accesses the link, the dedicated page is displayed and the suggestions can be viewed.

[0669] Tax payment procedure support

[0670] The user selects the desired option from the tax payment method and campaign information presented on the device. The device sends the user's selection information to the server. Based on the information received, the server begins supporting the appropriate tax payment procedures. The server provides information to support the user's tax payment procedures, such as providing a link to the hometown tax payment site and automatically generating the necessary documents. The user completes the tax payment procedures using the information provided on the device.

[0671] Receipt organization (for sole proprietors)

[0672] The user scans or uploads an image of a receipt using their device. The device sends the scanned or uploaded receipt image to the server. The server receives the image and sends an analysis request to the AI ​​engine. The AI ​​engine analyzes the necessary information from the receipt image (date, amount, expenditure details, etc.) and stores it in a database. The AI ​​engine reevaluates the tax payment information based on the newly acquired receipt information and generates an updated proposal. The server reflects the reevaluated proposal on the user's personal page and notifies the user of the changes.

[0673] Specific examples

[0674] Example 1: Part-time individual user

[0675] The user uses a device to input information such as an annual income of 2 million yen and being single, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. Based on the emotional data, an installment plan that reduces the user's stress is proposed. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with the tax payment procedure.

[0676] Example 2: Freelance sole proprietor

[0677] The user uses a device to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code information, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. Taking the emotional data into consideration, the least stressful option for the user is suggested. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[0678] Summary

[0679] This system provides optimal tax payment methods and information on advantageous campaigns based on the user's input information and emotional data, enabling efficient tax payment procedures. It also aims to further improve tax payment efficiency for self-employed individuals by organizing and reevaluating receipts. By combining it with an emotional engine, the system reduces user stress and provides a more comfortable tax payment experience.

[0680] The processing flow will be explained below.

[0681] Step 1:

[0682] The user uses the terminal to enter information such as their annual income, family composition, online banking account, credit card information, and QR code payment account information.

[0683] Step 2:

[0684] When a user enters information, the emotion engine recognizes the user's current emotion through facial detection, voice analysis, etc., and obtains emotion data.

[0685] Step 3:

[0686] The terminal temporarily stores the input user information and acquired emotion data and transmits them to the server.

[0687] Step 4:

[0688] The server receives the user information and emotion data and stores them in a database.

[0689] Step 5:

[0690] The server retrieves the stored user information and emotional data from the database and sends an analysis request to the AI ​​engine.

[0691] Step 6:

[0692] The AI ​​engine analyzes various tax payment methods and campaign information based on the user's annual income, family composition, financial service usage, and emotional data.

[0693] Step 7:

[0694] Taking into account emotional data, the AI ​​engine generates optimal suggestions to reduce the user's stress. The AI ​​engine generates the analysis results and sends them to the server.

[0695] Step 8:

[0696] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page.

[0697] Step 9:

[0698] The server sends a request to the user terminal to display the proposal along with a link to access a dedicated page.

[0699] Step 10:

[0700] The device receives the request from the server and displays a link to access a dedicated page for the user. When the user clicks the link, a dedicated page is displayed where the user can check the proposed content.

[0701] Step 11:

[0702] The user selects the desired option from the tax payment method and campaign information presented on the device. The emotion engine also retrieves the emotion at the time of selection.

[0703] Step 12:

[0704] The device sends the user's selection information and emotion data to the server, which then begins supporting the appropriate tax payment procedures based on the received information.

[0705] Step 13:

[0706] The server provides links to hometown tax payment sites, automatically generates necessary documents, and provides information to assist users with tax payment procedures.

[0707] Step 14:

[0708] The user completes the tax payment procedure using the information provided using the terminal.

[0709] Step 15:

[0710] The user uses the device to scan or upload an image of the receipt, and the emotion engine captures the user's emotions during this process.

[0711] Step 16:

[0712] The device sends the scanned or uploaded receipt image and emotion data to the server, which receives the image and emotion data and sends an analysis request to the AI ​​engine.

[0713] Step 17:

[0714] The AI ​​engine analyzes the necessary information (date, amount, expenditure details, etc.) from the receipt image and stores it in a database.

[0715] Step 18:

[0716] The AI ​​engine reevaluates the payment based on the emotional data and generates the optimal tax payment method. The reevaluated proposal is then sent to the server.

[0717] Step 19:

[0718] The server reflects the re-evaluated proposal on the user's personal page and notifies the user.

[0719] Step 20:

[0720] The user uses the terminal to check the proposal based on the reevaluation and carry out the necessary procedures.

[0721] Example 2

[0722] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0723] Conventional tax payment support systems often provide uniform information without considering the user's emotional state. This makes it difficult to provide optimal tax payment methods and campaign information for users. Furthermore, systems have not adequately improved the efficiency of receipt organization and expense accounting for sole proprietors. This has led to problems such as stress and complication when users go through the tax payment process.

[0724] The specification processing by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for having the user input annual income, family composition, and financial account information, means for acquiring the user's emotion data using an emotion engine, means for temporarily saving the input information and emotion data, means for transmitting the saved information and emotion data to the server, means for saving the received information and emotion data in a database, means for analyzing the saved information and emotion data using an AI engine, means for sending a request to reflect the analysis results in a user-dedicated page, means for displaying a link to the dedicated page on the user terminal, and means for providing the user with optimal tax payment methods and campaign information. This makes it possible to provide the user with optimal tax payment methods and advantageous campaign information based on the user's input information and emotion data, thereby improving the efficiency of tax payment procedures and reducing stress for the user.

[0725] "User" refers to an individual or sole proprietor who uses the system.

[0726] "Annual income" refers to the total amount of income a user receives in a year.

[0727] "Family composition" refers to information about the members of a user's household and their relationships.

[0728] "Financial account information" refers to information related to user financial transactions such as online banking, credit cards, and QR code payment accounts.

[0729] An "emotion engine" refers to a program or device that recognizes and acquires emotional data from a user's facial expressions and voice.

[0730] "Emotion data" refers to information about the user's emotions obtained by the emotion engine.

[0731] "Server" refers to a central processing unit that receives, stores, analyzes, and provides information sent by users.

[0732] A "database" refers to a system for systematically storing information and data.

[0733] An "AI engine" refers to a program or device that uses artificial intelligence to analyze data and generate optimal suggestions.

[0734] "User-specific page" refers to a web page that is customized for a particular user.

[0735] "Tax payment procedures" refers to the series of steps required to pay taxes.

[0736] "Hometown tax donation site" refers to a website through which users can make hometown tax donations.

[0737] "Automatic generation of required documents" refers to the process of automatically generating documents required for a user to complete tax procedures.

[0738] "Receipt" means a document issued as evidence of a transaction or payment.

[0739] "OCR technology" refers to optical character recognition technology, which extracts text data from images.

[0740] "Reassessment" refers to the process of reexamining and updating existing information.

[0741] "Notification" refers to an action to inform a user of specific information.

[0742] The present invention relates to a system that provides optimal tax payment methods and campaign information based on a user's annual income, family structure, financial account information, and emotional data. Specific embodiments of the system are described below.

[0743] System Configuration

[0744] This system consists of a user terminal, emotion engine, server, database, and AI engine. By properly linking these components, it helps users to complete tax procedures efficiently and comfortably.

[0745] Enter and save user information

[0746] Using a device such as a smartphone or PC, a user accesses a dedicated application or web page and enters information such as annual income, family composition, and financial account information. The entered information is temporarily stored on the device. At the same time, an emotion engine (e.g., a facial expression analysis camera or a voice recognition microphone) installed on the device acquires emotional data from the user's facial expressions and voice. This emotional data is also temporarily stored on the device. The device then encrypts this information and sends it to a server.

[0747] Data storage and analysis

[0748] The server stores the received user information and emotional data in a database. The server periodically retrieves new user information and emotional data from the database and sends an analysis request to the AI ​​engine. The AI ​​engine (e.g., generative AI model) analyzes the optimal tax payment method and campaign information based on the user's annual income, family composition, financial services used, and emotional data.

[0749] Viewing Proposals

[0750] The analysis results generated by the AI ​​engine are sent to the server. Based on these results, the server prepares to generate a personalized page for the user. The server then sends a request to the user's device to display the suggestions along with a link to the personalized page, and the device displays the link to the user. When the user clicks the link, they can access the personalized page and check the suggestions.

[0751] Tax payment assistance

[0752] When a user selects their desired payment method from the tax payment method and campaign information presented on the dedicated page, the selected information is sent from the device to the server. Based on the received information, the server starts a process to assist with the appropriate tax payment procedures. Specifically, it provides a link to the hometown tax payment website and automatically generates the necessary documents, which are then provided to the user. The user then uses the device to complete the tax payment procedures based on this information.

[0753] Receipt organization (for sole proprietors)

[0754] As a feature for self-employed individuals, users can scan or upload images of receipts using their device. The device then sends the image data to a server, which then requests an AI engine to analyze it. The AI ​​engine uses OCR technology to extract necessary information from the receipt (date, amount, expenditure details, etc.) and stores it in a database. Based on the newly acquired receipt data, the AI ​​engine reevaluates the tax payment information, generates updated proposals, and the server notifies the user of the changes, which are then reflected on the user's personal page.

[0755] Specific examples

[0756] Example 1: Part-time individual user

[0757] The user uses a device to input information such as an annual income of 2 million yen and being single, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. Based on the emotional data, an installment plan that reduces the user's stress is proposed. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with the tax payment procedure.

[0758] Example 2: Freelance sole proprietor

[0759] The user uses a device to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code information, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. Taking the emotional data into consideration, the least stressful option for the user is suggested. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[0760] Example prompts to input to the generative AI model

[0761] "Generate analysis results to suggest the optimal tax payment method for a single user with an annual income of 2 million yen. Take into account the user's emotional data and suggest the optimal installment plan and campaign information."

[0762] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0763] Step 1: Enter and save user information

[0764] The user uses the device to input information such as annual income, family composition, and financial account information. Once the input is complete, the emotion engine is activated and acquires emotional data from the user's facial expressions and voice. Based on this, the device temporarily stores the input information and emotional data. This information is then encrypted and sent to the server. The server stores the received information and emotional data in a database.

[0765] Input: Annual income, family structure, financial account information, emotional data

[0766] Output: Temporarily saved input information and emotion data, sent to the server and saved in the database

[0767] Step 2: Data analysis and sentiment analysis

[0768] The server retrieves stored user information and emotional data from the database. The retrieved data is sent to an AI engine (generative AI model) and requested to analyze the optimal tax payment method and campaign information. The AI ​​engine calculates the data based on annual income, family composition, financial services used, and emotional data to generate optimal proposals. The analysis results are sent to the server.

[0769] Input: User information, emotion data

[0770] Output: Analysis results by the AI ​​engine

[0771] Step 3: View the proposal

[0772] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. It generates HTML data for the dedicated page and sends a request to the user's device to display the suggestions along with a link to access the dedicated page. The device receives the request and notifies the user of the link.

[0773] Input: Analysis results by AI engine

[0774] Output: Link and suggestions for display on the user's device

[0775] Step 4: Tax Preparation Assistance

[0776] The user checks the proposed payment method and campaign information and selects the desired option. The selected information is sent from the device to the server. Based on the information received by the server, support for the appropriate payment procedure begins, automatically generating a link to the hometown tax payment site and necessary documents. The user then completes the payment procedure based on this information.

[0777] Input: User selection information

[0778] Output: Hometown tax payment site link, required documents, and completion of tax payment procedures

[0779] Step 5: Organizing receipts (for self-employed individuals)

[0780] Self-employed users scan or upload images of receipts using their devices. These image data are sent to a server, which then sends an analysis request to an AI engine. The AI ​​engine uses OCR technology to extract the necessary information from the receipt image and stores it in a database. It then reevaluates the tax payment information based on the new receipt information and generates an updated proposal. The server reflects the reevaluated proposal on the user's personal page and notifies the user of the changes.

[0781] Input: Receipt image

[0782] Output: Parsed receipt data, notification of re-evaluated proposals

[0783] (Application example 2)

[0784] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0785] The main function of conventional tax payment support systems is to provide optimal tax payment methods and campaign information based on the information entered by the user, but because they do not take into account the user's emotions or real-time behavioral data, the optimal suggestions do not necessarily meet the user's needs.In addition, the organization of receipts and updating information for expense accounting must be done manually, which is a burden for users.

[0786] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for prompting the user to input annual income, family composition, and financial account information; means for saving the input information in a database; means for identifying emotional data from the user's facial expression and acquiring the emotional data; means for performing analysis using an AI engine based on the saved information and emotional data; means for providing the user with optimal tax payment methods and campaign information; means for the user to check their purchase history and payment information at a specific location in real time; means for scanning images of receipts for the user's expense reporting; means for analyzing the scanned images and acquiring necessary information; means for reevaluating the optimal tax payment method based on the acquired information; and means for notifying the user of the reevaluated proposal. This makes it possible to propose the optimal tax payment method taking into account the user's emotions and real-time behavior, thereby reducing the user's burden and improving the efficiency of tax payment procedures.

[0787] "User" means an individual or sole proprietor who uses the system.

[0788] "Annual income" refers to the total income earned by a user in a year.

[0789] "Family composition" refers to the composition of members in the user's household, and specifically includes information on spouse, children, and the like.

[0790] "Financial account information" refers to information about the accounts of financial services used by users, such as online banking, credit cards, and QR code payment accounts.

[0791] A "database" is an information accumulation device for storing information and emotional data obtained from users.

[0792] "Emotion data" is data based on emotions recognized from the user's facial expressions, and is information indicating the user's mental state.

[0793] The "AI engine" is an artificial intelligence program that analyzes stored information and emotional data to generate optimal tax payment methods and campaign information.

[0794] The "optimal tax payment method" refers to the most efficient tax payment method that satisfies legal requirements while minimizing the burden on users.

[0795] "Campaign information" is information about various campaigns and special offers related to tax payments, which provide advantageous conditions for the user when paying taxes.

[0796] A "specific location" refers to a place where purchasing activities are mainly carried out, such as a place or store that a user visits in daily life.

[0797] "Purchase history" is a record of past purchases made by a user, including information on what was purchased, where it was purchased, and how much it cost.

[0798] "Payment Information" refers to the payment method and payment details used by the User to pay for the Product.

[0799] "Expense accounting" refers to the process of accurately calculating expenses incurred in running a business and reflecting them in tax returns.

[0800] "Receipt Image" refers to image data of a receipt captured using smart glasses or a device to provide proof of payment for a purchased item by a user.

[0801] "Scanning" refers to the process of optically reading physical documents or receipts and storing them as digital data.

[0802] "Analysis" is the process of extracting information contained in scanned image data and identifying necessary items.

[0803] "Reevaluation" refers to the process of reconsidering and optimizing existing tax payment methods and proposals based on new information obtained.

[0804] The following describes an embodiment of the present invention. This system provides the optimal tax payment method based on the user's input of annual income, family structure, financial account information, and emotion data acquired from facial expressions. Furthermore, the system also has a function that allows the user to check purchase history and payment information in real time at a specific location.

[0805] As a specific example, a case where smart glasses are used will be described. A user wears the smart glasses and inputs their annual income, family composition, and financial account information through the smart glasses' interface. At this time, a camera built into the smart glasses captures the user's facial expressions, and emotion data is obtained through an emotion recognition model (e.g., a model using TensorFlow or Keras).

[0806] The server acquires the information and emotional data entered by the user and stores it in a database. It also uses an AI engine to analyze the stored information. Specifically, it suggests optimal tax payment methods and campaign information based on the user's annual income, family composition, financial services used, and emotional data.

[0807] Through the smart glasses, users can check campaign information and tax-saving methods in real time at specific locations. This allows them to find the best tax payment plan and campaign information while shopping. When users scan a receipt with the smart glasses' camera, the image is sent to the server for analysis. Based on the analysis results, the tax payment information is reevaluated and updated suggestions are notified to the user.

[0808] The specific hardware used includes smart glasses, a camera, and a microphone, while the software includes an emotion recognition model, a data transmission and reception server, and an AI engine.

[0809] For example, when a user is shopping at a supermarket, they can receive information about a 5% cashback campaign through the smart glasses and see in real time how it will affect their household finances, helping them choose the best tax payment method and efficiently complete the tax payment process.

[0810] Examples of specific prompts include:

[0811] "Please explain in detail your approach to capture emotional data through the camera in smart glasses while users are shopping at a supermarket, and display tax campaign information provided in real time. Also, please describe in detail how this system optimizes the user's tax payment plan."

[0812] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0813] Step 1:

[0814] The user inputs annual income, family composition, and financial account information through the interface of the smart glasses. Input data: annual income, family composition, and financial account information. Output data: user information.

[0815] Step 2:

[0816] The camera in the smart glasses captures the user's facial expressions and runs the emotion recognition model to obtain emotion data. Input data: user's facial expressions. Output data: emotion data.

[0817] Step 3:

[0818] The device temporarily stores user information and emotion data in a database and sends it to the server. Input data: User information, emotion data. Output data: Data sent to the server.

[0819] Step 4:

[0820] The server stores the received user information and emotion data in a database. Input data: Data sent to the server. Output data: Data stored in the database.

[0821] Step 5:

[0822] The server sends an analysis request to the AI ​​engine based on the stored user information and emotion data. Input data: Data stored in the database. Output data: Data sent to the AI ​​engine.

[0823] Step 6:

[0824] The AI ​​engine generates optimal tax payment methods and campaign information based on user information and emotional data. Input data: user information, emotional data. Output data: tax payment methods, campaign information.

[0825] Step 7:

[0826] The server prepares the analysis results (tax payment methods, campaign information) received from the AI ​​engine and prepares them to be reflected on the user's dedicated page. Input data: Data received from the AI ​​engine. Output data: Data on the user's dedicated page.

[0827] Step 8:

[0828] The server sends a request to the user's device to display the proposal along with a link to access the dedicated page. Input data: Data on the user's dedicated page. Output data: The request sent to the device.

[0829] Step 9:

[0830] The terminal receives the request from the server and displays a link to access the user's private page. Input data: Request from the server. Output data: Terminal screen with the link displayed.

[0831] Step 10:

[0832] Users use smart glasses to shop at specific locations and check campaign information and tax-saving methods in real time. Input data: User's location information, shopping data. Output data: Campaign information displayed in real time.

[0833] Step 11:

[0834] The user scans the receipt using the camera on the smart glasses and uploads the image to the device. Input data: Image of the receipt. Output data: Image data stored on the device.

[0835] Step 12:

[0836] The device sends the scanned receipt image to the server, where it is analyzed by the AI ​​engine. Input data: Image data stored on the device. Output data: Analyzed receipt information.

[0837] Step 13:

[0838] The AI ​​engine reevaluates the tax payment information based on the receipt information obtained and generates an updated tax payment proposal. Input data: Parsed receipt information. Output data: Updated tax payment proposal.

[0839] Step 14:

[0840] The server updates the re-evaluated proposal on the user's personal page and notifies the user of the changes. Input data: Updated tax proposal. Output data: Changes notified to the user.

[0841] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0842] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0843] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0844] [Third embodiment]

[0845] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0846] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0847] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0848] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0849] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0850] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0851] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0852] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0853] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0854] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0855] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0856] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0857] This invention is a system that uses AI to propose the best tax payment method for individuals and sole proprietors. This system includes the following methods to help users pay their taxes efficiently and optimally.

[0858] Program processing

[0859] Enter and save user information

[0860] The user uses the device to input their annual income, family composition, and financial account information (online banking, credit card, QR code payment account, etc.). The device temporarily stores the input information and sends it to the server. The server then stores the received user information in a database.

[0861] Data analysis

[0862] The server retrieves the saved user information and requests an analysis from the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and advantageous campaign information based on the user's annual income, family composition, and financial services used. The AI ​​engine generates the analysis results and sends them to the server.

[0863] Information provision

[0864] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. The server sends a request to the device to display the suggestions on the dedicated page. The device receives the request from the server and provides a link to access the user's dedicated page. The user accesses the dedicated page from their device and checks the suggestions (optimal tax payment methods and advantageous campaign information).

[0865] Tax payment procedure support

[0866] The user selects their desired option from the payment method and campaign information presented on the device. The device sends the user's selection information to the server. Based on the information received, the server begins supporting the appropriate payment procedures. The server provides the user with information to assist with the procedures, such as providing a link to the hometown tax payment website and automatically generating the necessary documents. The user then completes the payment procedures using the information provided on the device.

[0867] Receipt organization (for sole proprietors)

[0868] The user scans or uploads an image of a receipt using their device. The device sends the scanned or uploaded receipt image to the server. The server sends the received receipt image to the AI ​​engine. The AI ​​engine analyzes the necessary information from the image (date, amount, expenditure details, etc.) and stores the information in a database. The AI ​​engine reevaluates the tax payment method based on the newly acquired receipt information and generates an updated proposal. The server reflects the updated proposal on the user's dedicated page and notifies the user.

[0869] Specific examples

[0870] Example 1: Part-time individual user

[0871] The user uses a device to enter information such as an annual income of 2 million yen and being single. The server stores this information in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with tax payment procedures.

[0872] Example 2: Freelance sole proprietor

[0873] The user uses a terminal to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code account information. The server stores this information in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[0874] Summary

[0875] This system provides users with the most suitable tax payment method and information on special campaigns based on the information they input, enabling them to carry out tax payment procedures efficiently. For self-employed individuals, it also aims to further improve tax payment efficiency by organizing and reevaluating receipts.

[0876] The processing flow will be explained below.

[0877] Step 1:

[0878] The user uses the terminal to enter information such as their annual income, family composition, online banking account, credit card information, and QR code payment account information.

[0879] Step 2:

[0880] The terminal temporarily stores the entered user information, and when all the information is collected, it prepares to send it to the server.

[0881] Step 3:

[0882] The terminal makes a request to send user information to the server, which receives the request and stores the user information in a database.

[0883] Step 4:

[0884] The server retrieves the stored user information from the database and sends an analysis request to the AI ​​engine.

[0885] Step 5:

[0886] Based on the user information received by the AI ​​engine, it analyzes the optimal tax payment method and campaign information based on annual income, family composition, and the financial services used.

[0887] Step 6:

[0888] The AI ​​engine generates analysis results, compiles optimal tax payment methods and campaign information, and sends the results to the server.

[0889] Step 7:

[0890] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page.

[0891] Step 8:

[0892] The server sends a request to the user terminal to display the proposal along with a link to access a dedicated page.

[0893] Step 9:

[0894] The device receives the request from the server and displays a link to access a dedicated page for the user. When the user clicks the link, a dedicated page is displayed where the user can check the proposed content.

[0895] Step 10:

[0896] The user uses the terminal to select the desired option from the tax payment method and campaign information presented.

[0897] Step 11:

[0898] The terminal sends the information selected by the user to the server, which then begins supporting the appropriate tax payment procedures based on the received information.

[0899] Step 12:

[0900] The server provides links to hometown tax payment sites, automatically generates necessary documents, and provides information to assist users with tax payment procedures.

[0901] Step 13:

[0902] The user uses the terminal to complete the tax payment procedure based on the information provided.

[0903] Step 14:

[0904] The user uses the device to scan or upload an image of the receipt.

[0905] Step 15:

[0906] The device sends the scanned or uploaded receipt image to the server, which receives the image and sends an analysis request to the AI ​​engine.

[0907] Step 16:

[0908] The AI ​​engine analyzes the necessary information (date, amount, expenditure details, etc.) from the receipt image and stores it in a database.

[0909] Step 17:

[0910] The AI ​​engine reevaluates the user's tax payment information based on receipt analysis data and generates optimized proposals.

[0911] Step 18:

[0912] The server reflects the re-evaluated proposals on the user's personal page and notifies the user of the changes.

[0913] Step 19:

[0914] The user uses the terminal to check the proposal based on the reevaluation and follow up on the necessary procedures.

[0915] Example 1

[0916] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0917] Tax payment procedures are complex and burdensome for individuals and sole proprietors, making it difficult to find optimal tax payment methods and effective campaign information. Furthermore, for sole proprietors, organizing receipts and reevaluating tax payment methods based on them is also an important issue. Thus, the lack of support for users to pay taxes efficiently and optimally is an issue.

[0918] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0919] In this invention, the server includes means for having the user input income information, household information, and financial information, means for saving the input information in a storage device, means for analyzing the saved information using an artificial intelligence engine, and means for providing the user with optimal tax payment methods and promotional information. This enables users to pay taxes efficiently and optimally, and also enables self-employed individuals to further improve tax payment efficiency by organizing receipts and reevaluating tax payment methods.

[0920] "Income Information" means information relating to a User's annual income or other income.

[0921] "Household information" refers to information about the user's household, such as family structure and support status.

[0922] "Financial information" refers to information regarding financial services used by users (online banking, credit cards, QR code payments, etc.).

[0923] "Storage" refers to a storage device or database for saving data entered by a user.

[0924] An "artificial intelligence engine" refers to a system equipped with an artificial intelligence algorithm that analyzes input data and provides optimal tax payment methods and campaign information.

[0925] "Tax Method" means the method by which the User pays or calculates the Taxes payable by the User.

[0926] "Promotion information" refers to campaigns and discount information available to users.

[0927] "Receipt" refers to a receipt or invoice issued when making a purchase or using a service.

[0928] "Digitalization" refers to scanning and converting paper-based information into electronic form.

[0929] "Extraction" refers to extracting necessary information from image or text data.

[0930] The present invention is a system that proposes optimal tax payment methods for individuals and sole proprietors, and is characterized by performing analysis using an artificial intelligence engine, utilizing a variety of user information such as annual income, family structure, and financial information. This system is implemented primarily using the following hardware and software:

[0931] Hardware and software used

[0932] 1. Terminal (user side): This refers to a device such as a smartphone, tablet, or PC that the user uses to input information. The terminal provides an input interface, temporarily stores information from the user, encrypts it, and sends it to the server.

[0933] 2. Server: Refers to a cloud server or on-premise server that receives, stores, and analyzes information. The server is connected to a database where data is stored. The server is also equipped with an AI engine and has the ability to analyze user data.

[0934] 3. Artificial Intelligence Engine (AI Engine): Analyzes user information using machine learning algorithms and generates optimal tax payment methods and campaign information. For example, a model using Python and TensorFlow is implemented.

[0935] Natural language processing explanation

[0936] Entering and saving user information

[0937] The user enters the necessary information (annual income, family composition, financial information) through the terminal. The terminal temporarily stores the entered information in memory and sends it in encrypted form to the server. The server stores the received information in a database.

[0938] Analyzing the data

[0939] The server retrieves the saved user information and requests an analysis from the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and campaign information based on annual income, family composition, and financial services used, and sends the results to the server.

[0940] Proposal content provided

[0941] The server prepares the analysis results received from the AI ​​engine to be reflected on the user's dedicated page. The server then sends a request to the device to display the suggestions on the dedicated page. The device receives the request and provides a link to access the user's dedicated page. The user accesses the dedicated page from their device and checks the suggestions.

[0942] Tax payment assistance

[0943] The user selects the desired option from the tax payment method and campaign information presented on a dedicated page. The device sends the user's selection information to the server, and the server supports the appropriate tax payment procedures based on the received information. This includes providing a link to the hometown tax payment website and automatically generating the necessary documents. The user then completes the tax payment procedures using the device.

[0944] Organizing receipts (for self-employed individuals)

[0945] The user scans or uploads an image of the receipt. The device sends it to the server, which then sends the image to the AI ​​engine. The AI ​​engine uses image recognition technology (OCR) to analyze the necessary information and stores it in a database. The AI ​​engine reevaluates the tax payment method based on the newly acquired information and sends an updated proposal to the server. The server then updates the user's personal page with the new proposal and notifies them.

[0946] Specific examples

[0947] Example 1: Part-time individual user

[0948] The user uses a device to enter information such as an annual income of 2 million yen and being single. The server stores this information in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with tax payment procedures.

[0949] Example 2: Freelance sole proprietor

[0950] The user uses a terminal to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code account information. The server stores this information in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[0951] In this way, the system of the present invention uses an AI engine to analyze user information and provide optimal tax payment methods and promotional information, enabling users to pay taxes efficiently and optimally. Furthermore, for sole proprietors, it provides a receipt organization function, further improving tax payment efficiency.

[0952] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0953] Step 1: The user enters information using the terminal.

[0954] Input and Output: The user enters income, household, and financial information and sends it to the device.

[0955] Specific behavior:

[0956] The user accesses the system's input form using a smartphone or PC. Here, they enter information such as annual income, family composition, online banking, credit card, and QR code payment account. The device temporarily stores the entered information in its memory. When the user presses the "Send" button, the device encrypts this information and sends it to the server.

[0957] Step 2: The device sends the entered information to the server

[0958] Input and Output: Receives encrypted user information from the terminal and sends it to the server.

[0959] Specific behavior:

[0960] The device packages the encrypted user information into packets and sends them to the server using an HTTP request, which the server receives and decrypts.

[0961] Step 3: The server saves the user information to a database

[0962] Input and Output: The server receives the encrypted information and stores it in a database.

[0963] Specific behavior:

[0964] The server decrypts the received data and generates a SQL query to store in the database, which the server executes and stores the user information securely.

[0965] Step 4: The server sends the data to the AI ​​engine

[0966] Input and Output: User information is retrieved from the database and sent to the AI ​​engine.

[0967] Specific behavior:

[0968] The server retrieves user information from the database and generates a request to send to the AI ​​engine. The server converts the user information into JSON format and sends it to the AI ​​engine.

[0969] Step 5: The AI ​​engine analyzes the data

[0970] Input and output: Analyzes user information received from the server and generates optimal tax payment methods and campaign information.

[0971] Specific behavior:

[0972] The AI ​​engine analyzes the received user information and uses machine learning algorithms to derive optimal tax payment methods and campaign information. For example, it analyzes prompts generated by the AI ​​model and determines that a particular campaign will have a high tax savings effect. The analysis results are sent to the server in JSON format.

[0973] Step 6: The server prepares to reflect the analysis results on the user's personal page

[0974] Input and output: Prepares the analysis results received from the AI ​​engine to be reflected on the user's dedicated page.

[0975] Specific behavior:

[0976] The server stores the analysis results received from the AI ​​engine in a database and generates HTML and JavaScript files to display on a user-specific page.

[0977] Step 7: The server sends a request to the device to display the proposal on a dedicated page.

[0978] Input and Output: The server generates a link for the user and sends a request containing that link to the device.

[0979] Specific behavior:

[0980] The server generates a link to a user-specific page and sends a notification request including this link to the terminal, which receives and displays the request.

[0981] Step 8: The user visits the dedicated page and checks the proposal.

[0982] Input and Output: The user clicks on a link on the device and accesses a dedicated page.

[0983] Specific behavior:

[0984] Users click on the link provided on their device to access a dedicated page, which displays information on the best tax payment methods and campaigns.

[0985] Step 9: User selects desired option from suggestions

[0986] Input and output: The user selects the best offer on a dedicated page and sends the information to the device.

[0987] Specific behavior:

[0988] The user selects the desired option from the options displayed on the dedicated page (hometown tax donation site, campaign, etc.) and presses the "Select" button. The device then sends this selection information to the server.

[0989] Step 10: The server receives the selection information and assists with the tax payment process.

[0990] Input and Output: Generates information to assist with tax procedures based on received information and provides it to the user.

[0991] Specific behavior:

[0992] Based on the user's selection, the server automatically generates and provides the user with related links (for example, hometown tax payment websites) and necessary documents, allowing the user to complete the tax payment procedure using their device.

[0993] Step 11: User scans or uploads image of receipt (for sole proprietors)

[0994] Input and Output: User scans an image of a receipt, saves it on the device, and sends it to the server.

[0995] Specific behavior:

[0996] The user scans the receipt using the smartphone camera and saves the image on the device. Then, the user logs in to the system and uploads the image. The device sends the image to the server.

[0997] Step 12: The server sends the received image to the AI ​​engine

[0998] Input and output: The server sends the received image data to the AI ​​engine for analysis.

[0999] Specific behavior:

[1000] The server sends the received image data to the AI ​​engine, which uses image recognition technology (OCR) to extract the necessary information from the receipt.

[1001] Step 13: The AI ​​engine analyzes the image and stores the information in a database

[1002] Input and Output: Analyze the received receipt image and store the extracted information in a database.

[1003] Specific behavior:

[1004] The AI ​​engine analyzes the received image and uses OCR technology to extract the date, amount, expenditure details, etc. The extracted data is sent to the server, which then stores it in a database.

[1005] Step 14: The AI ​​engine reevaluates the proposal based on the newly acquired information

[1006] Inputs and Outputs: Re-evaluate tax payment methods based on extracted information and generate updated proposals.

[1007] Specific behavior:

[1008] Based on the newly acquired information, the AI ​​engine reevaluates and optimizes existing tax payment methods and promotional information, generates new proposals, and sends them to the server in JSON format.

[1009] Step 15: The server updates the user's page with the updated proposal and notifies them.

[1010] Input and Output: The updated proposal is reflected on the user's personal page and a notification is sent to the user.

[1011] Specific behavior:

[1012] The server receives new suggestions from the AI ​​engine, saves them in a database, and prepares them for display on the user's personal page. The server generates a notification and sends it to the device. The device receives the notification and notifies the user.

[1013] Through the above processing steps, the system of the present invention provides users with the most suitable tax payment method and campaign information, and supports the tax payment procedure. It also provides self-employed individuals with a receipt organization function, further improving the efficiency of tax payment.

[1014] (Application example 1)

[1015] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1016] The current diversification of e-commerce and payment methods makes it difficult for users to choose the optimal payment method from the numerous payment options and campaign information available. In particular, selecting the optimal payment method or campaign requires time and effort, which can degrade the user experience.

[1017] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1018] In this invention, the server includes means for having the user input annual income, family composition, and financial account information, means for saving the input information in a database, means for analyzing the saved information using an AI engine, and means for providing the user with optimal payment methods and campaign information. This allows the user to automatically select the optimal payment options and campaigns from multiple options and campaigns, eliminating the need for selection and enabling efficient purchasing activities.

[1019] "Annual income" is information indicating the total annual income of the user.

[1020] "Family composition" is information indicating the composition of members in the user's household, specifically the number of spouses and children and their relationships.

[1021] "Financial account information" refers to financial account information such as bank accounts, credit cards, and electronic money used by the user.

[1022] "Payment history" is a record of a user's past financial transactions and purchases.

[1023] "Credit card information" refers to information related to a credit card, such as the account number, issuing institution, and usage history.

[1024] "Electronic money information" refers to account information and usage history related to the electronic money service used by the user.

[1025] The "AI engine" is a system that uses artificial intelligence technology to analyze data and generate optimal payment methods and campaign information.

[1026] "Campaign information" is information about benefits such as discounts and cash backs offered by financial institutions and service providers that are beneficial to users.

[1027] This invention is a system that allows users to efficiently select electronic commerce and payment methods. This system consists of a server and user terminals, collects and analyzes user information, and provides optimal payment methods and campaign information.

[1028] Hardware and software used

[1029] Hardware: User devices (smartphones, tablets, PCs, etc.), servers

[1030] Software: Web server (Flask, etc.), database (SQLite, etc.), AI engine

[1031] System Program

[1032] 1. Enter and save user information

[1033] The server provides an interface for allowing the user to input information on annual income, family structure, and financial accounts.

[1034] The user terminal inputs this information, temporarily stores it, and then transmits it to the server.

[1035] The server stores the received information in a database.

[1036] 2. Data analysis

[1037] The server sends the stored information to the AI ​​engine.

[1038] The AI ​​engine analyzes the information and generates the most suitable payment methods and campaign information for the user.

[1039] The generated information is sent back to the server and reflected on the user's personal page.

[1040] 3. Information provision

[1041] The server notifies the user of the most suitable payment method and campaign information.

[1042] The user device provides this information to the user using alerts and notification functions.

[1043] Specific examples

[1044] Example 1: Individual user with an annual income of 5 million yen

[1045] The user enters information about their annual income of 5 million yen, their family composition (husband and wife and two children), various credit cards, and electronic money into the terminal.

[1046] The server stores this information in a database, and the AI ​​engine analyzes it.

[1047] The AI ​​engine generates the optimal credit card cashback campaign, and the server displays it on a user-specific page.

[1048] The user checks the dedicated page on the device and selects the presented cashback campaign.

[1049] Prompt Sentence Examples

[1050] "User ID 1, annual income: 5 million yen, family composition: couple and two children, financial account information: credit card X, electronic money Y"

[1051] This system allows users to easily obtain optimal payment methods and campaign information, enabling them to make purchases efficiently.

[1052] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1053] Step 1:

[1054] The user uses a terminal to input annual income, family composition, and financial account information. This information is temporarily stored on the terminal. The input data is as follows: "Annual income: 5 million yen, Family composition: Couple with two children, Financial account information: Credit card X, Electronic money Y."

[1055] Step 2:

[1056] The terminal sends the entered user information to the server. The server receives the information and stores it in a database. The input information sent to the server is "annual income, family composition, and financial account information," and the output is the user information stored in the database.

[1057] Step 3:

[1058] The server sends the saved user information to the AI ​​engine. The AI ​​engine performs data analysis to generate optimal payment methods and campaign information based on the user's annual income, family structure, and financial account information. User information is sent as input to the AI ​​engine, and the output is "optimal payment methods and campaign information."

[1059] Step 4:

[1060] The AI ​​engine performs the analysis and generates optimal payment methods and campaign information. For example, the AI ​​engine outputs the analysis result, such as "Credit card X's 5% cash back campaign is applicable."

[1061] Step 5:

[1062] The server receives the analysis results from the AI ​​engine and prepares them to generate a user-specific page. The output is a combination of the user-specific page template and the analysis results.

[1063] Step 6:

[1064] The server sends an access link to the dedicated page to the user's terminal. The terminal receives the link sent from the server and notifies the user. This prepares the user to access the dedicated page. The output is a link that the user can click.

[1065] Step 7:

[1066] The user accesses a dedicated page from their device and checks the most suitable payment method and campaign information. Specifically, they can select from the displayed payment methods and campaign information. The output is the user's selection.

[1067] Step 8:

[1068] The terminal sends the payment method and campaign information selected by the user to the server. The server automatically proceeds with the procedure based on the received selection information and applies the optimal payment method and campaign. The output shows the procedure completed.

[1069] Through the above processing steps, the user can efficiently obtain the most suitable payment method and campaign information and carry out purchasing activities.

[1070] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1071] This invention is a system that uses AI and an emotion engine to propose the best tax payment method for individuals and sole proprietors. This system includes the following means to help users pay their taxes efficiently and optimally.

[1072] Program processing

[1073] Enter and save user information

[1074] The user uses the device to input their annual income, family composition, and financial account information (online banking, credit card, QR code payment account, etc.). The emotion engine then recognizes emotions from the user's facial expressions and voice and acquires emotional data. The device temporarily stores the input information and emotional data and sends it to the server. The server then stores the received information and emotional data in a database.

[1075] Data analysis and sentiment reflection

[1076] The server retrieves stored user information and emotional data from the database and sends an analysis request to the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and campaign information based on the user's annual income, family composition, financial services used, and emotional data. By taking emotional data into consideration, the proposals are optimized to reduce the user's stress. The AI ​​engine generates the analysis results and sends them to the server.

[1077] Information provision

[1078] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. The server sends a request to the user's device to display the suggestions along with a link to access the dedicated page. The device receives the request from the server and displays a link to access the user's dedicated page. When the user accesses the link, the dedicated page is displayed and the suggestions can be viewed.

[1079] Tax payment procedure support

[1080] The user selects the desired option from the tax payment method and campaign information presented on the device. The device sends the user's selection information to the server. Based on the information received, the server begins supporting the appropriate tax payment procedures. The server provides information to support the user's tax payment procedures, such as providing a link to the hometown tax payment site and automatically generating the necessary documents. The user completes the tax payment procedures using the information provided on the device.

[1081] Receipt organization (for sole proprietors)

[1082] The user scans or uploads an image of a receipt using their device. The device sends the scanned or uploaded receipt image to the server. The server receives the image and sends an analysis request to the AI ​​engine. The AI ​​engine analyzes the necessary information from the receipt image (date, amount, expenditure details, etc.) and stores it in a database. The AI ​​engine reevaluates the tax payment information based on the newly acquired receipt information and generates an updated proposal. The server reflects the reevaluated proposal on the user's personal page and notifies the user of the changes.

[1083] Specific examples

[1084] Example 1: Part-time individual user

[1085] The user uses a device to input information such as an annual income of 2 million yen and being single, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. Based on the emotional data, an installment plan that reduces the user's stress is proposed. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with the tax payment procedure.

[1086] Example 2: Freelance sole proprietor

[1087] The user uses a device to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code information, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. Taking the emotional data into consideration, the least stressful option for the user is suggested. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[1088] Summary

[1089] This system provides optimal tax payment methods and information on advantageous campaigns based on the user's input information and emotional data, enabling efficient tax payment procedures. It also aims to further improve tax payment efficiency for self-employed individuals by organizing and reevaluating receipts. By combining it with an emotional engine, the system reduces user stress and provides a more comfortable tax payment experience.

[1090] The processing flow will be explained below.

[1091] Step 1:

[1092] The user uses the terminal to enter information such as their annual income, family composition, online banking account, credit card information, and QR code payment account information.

[1093] Step 2:

[1094] When a user enters information, the emotion engine recognizes the user's current emotion through facial detection, voice analysis, etc., and obtains emotion data.

[1095] Step 3:

[1096] The terminal temporarily stores the input user information and acquired emotion data and transmits them to the server.

[1097] Step 4:

[1098] The server receives the user information and emotion data and stores them in a database.

[1099] Step 5:

[1100] The server retrieves the stored user information and emotional data from the database and sends an analysis request to the AI ​​engine.

[1101] Step 6:

[1102] The AI ​​engine analyzes various tax payment methods and campaign information based on the user's annual income, family composition, financial service usage, and emotional data.

[1103] Step 7:

[1104] Taking into account emotional data, the AI ​​engine generates optimal suggestions to reduce the user's stress. The AI ​​engine generates the analysis results and sends them to the server.

[1105] Step 8:

[1106] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page.

[1107] Step 9:

[1108] The server sends a request to the user terminal to display the proposal along with a link to access a dedicated page.

[1109] Step 10:

[1110] The device receives the request from the server and displays a link to access a dedicated page for the user. When the user clicks the link, a dedicated page is displayed where the user can check the proposed content.

[1111] Step 11:

[1112] The user selects the desired option from the tax payment method and campaign information presented on the device. The emotion engine also retrieves the emotion at the time of selection.

[1113] Step 12:

[1114] The device sends the user's selection information and emotion data to the server, which then begins supporting the appropriate tax payment procedures based on the received information.

[1115] Step 13:

[1116] The server provides links to hometown tax payment sites, automatically generates necessary documents, and provides information to assist users with tax payment procedures.

[1117] Step 14:

[1118] The user completes the tax payment procedure using the information provided using the terminal.

[1119] Step 15:

[1120] The user uses the device to scan or upload an image of the receipt, and the emotion engine captures the user's emotions during this process.

[1121] Step 16:

[1122] The device sends the scanned or uploaded receipt image and emotion data to the server, which receives the image and emotion data and sends an analysis request to the AI ​​engine.

[1123] Step 17:

[1124] The AI ​​engine analyzes the necessary information (date, amount, expenditure details, etc.) from the receipt image and stores it in a database.

[1125] Step 18:

[1126] The AI ​​engine reevaluates the payment based on the emotional data and generates the optimal tax payment method. The reevaluated proposal is then sent to the server.

[1127] Step 19:

[1128] The server reflects the re-evaluated proposal on the user's personal page and notifies the user.

[1129] Step 20:

[1130] The user uses the terminal to check the proposal based on the reevaluation and carry out the necessary procedures.

[1131] Example 2

[1132] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1133] Conventional tax payment support systems often provide uniform information without considering the user's emotional state. This makes it difficult to provide optimal tax payment methods and campaign information for users. Furthermore, systems have not adequately improved the efficiency of receipt organization and expense accounting for sole proprietors. This has led to problems such as stress and complication when users go through the tax payment process.

[1134] The specification processing by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for having the user input annual income, family composition, and financial account information, means for acquiring the user's emotion data using an emotion engine, means for temporarily saving the input information and emotion data, means for transmitting the saved information and emotion data to the server, means for saving the received information and emotion data in a database, means for analyzing the saved information and emotion data using an AI engine, means for sending a request to reflect the analysis results in a user-dedicated page, means for displaying a link to the dedicated page on the user terminal, and means for providing the user with optimal tax payment methods and campaign information. This makes it possible to provide the user with optimal tax payment methods and advantageous campaign information based on the user's input information and emotion data, thereby improving the efficiency of tax payment procedures and reducing stress for the user.

[1135] "User" refers to an individual or sole proprietor who uses the system.

[1136] "Annual income" refers to the total amount of income a user receives in a year.

[1137] "Family composition" refers to information about the members of a user's household and their relationships.

[1138] "Financial account information" refers to information related to user financial transactions such as online banking, credit cards, and QR code payment accounts.

[1139] An "emotion engine" refers to a program or device that recognizes and acquires emotional data from a user's facial expressions and voice.

[1140] "Emotion data" refers to information about the user's emotions obtained by the emotion engine.

[1141] "Server" refers to a central processing unit that receives, stores, analyzes, and provides information sent by users.

[1142] A "database" refers to a system for systematically storing information and data.

[1143] An "AI engine" refers to a program or device that uses artificial intelligence to analyze data and generate optimal suggestions.

[1144] "User-specific page" refers to a web page that is customized for a particular user.

[1145] "Tax payment procedures" refers to the series of steps required to pay taxes.

[1146] "Hometown tax donation site" refers to a website through which users can make hometown tax donations.

[1147] "Automatic generation of required documents" refers to the process of automatically generating documents required for a user to complete tax procedures.

[1148] "Receipt" means a document issued as evidence of a transaction or payment.

[1149] "OCR technology" refers to optical character recognition technology, which extracts text data from images.

[1150] "Reassessment" refers to the process of reexamining and updating existing information.

[1151] "Notification" refers to an action to inform a user of specific information.

[1152] The present invention relates to a system that provides optimal tax payment methods and campaign information based on a user's annual income, family structure, financial account information, and emotional data. Specific embodiments of the system are described below.

[1153] System Configuration

[1154] This system consists of a user terminal, emotion engine, server, database, and AI engine. By properly linking these components, it helps users to complete tax procedures efficiently and comfortably.

[1155] Enter and save user information

[1156] Using a device such as a smartphone or PC, a user accesses a dedicated application or web page and enters information such as annual income, family composition, and financial account information. The entered information is temporarily stored on the device. At the same time, an emotion engine (e.g., a facial expression analysis camera or a voice recognition microphone) installed on the device acquires emotional data from the user's facial expressions and voice. This emotional data is also temporarily stored on the device. The device then encrypts this information and sends it to a server.

[1157] Data storage and analysis

[1158] The server stores the received user information and emotional data in a database. The server periodically retrieves new user information and emotional data from the database and sends an analysis request to the AI ​​engine. The AI ​​engine (e.g., generative AI model) analyzes the optimal tax payment method and campaign information based on the user's annual income, family composition, financial services used, and emotional data.

[1159] Viewing Proposals

[1160] The analysis results generated by the AI ​​engine are sent to the server. Based on these results, the server prepares to generate a personalized page for the user. The server then sends a request to the user's device to display the suggestions along with a link to the personalized page, and the device displays the link to the user. When the user clicks the link, they can access the personalized page and check the suggestions.

[1161] Tax payment assistance

[1162] When a user selects their desired payment method from the tax payment method and campaign information presented on the dedicated page, the selected information is sent from the device to the server. Based on the received information, the server starts a process to assist with the appropriate tax payment procedures. Specifically, it provides a link to the hometown tax payment website and automatically generates the necessary documents, which are then provided to the user. The user then uses the device to complete the tax payment procedures based on this information.

[1163] Receipt organization (for sole proprietors)

[1164] As a feature for self-employed individuals, users can scan or upload images of receipts using their device. The device then sends the image data to a server, which then requests an AI engine to analyze it. The AI ​​engine uses OCR technology to extract necessary information from the receipt (date, amount, expenditure details, etc.) and stores it in a database. Based on the newly acquired receipt data, the AI ​​engine reevaluates the tax payment information, generates updated proposals, and the server notifies the user of the changes, which are then reflected on the user's personal page.

[1165] Specific examples

[1166] Example 1: Part-time individual user

[1167] The user uses a device to input information such as an annual income of 2 million yen and being single, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. Based on the emotional data, an installment plan that reduces the user's stress is proposed. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with the tax payment procedure.

[1168] Example 2: Freelance sole proprietor

[1169] The user uses a device to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code information, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. Taking the emotional data into consideration, the least stressful option for the user is suggested. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[1170] Example prompts to input to the generative AI model

[1171] "Generate analysis results to suggest the optimal tax payment method for a single user with an annual income of 2 million yen. Take into account the user's emotional data and suggest the optimal installment plan and campaign information."

[1172] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1173] Step 1: Enter and save user information

[1174] The user uses the device to input information such as annual income, family composition, and financial account information. Once the input is complete, the emotion engine is activated and acquires emotional data from the user's facial expressions and voice. Based on this, the device temporarily stores the input information and emotional data. This information is then encrypted and sent to the server. The server stores the received information and emotional data in a database.

[1175] Input: Annual income, family structure, financial account information, emotional data

[1176] Output: Temporarily saved input information and emotion data, sent to the server and saved in the database

[1177] Step 2: Data analysis and sentiment analysis

[1178] The server retrieves stored user information and emotional data from the database. The retrieved data is sent to an AI engine (generative AI model) and requested to analyze the optimal tax payment method and campaign information. The AI ​​engine calculates the data based on annual income, family composition, financial services used, and emotional data to generate optimal proposals. The analysis results are sent to the server.

[1179] Input: User information, emotion data

[1180] Output: Analysis results by the AI ​​engine

[1181] Step 3: View the proposal

[1182] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. It generates HTML data for the dedicated page and sends a request to the user's device to display the suggestions along with a link to access the dedicated page. The device receives the request and notifies the user of the link.

[1183] Input: Analysis results by AI engine

[1184] Output: Link and suggestions for display on the user's device

[1185] Step 4: Tax Preparation Assistance

[1186] The user checks the proposed payment method and campaign information and selects the desired option. The selected information is sent from the device to the server. Based on the information received by the server, support for the appropriate payment procedure begins, automatically generating a link to the hometown tax payment site and necessary documents. The user then completes the payment procedure based on this information.

[1187] Input: User selection information

[1188] Output: Hometown tax payment site link, required documents, and completion of tax payment procedures

[1189] Step 5: Organizing receipts (for self-employed individuals)

[1190] Self-employed users scan or upload images of receipts using their devices. These image data are sent to a server, which then sends an analysis request to an AI engine. The AI ​​engine uses OCR technology to extract the necessary information from the receipt image and stores it in a database. It then reevaluates the tax payment information based on the new receipt information and generates an updated proposal. The server reflects the reevaluated proposal on the user's personal page and notifies the user of the changes.

[1191] Input: Receipt image

[1192] Output: Parsed receipt data, notification of re-evaluated proposals

[1193] (Application example 2)

[1194] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1195] The main function of conventional tax payment support systems is to provide optimal tax payment methods and campaign information based on the information entered by the user, but because they do not take into account the user's emotions or real-time behavioral data, the optimal suggestions do not necessarily meet the user's needs.In addition, the organization of receipts and updating information for expense accounting must be done manually, which is a burden for users.

[1196] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for prompting the user to input annual income, family composition, and financial account information; means for saving the input information in a database; means for identifying emotional data from the user's facial expression and acquiring the emotional data; means for performing analysis using an AI engine based on the saved information and emotional data; means for providing the user with optimal tax payment methods and campaign information; means for the user to check their purchase history and payment information at a specific location in real time; means for scanning images of receipts for the user's expense reporting; means for analyzing the scanned images and acquiring necessary information; means for reevaluating the optimal tax payment method based on the acquired information; and means for notifying the user of the reevaluated proposal. This makes it possible to propose the optimal tax payment method taking into account the user's emotions and real-time behavior, thereby reducing the user's burden and improving the efficiency of tax payment procedures.

[1197] "User" means an individual or sole proprietor who uses the system.

[1198] "Annual income" refers to the total income earned by a user in a year.

[1199] "Family composition" refers to the composition of members in the user's household, and specifically includes information on spouse, children, and the like.

[1200] "Financial account information" refers to information about the accounts of financial services used by users, such as online banking, credit cards, and QR code payment accounts.

[1201] A "database" is an information accumulation device for storing information and emotional data obtained from users.

[1202] "Emotion data" is data based on emotions recognized from the user's facial expressions, and is information indicating the user's mental state.

[1203] The "AI engine" is an artificial intelligence program that analyzes stored information and emotional data to generate optimal tax payment methods and campaign information.

[1204] The "optimal tax payment method" refers to the most efficient tax payment method that satisfies legal requirements while minimizing the burden on users.

[1205] "Campaign information" is information about various campaigns and special offers related to tax payments, which provide advantageous conditions for the user when paying taxes.

[1206] A "specific location" refers to a place where purchasing activities are mainly carried out, such as a place or store that a user visits in daily life.

[1207] "Purchase history" is a record of past purchases made by a user, including information on what was purchased, where it was purchased, and how much it cost.

[1208] "Payment Information" refers to the payment method and payment details used by the User to pay for the Product.

[1209] "Expense accounting" refers to the process of accurately calculating expenses incurred in running a business and reflecting them in tax returns.

[1210] "Receipt Image" refers to image data of a receipt captured using smart glasses or a device to provide proof of payment for a purchased item by a user.

[1211] "Scanning" refers to the process of optically reading physical documents or receipts and storing them as digital data.

[1212] "Analysis" is the process of extracting information contained in scanned image data and identifying necessary items.

[1213] "Reevaluation" refers to the process of reconsidering and optimizing existing tax payment methods and proposals based on new information obtained.

[1214] The following describes an embodiment of the present invention. This system provides the optimal tax payment method based on the user's input of annual income, family structure, financial account information, and emotion data acquired from facial expressions. Furthermore, the system also has a function that allows the user to check purchase history and payment information in real time at a specific location.

[1215] As a specific example, a case where smart glasses are used will be described. A user wears the smart glasses and inputs their annual income, family composition, and financial account information through the smart glasses' interface. At this time, a camera built into the smart glasses captures the user's facial expressions, and emotion data is obtained through an emotion recognition model (e.g., a model using TensorFlow or Keras).

[1216] The server acquires the information and emotional data entered by the user and stores it in a database. It also uses an AI engine to analyze the stored information. Specifically, it suggests optimal tax payment methods and campaign information based on the user's annual income, family composition, financial services used, and emotional data.

[1217] Through the smart glasses, users can check campaign information and tax-saving methods in real time at specific locations. This allows them to find the best tax payment plan and campaign information while shopping. When users scan a receipt with the smart glasses' camera, the image is sent to the server for analysis. Based on the analysis results, the tax payment information is reevaluated and updated suggestions are notified to the user.

[1218] The specific hardware used includes smart glasses, a camera, and a microphone, while the software includes an emotion recognition model, a data transmission and reception server, and an AI engine.

[1219] For example, when a user is shopping at a supermarket, they can receive information about a 5% cashback campaign through the smart glasses and see in real time how it will affect their household finances, helping them choose the best tax payment method and efficiently complete the tax payment process.

[1220] Examples of specific prompts include:

[1221] "Please explain in detail your approach to capture emotional data through the camera in smart glasses while users are shopping at a supermarket, and display tax campaign information provided in real time. Also, please describe in detail how this system optimizes the user's tax payment plan."

[1222] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1223] Step 1:

[1224] The user inputs annual income, family composition, and financial account information through the interface of the smart glasses. Input data: annual income, family composition, and financial account information. Output data: user information.

[1225] Step 2:

[1226] The camera in the smart glasses captures the user's facial expressions and runs the emotion recognition model to obtain emotion data. Input data: user's facial expressions. Output data: emotion data.

[1227] Step 3:

[1228] The device temporarily stores user information and emotion data in a database and sends it to the server. Input data: User information, emotion data. Output data: Data sent to the server.

[1229] Step 4:

[1230] The server stores the received user information and emotion data in a database. Input data: Data sent to the server. Output data: Data stored in the database.

[1231] Step 5:

[1232] The server sends an analysis request to the AI ​​engine based on the stored user information and emotion data. Input data: Data stored in the database. Output data: Data sent to the AI ​​engine.

[1233] Step 6:

[1234] The AI ​​engine generates optimal tax payment methods and campaign information based on user information and emotional data. Input data: user information, emotional data. Output data: tax payment methods, campaign information.

[1235] Step 7:

[1236] The server prepares the analysis results (tax payment methods, campaign information) received from the AI ​​engine and prepares them to be reflected on the user's dedicated page. Input data: Data received from the AI ​​engine. Output data: Data on the user's dedicated page.

[1237] Step 8:

[1238] The server sends a request to the user's device to display the proposal along with a link to access the dedicated page. Input data: Data on the user's dedicated page. Output data: The request sent to the device.

[1239] Step 9:

[1240] The terminal receives the request from the server and displays a link to access the user's private page. Input data: Request from the server. Output data: Terminal screen with the link displayed.

[1241] Step 10:

[1242] Users use smart glasses to shop at specific locations and check campaign information and tax-saving methods in real time. Input data: User's location information, shopping data. Output data: Campaign information displayed in real time.

[1243] Step 11:

[1244] The user scans the receipt using the camera on the smart glasses and uploads the image to the device. Input data: Image of the receipt. Output data: Image data stored on the device.

[1245] Step 12:

[1246] The device sends the scanned receipt image to the server, where it is analyzed by the AI ​​engine. Input data: Image data stored on the device. Output data: Analyzed receipt information.

[1247] Step 13:

[1248] The AI ​​engine reevaluates the tax payment information based on the receipt information obtained and generates an updated tax payment proposal. Input data: Parsed receipt information. Output data: Updated tax payment proposal.

[1249] Step 14:

[1250] The server updates the re-evaluated proposal on the user's personal page and notifies the user of the changes. Input data: Updated tax proposal. Output data: Changes notified to the user.

[1251] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1252] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1253] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1254] [Fourth embodiment]

[1255] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1256] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1257] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1258] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1259] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1260] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1261] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1262] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1263] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1264] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1265] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1266] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1267] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1268] This invention is a system that uses AI to propose the best tax payment method for individuals and sole proprietors. This system includes the following methods to help users pay their taxes efficiently and optimally.

[1269] Program processing

[1270] Enter and save user information

[1271] The user uses the device to input their annual income, family composition, and financial account information (online banking, credit card, QR code payment account, etc.). The device temporarily stores the input information and sends it to the server. The server then stores the received user information in a database.

[1272] Data analysis

[1273] The server retrieves the saved user information and requests an analysis from the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and advantageous campaign information based on the user's annual income, family composition, and financial services used. The AI ​​engine generates the analysis results and sends them to the server.

[1274] Information provision

[1275] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. The server sends a request to the device to display the suggestions on the dedicated page. The device receives the request from the server and provides a link to access the user's dedicated page. The user accesses the dedicated page from their device and checks the suggestions (optimal tax payment methods and advantageous campaign information).

[1276] Tax payment procedure support

[1277] The user selects their desired option from the payment method and campaign information presented on the device. The device sends the user's selection information to the server. Based on the information received, the server begins supporting the appropriate payment procedures. The server provides the user with information to assist with the procedures, such as providing a link to the hometown tax payment website and automatically generating the necessary documents. The user then completes the payment procedures using the information provided on the device.

[1278] Receipt organization (for sole proprietors)

[1279] The user scans or uploads an image of a receipt using their device. The device sends the scanned or uploaded receipt image to the server. The server sends the received receipt image to the AI ​​engine. The AI ​​engine analyzes the necessary information from the image (date, amount, expenditure details, etc.) and stores the information in a database. The AI ​​engine reevaluates the tax payment method based on the newly acquired receipt information and generates an updated proposal. The server reflects the updated proposal on the user's dedicated page and notifies the user.

[1280] Specific examples

[1281] Example 1: Part-time individual user

[1282] The user uses a device to enter information such as an annual income of 2 million yen and being single. The server stores this information in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with tax payment procedures.

[1283] Example 2: Freelance sole proprietor

[1284] The user uses a terminal to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code account information. The server stores this information in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[1285] Summary

[1286] This system provides users with the most suitable tax payment method and information on special campaigns based on the information they input, enabling them to carry out tax payment procedures efficiently. For self-employed individuals, it also aims to further improve tax payment efficiency by organizing and reevaluating receipts.

[1287] The processing flow will be explained below.

[1288] Step 1:

[1289] The user uses the terminal to enter information such as their annual income, family composition, online banking account, credit card information, and QR code payment account information.

[1290] Step 2:

[1291] The terminal temporarily stores the entered user information, and when all the information is collected, it prepares to send it to the server.

[1292] Step 3:

[1293] The terminal makes a request to send user information to the server, which receives the request and stores the user information in a database.

[1294] Step 4:

[1295] The server retrieves the stored user information from the database and sends an analysis request to the AI ​​engine.

[1296] Step 5:

[1297] Based on the user information received by the AI ​​engine, it analyzes the optimal tax payment method and campaign information based on annual income, family composition, and the financial services used.

[1298] Step 6:

[1299] The AI ​​engine generates analysis results, compiles optimal tax payment methods and campaign information, and sends the results to the server.

[1300] Step 7:

[1301] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page.

[1302] Step 8:

[1303] The server sends a request to the user terminal to display the proposal along with a link to access a dedicated page.

[1304] Step 9:

[1305] The device receives the request from the server and displays a link to access a dedicated page for the user. When the user clicks the link, a dedicated page is displayed where the user can check the proposed content.

[1306] Step 10:

[1307] The user uses the terminal to select the desired option from the tax payment method and campaign information presented.

[1308] Step 11:

[1309] The terminal sends the information selected by the user to the server, which then begins supporting the appropriate tax payment procedures based on the received information.

[1310] Step 12:

[1311] The server provides links to hometown tax payment sites, automatically generates necessary documents, and provides information to assist users with tax payment procedures.

[1312] Step 13:

[1313] The user uses the terminal to complete the tax payment procedure based on the information provided.

[1314] Step 14:

[1315] The user uses the device to scan or upload an image of the receipt.

[1316] Step 15:

[1317] The device sends the scanned or uploaded receipt image to the server, which receives the image and sends an analysis request to the AI ​​engine.

[1318] Step 16:

[1319] The AI ​​engine analyzes the necessary information (date, amount, expenditure details, etc.) from the receipt image and stores it in a database.

[1320] Step 17:

[1321] The AI ​​engine reevaluates the user's tax payment information based on receipt analysis data and generates optimized proposals.

[1322] Step 18:

[1323] The server reflects the re-evaluated proposals on the user's personal page and notifies the user of the changes.

[1324] Step 19:

[1325] The user uses the terminal to check the proposal based on the reevaluation and follow up on the necessary procedures.

[1326] Example 1

[1327] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1328] Tax payment procedures are complex and burdensome for individuals and sole proprietors, making it difficult to find optimal tax payment methods and effective campaign information. Furthermore, for sole proprietors, organizing receipts and reevaluating tax payment methods based on them is also an important issue. Thus, the lack of support for users to pay taxes efficiently and optimally is an issue.

[1329] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1330] In this invention, the server includes means for having the user input income information, household information, and financial information, means for saving the input information in a storage device, means for analyzing the saved information using an artificial intelligence engine, and means for providing the user with optimal tax payment methods and promotional information. This enables users to pay taxes efficiently and optimally, and also enables self-employed individuals to further improve tax payment efficiency by organizing receipts and reevaluating tax payment methods.

[1331] "Income Information" means information relating to a User's annual income or other income.

[1332] "Household information" refers to information about the user's household, such as family structure and support status.

[1333] "Financial information" refers to information regarding financial services used by users (online banking, credit cards, QR code payments, etc.).

[1334] "Storage" refers to a storage device or database for saving data entered by a user.

[1335] An "artificial intelligence engine" refers to a system equipped with an artificial intelligence algorithm that analyzes input data and provides optimal tax payment methods and campaign information.

[1336] "Tax Method" means the method by which the User pays or calculates the Taxes payable by the User.

[1337] "Promotion information" refers to campaigns and discount information available to users.

[1338] "Receipt" refers to a receipt or invoice issued when making a purchase or using a service.

[1339] "Digitalization" refers to scanning and converting paper-based information into electronic form.

[1340] "Extraction" refers to extracting necessary information from image or text data.

[1341] The present invention is a system that proposes optimal tax payment methods for individuals and sole proprietors, and is characterized by performing analysis using an artificial intelligence engine, utilizing a variety of user information such as annual income, family structure, and financial information. This system is implemented primarily using the following hardware and software:

[1342] Hardware and software used

[1343] 1. Terminal (user side): This refers to a device such as a smartphone, tablet, or PC that the user uses to input information. The terminal provides an input interface, temporarily stores information from the user, encrypts it, and sends it to the server.

[1344] 2. Server: Refers to a cloud server or on-premise server that receives, stores, and analyzes information. The server is connected to a database where data is stored. The server is also equipped with an AI engine and has the ability to analyze user data.

[1345] 3. Artificial Intelligence Engine (AI Engine): Analyzes user information using machine learning algorithms and generates optimal tax payment methods and campaign information. For example, a model using Python and TensorFlow is implemented.

[1346] Natural language processing explanation

[1347] Entering and saving user information

[1348] The user enters the necessary information (annual income, family composition, financial information) through the terminal. The terminal temporarily stores the entered information in memory and sends it in encrypted form to the server. The server stores the received information in a database.

[1349] Analyzing the data

[1350] The server retrieves the saved user information and requests an analysis from the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and campaign information based on annual income, family composition, and financial services used, and sends the results to the server.

[1351] Proposal content provided

[1352] The server prepares the analysis results received from the AI ​​engine to be reflected on the user's dedicated page. The server then sends a request to the device to display the suggestions on the dedicated page. The device receives the request and provides a link to access the user's dedicated page. The user accesses the dedicated page from their device and checks the suggestions.

[1353] Tax payment assistance

[1354] The user selects the desired option from the tax payment method and campaign information presented on a dedicated page. The device sends the user's selection information to the server, and the server supports the appropriate tax payment procedures based on the received information. This includes providing a link to the hometown tax payment website and automatically generating the necessary documents. The user then completes the tax payment procedures using the device.

[1355] Organizing receipts (for self-employed individuals)

[1356] The user scans or uploads an image of the receipt. The device sends it to the server, which then sends the image to the AI ​​engine. The AI ​​engine uses image recognition technology (OCR) to analyze the necessary information and stores it in a database. The AI ​​engine reevaluates the tax payment method based on the newly acquired information and sends an updated proposal to the server. The server then updates the user's personal page with the new proposal and notifies them.

[1357] Specific examples

[1358] Example 1: Part-time individual user

[1359] The user uses a device to enter information such as an annual income of 2 million yen and being single. The server stores this information in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with tax payment procedures.

[1360] Example 2: Freelance sole proprietor

[1361] The user uses a terminal to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code account information. The server stores this information in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[1362] In this way, the system of the present invention uses an AI engine to analyze user information and provide optimal tax payment methods and promotional information, enabling users to pay taxes efficiently and optimally. Furthermore, for sole proprietors, it provides a receipt organization function, further improving tax payment efficiency.

[1363] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1364] Step 1: The user enters information using the terminal.

[1365] Input and Output: The user enters income, household, and financial information and sends it to the device.

[1366] Specific behavior:

[1367] The user accesses the system's input form using a smartphone or PC. Here, they enter information such as annual income, family composition, online banking, credit card, and QR code payment account. The device temporarily stores the entered information in its memory. When the user presses the "Send" button, the device encrypts this information and sends it to the server.

[1368] Step 2: The device sends the entered information to the server

[1369] Input and Output: Receives encrypted user information from the terminal and sends it to the server.

[1370] Specific behavior:

[1371] The device packages the encrypted user information into packets and sends them to the server using an HTTP request, which the server receives and decrypts.

[1372] Step 3: The server saves the user information to a database

[1373] Input and Output: The server receives the encrypted information and stores it in a database.

[1374] Specific behavior:

[1375] The server decrypts the received data and generates a SQL query to store in the database, which the server executes and stores the user information securely.

[1376] Step 4: The server sends the data to the AI ​​engine

[1377] Input and Output: User information is retrieved from the database and sent to the AI ​​engine.

[1378] Specific behavior:

[1379] The server retrieves user information from the database and generates a request to send to the AI ​​engine. The server converts the user information into JSON format and sends it to the AI ​​engine.

[1380] Step 5: The AI ​​engine analyzes the data

[1381] Input and output: Analyzes user information received from the server and generates optimal tax payment methods and campaign information.

[1382] Specific behavior:

[1383] The AI ​​engine analyzes the received user information and uses machine learning algorithms to derive optimal tax payment methods and campaign information. For example, it analyzes prompts generated by the AI ​​model and determines that a particular campaign will have a high tax savings effect. The analysis results are sent to the server in JSON format.

[1384] Step 6: The server prepares to reflect the analysis results on the user's personal page

[1385] Input and output: Prepares the analysis results received from the AI ​​engine to be reflected on the user's dedicated page.

[1386] Specific behavior:

[1387] The server stores the analysis results received from the AI ​​engine in a database and generates HTML and JavaScript files to display on a user-specific page.

[1388] Step 7: The server sends a request to the device to display the proposal on a dedicated page.

[1389] Input and Output: The server generates a link for the user and sends a request containing that link to the device.

[1390] Specific behavior:

[1391] The server generates a link to a user-specific page and sends a notification request including this link to the terminal, which receives and displays the request.

[1392] Step 8: The user visits the dedicated page and checks the proposal.

[1393] Input and Output: The user clicks on a link on the device and accesses a dedicated page.

[1394] Specific behavior:

[1395] Users click on the link provided on their device to access a dedicated page, which displays information on the best tax payment methods and campaigns.

[1396] Step 9: User selects desired option from suggestions

[1397] Input and output: The user selects the best offer on a dedicated page and sends the information to the device.

[1398] Specific behavior:

[1399] The user selects the desired option from the options displayed on the dedicated page (hometown tax donation site, campaign, etc.) and presses the "Select" button. The device then sends this selection information to the server.

[1400] Step 10: The server receives the selection information and assists with the tax payment process.

[1401] Input and Output: Generates information to assist with tax procedures based on received information and provides it to the user.

[1402] Specific behavior:

[1403] Based on the user's selection, the server automatically generates and provides the user with related links (for example, hometown tax payment websites) and necessary documents, allowing the user to complete the tax payment procedure using their device.

[1404] Step 11: User scans or uploads image of receipt (for sole proprietors)

[1405] Input and Output: User scans an image of a receipt, saves it on the device, and sends it to the server.

[1406] Specific behavior:

[1407] The user scans the receipt using the smartphone camera and saves the image on the device. Then, the user logs in to the system and uploads the image. The device sends the image to the server.

[1408] Step 12: The server sends the received image to the AI ​​engine

[1409] Input and output: The server sends the received image data to the AI ​​engine for analysis.

[1410] Specific behavior:

[1411] The server sends the received image data to the AI ​​engine, which uses image recognition technology (OCR) to extract the necessary information from the receipt.

[1412] Step 13: The AI ​​engine analyzes the image and stores the information in a database

[1413] Input and Output: Analyze the received receipt image and store the extracted information in a database.

[1414] Specific behavior:

[1415] The AI ​​engine analyzes the received image and uses OCR technology to extract the date, amount, expenditure details, etc. The extracted data is sent to the server, which then stores it in a database.

[1416] Step 14: The AI ​​engine reevaluates the proposal based on the newly acquired information

[1417] Inputs and Outputs: Re-evaluate tax payment methods based on extracted information and generate updated proposals.

[1418] Specific behavior:

[1419] Based on the newly acquired information, the AI ​​engine reevaluates and optimizes existing tax payment methods and promotional information, generates new proposals, and sends them to the server in JSON format.

[1420] Step 15: The server updates the user's page with the updated proposal and notifies them.

[1421] Input and Output: The updated proposal is reflected on the user's personal page and a notification is sent to the user.

[1422] Specific behavior:

[1423] The server receives new suggestions from the AI ​​engine, saves them in a database, and prepares them for display on the user's personal page. The server generates a notification and sends it to the device. The device receives the notification and notifies the user.

[1424] Through the above processing steps, the system of the present invention provides users with the most suitable tax payment method and campaign information, and supports the tax payment procedure. It also provides self-employed individuals with a receipt organization function, further improving the efficiency of tax payment.

[1425] (Application example 1)

[1426] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1427] The current diversification of e-commerce and payment methods makes it difficult for users to choose the optimal payment method from the numerous payment options and campaign information available. In particular, selecting the optimal payment method or campaign requires time and effort, which can degrade the user experience.

[1428] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1429] In this invention, the server includes means for having the user input annual income, family composition, and financial account information, means for saving the input information in a database, means for analyzing the saved information using an AI engine, and means for providing the user with optimal payment methods and campaign information. This allows the user to automatically select the optimal payment options and campaigns from multiple options and campaigns, eliminating the need for selection and enabling efficient purchasing activities.

[1430] "Annual income" is information indicating the total annual income of the user.

[1431] "Family composition" is information indicating the composition of members in the user's household, specifically the number of spouses and children and their relationships.

[1432] "Financial account information" refers to financial account information such as bank accounts, credit cards, and electronic money used by the user.

[1433] "Payment history" is a record of a user's past financial transactions and purchases.

[1434] "Credit card information" refers to information related to a credit card, such as the account number, issuing institution, and usage history.

[1435] "Electronic money information" refers to account information and usage history related to the electronic money service used by the user.

[1436] The "AI engine" is a system that uses artificial intelligence technology to analyze data and generate optimal payment methods and campaign information.

[1437] "Campaign information" is information about benefits such as discounts and cash backs offered by financial institutions and service providers that are beneficial to users.

[1438] This invention is a system that allows users to efficiently select electronic commerce and payment methods. This system consists of a server and user terminals, collects and analyzes user information, and provides optimal payment methods and campaign information.

[1439] Hardware and software used

[1440] Hardware: User devices (smartphones, tablets, PCs, etc.), servers

[1441] Software: Web server (Flask, etc.), database (SQLite, etc.), AI engine

[1442] System Program

[1443] 1. Enter and save user information

[1444] The server provides an interface for allowing the user to input information on annual income, family structure, and financial accounts.

[1445] The user terminal inputs this information, temporarily stores it, and then transmits it to the server.

[1446] The server stores the received information in a database.

[1447] 2. Data analysis

[1448] The server sends the stored information to the AI ​​engine.

[1449] The AI ​​engine analyzes the information and generates the most suitable payment methods and campaign information for the user.

[1450] The generated information is sent back to the server and reflected on the user's personal page.

[1451] 3. Information provision

[1452] The server notifies the user of the most suitable payment method and campaign information.

[1453] The user device provides this information to the user using alerts and notification functions.

[1454] Specific examples

[1455] Example 1: Individual user with an annual income of 5 million yen

[1456] The user enters information about their annual income of 5 million yen, their family composition (husband and wife and two children), various credit cards, and electronic money into the terminal.

[1457] The server stores this information in a database, and the AI ​​engine analyzes it.

[1458] The AI ​​engine generates the optimal credit card cashback campaign, and the server displays it on a user-specific page.

[1459] The user checks the dedicated page on the device and selects the presented cashback campaign.

[1460] Prompt Sentence Examples

[1461] "User ID 1, annual income: 5 million yen, family composition: couple and two children, financial account information: credit card X, electronic money Y"

[1462] This system allows users to easily obtain optimal payment methods and campaign information, enabling them to make purchases efficiently.

[1463] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1464] Step 1:

[1465] The user uses a terminal to input annual income, family composition, and financial account information. This information is temporarily stored on the terminal. The input data is as follows: "Annual income: 5 million yen, Family composition: Couple with two children, Financial account information: Credit card X, Electronic money Y."

[1466] Step 2:

[1467] The terminal sends the entered user information to the server. The server receives the information and stores it in a database. The input information sent to the server is "annual income, family composition, and financial account information," and the output is the user information stored in the database.

[1468] Step 3:

[1469] The server sends the saved user information to the AI ​​engine. The AI ​​engine performs data analysis to generate optimal payment methods and campaign information based on the user's annual income, family structure, and financial account information. User information is sent as input to the AI ​​engine, and the output is "optimal payment methods and campaign information."

[1470] Step 4:

[1471] The AI ​​engine performs the analysis and generates optimal payment methods and campaign information. For example, the AI ​​engine outputs the analysis result, such as "Credit card X's 5% cash back campaign is applicable."

[1472] Step 5:

[1473] The server receives the analysis results from the AI ​​engine and prepares them to generate a user-specific page. The output is a combination of the user-specific page template and the analysis results.

[1474] Step 6:

[1475] The server sends an access link to the dedicated page to the user's terminal. The terminal receives the link sent from the server and notifies the user. This prepares the user to access the dedicated page. The output is a link that the user can click.

[1476] Step 7:

[1477] The user accesses a dedicated page from their device and checks the most suitable payment method and campaign information. Specifically, they can select from the displayed payment methods and campaign information. The output is the user's selection.

[1478] Step 8:

[1479] The terminal sends the payment method and campaign information selected by the user to the server. The server automatically proceeds with the procedure based on the received selection information and applies the optimal payment method and campaign. The output shows the procedure completed.

[1480] Through the above processing steps, the user can efficiently obtain the most suitable payment method and campaign information and carry out purchasing activities.

[1481] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1482] This invention is a system that uses AI and an emotion engine to propose the best tax payment method for individuals and sole proprietors. This system includes the following means to help users pay their taxes efficiently and optimally.

[1483] Program processing

[1484] Enter and save user information

[1485] The user uses the device to input their annual income, family composition, and financial account information (online banking, credit card, QR code payment account, etc.). The emotion engine then recognizes emotions from the user's facial expressions and voice and acquires emotional data. The device temporarily stores the input information and emotional data and sends it to the server. The server then stores the received information and emotional data in a database.

[1486] Data analysis and sentiment reflection

[1487] The server retrieves stored user information and emotional data from the database and sends an analysis request to the AI ​​engine. The AI ​​engine analyzes the optimal tax payment method and campaign information based on the user's annual income, family composition, financial services used, and emotional data. By taking emotional data into consideration, the proposals are optimized to reduce the user's stress. The AI ​​engine generates the analysis results and sends them to the server.

[1488] Information provision

[1489] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. The server sends a request to the user's device to display the suggestions along with a link to access the dedicated page. The device receives the request from the server and displays a link to access the user's dedicated page. When the user accesses the link, the dedicated page is displayed and the suggestions can be viewed.

[1490] Tax payment procedure support

[1491] The user selects the desired option from the tax payment method and campaign information presented on the device. The device sends the user's selection information to the server. Based on the information received, the server begins supporting the appropriate tax payment procedures. The server provides information to support the user's tax payment procedures, such as providing a link to the hometown tax payment site and automatically generating the necessary documents. The user completes the tax payment procedures using the information provided on the device.

[1492] Receipt organization (for sole proprietors)

[1493] The user scans or uploads an image of a receipt using their device. The device sends the scanned or uploaded receipt image to the server. The server receives the image and sends an analysis request to the AI ​​engine. The AI ​​engine analyzes the necessary information from the receipt image (date, amount, expenditure details, etc.) and stores it in a database. The AI ​​engine reevaluates the tax payment information based on the newly acquired receipt information and generates an updated proposal. The server reflects the reevaluated proposal on the user's personal page and notifies the user of the changes.

[1494] Specific examples

[1495] Example 1: Part-time individual user

[1496] The user uses a device to input information such as an annual income of 2 million yen and being single, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. Based on the emotional data, an installment plan that reduces the user's stress is proposed. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with the tax payment procedure.

[1497] Example 2: Freelance sole proprietor

[1498] The user uses a device to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code information, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. Taking the emotional data into consideration, the least stressful option for the user is suggested. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[1499] Summary

[1500] This system provides optimal tax payment methods and information on advantageous campaigns based on the user's input information and emotional data, enabling efficient tax payment procedures. It also aims to further improve tax payment efficiency for self-employed individuals by organizing and reevaluating receipts. By combining it with an emotional engine, the system reduces user stress and provides a more comfortable tax payment experience.

[1501] The processing flow will be explained below.

[1502] Step 1:

[1503] The user uses the terminal to enter information such as their annual income, family composition, online banking account, credit card information, and QR code payment account information.

[1504] Step 2:

[1505] When a user enters information, the emotion engine recognizes the user's current emotion through facial detection, voice analysis, etc., and obtains emotion data.

[1506] Step 3:

[1507] The terminal temporarily stores the input user information and acquired emotion data and transmits them to the server.

[1508] Step 4:

[1509] The server receives the user information and emotion data and stores them in a database.

[1510] Step 5:

[1511] The server retrieves the stored user information and emotional data from the database and sends an analysis request to the AI ​​engine.

[1512] Step 6:

[1513] The AI ​​engine analyzes various tax payment methods and campaign information based on the user's annual income, family composition, financial service usage, and emotional data.

[1514] Step 7:

[1515] Taking into account emotional data, the AI ​​engine generates optimal suggestions to reduce the user's stress. The AI ​​engine generates the analysis results and sends them to the server.

[1516] Step 8:

[1517] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page.

[1518] Step 9:

[1519] The server sends a request to the user terminal to display the proposal along with a link to access a dedicated page.

[1520] Step 10:

[1521] The device receives the request from the server and displays a link to access a dedicated page for the user. When the user clicks the link, a dedicated page is displayed where the user can check the proposed content.

[1522] Step 11:

[1523] The user selects the desired option from the tax payment method and campaign information presented on the device. The emotion engine also retrieves the emotion at the time of selection.

[1524] Step 12:

[1525] The device sends the user's selection information and emotion data to the server, which then begins supporting the appropriate tax payment procedures based on the received information.

[1526] Step 13:

[1527] The server provides links to hometown tax payment sites, automatically generates necessary documents, and provides information to assist users with tax payment procedures.

[1528] Step 14:

[1529] The user completes the tax payment procedure using the information provided using the terminal.

[1530] Step 15:

[1531] The user uses the device to scan or upload an image of the receipt, and the emotion engine captures the user's emotions during this process.

[1532] Step 16:

[1533] The device sends the scanned or uploaded receipt image and emotion data to the server, which receives the image and emotion data and sends an analysis request to the AI ​​engine.

[1534] Step 17:

[1535] The AI ​​engine analyzes the necessary information (date, amount, expenditure details, etc.) from the receipt image and stores it in a database.

[1536] Step 18:

[1537] The AI ​​engine reevaluates the payment based on the emotional data and generates the optimal tax payment method. The reevaluated proposal is then sent to the server.

[1538] Step 19:

[1539] The server reflects the re-evaluated proposal on the user's personal page and notifies the user.

[1540] Step 20:

[1541] The user uses the terminal to check the proposal based on the reevaluation and carry out the necessary procedures.

[1542] Example 2

[1543] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1544] Conventional tax payment support systems often provide uniform information without considering the user's emotional state. This makes it difficult to provide optimal tax payment methods and campaign information for users. Furthermore, systems have not adequately improved the efficiency of receipt organization and expense accounting for sole proprietors. This has led to problems such as stress and complication when users go through the tax payment process.

[1545] The specification processing by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for having the user input annual income, family composition, and financial account information, means for acquiring the user's emotion data using an emotion engine, means for temporarily saving the input information and emotion data, means for transmitting the saved information and emotion data to the server, means for saving the received information and emotion data in a database, means for analyzing the saved information and emotion data using an AI engine, means for sending a request to reflect the analysis results in a user-dedicated page, means for displaying a link to the dedicated page on the user terminal, and means for providing the user with optimal tax payment methods and campaign information. This makes it possible to provide the user with optimal tax payment methods and advantageous campaign information based on the user's input information and emotion data, thereby improving the efficiency of tax payment procedures and reducing stress for the user.

[1546] "User" refers to an individual or sole proprietor who uses the system.

[1547] "Annual income" refers to the total amount of income a user receives in a year.

[1548] "Family composition" refers to information about the members of a user's household and their relationships.

[1549] "Financial account information" refers to information related to user financial transactions such as online banking, credit cards, and QR code payment accounts.

[1550] An "emotion engine" refers to a program or device that recognizes and acquires emotional data from a user's facial expressions and voice.

[1551] "Emotion data" refers to information about the user's emotions obtained by the emotion engine.

[1552] "Server" refers to a central processing unit that receives, stores, analyzes, and provides information sent by users.

[1553] A "database" refers to a system for systematically storing information and data.

[1554] An "AI engine" refers to a program or device that uses artificial intelligence to analyze data and generate optimal suggestions.

[1555] "User-specific page" refers to a web page that is customized for a particular user.

[1556] "Tax payment procedures" refers to the series of steps required to pay taxes.

[1557] "Hometown tax donation site" refers to a website through which users can make hometown tax donations.

[1558] "Automatic generation of required documents" refers to the process of automatically generating documents required for a user to complete tax procedures.

[1559] "Receipt" means a document issued as evidence of a transaction or payment.

[1560] "OCR technology" refers to optical character recognition technology, which extracts text data from images.

[1561] "Reassessment" refers to the process of reexamining and updating existing information.

[1562] "Notification" refers to an action to inform a user of specific information.

[1563] The present invention relates to a system that provides optimal tax payment methods and campaign information based on a user's annual income, family structure, financial account information, and emotional data. Specific embodiments of the system are described below.

[1564] System Configuration

[1565] This system consists of a user terminal, emotion engine, server, database, and AI engine. By properly linking these components, it helps users to complete tax procedures efficiently and comfortably.

[1566] Enter and save user information

[1567] Using a device such as a smartphone or PC, a user accesses a dedicated application or web page and enters information such as annual income, family composition, and financial account information. The entered information is temporarily stored on the device. At the same time, an emotion engine (e.g., a facial expression analysis camera or a voice recognition microphone) installed on the device acquires emotional data from the user's facial expressions and voice. This emotional data is also temporarily stored on the device. The device then encrypts this information and sends it to a server.

[1568] Data storage and analysis

[1569] The server stores the received user information and emotional data in a database. The server periodically retrieves new user information and emotional data from the database and sends an analysis request to the AI ​​engine. The AI ​​engine (e.g., generative AI model) analyzes the optimal tax payment method and campaign information based on the user's annual income, family composition, financial services used, and emotional data.

[1570] Viewing Proposals

[1571] The analysis results generated by the AI ​​engine are sent to the server. Based on these results, the server prepares to generate a personalized page for the user. The server then sends a request to the user's device to display the suggestions along with a link to the personalized page, and the device displays the link to the user. When the user clicks the link, they can access the personalized page and check the suggestions.

[1572] Tax payment assistance

[1573] When a user selects their desired payment method from the tax payment method and campaign information presented on the dedicated page, the selected information is sent from the device to the server. Based on the received information, the server starts a process to assist with the appropriate tax payment procedures. Specifically, it provides a link to the hometown tax payment website and automatically generates the necessary documents, which are then provided to the user. The user then uses the device to complete the tax payment procedures based on this information.

[1574] Receipt organization (for sole proprietors)

[1575] As a feature for self-employed individuals, users can scan or upload images of receipts using their device. The device then sends the image data to a server, which then requests an AI engine to analyze it. The AI ​​engine uses OCR technology to extract necessary information from the receipt (date, amount, expenditure details, etc.) and stores it in a database. Based on the newly acquired receipt data, the AI ​​engine reevaluates the tax payment information, generates updated proposals, and the server notifies the user of the changes, which are then reflected on the user's personal page.

[1576] Specific examples

[1577] Example 1: Part-time individual user

[1578] The user uses a device to input information such as an annual income of 2 million yen and being single, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine analyzes resident tax installment payment campaigns and optimal payment plans. Based on the emotional data, an installment plan that reduces the user's stress is proposed. The user selects the campaign information presented and sends it from the device to the server. The server provides links and necessary documents to assist with the tax payment procedure.

[1579] Example 2: Freelance sole proprietor

[1580] The user uses a device to enter information such as an annual income of 5 million yen, family composition (couple and two children), various credit cards, and QR code information, and the emotion engine obtains the user's current emotional data. The server stores this information and emotional data in a database, and the AI ​​engine provides the optimal hometown tax payment website and credit card cashback campaigns. Taking the emotional data into consideration, the least stressful option for the user is suggested. The user scans and uploads receipts, which the AI ​​engine analyzes and generates expense information. The server notifies the user of the reevaluated optimal tax payment method, and the user completes the tax payment procedure.

[1581] Example prompts to input to the generative AI model

[1582] "Generate analysis results to suggest the optimal tax payment method for a single user with an annual income of 2 million yen. Take into account the user's emotional data and suggest the optimal installment plan and campaign information."

[1583] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1584] Step 1: Enter and save user information

[1585] The user uses the device to input information such as annual income, family composition, and financial account information. Once the input is complete, the emotion engine is activated and acquires emotional data from the user's facial expressions and voice. Based on this, the device temporarily stores the input information and emotional data. This information is then encrypted and sent to the server. The server stores the received information and emotional data in a database.

[1586] Input: Annual income, family structure, financial account information, emotional data

[1587] Output: Temporarily saved input information and emotion data, sent to the server and saved in the database

[1588] Step 2: Data analysis and sentiment analysis

[1589] The server retrieves stored user information and emotional data from the database. The retrieved data is sent to an AI engine (generative AI model) and requested to analyze the optimal tax payment method and campaign information. The AI ​​engine calculates the data based on annual income, family composition, financial services used, and emotional data to generate optimal proposals. The analysis results are sent to the server.

[1590] Input: User information, emotion data

[1591] Output: Analysis results by the AI ​​engine

[1592] Step 3: View the proposal

[1593] The server prepares to reflect the analysis results received from the AI ​​engine on the user's dedicated page. It generates HTML data for the dedicated page and sends a request to the user's device to display the suggestions along with a link to access the dedicated page. The device receives the request and notifies the user of the link.

[1594] Input: Analysis results by AI engine

[1595] Output: Link and suggestions for display on the user's device

[1596] Step 4: Tax Preparation Assistance

[1597] The user checks the proposed payment method and campaign information and selects the desired option. The selected information is sent from the device to the server. Based on the information received by the server, support for the appropriate payment procedure begins, automatically generating a link to the hometown tax payment site and necessary documents. The user then completes the payment procedure based on this information.

[1598] Input: User selection information

[1599] Output: Hometown tax payment site link, required documents, and completion of tax payment procedures

[1600] Step 5: Organizing receipts (for self-employed individuals)

[1601] Self-employed users scan or upload images of receipts using their devices. These image data are sent to a server, which then sends an analysis request to an AI engine. The AI ​​engine uses OCR technology to extract the necessary information from the receipt image and stores it in a database. It then reevaluates the tax payment information based on the new receipt information and generates an updated proposal. The server reflects the reevaluated proposal on the user's personal page and notifies the user of the changes.

[1602] Input: Receipt image

[1603] Output: Parsed receipt data, notification of re-evaluated proposals

[1604] (Application example 2)

[1605] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1606] The main function of conventional tax payment support systems is to provide optimal tax payment methods and campaign information based on the information entered by the user, but because they do not take into account the user's emotions or real-time behavioral data, the optimal suggestions do not necessarily meet the user's needs.In addition, the organization of receipts and updating information for expense accounting must be done manually, which is a burden for users.

[1607] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for prompting the user to input annual income, family composition, and financial account information; means for saving the input information in a database; means for identifying emotional data from the user's facial expression and acquiring the emotional data; means for performing analysis using an AI engine based on the saved information and emotional data; means for providing the user with optimal tax payment methods and campaign information; means for the user to check their purchase history and payment information at a specific location in real time; means for scanning images of receipts for the user's expense reporting; means for analyzing the scanned images and acquiring necessary information; means for reevaluating the optimal tax payment method based on the acquired information; and means for notifying the user of the reevaluated proposal. This makes it possible to propose the optimal tax payment method taking into account the user's emotions and real-time behavior, thereby reducing the user's burden and improving the efficiency of tax payment procedures.

[1608] "User" means an individual or sole proprietor who uses the system.

[1609] "Annual income" refers to the total income earned by a user in a year.

[1610] "Family composition" refers to the composition of members in the user's household, and specifically includes information on spouse, children, and the like.

[1611] "Financial account information" refers to information about the accounts of financial services used by users, such as online banking, credit cards, and QR code payment accounts.

[1612] A "database" is an information accumulation device for storing information and emotional data obtained from users.

[1613] "Emotion data" is data based on emotions recognized from the user's facial expressions, and is information indicating the user's mental state.

[1614] The "AI engine" is an artificial intelligence program that analyzes stored information and emotional data to generate optimal tax payment methods and campaign information.

[1615] The "optimal tax payment method" refers to the most efficient tax payment method that satisfies legal requirements while minimizing the burden on users.

[1616] "Campaign information" is information about various campaigns and special offers related to tax payments, which provide advantageous conditions for the user when paying taxes.

[1617] A "specific location" refers to a place where purchasing activities are mainly carried out, such as a place or store that a user visits in daily life.

[1618] "Purchase history" is a record of past purchases made by a user, including information on what was purchased, where it was purchased, and how much it cost.

[1619] "Payment Information" refers to the payment method and payment details used by the User to pay for the Product.

[1620] "Expense accounting" refers to the process of accurately calculating expenses incurred in running a business and reflecting them in tax returns.

[1621] "Receipt Image" refers to image data of a receipt captured using smart glasses or a device to provide proof of payment for a purchased item by a user.

[1622] "Scanning" refers to the process of optically reading physical documents or receipts and storing them as digital data.

[1623] "Analysis" is the process of extracting information contained in scanned image data and identifying necessary items.

[1624] "Reevaluation" refers to the process of reconsidering and optimizing existing tax payment methods and proposals based on new information obtained.

[1625] The following describes an embodiment of the present invention. This system provides the optimal tax payment method based on the user's input of annual income, family structure, financial account information, and emotion data acquired from facial expressions. Furthermore, the system also has a function that allows the user to check purchase history and payment information in real time at a specific location.

[1626] As a specific example, a case where smart glasses are used will be described. A user wears the smart glasses and inputs their annual income, family composition, and financial account information through the smart glasses' interface. At this time, a camera built into the smart glasses captures the user's facial expressions, and emotion data is obtained through an emotion recognition model (e.g., a model using TensorFlow or Keras).

[1627] The server acquires the information and emotional data entered by the user and stores it in a database. It also uses an AI engine to analyze the stored information. Specifically, it suggests optimal tax payment methods and campaign information based on the user's annual income, family composition, financial services used, and emotional data.

[1628] Through the smart glasses, users can check campaign information and tax-saving methods in real time at specific locations. This allows them to find the best tax payment plan and campaign information while shopping. When users scan a receipt with the smart glasses' camera, the image is sent to the server for analysis. Based on the analysis results, the tax payment information is reevaluated and updated suggestions are notified to the user.

[1629] The specific hardware used includes smart glasses, a camera, and a microphone, while the software includes an emotion recognition model, a data transmission and reception server, and an AI engine.

[1630] For example, when a user is shopping at a supermarket, they can receive information about a 5% cashback campaign through the smart glasses and see in real time how it will affect their household finances, helping them choose the best tax payment method and efficiently complete the tax payment process.

[1631] Examples of specific prompts include:

[1632] "Please explain in detail your approach to capture emotional data through the camera in smart glasses while users are shopping at a supermarket, and display tax campaign information provided in real time. Also, please describe in detail how this system optimizes the user's tax payment plan."

[1633] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1634] Step 1:

[1635] The user inputs annual income, family composition, and financial account information through the interface of the smart glasses. Input data: annual income, family composition, and financial account information. Output data: user information.

[1636] Step 2:

[1637] The camera in the smart glasses captures the user's facial expressions and runs the emotion recognition model to obtain emotion data. Input data: user's facial expressions. Output data: emotion data.

[1638] Step 3:

[1639] The device temporarily stores user information and emotion data in a database and sends it to the server. Input data: User information, emotion data. Output data: Data sent to the server.

[1640] Step 4:

[1641] The server stores the received user information and emotion data in a database. Input data: Data sent to the server. Output data: Data stored in the database.

[1642] Step 5:

[1643] The server sends an analysis request to the AI ​​engine based on the stored user information and emotion data. Input data: Data stored in the database. Output data: Data sent to the AI ​​engine.

[1644] Step 6:

[1645] The AI ​​engine generates optimal tax payment methods and campaign information based on user information and emotional data. Input data: user information, emotional data. Output data: tax payment methods, campaign information.

[1646] Step 7:

[1647] The server prepares the analysis results (tax payment methods, campaign information) received from the AI ​​engine and prepares them to be reflected on the user's dedicated page. Input data: Data received from the AI ​​engine. Output data: Data on the user's dedicated page.

[1648] Step 8:

[1649] The server sends a request to the user's device to display the proposal along with a link to access the dedicated page. Input data: Data on the user's dedicated page. Output data: The request sent to the device.

[1650] Step 9:

[1651] The terminal receives the request from the server and displays a link to access the user's private page. Input data: Request from the server. Output data: Terminal screen with the link displayed.

[1652] Step 10:

[1653] Users use smart glasses to shop at specific locations and check campaign information and tax-saving methods in real time. Input data: User's location information, shopping data. Output data: Campaign information displayed in real time.

[1654] Step 11:

[1655] The user scans the receipt using the camera on the smart glasses and uploads the image to the device. Input data: Image of the receipt. Output data: Image data stored on the device.

[1656] Step 12:

[1657] The device sends the scanned receipt image to the server, where it is analyzed by the AI ​​engine. Input data: Image data stored on the device. Output data: Analyzed receipt information.

[1658] Step 13:

[1659] The AI ​​engine reevaluates the tax payment information based on the receipt information obtained and generates an updated tax payment proposal. Input data: Parsed receipt information. Output data: Updated tax payment proposal.

[1660] Step 14:

[1661] The server updates the re-evaluated proposal on the user's personal page and notifies the user of the changes. Input data: Updated tax proposal. Output data: Changes notified to the user.

[1662] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1663] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1664] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1665] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1666] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1667] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1668] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1669] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1670] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1671] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1672] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1673] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1674] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1675] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1676] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1677] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1678] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1679] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1680] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1681] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1682] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1683] The following is further disclosed regarding the above embodiment.

[1684] (Claim 1)

[1685] A means for allowing a user to input annual income, family composition, and financial account information;

[1686] a means for storing the entered information in a database;

[1687] A means of analyzing the stored information using an AI engine,

[1688] A means to provide users with the best tax payment methods and campaign information,

[1689] A system including:

[1690] (Claim 2)

[1691] A means for automating the procedure by sending the information selected by the user to a server based on the tax payment method and campaign information provided;

[1692] 10. The system of claim 1, comprising:

[1693] (Claim 3)

[1694] A means to scan or upload an image of your receipt;

[1695] A means of analyzing scanned or uploaded images and obtaining the required information;

[1696] A means of reassessing the optimal tax payment method based on the information obtained and notifying the user of updated proposals;

[1697] 10. The system of claim 1, comprising:

[1698] "Example 1"

[1699] (Claim 1)

[1700] means for allowing a user to input income information, household information, and financial information;

[1701] means for storing the input information in a storage device;

[1702] A means for analyzing the stored information using an artificial intelligence engine;

[1703] A means to provide users with the most suitable tax methods and promotional information;

[1704] A system including:

[1705] (Claim 2)

[1706] A means for transmitting the user's selected information based on the tax method and promotion information provided to the server and automating the process;

[1707] 10. The system of claim 1, comprising:

[1708] (Claim 3)

[1709] means for digitizing or transmitting an image of the receipt;

[1710] means for analyzing the digitized or transmitted image and extracting the required information;

[1711] A means for re-evaluating the optimal tax method based on the extracted information and notifying the user of updated proposals;

[1712] 10. The system of claim 1, comprising:

[1713] "Application Example 1"

[1714] (Claim 1)

[1715] A means for allowing a user to input annual income, family composition, and financial account information;

[1716] a means for storing the entere...

Claims

1. A means for allowing a user to input annual income, family composition, and financial account information; a means for storing the entered information in a database; A means of analyzing the stored information using an AI engine, A means to provide users with the best tax payment methods and campaign information, A system including:

2. A means for automating the procedure by sending the information selected by the user to a server based on the tax payment method and campaign information provided; The system of claim 1 , comprising:

3. A means to scan or upload an image of your receipt; A means of analyzing scanned or uploaded images and obtaining the required information; A means of reassessing the optimal tax payment method based on the information obtained and notifying the user of updated proposals; The system of claim 1 , comprising:

Images